SMF – Search my Files v17

   is the fastest duplicate files finder and a multi-dimensional
 
   – file searcher,
   – file copier / mover,
   – file deleter / eraser,
   – and duplicate previewer…
 

It has excessive search filter capabilities and a SQLite driven result reporting tool, with which you can sub-filter the results according to your needs.

With this combination the search possibilities are nearly unlimited.

  • Search for files by last modified date / keyword / file attribute
  • Search for pictures of a certain filesize / dimension / EXIF info
  • Search for MP3 by length / author / bitrate
  • Search for duplicate pictures of a certain filesize / dimension
  • etc., etc.

Furthermore SMF enables you to open / copy / move / delete / erase any file found.

Initiated searches can be performed in the background while minimizing SMF to the tray.

SMF – Search my Files features are

  • A good looking GUI,
  • Search files by location,
  • Search files and / or folders,
  • Poll Filenames and Locations in Long and Short (8.3) format,
  • Poll File Extensions,
  • Poll File Times (modified, created, accessed),
  • Poll Filesize,
  • Poll File Attributes,
  • Poll File Extended Attributes,
  • Filter by Extensions,
  • Filter by Attribute,
  • Filter by Filesize,
  • Filter by Filetime,
  • Free Filter by usage of RegEx.

  • Extract true file-type (using TrIDLib.dll),
  • Extract any info from media files (using MediaInfo.dll),
  • Calculate various hashes (md5, crc32, sha1),
  • Extract and analyze ADS Alternative File Streams from any file,
  • Free Filter by usage of RegEx.
  • Results can be saved and loaded,
  • Extensive SQLite driven Reporting Tool,
  • allows free querying,
  • any selection of files can be copied or moved,
  • deleted or erased.
  • md5 driven duplicate file detection is implemented,
  • simplified md5 calculation to achieve superior detection speed,
  • plus the file preview functionality of the report (jpg, pdf, mpg…, all previews supported by Windows Explorer),
  • If you find any bugs or limitations please let me know.


24-Oct-20: SMF - Search my Files - v17 - Executable (1040)
24-Oct-20: SMF - Search my Files - v17 - Source (157)
Changelog

v16 > v17 – 2024, Oct 20
Fixed – “Datatype mismatch” crash in “Hash Cache” function of duplicates search

v15 > v16 – 2024, Oct 9
Updated – SQLite Dll to 3.46.1
Updated – MediaInfo Dll to 24.06
Updated – TrID Definitions to version 2024-Oct-9
Updated – dHash > added support for video files, if ffmpeg.exe exists in directory “SMF_Files\Bins”
Updated – dHash > added support for WebP image files, based on WebP UDF by UEZ
Updated – dHash > added optional dhash for Video files (requires ffmpeg)
Updated – Lots of other small bug fixes and style changes

v14 > v15 – 2023, Jun 03
Updated – SQLite Dll to 3.42.0
Updated – MediaInfo Dll to 23.04
Updated – TrID Definitions to version 2023-May-14
Updated – Added dHash visual similarity check
Updated – Improved thumbnail creation speed
Fixed – Caching of hashes to speed up duplicate search
Fixed – Report crash on stats change
Fixed – CTRL+ALT+F explorer integration
Updated – Lots of other small bug fixes and style changes

v13 > v14 – 2021, Oct 10
Updated – SQLite Dll to 3.37.0-Beta
Updated – MediaInfo Dll to 21.09
Updated – TrID Definitions to version 2021 Oct 09
Fixed – Portable Installation
Fixed – Errors in Regex Search
Updated – Lots of other small bug fixes and style changes

v12 > v13 – 2019, Dec 07
Updated – SQLite Dll to 3.31.0-Beta
Updated – MediaInfo Dll to 19.09
Updated – TrID Definitions to version 2019 Dec 02
Updated – Further speed improvements
Updated – Lots of other small bug fixes and style changes

v11 > v12 – 2018, Sep 16
Updated – Codebase to AutoIt v3.3.14.5
Updated – SQLite Dll to 3.25.0
Updated – MediaInfo Dll to 18.08.01
Updated – TrID Definitions to version 2018 Sep 14
Updated – Further speed improvements
Updated – Lots of other small bug fixes and style changes
Fixed – Rare lockup on start
Fixed – Errors in Win10 Treeview for network drives
Fixed – Errors in autoupdate of Treeview
Fixed – Thumbnail cache in report

v10 > v11 – 2017, Jun 18
Updated – Improved file and duplicates search speed
Fixed – Error in Report thumbnails cached in DB
Fixed – Single quote ‘ in filenames led to errors in report
Fixed – Win XP compatibility
Updated – Lots of other small bug fixes and style changes
Updated – SQLite Dll to 3.19.3
Updated – MediaInfo Dll to 0.7.96
Updated – TrID Definitions to version 2017 Jun 15

v9 > v10 – 2016, Jan 03
Updated – Improved file and duplicates search speed
Fixed – Duplicates Search “Hash-Cache” functionality worked sub-optimal, now brings real improvement on repeated searches
Report – Improved speed of TNP Thumbnail Provider
Report – Added thumbnail and icon cache functionality
Report – Added custom cell highlighting feature
Report – Added optional checkboxes in Filename Column
Report – Improved Copy/MoveTo dialog
Report – Column order/size, OFFSET and LIMIT are now saved
Report – Save Styles fixed
Updated – Treeview functions
Added – Optional Explorer Contextmenu entry to “Search with SMF for duplicate files”
Updated – Lots of other bug fixes and style changes
Updated – SQLite Dll to 3.9.2
Updated – MediaInfo Dll to 0.7.81
Updated – TrID Definitions to version 2015 Dec 29

8.0 > 9.0 – 2014, Sep 06
Added – Duplicates Search “Hash-Cache” functionality (optional), calculated hashes are cached and re-used in next search run to improve duplicate search speed
Fixed – Option to Auto-update Folder Treeview sometimes crashed (e.g. new drives added)
Report – Added memory check function, if more than 90% of memory is in use, do not create any more icons / thumbnail previews
Report – Added option to change report icon size with CTRL+MouseWheel
Updated – Lots of other bug fixes and style changes
Updated – SQLite Dll to 3.8.6
Updated – MediaInfo Dll to 0.7.70
Updated – TrID Definitions to version 2014 Aug 23

7.0 > 8.0 – 2014, Apr 06
Fixed – “Image Infos” return could produce SQL errors (when trying to extract infos from damaged pictures) > added _SQLite_FastEscapeEx() call
Fixed – “Extended File Attributes” column return could produce SQL errors > replaced “#” character in property (column) name / added _SQLite_FastEscapeEx() for values
Fixed – “MediaInfo” column return could produce SQL errors > replaced “*” character in property (column) name > see result prep of _FileListToSqlite_PrepareTable()
Fixed – While running, report was not auto-updated correctly after finish
Report – Implemented _LV_Resort_Thumbnail_Creation_Queue(), now those thumbnails visible should be loaded first
Report – Implemented new “CopyTo” multi-selection dialog
Report – Added browse and info controls to fullscreen report
Added – Option to auto-update Folder Treeview
Added – “Fast Search Loop” feature for faster default search > searches up to 13.000 files per second!
Added – “File MIME Type” analysis > _FileListToSqlite_InsertValues_Do_Sub_33_Collect_File_MIME_Type
Report – Added some more default thumbnail sizes: 96px / 160px / 192px
Report – Tweaked CopyMove CallbackDlg function, now shows thumbnails instead of icons, plus links are clickable
Updated – Lots of small bug fixes and style changes
Updated – SQLite Dll to 3.8.4.3
Updated – MediaInfo Dll to 0.7.68
Updated – TrID Definitions to version 2014 Mar 22

6.0 > 7.0 – 2013, Dec 22
Fixed – Labels on “Report Settings” GUI were partially cropped
Fixed – Crash on “Computer Info Report”
Updated – Removed “midi” sound from “About” dialog
Updated – Made some MsgBoxs (e.g. “Exit”) child to the Topmost default window
Updated – Added option to auto-update Folder Treeview
Fixed – Report – “Thumbnail interface to use” was not correctly loaded on style change
Updated – MediaInfo > set default from “General”/”General” to “Video”/”Video”
Updated – MediaInfo > set no values to 0 for numeric columns and NULL for text values / previously all none values defaulted to NULL
Updated – Folder Treeview > added option to cancel refresh when (slow) network folders are included
Report – Added several hotkeys (e.g. style change) to standard and fullscreen report
Report – Make all relevant functions work with fullscreen GUI too
Fixed – Restore of saved “Extended Attributes” search columns not correct on restart
Plus – Lots of small bug fixes and style changes
Updated – SQLite Dll to 3.8.2
Updated – MediaInfo Dll to 0.7.65
Updated – TrID Definitions to version 2013 Dec 19

5.0 > 6.0 – 2013, Sep 29
Fixed – Different small bugs in main program and report
Report – Added special fullscreen mode (F11)
Report – Added default styles
Updated – Added option to keep current folder selection on purge of DB
Updated – Added lot’s of hotkeys for main program and report (see “About” for details)
Updated – SQLite Dll to 3.8.0.2
Updated – MediaInfo Dll to 0.7.64
Updated – TrID Definitions to version 2013 Sep 20

4.0 > 5.0 – 2013, Jul 26
Fixed – Unwanted auto-reopen of report issue
Fixed – Occasional program crash in search for “Executable Infos”
Fixed – Crash on “Export” if not column was selected
Fixed – “Progress” tab, fixed crash on click of “Pre-Filter Active” icon
Added – “Throttle Search Speed” option
Report – Added “IN Reference Filelist”
Report – Added “LIKE Reference Filelist”
Report – Added “IN Reference Extensionlist” option
Report – Added “Between Reference Dates” option
Report – “Load & Save Styles” => made save names selectable
Report – Added “LIKE Expressions” and “NOT LIKE Expressions” multiple value selection
Report – Added Custom SQLite query builder
Added – Optional duplicate search for “Duplicate_Filename”
Updated – SQLite Dll to 3.7.17
Updated – MediaInfo Dll to 0.7.64
Updated – TrID Definitions to version 2013 Jul 23

3.2 > 4.0 – 2013, Apr 25
– Fixed some SQLite deadlock situations
– Improved “File Content” search
– Report: Improved filtering / default settings & workflow
– Report: Added “Move Secure” feature (copy & erase)
– Report – ToolTip Preview – Show Details: Added “On-Hover show file HEX & content” feature
– Improved Portable and Fixed install routines
– ContextMenu search now works for multiple directory selection
– Search by Command-line , use “;” to delimit multiple directories to search
– Updated SQLite DLL to 3.7.16.2
– Updated TrID Definitions to version 2013 Apr 23

3.1 > 3.2 – 2013, Mar 21
– Report: Bug fixed in the “Remove empty folders” feature (only delete to recycle bin effected), thanks to tcurran for reporting!

3.0 > 3.1 – 2013, Mar 20
– All SMF functionalities should now work with long filenames too (max buffer = 4.096 wchars, deliberately limited to improve performance)
– Added optional password to recover from tray
– Report: Added ToolTip Previewer for large previews of the currently selected file
– Report: Fixed bug which occasionally froze whole report (WM_COMMAND loop back)
– Report: Updated “Copy & Move” operations to handle long filenames, removed copy.dll and added own wrapper for _LargeFileCopy UDF
– Fixed a lot of other bugs and improved overall performance
– Updated to SQLite DLL to v3.7.16
– Updated MediaInfo DLL to version 0.7.62
– Updated TrID Definitions to version 2013 Mar 15

Version Archive

License & Disclaimer

License
This program is freeware under a Creative Commons License “by-nc-nd 3.0”, and this means your are allowed to share, copy and redistribute the material in any medium or format under the following conditions:

  • Attribution – You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work).
  • Noncommercial – You may not use this work for commercial purposes.
  • NoDerivatives – If you remix, transform, or build upon the material, you may not distribute the modified material.

    • For distribution, you must make clear to others the license terms of this work. Any of the above conditions can be waived if you get permission from the copyright holder. Nothing in this license impairs or restricts the author’s moral rights.

    For any form of distribution of this software a link back to the authors website at https://funk.eu is required.

    Disclaimer
    This program is distributed in the hope that it will be useful, but
    WITHOUT ANY WARRANTY
    The Author of this Software expressly disclaims any warranty for the SOFTWARE PRODUCT. The SOFTWARE PRODUCT and any related documentation is provided “as is” without warranty of any kind, either express or implied, including, without limitation, the implied warranties or merchantability, fitness for a particular purpose, or non-infringement. The entire risk arising out of use or performance of the SOFTWARE PRODUCT remains with you.
    NO LIABILITY FOR DAMAGES
    In no event shall the author of this Software be liable for any damages whatsoever (including, without limitation, damages for loss of business profits, business interruption, loss of business information, or any other pecuniary loss) arising out of the use of or inability to use this product, even if the Author of this Software has been advised of the possibility of such damages. Because some states/jurisdictions do not allow the exclusion or limitation of liability for consequential or incidental damages, the above limitation may not apply to you.

    It works fine at least on the 64bit Win10-1803 machines I tested it on.

    Thanks to my sweet girlfriend for reviewing, giving new ideas and having so much patience with me :-*.

    Thanks to Jon, Larry, Jos, Valik and Jpm for creating AutoIt and maintaining the forum.

    And finally thanks to all these great guys from the forum, providing excellent UDFs, snippets of code I use in SMF or help and feedback:

    Achilles, Ascend4nt, Ed_Maximized, Elgabionline, Erik Pilsits (Wraithdu), Eukalyptus, Gafrost, Holger Kotsch, Jarvis J. Stubblefield (JSThePatriot), Jos, Lahire Biette, Lazycat, Lod3n, Prog@ndy, Ptrex, Rasim, RazorM, RobSaunders, Sean Hart, Siao, Simucal, Smashly, SmOke_N, Teh_hahn, trancexx, Valik, Ward, WideBoyDixon, Yann Perrin, Yashied & Zedna.
     
    SMF uses the TrIDLib.dll as a plugin to identify true file types. For details visit Marco Pontello’s website for infos.

    http://mark0.net/soft-trid-e.html

    Please let me know if you found some piece of code in the source for which I forgot to mention a credit.

    http://www.autoitscript.com/forum/index.php

    Used AutoIt Versions

    • AU 3.2.12.1 up to SMF 0.4.8.6.1
    • AU 3.3.0.0 up to SMF 1.0.0.0
    • AU 3.3.4.0 up to SMF 1.1.3.9
    • AU 3.3.6.0 up to SMF 1.1.7.2
    • AU 3.3.6.1 up to SMF 1.8
    • AU 3.3.8.0 up to SMF 2.0
    • AU 3.3.8.1 starting from SMF 3.0
    • AU 3.3.14.5 starting from SMF v12
    • AU 3.3.16.1 starting from SMF v14