timeline-main.zip

# Timeline - Photo Organizer Timeline is a web application which aims to organize photos similar to how Google Photos or Amazon Photos does. Instead of Google or Amazon Photos it is not running in the cloud but on you own Device (Server, NAS, PC) ## Features * Timeline reads and monitors photos from a specified directory on your device. It doesn't touch any of your photos, all data is written elsewhere * It will display photos in a timeline based view, ordered by date (newest photos first) with fast endless scrolling functionality (no paging) * Timeline extracts exif data. A limited set is visible in the information panel * It will detect faces on the photos using MTCNN (Tensorflow) * Once some faces are detected, they can be named. * Other faces are matched against the known faces. This works quite well for most faces except for infant and baby faces where it is not very good in separating them * In order to ease up the face classification it clusters similar faces for easy naming * It tries also to do some object detection in the photos using Tensorflow; currently using * If GPS information is present in the Exif Data it will do a reverse geo location look to resolve the address * When viewing an Photo in full screen you will see of of the detected information (Identified and non identified faces, things a resolved address along with a little map and some important Exif data) * now also playing HEIC, MOV, and MP4 files ## New (0.7) * Selection of Photos via left and right cursor keys * Rating of Photos via the usual Rating stars either by clicking the rating while hovering over a photo or selecting a photo via cursor left/right and use the 0-5 keys (filtering for the so rated photos will follow) * Option to change the preview size to accommodate more or less on the photo wall ## New (0.8) * Selection of Multiple Photos at one by Shift-Click * Albums can be created (and deleted) * New Albums Overview * Photos can be removed from the Catalog * New Search View. Photos can be searched by Date Range, Rating, Camera Make, Country, City, People * A new default Album "Last Import" is created and filled by last added photos accessible with a new navigation shortcut * A new simple view showing the photos to be sorted into the index is available ## New 0.84 * Major re-arrangement with regards to workers. Now only one worker process is required - should be a bit faster but due to loading the models now in each preforked worker process they consume more memory. On something with only 4GB RAM the number of worker should only be 1. With 8GB 3-4 should be ok. Due to using preforked workers they will now be scaled down when not needed anymore. * Searching for Photos by date, rating, location can now be saved as "smart album" (not really smart but I didn't find a better name). Once defined they also can be edited afterwards. * For faces it is now detect the expression (happy, sad, neutral ...). This will be later used to find some nice photos of happy people. I was also trying this with gender and age but it was not very precise ## New 0.85 * Sectioning is now happening already while importing photos. With this new photos are visible immediately. The background sectioning still happens and is used to equally size the sections in terms of the contained photos * Uploading of Phots is now possible. Therefore a folder has to be specified which is created below PHOTO_PATH. Photos will be uploaded there and sorted by year and month ## New 0.90 * Now also reading and displaying (iPhone) HEIC files * Addionally also reading and displaying MOV and MP4 files. MOV files will be converted to MP4, so both types will be playable in the Browser. Similar to Google Photos a preview of the video files will played back when hovering over a video https://user-images.githubusercontent.com/71876828/149617848-ed456d59-cc71-4eb3-881e-2ee91bb81c21.mp4 ## New 0.95 * Frontend reworked in order to use the space more effectively. Again trying to mimic Google Photos for the layout a bit more * Separated a dedicated worker for video conversion. Otherwise ffmpeg will eat all CPU resources. Now, there is only one video conversion task happening at a time ## New 0.95.1 * Fullscreen videos will now be transcoded on demand (when clicked). A spinner indicates the conversion. This behaviour can be configured (VIDEO_TRANSCODE_ON_DEMAND in env-File) ## New 0.96 * The basepath of the Web Application is not / anymore but configurable path. Default is /timeline. The reason for a basepath is to be able to put this behind one other webserver (nginx, caddy) so that it allows it to proxy different applications under one domain (e.g. some dynamic dns with nextcloud, darktable ...) * Experimental: When all assets are processed, Timeline attempts to find events. These events are identified by a certain amount of photos within a certain timeframe. The is again configurable by EVENT_MIN_SAMPLES and EVENT_HOURS_EPSILON. Again the DBSAN Algorithm is utilised for this. So identified Events will be created as Albums. The Album name will be constructed of a Date and a Location name (City, County ...). The Presentation of Albums clearly needs to be improved. ## Next to come * Bug fixing * Finding co-occurrences of people over time and creating albums of of it ### General View <img src="assets/start_view.jpg" width="400"/> ### Fullscreen Photo with information panel <img src="assets/detail_things.jpg" width="400"/> Please note that it detects more than just one thing. ## Faces and Persons <img src="assets/faces.jpg" width="400"/> ## Things and Objects <img src="assets/things.jpg" width="400"/> ## Places <img src="assets/places.jpg" width="400"/> ## Info There is also a Dark Mode and an information panel showing what is happening in the background. <img src="assets/info.jpg" width="400"> ## Search View There is also a new Seach View (to be extended) to query photos by various combined attributes <img src="assets/search.jpg" width="400"> ## Album View Photos can be selected and added to existing or new Albums <img src="assets/albums.jpg" width="400"> # How to use it The easiest way is to use Docker, resp. docker-compose 1. `wget https://raw.githubusercontent.com/hulk66/timeline/main/docker-compose.yml` 2. `wget https://raw.githubusercontent.com/hulk66/timeline/main/env`, modify the env file according to your needs and save it as `.env`. The following things have to be changed: 1. `ASSET_PATH` - this points to the directory where your assets are located. Timeline will recursively scan all Photos and Videos (JPG, HEIC, MOV, MP4). This is read-only: Timeline will not change anything in here. 2. `PREVIEW_PATH`- For performance reasons this directory is used to generate all kinds of previews. 3. `LOG_PATH`- This is where Timeline does the logging. Most important here is the `process_worker.log`. 4. `DATABASE_DATA` - Here is where all data from mariaDB is saved 5. `RABBITMQ_DATA`- Same for RabbitMQ which is used as the message broker 6. `WORKERS_PROCESS`- Number of workers to be used. This depends on the machine you are running Timeline on. For everything below 8GB RAM only 2 or 3 workers are recommended. If you have more RAM then also 4-6 might be ok 7. `DB_SUPER_USER_PW` - is the password for to access the database (via adminer) 8. If you want a different basepath then `timeline` in the URL this can be configured as well. For the timebeing it has to be some path and must not be empty If used with Docker please specify all paths absolute. Important: **All directories have to exist**. They won't be created. Once you have the `.env` file in place run it with `docker-compose up` or `docker-compose up -d` to run it in the background. Given everything is downloaded from Dockerhub (mariaDB, RabbitMQ ...) it may take 3-4 minutes to start up all containers depending on the system. If all containers are up and running you should be able to see some ch