Commit graph

351 commits

Author SHA1 Message Date
Michael Mayer
45d1360c18 Metadata: Improve location estimates and UTC handling #1668 2021-11-23 19:23:10 +01:00
Michael Mayer
d813171204 Metadata: Estimate latitude and longitude if possible #1668 2021-11-22 18:18:41 +01:00
Michael Mayer
df1ffc68cf UX: Reduce loading-animation size on slash screen 2021-11-20 16:27:30 +01:00
Michael Mayer
c48310f077 Albums: Improve state geodata and sort by country #1608 #1664 2021-11-18 00:46:34 +01:00
theresa
8dcf410cc9 Tests: Add unit tests for pkg/txt 2021-11-17 18:15:07 +01:00
Jan Loewe
f5dc3fae4a
Places: Add Normalization Mappings for NDS (Germany) #1664 (#1729) 2021-11-12 09:14:48 +01:00
Michael Mayer
a354a17041 Auth: Normalize Username (trim space, lowercase) #1103 #1309 #1546 #1610 2021-11-12 09:10:15 +01:00
Max Nuding
666a2358fa
Places: Add Normalization Mappings for BW and RLP (Germany) #1664 #1726 2021-11-12 07:35:40 +01:00
Michael Mayer
bb9442e6c4 People: Add "photoprism places update" CLI command #1664 2021-11-12 05:09:17 +01:00
Michael Mayer
72d546f8c8 Places: Add state name normalizations for AU and NZ #1664 2021-11-11 17:41:01 +01:00
Michael Mayer
0575ab2276 Places: Add state name normalizations for Germany #1664 2021-11-11 17:10:52 +01:00
Michael Mayer
6c02ee2512 Places: Improve state name normalization #1664 2021-11-11 16:00:42 +01:00
Michael Mayer
e525ce5c46 Places: Don't auto capitalize state names #1664 2021-11-09 19:56:19 +01:00
Michael Mayer
051251bafb Text: Update specialwords.go 2021-11-09 16:55:47 +01:00
Michael Mayer
e4fd294689 Places: Normalize US & CA state names #1664 2021-11-09 11:42:10 +01:00
Michael Mayer
25a954d568 Search: Add live and raw search filters, improve faces filter #22 2021-10-13 16:12:56 +02:00
Michael Mayer
2a119380a7 Folders: Ignore names listed in .ppignore #1609 2021-10-09 13:57:28 +02:00
Eng Zer Jun
44f7700c0c
Enable module graph pruning and deprecate io/ioutil (#1600)
* Backend: Enable Go module graph pruning and lazy module loading

This commit applies the changes by running `go mod tidy -go=1.17` to
enable module graph pruning and lazy module loading supported by Go 1.17
or higher.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

* Backend: Move from io/ioutil to io and os package

The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2021-10-06 07:10:50 +02:00
Michael Mayer
f7153cdd21 People: Improve logging, command help, and handling of broken files #22 2021-10-05 18:42:39 +02:00
Michael Mayer
24eff21aa4 Search: Default to photo names and keywords #1517 #1560
Default to photo name when search term is too short or on the stop list.
Search full text index otherwise, which now include names of people
(requires reindexing).
2021-09-29 20:09:34 +02:00
Michael Mayer
125b05b489 Search: Remove sea. sinon, and sino from stopwords list 2021-09-25 15:56:44 +02:00
Michael Mayer
2929733f78 Index: Ignore files and folders starting with @ #1543
Synology stores hidden sidecar / thumbnail files in @eaDir.
2021-09-24 01:24:36 +02:00
Michael Mayer
eb8bc7b709 Backend: Improve resilience #1544 2021-09-23 23:46:17 +02:00
Michael Mayer
3c3b19aa8e People: Add search filter for finding unclustered faces #22 2021-09-23 14:23:00 +02:00
Michael Mayer
8eb970ae8b RAW: Remove unwanted characters like quotes from file extensions #1362 2021-09-21 18:10:21 +02:00
Michael Mayer
b081f27e17 RAW: Add File Extension Blacklists for Darktable and RawTherapee #1362 2021-09-21 15:33:46 +02:00
Michael Mayer
070efcbc66 Search: Improve "year", "month", and "day" filters 2021-09-20 23:32:35 +02:00
Michael Mayer
77b7fb2582 Text: Add tests for short words 2021-09-20 22:28:20 +02:00
Michael Mayer
0de2a492bb Text: Update and add tests for short words 2021-09-20 22:27:18 +02:00
Michael Mayer
04d2cfa650 People: Use slug as search filter #22 2021-09-20 12:36:59 +02:00
Michael Mayer
1f92f294dd People: Normalize names #22 2021-09-19 13:35:44 +02:00
Michael Mayer
f7cc61edbc People: Shorten names in titles #22 2021-09-18 21:40:57 +02:00
Michael Mayer
ed22f245db People: Add faces API endpoint & JS model #22 2021-09-18 15:32:39 +02:00
Michael Mayer
0f90258ef9 Search: Omit full text index if query is too short #1517 2021-09-17 15:52:25 +02:00
Michael Mayer
c584424183 Labels: Disable client-side capitalization #1509 2021-09-06 15:00:41 +02:00
Michael Mayer
cf9fb1db1a People: Combine family names in photo titles #22 2021-09-05 22:12:53 +02:00
Michael Mayer
6f5e839e2f People: Move crop package to internal #22 2021-09-05 11:05:33 +02:00
Michael Mayer
9ba396e50f Search: Detect and set filters based on search terms
Reduces the amount of typing necessary to search for faces, videos,
favorites, stacks, panoramas, scans, and monochrome pictures.
2021-09-03 20:14:11 +02:00
Michael Mayer
2bde7e5696 Panoramas: Increase projection type string limit to 32 characters #1508 2021-09-03 19:02:26 +02:00
Michael Mayer
34c8f9d7b1 People: Implement crop thumbnail API #22 2021-09-03 17:42:37 +02:00
Michael Mayer
c520cb4ee4 People: Add autocomplete for selecting a person #22 2021-09-03 16:14:09 +02:00
Michael Mayer
c179a790b8 People: Improve face crop caching #22 2021-09-02 23:47:37 +02:00
theresa
c61a0f7d0e Tests: Add unit tests 2021-09-02 17:44:27 +02:00
Michael Mayer
9acd4a25b9 People: Generate photo titles from subject names #22 2021-09-02 14:23:40 +02:00
Michael Mayer
a5f8e6149f Titles: Add German smallwords to improve capitalization 2021-09-02 09:37:23 +02:00
Michael Mayer
7f6fd7f47a Backend: Update Go build tags after upgrading to 1.17 2021-08-31 18:49:08 +02:00
Michael Mayer
c0a21045fb People: Improve search query parser #22 #882 2021-08-30 11:26:57 +02:00
Michael Mayer
71372c6f87 Videos: Add .mp to known file extensions #1501 2021-08-29 16:26:20 +02:00
Michael Mayer
11d1034752 People: Add keywords, subjects, and albums search filters #22 #882 2021-08-29 16:16:49 +02:00
Michael Mayer
2e85b3cccd People: Split facial recognition into smaller functions #22
Clustering and matching have been improved along the way. This opens
the door for further optimizations while keeping the code readable.
2021-08-22 16:14:34 +02:00
Michael Mayer
29a65dbaab People: Fork clusters library with fixed dbscan implementation #1478 2021-08-19 14:24:30 +02:00
Michael Mayer
97c3e0abe8 Import: Ignore dot files listed in .ppignore #1348 2021-07-16 18:27:28 +02:00
Michael Mayer
07c711a0b4 RAW: Skip Darktable when converting Canon CR3 and Fuji RAF files #1362 2021-07-16 18:12:42 +02:00
Michael Mayer
49fd531420 People: Implement marker update API #22 2021-06-02 17:25:04 +02:00
Michael Mayer
58e3573e10 People: Add include and exclude as aliases for yes and no in search #22 2021-05-26 11:04:14 +02:00
Michael Mayer
5ecba4926a People: Show number of faces in edit dialog #22 2021-05-26 09:51:00 +02:00
Michael Mayer
d3e53a89dd Metadata: Allow single quotes in keywords #1196 2021-05-05 12:32:49 +02:00
Michael Mayer
256c82fc93 Metadata: Trim trailing - from keywords #1153 2021-05-05 12:23:19 +02:00
Michael Mayer
1fea0b136e Backend: Fix potential issue in txt.Int() 2021-05-04 17:54:57 +02:00
Michael Mayer
50d2ff1e69 Backend: Upgrade dependencies and fix potential issues 2021-05-04 17:30:39 +02:00
Michael Mayer
e10118a65f Metadata: Merge keywords if priority is the same #1153
Also reduces length limit for latin words to 2 letters.
2021-05-04 15:02:54 +02:00
Michael Mayer
6cbf0696c4 Metadata: Don't remove stopwords from keywords #1153 2021-04-30 17:37:37 +02:00
Michael Mayer
014642f401 Stopwords: Remove done, elsewhere, ended, exactly #1153 2021-04-27 10:02:34 +02:00
Michael Mayer
27c106863d Metadata: Merge existing keywords #1153 2021-04-25 14:17:34 +02:00
Michael Mayer
7de3713024 Backup: Improve command flags and usage docs #1190 #1193 2021-04-19 13:48:46 +02:00
Krassimir Valev
2bace7954d
Remove Niagara Falls from country mapping (#1144)
The waterfalls are on a border, so they cannot be uniquely assigned to Canada
(or USA).
2021-03-28 20:23:49 +02:00
theresa
816aca7420 Tests: Add tests for internal/api 2021-03-10 16:55:55 +01:00
theresa
ce9651df10 Tests: Add tests for /pkg 2021-03-03 15:41:32 +01:00
Michael Mayer
d78310c8f0 Videos: Add .m4v to known mp4 video file extensions #703 #1039 2021-02-15 13:02:55 +01:00
Krassimir Valev
58d6d23967
Support .mts and .mpo files (#1029) 2021-02-14 19:25:52 +01:00
Michael Mayer
9039774cf7 Metadata: Rename unknown country code variable 2021-02-07 17:42:52 +01:00
Michael Mayer
e57e9aff70 Metadata: Improve country code from string estimate 2021-02-07 17:39:41 +01:00
Michael Mayer
789cab83c9 Metadata: Add special words for title capitalization 2021-02-05 09:13:05 +01:00
Michael Mayer
57dc591b12 Remove small words from filename title endings 2021-01-27 15:21:54 +01:00
Michael Mayer
ae2f761a05 Backend: Add strings to specialwords.go 2021-01-27 11:59:41 +01:00
Michael Mayer
899419383a Metadata: Fix indexing keywords in original file name and path #920 2021-01-25 19:30:29 +01:00
Michael Mayer
a564cff3af Metadata: Update countries.go 2021-01-15 11:52:12 +01:00
Krassimir Valev
405fb3c459
Metadata: Add more places to the countries mapping (#899) 2021-01-15 10:47:27 +01:00
theresa
e01b193f88 Stopwords: Add dscn 2021-01-11 17:41:34 +01:00
Michael Mayer
19b2f1de13 Import: Improve handling of severe errors (panics) #261 2021-01-09 13:50:14 +01:00
Michael Mayer
a8c46f616a Colors: Clean-up examples 2021-01-09 04:45:08 +01:00
Michael Mayer
9ec2381307 Update copyright after year change 2021-01-01 22:37:25 +01:00
Michael Mayer
8e22fbf8f6 Metadata: Store and compare data source for details #755 2020-12-31 13:51:31 +01:00
Michael Mayer
4614cbe4ea Frontend: Enable search for 2 character words #773 #746 2020-12-30 13:59:27 +01:00
Michael Mayer
8cfabe3205 Metadata: Cache ExifTool JSON by original file hash #755 #759 2020-12-30 13:33:47 +01:00
Michael Mayer
91acaaa573 Index shorter keywords in languages like Chinese #746
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-12-27 16:37:28 +01:00
Michael Mayer
02722ab861 Config: Detect case-insensitive file systems
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-12-26 18:06:54 +01:00
Michael Mayer
d430ae24ee Indexer: Fix JSON sidecar creation using Exiftool
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-12-25 20:29:06 +01:00
Michael Mayer
92b99060c1 Add capitalization tests #737
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-12-23 22:54:46 +01:00
Michael Mayer
859e4f7d8c Indexer: Set a default color for photos with multiple files #715 2020-12-17 12:32:53 +01:00
Michael Mayer
3d7c9323d8 Indexer: Improve color & chroma classification #596 2020-12-17 11:47:31 +01:00
Michael Mayer
c4b42d7e61 Refactor txt package 2020-12-16 12:34:39 +01:00
Michael Mayer
473566f404 Videos: Enforce transcoding to MPEG-4 AVC #603 2020-12-12 17:20:31 +01:00
Michael Mayer
73a00efae8 Workaround for bad image rotation in Exif headers #637 2020-12-12 13:05:58 +01:00
Michael Mayer
8a86fbc60f Indexer: Update index after renaming related sidecar files 2020-12-11 19:39:42 +01:00
Michael Mayer
424c0ce616 Indexer: Automatically rename related sidecar files 2020-12-11 19:17:07 +01:00
Michael Mayer
004400b118 Albums: Improve folder indexing 2020-12-09 13:10:21 +01:00
Michael Mayer
ccdd048c47 Indexer: Ignore date in canonical file names
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-12-08 23:20:43 +01:00
Michael Mayer
846c635f22 Video: Transcoding to AVC1 #636 #513 #624 #603 #533 $440 2020-12-05 04:24:10 +01:00
Michael Mayer
0b16a67c90 WebDAV: Sync video files #504 2020-12-05 02:18:45 +01:00
Michael Mayer
b7876711ad Fallback to backup path if storage path is not defined or writable 2020-12-04 11:37:31 +01:00
Michael Mayer
3464bf35ed Config: Add backup path parameter 2020-12-04 11:02:19 +01:00
Michael Mayer
5daa689975 Backend: Format go imports 2020-11-21 18:08:41 +01:00
Theresa Gresch
b6d9d7e11f Backend: Add tests for pkg 2020-10-19 15:11:27 +02:00
Michael Mayer
45f1a34018 Backend: Use constants for home dir and path separator
Signed-off-by: Michael Mayer <michael@lastzero.net>
2020-10-19 09:52:52 +02:00
Michael Mayer
c8ded4c7c1 Backend: Refactor .ppignore pattern matching
Signed-off-by: Michael Mayer <michael@lastzero.net>
2020-10-19 09:23:09 +02:00
Michael Mayer
9eef7b37ab Backend: Improve .ppignore pattern matching
Signed-off-by: Michael Mayer <michael@lastzero.net>
2020-10-18 20:03:25 +02:00
Michael Mayer
4e172c450a Improve feedback form
Signed-off-by: Michael Mayer <michael@lastzero.net>
2020-10-05 07:40:11 +02:00
Michael Mayer
d38c84bbfb Update trademark
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-09-21 02:48:22 +02:00
Michael Mayer
9e37c86b67 Backend: Fallback to file extension for mime type detection
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-09-20 15:12:45 +02:00
Michael Mayer
db4749a6f8 Config: Show helpful error message when a path is missing #418
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-08-18 19:09:46 +02:00
Michael Mayer
6e2849fba2 Index: Don't stack files based on XMP InstanceID
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-08-18 00:45:53 +02:00
Theresa Gresch
6c03ad73fd Backend: Add german cities to countries.go 2020-08-17 20:23:23 +02:00
Michael Mayer
d43d3a22e0 Backend: Improve country estimate from folder name
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-08-14 15:36:48 +02:00
Theresa Gresch
a6a4899ccc Backend: Add special word 2020-08-12 19:14:45 +02:00
Theresa Gresch
68d490c975 Backend: Add new stopword 2020-08-12 19:14:01 +02:00
Michael Mayer
0938fe1fa0 Backend: Move .cr3 in file type list #445
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-08-06 10:56:33 +02:00
Michael Mayer
91a1a1ca27 Backend: Ignore image unique IDs that are not standard UUIDs
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-23 15:34:20 +02:00
Michael Mayer
7d00e68d92 Index: Refactor mime type detection #391
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-21 14:43:45 +02:00
Michael Mayer
ad93f04003 Backend: Add "des" to smallwords.go
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-21 03:30:18 +02:00
Michael Mayer
8d3b46a631 Backend: Add "los" to shortwords.go
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-21 03:19:03 +02:00
Michael Mayer
bf6c79ad67 Backend: Keep plus in titles generated from file names
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-20 13:30:25 +02:00
Michael Mayer
2283f6019a Backend: Keep ampersand in titles generated from file names
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-20 13:25:09 +02:00
Michael Mayer
138dabd0c8 Metadata: Use mime type to determine file format and exif parser #391
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-19 16:39:43 +02:00
Michael Mayer
0023fdb1e2 Fix indexing aborts when encountering broken symlink #414
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-19 14:45:49 +02:00
Michael Mayer
24cfa1aea2 Backend: Refactor file indexing / skipping
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-18 20:58:35 +02:00
Michael Mayer
cc946b8ea8 Use int64 for file modification timestamps #391
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-17 16:09:55 +02:00
Michael Mayer
ab7931732e File Browser: Add empty file to test directory
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-16 16:01:46 +02:00
Michael Mayer
6847b8b5f9
Complete file browser with symlink support and full folder / file names (#412)
* Backend: Code clean-up

Signed-off-by: Michael Mayer <michael@liquidbytes.net>

* File Browser: Show complete, original file and folder names #408

Signed-off-by: Michael Mayer <michael@liquidbytes.net>

* File Browser: Follow symlinks #201 #403 #407

Warning: Following symlinks can make folder lists non-deterministic
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-16 15:43:23 +02:00
Michael Mayer
5866ba307f Backend: Improve detection of generated file names
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-14 15:00:14 +02:00
Michael Mayer
8989c987a2 Unstack all types, except primary and sidecar files #394
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-14 11:00:49 +02:00
Theresa Gresch
832715f861 Backend: Improve Dsc regular expression and add test 2020-07-14 08:46:20 +02:00
Michael Mayer
70c6a68169 Use date from file name if no metadata was found #396
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-13 19:34:21 +02:00
Michael Mayer
2bcb954266 Show taken date incl source in photo info tab #396
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-13 16:29:36 +02:00
Michael Mayer
849225e1ea Backend: Tweak db connection params and add stack to panic logs
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-13 15:16:09 +02:00
Michael Mayer
4fb263f8a4 Add location field to album metadata
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-12 16:36:39 +02:00
Michael Mayer
99eaae0816 Backend: Import JSON metadata from Google Photos
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-11 16:46:29 +02:00
Michael Mayer
5c780c99db Backend: Add words to stopwords.txt
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-07 20:28:17 +02:00
Theresa Gresch
f58ca6dcda Backend: Add unit tests for internal/form 2020-07-07 18:03:20 +02:00
Theresa Gresch
0faf7dbb7f Backend: Add unit tests for pkg 2020-07-07 16:29:55 +02:00
Michael Mayer
f7c955053f Backend: Update short and small words list in txt package
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-07 15:25:19 +02:00
Theresa Gresch
e74de4716e Backend: Add unit tests for pkg/fs 2020-07-07 15:13:42 +02:00
Michael Mayer
1284091b77 Backend: Improve FileTitle() function
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-06 11:31:03 +02:00
Michael Mayer
8e07f1c61a Backend: Add "eos" to stopwords list
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-06 10:31:33 +02:00
Michael Mayer
d4008564bb Backend: Update countries.txt and stopwords.txt
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-05 17:37:40 +02:00
Michael Mayer
f86a2fe50b Backend: Add "misc" to stopwords list
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-07-01 10:13:55 +02:00
Michael Mayer
bfd73932e5 Improve UX and title generation from file names
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-06-29 11:10:24 +02:00
Michael Mayer
957638e0df Stopwords: Remove "fuji"
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-06-27 14:50:58 +02:00
Michael Mayer
045f5915c2 Backend: Add "xd" to SpecialWords list
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-06-27 14:27:37 +02:00
Michael Mayer
f0af60a82b Stopwords: Add "unknown", "title", "caption" and "description"
Signed-off-by: Michael Mayer <michael@liquidbytes.net>
2020-06-27 14:24:30 +02:00