Commit graph

409 commits

Author SHA1 Message Date
Eugene Burmakin
e64e706b0f Unify timestamps 2025-07-07 23:38:10 +02:00
Eugene Burmakin
a66f41d9fb Add documentation 2025-07-07 23:12:02 +02:00
Eugene Burmakin
f33dcdfe21 Store track distance in user's preferred unit 2025-07-07 22:23:37 +02:00
Eugene Burmakin
0d657b9d6e Add incremental track generation 2025-07-07 21:48:07 +02:00
Eugene Burmakin
92a15c8ad3 Handle unfinished tracks 2025-07-07 18:59:42 +02:00
Eugene Burmakin
7619feff69 Add data migration to create tracks from points 2025-07-06 13:49:53 +02:00
Eugene Burmakin
15be46b604 Fix tests 2025-07-04 20:55:05 +02:00
Eugene Burmakin
1468f1f9dc Remove tracks api endpoint 2025-07-04 20:09:06 +02:00
Eugene Burmakin
565f92c463 Add tracks to map 2025-07-04 19:49:56 +02:00
Eugene Burmakin
862f601e1d Add tracks calculation and storage in the database 2025-07-03 20:18:18 +02:00
Eugene Burmakin
3b474704ea Fixes for visits suggestions. 2025-07-02 23:50:32 +02:00
Eugene Burmakin
12a53aac20 Don't check for new version in production. 2025-07-02 21:58:19 +02:00
Eugene Burmakin
00be1e8245 Update export data format example 2025-07-02 20:38:38 +02:00
Eugene Burmakin
d518603719 Update importing process 2025-07-02 20:22:40 +02:00
Eugene Burmakin
f86487f742 Fix exception reporter 2025-06-30 23:54:45 +02:00
Eugene Burmakin
1ebe2da84a Update changelog 2025-06-30 22:51:25 +02:00
Eugene Burmakin
32a00db9b9 Clean up some code 2025-06-30 22:29:28 +02:00
Eugene Burmakin
d10ca668a9 Map country codes instead of guessing 2025-06-30 22:08:34 +02:00
Eugene Burmakin
cabd63344a Fix failing test 2025-06-30 20:51:18 +02:00
Eugene Burmakin
f37039ad8e Add export and import specs 2025-06-30 20:29:47 +02:00
Eugene Burmakin
aeac8262df Update importing process 2025-06-29 11:49:44 +02:00
Eugene Burmakin
8ad0b20d3d Add import data feature 2025-06-28 12:22:56 +02:00
Eugene Burmakin
4898cd82ac Update specs 2025-06-26 22:05:32 +02:00
Eugene Burmakin
631ee0e64c Clean up specs a bit 2025-06-26 19:48:42 +02:00
Eugene Burmakin
2088b769d7 Add tests 2025-06-26 19:24:40 +02:00
Eugene Burmakin
22a7d662c9 Update exporting process to use minimal compression for speed/size balance 2025-06-26 00:31:21 +02:00
Eugene Burmakin
dd87f57971 Use as_json to export points data 2025-06-25 22:23:56 +02:00
Eugene Burmakin
36e426433e Extract exporting data to services 2025-06-25 22:23:43 +02:00
Eugene Burmakin
347233dbb2 User export: exporting all data with ids 2025-06-25 21:44:36 +02:00
Eugene Burmakin
7fc2207810 User export: exporting areas, stats, notifications, trips 2025-06-25 21:26:08 +02:00
Eugene Burmakin
6ebf58d7ad Export trips data 2025-06-25 21:21:03 +02:00
Eugene Burmakin
7988fadd5f User export: exporting exports and imports data with files 2025-06-25 21:14:33 +02:00
Eugene Burmakin
58e3b65714 Fix notifications scroll 2025-06-11 21:12:03 +02:00
Eugene Burmakin
b76602d9c8 Return sidekiq and redis to Dawarich 2025-06-09 13:39:25 +02:00
Eugene Burmakin
b6a7896119 Revert cities and countries logic 2025-06-09 12:09:42 +02:00
Eugene Burmakin
3426f2d66b Fixed a bug where points from Immich and Photoprism did not have lonlat attribute set. #1318 2025-06-08 16:41:01 +02:00
Eugene Burmakin
6d39f4306f Remove Redis and Sidekiq from Dawarich 2025-06-02 20:53:35 +02:00
Eugene Burmakin
551c6e7629 Use sqlite for cable in development 2025-05-31 21:27:20 +02:00
Evgenii Burmakin
89c286a69b
Merge branch 'dev' into tests/system 2025-05-29 12:42:48 +02:00
Evgenii Burmakin
05018b6e6c
Merge pull request #610 from arne182/patch-2
Fix logic for grouping consecutive points in CountriesAndCities
2025-05-29 12:42:01 +02:00
Eugene Burmakin
f5cefdbd03 Add system tests for map interaction 2025-05-26 20:33:48 +02:00
Eugene Burmakin
64d33f5e6e Fix few issues 2025-05-22 19:09:43 +02:00
Eugene Burmakin
8728a22974 Update safe settings 2025-05-19 23:28:33 +02:00
Eugene Burmakin
605ceee820 Add modal to show countries and cities visited in a year 2025-05-18 00:15:25 +02:00
Eugene Burmakin
f738956959 Minor changes 2025-05-17 21:53:50 +02:00
Eugene Burmakin
e511eb7548 Update changelog 2025-05-17 21:50:34 +02:00
Eugene Burmakin
5688d66972 Rework settings pages 2025-05-17 21:44:22 +02:00
Eugene Burmakin
06aee05602 Move distance unit settings to user settings 2025-05-17 20:35:38 +02:00
Eugene Burmakin
630c813f0b Fix visits overlapping issue 2025-05-17 20:10:03 +02:00
Eugene Burmakin
abd4325891 Address N+1 queries in Place::FetchData and skip locationless points 2025-05-17 19:14:28 +02:00
Eugene Burmakin
c69d4f45f1 Update views and specs 2025-05-16 19:53:42 +02:00
Eugene Burmakin
5be5c1e584 Put countries into database 2025-05-16 18:51:48 +02:00
Eugene Burmakin
a48cff098b Some frontend fixes 2025-05-15 18:23:24 +02:00
Eugene Burmakin
556af7fd02 Replace stubs with Geocoder search 2025-05-13 20:21:18 +02:00
Eugene Burmakin
79f2522f54 Fetch countries for a trip via geocoding service 2025-05-13 19:43:02 +02:00
Eugene Burmakin
857f1da942 Unify name builder usage 2025-05-12 23:36:46 +02:00
Eugene Burmakin
aa521dba9b Extract place name suggester 2025-05-12 22:49:30 +02:00
Eugene Burmakin
ed7b6d6d24 Add a STORE_GEODATA environment variable to control whether to store geodata in the database. 2025-05-12 22:33:47 +02:00
Evgenii Burmakin
f571d1ebad
Merge branch 'dev' into fix/small-fixes 2025-05-12 21:44:42 +02:00
Eugene Burmakin
52aefa109e Skip points without lonlat and timestamp from Owntracks 2025-05-12 21:41:55 +02:00
Eugene Burmakin
fa80658904 Fix GeoJSON import speed/velocity 2025-05-08 17:28:06 +02:00
Eugene Burmakin
e6fddddc01 Fix tests 2025-05-04 00:16:02 +02:00
Eugene Burmakin
c786671d95 Refactor points creation to be synchronous 2025-05-03 22:40:44 +02:00
Eugene Burmakin
8087229d87 Fix pmtiles map 2025-05-03 20:36:09 +02:00
Eugene Burmakin
b3e38a24ce Remove comment 2025-04-23 23:41:11 +02:00
Eugene Burmakin
07d00f189d Rename parsers to importers 2025-04-23 23:36:16 +02:00
Eugene Burmakin
e433ed4d1c Use secure file downloader for imports 2025-04-23 23:27:55 +02:00
Eugene Burmakin
45a310319f Fix failing specs 2025-04-23 23:07:58 +02:00
Eugene Burmakin
deeb250910 Extract file downloader 2025-04-23 22:46:39 +02:00
Eugene Burmakin
2e53f39a7f Update import edit view 2025-04-19 13:18:39 +02:00
Eugene Burmakin
d6b5ce0549 Implement SMTP mailing and fix some bugs 2025-04-15 21:34:02 +02:00
Eugene Burmakin
5fe503f745 Extract latitude and longitude from raw_data 2025-04-13 23:25:26 +02:00
Eugene Burmakin
b0b0a11c30 Fix few errors 2025-04-12 13:06:32 +02:00
Eugene Burmakin
dae1733320 Remove telemetry 2025-04-11 19:13:46 +02:00
Eugene Burmakin
5ab8b17cdd Update records storage importer to process all records 2025-04-06 16:49:50 +02:00
Eugene Burmakin
41604d71a6 Add brakeman and some tests 2025-04-04 22:16:52 +02:00
Eugene Burmakin
99bb982792 Merge from dev 2025-04-04 20:14:44 +02:00
Eugene Burmakin
29da64400b Update changelog and fix visits pane z-index 2025-03-16 13:36:06 +01:00
Eugene Burmakin
c86921a29b Update tests and refactor some code 2025-03-09 16:29:16 +01:00
Eugene Burmakin
5ee3d43b10 Fix some more tests and rework visit_suggesting_job a bit 2025-03-09 15:37:32 +01:00
Eugene Burmakin
4a859fb350 Add bunch of tests and refactor some stuff 2025-03-09 14:58:30 +01:00
Eugene Burmakin
761aaa3cb8 Highlight visits on map when clicked on 2025-03-08 21:04:56 +01:00
Eugene Burmakin
43c7e64efb Add osm_id, osm_key, osm_value, osm_type to places 2025-03-08 19:40:28 +01:00
Eugene Burmakin
d78482f1bf Get 20 places results and dont round coordinates 2025-03-08 19:08:47 +01:00
Eugene Burmakin
52fd54e39f Implement area selecting to show visits 2025-03-07 23:32:56 +01:00
Eugene Burmakin
adf923542d Move visits to different panes 2025-03-06 00:13:47 +01:00
Eugene Burmakin
6b356d24b1 Implement visits merging 2025-03-05 20:04:26 +01:00
Eugene Burmakin
bc91004713 Fix smart detect spec 2025-03-04 21:16:45 +01:00
Eugene Burmakin
9d68458622 Fix some more tests 2025-03-03 23:54:39 +01:00
Eugene Burmakin
70d754b397 Fix some tests 2025-03-03 22:39:43 +01:00
Eugene Burmakin
ebde7d32fb Use tighter place search for suggested places 2025-03-03 21:45:09 +01:00
Eugene Burmakin
d769861e69 Use postgis to find existing places 2025-03-03 21:34:06 +01:00
Eugene Burmakin
c2f6224421 Add lonlat to places 2025-03-03 20:50:49 +01:00
Eugene Burmakin
414c9e831c Add possible places to visits 2025-03-03 20:11:21 +01:00
Eugene Burmakin
a4123791aa Add visits to the map page 2025-03-02 21:24:57 +01:00
Eugene Burmakin
56046a6965 Broadcast import progress after GPX import 2025-02-23 23:12:12 +01:00
Eugene Burmakin
383b88ab04 Speed up some importing processes 2025-02-22 23:14:23 +01:00
Eugene Burmakin
7c766a4d92 Fix the rest of the tests 2025-02-22 22:37:21 +01:00
Eugene Burmakin
4fa3c35fb8 Calculate distance using PostGIS ST_Distance with LAG 2025-02-22 00:02:13 +01:00
Eugene Burmakin
d9eac91834 Introduce latlon to Points and use it instead of latitude and longitude. 2025-02-21 23:45:36 +01:00
Eugene Burmakin
699e498670 Recalculate stats upon import deletion 2025-02-15 18:49:30 +01:00
Eugene Burmakin
51e589e17f Implement map tiles usage tracking and chart in user settings. 2025-02-13 21:04:29 +01:00
Evgenii Burmakin
838d85c62e
Merge pull request #876 from Freika/revert-875-revert-732-patch-3
Revert 875 revert 732 patch 3
2025-02-13 20:28:36 +01:00
Evgenii Burmakin
3d01bead20
Revert "Revert "Add radius param of 10"" 2025-02-13 20:28:09 +01:00
Evgenii Burmakin
46fbb4a1b1
Revert "Add radius param of 10" 2025-02-13 20:27:51 +01:00
Evgenii Burmakin
43e54a7388
Merge pull request #732 from arne182/patch-3
Add radius param of 10
2025-02-13 20:26:40 +01:00
Eugene Burmakin
5b2834599e Update prometheus metric name 2025-02-11 21:17:33 +01:00
Eugene Burmakin
06da91df27 Fix live map enabled default value 2025-02-11 21:12:35 +01:00
Eugene Burmakin
b2e6a141fc Rehash paths and add tests 2025-02-11 21:04:12 +01:00
Eugene Burmakin
1580fb8ade Export map tiles usage to Prometheus 2025-02-11 20:45:36 +01:00
Eugene Burmakin
0b362168c9 Implement custom map tiles and user settings with default values 2025-02-10 20:37:20 +01:00
Eugene Burmakin
b8c69c2a76 Fix importing of GPX files with empty tracks and reduce number of points created for other GPX files. 2025-02-08 23:52:37 +01:00
Eugene Burmakin
fea87b85bb Add docs and few fixes 2025-02-07 19:17:28 +01:00
Arne Schwarck
908232d397
Fix reverse geocoding issue
Previously, reverse geocoding queries in the Photon lookup did not properly
limit results within a specified search radius, leading to inaccurate or
unexpected locations being returned. This fix ensures that the :radius
parameter is passed directly, just like :limit and :distance_sort, instead
of being nested under :params.
By aligning with the Photon lookup implementation in Geocoder, this change
improves accuracy and ensures that results are correctly filtered based on
proximity, resolving issues where points were incorrectly matched due to
missing radius constraints.

Resolves: Reverse geocoding mismatch for close proximity queries
2025-01-25 22:11:35 +01:00
Arne Schwarck
e5ee29617e
Add radius param of 10
https://github.com/Freika/dawarich/discussions/652
2025-01-25 21:55:25 +01:00
Eugene Burmakin
7db7fb17d5 Add path to trips 2025-01-24 12:01:54 +01:00
Eugene Burmakin
f60c93ee4f Fix a bug where rc version was being checked as a stable release 2025-01-22 12:17:26 +01:00
Evgenii Burmakin
988e5a1a63
Merge branch 'dev' into fix/imports/gpx-empty-tracks 2025-01-22 12:04:19 +01:00
Eugene Burmakin
157d916f6b Fix a bug where a gpx file with empty tracks was not being imported 2025-01-22 11:15:55 +01:00
Eugene Burmakin
c3243bdba0 Fix authentication to GET /api/v1/countries/visited_cities 2025-01-22 10:53:33 +01:00
Eugene Burmakin
591543fe98 Rename GoogleMaps::RecordsParser to GoogleMaps::RecordsImporter 2025-01-21 19:42:04 +01:00
Eugene Burmakin
510868a594 Fix failed specs 2025-01-21 19:32:12 +01:00
Eugene Burmakin
b43810b1fb Import Google Records JSON in batches 2025-01-21 19:14:36 +01:00
Eugene Burmakin
0ff47f3ac7 Fix Google Records import 2025-01-21 16:03:52 +01:00
Eugene Burmakin
049812823f Stream google records import 2025-01-21 10:07:54 +01:00
Eugene Burmakin
983768a572 Assign user_id to points on parsing 2025-01-20 20:07:46 +01:00
Eugene Burmakin
6c0a954e8e Implement dawarich points parsing 2025-01-20 16:37:15 +01:00
Eugene Burmakin
e904d396c8 Make sure cache jobs are run only on server start 2025-01-07 15:02:35 +01:00
Eugene Burmakin
974f45a4c9 Remove REVERSE_GEOCODING_ENABLED env var 2025-01-07 13:41:09 +01:00
Eugene Burmakin
ae6dc5ac8a Remove Photon API env vars and use DawarichSettings for reverse geocoding settings 2025-01-07 13:12:14 +01:00
Eugene Burmakin
1e9f539dac Revert "Imported points will now be reverse geocoded only after import is finished." 2025-01-04 21:31:21 +01:00
Arne Schwarck
c1b767d791
Fix logic for grouping consecutive points in CountriesAndCities
This update corrects the logic for grouping consecutive points in the group_points_with_consecutive_cities method. It ensures sessions are properly split when transitioning between cities or encountering significant time gaps, leading to accurate grouping and filtering of points based on session duration.
2025-01-01 13:06:07 +01:00
Arne Schwarck
a6b04ba49a
Add Logging for Immich 2024-12-27 21:52:33 +01:00
Eugene Burmakin
d9bade8fe5 Fix specs for watcher and change z-index for markers and polylines 2024-12-25 13:05:42 +01:00
Evgenii Burmakin
d9c4c5d16e
Merge pull request #592 from Freika/fix/import-reverse-geocoding
Start reverse geocoding after import is finished
2024-12-25 12:43:11 +01:00
Eugene Burmakin
0276882db1 Start reverse geocoding after import is finished 2024-12-25 12:38:32 +01:00
Evgenii Burmakin
52a032acb0
Merge branch 'master' into import_google_formats 2024-12-25 11:53:40 +01:00
GED
af8b3b4f5d fix: remove debbuging messages 2024-12-25 05:06:56 +01:00
Eugene Burmakin
d640af4036 Add cache cleaning and preheating 2024-12-24 16:51:26 +01:00
GED
1f223142f3 error: watcher does not create points 2024-12-24 13:08:14 +01:00
Eugene Burmakin
6c18fbe41f Add buttons to update stats for a year or a month 2024-12-20 15:26:25 +01:00
Eugene Burmakin
5f93bf8522 Update to Rails 8.0.1 2024-12-17 12:56:21 +01:00
GED
ef8882037f refactor: rubocop 2024-12-17 11:29:19 +01:00
GED
a3614abdfa fix: raw_data parsing json since all formats are expecting import and user_id, but not a file 2024-12-17 11:19:15 +01:00
GED
409e3b745d feat: added certain files for watcher_spec with valid and invalid users 2024-12-16 20:53:48 +01:00
Eugene Burmakin
2ee7bb74a3 Fix some swagger specs and remove unused code 2024-12-16 15:42:26 +01:00
Eugene Burmakin
d9930521c9 Refactor code a bit and add some specs 2024-12-16 15:10:46 +01:00
GED
ab84d282d3 feat: added formats(google_phone_takeout, google_records, google_semantic_history, owntracks to the watcher 2024-12-16 12:13:38 +01:00
Eugene Burmakin
5cde596884 Rework countries and cities service 2024-12-11 17:14:26 +01:00
Eugene Burmakin
4bb39a2bbd Disable telemetry by default 2024-12-11 14:53:07 +01:00