45 commits

Author	SHA1	Message	Date
Eugene Burmakin	1671a781b0	Improve performance of Google Maps imports by batching database inserts.	2025-10-16 18:59:21 +02:00
Eugene Burmakin	7eb3103645	Rename a method	2025-08-22 20:40:06 +02:00
Eugene Burmakin	96c9f1030c	Move json loading to a module	2025-08-22 20:13:10 +02:00
Eugene Burmakin	ed3bb4fb67	Unify imports form	2025-08-22 19:10:40 +02:00
Eugene Burmakin	2088b769d7	Add tests	2025-06-26 19:24:40 +02:00
Eugene Burmakin	07d00f189d	Rename parsers to importers	2025-04-23 23:36:16 +02:00
Eugene Burmakin	e433ed4d1c	Use secure file downloader for imports	2025-04-23 23:27:55 +02:00
Eugene Burmakin	deeb250910	Extract file downloader	2025-04-23 22:46:39 +02:00
Eugene Burmakin	5ab8b17cdd	Update records storage importer to process all records	2025-04-06 16:49:50 +02:00
Eugene Burmakin	73edb35bb1	Implement Records.json import via the UI	2025-04-03 18:41:05 +02:00
Eugene Burmakin	41380ddf7c	Move some beds	2025-03-24 20:58:43 +01:00
Eugene Burmakin	fc8d0d8ddc	Fix failing tests and move testing imports to files	2025-03-24 20:46:16 +01:00
Eugene Burmakin	1e54d87d53	Implement support for storing import files in S3.	2025-03-23 22:00:41 +01:00
Eugene Burmakin	5758f9a923	Use attached file to import geojson and phone takeout	2025-03-23 19:13:59 +01:00
Eugene Burmakin	d9eac91834	Introduce latlon to Points and use it instead of latitude and longitude.	2025-02-21 23:45:36 +01:00
Eugene Burmakin	fea87b85bb	Add docs and few fixes	2025-02-07 19:17:28 +01:00
Eugene Burmakin	591543fe98	Rename GoogleMaps::RecordsParser to GoogleMaps::RecordsImporter	2025-01-21 19:42:04 +01:00
Eugene Burmakin	510868a594	Fix failed specs	2025-01-21 19:32:12 +01:00
Eugene Burmakin	b43810b1fb	Import Google Records JSON in batches	2025-01-21 19:14:36 +01:00
Eugene Burmakin	049812823f	Stream google records import	2025-01-21 10:07:54 +01:00
Eugene Burmakin	3ba70e906f	Add Imports::Broadcaster to some more parsers	2024-11-04 13:14:06 +01:00
Eugene Burmakin	9cc9632b6d	Remove unused parser from imports create service	2024-11-04 11:58:15 +01:00
Sascha Zepter	b8172c86e3	Merge branch 'Freika:master' into fix/import-google-timeline	2024-09-30 23:48:00 +02:00
Eugene Burmakin	ec793fe4aa	Fix incorrect timestamps for Google Location History (mobile device) points	2024-09-30 23:31:42 +02:00
Sascha Zepter	2231c0aab9	Merge branch 'Freika:master' into fix/import-google-timeline	2024-09-30 22:38:16 +02:00
Sascha Zepter	eb892dde9a	Refactor parse_timestamp: move to lib/timestamps.rb	2024-09-30 14:49:11 +00:00
Eugene Burmakin	2d26418337	Add specs for GoogleMaps::SemanticHistoryParser	2024-09-28 17:09:44 +02:00
Sascha Zepter	6077776880	Allow different timestamp formats in Google exports to be parsed	2024-09-24 22:46:52 +02:00
Eugene Burmakin	3592f46492	Rework GeoJSON import to support FeatureCollection as a root object and remove points counter for imports	2024-09-06 00:07:06 +02:00
Eugene Burmakin	e1648c5cb0	Rework Google Phone Takeout import to support location-history.json another file format	2024-07-08 18:05:02 +02:00
Eugene Burmakin	02213d84b1	Update changelog	2024-06-30 17:57:13 +02:00
Eugene Burmakin	1dbf5cbda5	Implement support for Google Phone Takeout import	2024-06-30 17:47:36 +02:00
Eugene Burmakin	6ed9a27040	Update Records.json importing script	2024-06-10 22:48:05 +02:00
Eugene Burmakin	96a5240729	Add Google Maps Phone Takeout parser	2024-06-08 22:10:10 +02:00
Eugene Burmakin	e2cc9a9992	Increase the concurrency of the Sidekiq workers to 10 and add the user_id to the records parsed from the Google Maps Timeline Export.	2024-05-25 22:27:18 +02:00
Eugene Burmakin	5f18a3051d	Fix interface inconsistencies	2024-05-25 13:36:15 +02:00
Eugene Burmakin	d25468207d	Add a rake task to import large files from Google Takeout	2024-05-23 20:35:31 +02:00
Eugene Burmakin	494eb2c0ec	Implement Google Maps records parser	2024-05-18 15:00:44 +02:00
Eugene Burmakin	e00f614b9a	Use shrine to upload files instead of ActiveStorage	2024-04-25 22:28:34 +02:00
Eugene Burmakin	b6769676c3	Fix google import and add stats for countries and cities visited and distance traveled by year	2024-03-28 15:11:59 +01:00
Eugene Burmakin	7292115a44	Move import processing to background job & allow to disable reverse geocoding	2024-03-24 18:05:39 +01:00
Eugene Burmakin	5cb8af66e0	Save number of raw points and doubles in import file	2024-03-23 14:20:20 +01:00
Eugene Burmakin	3f146b34c7	Prevent doubles in the database when importing points	2024-03-21 22:56:55 +01:00
Eugene Burmakin	1f3ee41bcb	Implement calculation of cities and countries with the number of points and the last timestamp	2024-03-17 17:58:09 +01:00
Eugene Burmakin	3c74bc2937	Migrate from old template	2024-03-15 23:27:31 +01:00