dawarich/lib/tasks/demo.rake
Evgenii Burmakin 3f0aaa09f5
0.36.4 (#2062)
* fix: move foreman to global gems to fix startup crash (#1971)

* Update exporting code to stream points data to file in batches to red… (#1980)

* Update exporting code to stream points data to file in batches to reduce memory usage

* Update changelog

* Update changelog

* Feature/maplibre frontend (#1953)

* Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet

* Implement phase 1

* Phases 1-3 + part of 4

* Fix e2e tests

* Phase 6

* Implement fog of war

* Phase 7

* Next step: fix specs, phase 7 done

* Use our own map tiles

* Extract v2 map logic to separate manager classes

* Update settings panel on v2 map

* Update v2 e2e tests structure

* Reimplement location search in maps v2

* Update speed routes

* Implement visits and places creation in v2

* Fix last failing test

* Implement visits merging

* Fix a routes e2e test and simplify the routes layer styling.

* Extract js to modules from maps_v2_controller.js

* Implement area creation

* Fix spec problem

* Fix some e2e tests

* Implement live mode in v2 map

* Update icons and panel

* Extract some styles

* Remove unused file

* Start adding dark theme to popups on MapLibre maps

* Make popups respect dark theme

* Move v2 maps to maplibre namespace

* Update v2 references to maplibre

* Put place, area and visit info into side panel

* Update API to use safe settings config method

* Fix specs

* Fix method name to config in SafeSettings and update usages accordingly

* Add missing public files

* Add handling for real time points

* Fix remembering enabled/disabled layers of the v2 map

* Fix lots of e2e tests

* Add settings to select map version

* Use maps/v2 as main path for MapLibre maps

* Update routing

* Update live mode

* Update maplibre controller

* Update changelog

* Remove some console.log statements

* Pull only necessary data for map v2 points

* Feature/raw data archive (#2009)

* 0.36.2 (#2007)

* fix: move foreman to global gems to fix startup crash (#1971)

* Update exporting code to stream points data to file in batches to red… (#1980)

* Update exporting code to stream points data to file in batches to reduce memory usage

* Update changelog

* Update changelog

* Feature/maplibre frontend (#1953)

* Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet

* Implement phase 1

* Phases 1-3 + part of 4

* Fix e2e tests

* Phase 6

* Implement fog of war

* Phase 7

* Next step: fix specs, phase 7 done

* Use our own map tiles

* Extract v2 map logic to separate manager classes

* Update settings panel on v2 map

* Update v2 e2e tests structure

* Reimplement location search in maps v2

* Update speed routes

* Implement visits and places creation in v2

* Fix last failing test

* Implement visits merging

* Fix a routes e2e test and simplify the routes layer styling.

* Extract js to modules from maps_v2_controller.js

* Implement area creation

* Fix spec problem

* Fix some e2e tests

* Implement live mode in v2 map

* Update icons and panel

* Extract some styles

* Remove unused file

* Start adding dark theme to popups on MapLibre maps

* Make popups respect dark theme

* Move v2 maps to maplibre namespace

* Update v2 references to maplibre

* Put place, area and visit info into side panel

* Update API to use safe settings config method

* Fix specs

* Fix method name to config in SafeSettings and update usages accordingly

* Add missing public files

* Add handling for real time points

* Fix remembering enabled/disabled layers of the v2 map

* Fix lots of e2e tests

* Add settings to select map version

* Use maps/v2 as main path for MapLibre maps

* Update routing

* Update live mode

* Update maplibre controller

* Update changelog

* Remove some console.log statements

---------

Co-authored-by: Robin Tuszik <mail@robin.gg>

* Remove esbuild scripts from package.json

* Remove sideEffects field from package.json

* Raw data archivation

* Add tests

* Fix tests

* Fix tests

* Update ExceptionReporter

* Add schedule to run raw data archival job monthly

* Change file structure for raw data archival feature

* Update changelog and version for raw data archival feature

---------

Co-authored-by: Robin Tuszik <mail@robin.gg>

* Set raw_data to an empty hash instead of nil when archiving

* Fix storage configuration and file extraction

* Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation (#2018)

* Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation

* Remove raw data from visited cities api endpoint

* Use user timezone to show dates on maps (#2020)

* Fix/pre epoch time (#2019)

* Use user timezone to show dates on maps

* Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates.

* Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates.

* Fix tests failing due to new index on stats table

* Fix failing specs

* Update redis client configuration to support unix socket connection

* Update changelog

* Fix kml kmz import issues (#2023)

* Fix kml kmz import issues

* Refactor KML importer to improve readability and maintainability

* Implement moving points in map v2 and fix route rendering logic to ma… (#2027)

* Implement moving points in map v2 and fix route rendering logic to match map v1.

* Fix route spec

* fix(maplibre): update date format to ISO 8601 (#2029)

* Add verification step to raw data archival process (#2028)

* Add verification step to raw data archival process

* Add actual verification of raw data archives after creation, and only clear raw_data for verified archives.

* Fix failing specs

* Eliminate zip-bomb risk

* Fix potential memory leak in js

* Return .keep files

* Use Toast instead of alert for notifications

* Add help section to navbar dropdown

* Update changelog

* Remove raw_data_archival_job

* Ensure file is being closed properly after reading in Archivable concern

* Add composite index to stats table if not exists

* Update changelog

* Update entrypoint to always sync static assets (not only new ones)

* Add family layer to MapLibre maps (#2055)

* Add family layer to MapLibre maps

* Update migration

* Don't show family toggle if feature is disabled

* Update changelog

* Return changelog

* Update changelog

* Update tailwind file

---------

Co-authored-by: Robin Tuszik <mail@robin.gg>
2025-12-26 14:57:55 +01:00

324 lines
10 KiB
Ruby
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# frozen_string_literal: true
namespace :demo do
desc 'Seed demo data: user, points from GeoJSON, visits, and areas'
task :seed_data, [:geojson_path] => :environment do |_t, args|
geojson_path = args[:geojson_path] || Rails.root.join('tmp/demo_data.geojson').to_s
unless File.exist?(geojson_path)
puts "Error: GeoJSON file not found at #{geojson_path}"
puts 'Usage: rake demo:seed_data[path/to/file.geojson]'
puts 'Or place file at tmp/demo_data.geojson'
exit 1
end
puts '🚀 Starting demo data generation...'
puts '=' * 60
# 1. Create demo user
puts "\n📝 Creating demo user..."
user = User.find_or_initialize_by(email: 'demo@dawarich.app')
if user.new_record?
user.password = 'password'
user.password_confirmation = 'password'
user.save!
user.update!(status: :active, active_until: 1000.years.from_now)
puts "✅ User created: #{user.email}"
puts ' Password: password'
puts " API Key: #{user.api_key}"
else
puts " User already exists: #{user.email}"
end
# 2. Import GeoJSON data
puts "\n📍 Importing GeoJSON data from #{geojson_path}..."
import = user.imports.create!(
name: "Demo Data Import - #{Time.current.strftime('%Y-%m-%d %H:%M')}",
source: :geojson
)
begin
Geojson::Importer.new(import, user.id, geojson_path).call
import.update!(status: :completed)
points_count = user.points.count
puts "✅ Imported #{points_count} points"
rescue StandardError => e
import.update!(status: :failed)
puts "❌ Import failed: #{e.message}"
exit 1
end
# Check if points were imported
points_count = Point.where(user_id: user.id).count
if points_count.zero?
puts '❌ No points found after import. Cannot create visits and areas.'
exit 1
end
# 3. Create suggested visits
puts "\n🏠 Creating 50 suggested visits..."
created_suggested = create_visits(user, 50, :suggested)
puts "✅ Created #{created_suggested} suggested visits"
# 4. Create confirmed visits
puts "\n✅ Creating 50 confirmed visits..."
created_confirmed = create_visits(user, 50, :confirmed)
puts "✅ Created #{created_confirmed} confirmed visits"
# 5. Create areas
puts "\n📍 Creating 10 areas..."
created_areas = create_areas(user, 10)
puts "✅ Created #{created_areas} areas"
# 6. Create family with members
puts "\n👨‍👩‍👧‍👦 Creating demo family..."
family_members = create_family_with_members(user)
puts "✅ Created family with #{family_members.count} members"
puts "\n" + '=' * 60
puts '🎉 Demo data generation complete!'
puts '=' * 60
puts "\n📊 Summary:"
puts " User: #{user.email}"
puts " Points: #{Point.where(user_id: user.id).count}"
puts " Places: #{user.visits.joins(:place).select('DISTINCT places.id').count}"
puts " Suggested Visits: #{user.visits.suggested.count}"
puts " Confirmed Visits: #{user.visits.confirmed.count}"
puts " Areas: #{user.areas.count}"
puts " Family Members: #{family_members.count}"
puts "\n🔐 Login credentials:"
puts ' Email: demo@dawarich.app'
puts ' Password: password'
puts "\n👨‍👩‍👧‍👦 Family member credentials:"
family_members.each_with_index do |member, index|
puts " Member #{index + 1}: #{member.email} / password"
end
end
def create_visits(user, count, status)
area_names = [
'Home', 'Work', 'Gym', 'Coffee Shop', 'Restaurant',
'Park', 'Library', 'Shopping Mall', 'Friend\'s House',
'Doctor\'s Office', 'Supermarket', 'School', 'Cinema',
'Beach', 'Museum', 'Airport', 'Train Station', 'Hotel'
]
# Get random points, excluding already used ones
used_point_ids = user.visits.pluck(:id).flat_map { |v| Visit.find(v).points.pluck(:id) }.uniq
available_points = Point.where(user_id: user.id).where.not(id: used_point_ids).order('RANDOM()').limit(count * 2)
if available_points.empty?
puts "⚠️ No available points for #{status} visits"
return 0
end
created_count = 0
available_points.first(count).each_with_index do |point, index|
# Random duration between 1-6 hours
duration_hours = rand(1..6)
started_at = point.recorded_at
ended_at = started_at + duration_hours.hours
# Create or find a place at this location
# Round coordinates to 5 decimal places (~1 meter precision)
rounded_lat = point.lat.round(5)
rounded_lon = point.lon.round(5)
place = Place.find_or_initialize_by(
latitude: rounded_lat,
longitude: rounded_lon
)
if place.new_record?
place.name = area_names.sample
place.lonlat = "POINT(#{rounded_lon} #{rounded_lat})"
place.save!
end
# Create visit with place
visit = user.visits.create!(
name: place.name,
place: place,
started_at: started_at,
ended_at: ended_at,
duration: (ended_at - started_at).to_i,
status: status
)
# Associate the point with the visit
point.update!(visit: visit)
# Find nearby points within 100 meters and associate them
nearby_points = Point.where(user_id: user.id)
.where.not(id: point.id)
.where.not(id: used_point_ids)
.where('timestamp BETWEEN ? AND ?', started_at.to_i, ended_at.to_i)
.select { |p| distance_between(point, p) < 100 }
.first(10)
nearby_points.each do |nearby_point|
nearby_point.update!(visit: visit)
used_point_ids << nearby_point.id
end
created_count += 1
print '.' if (index + 1) % 10 == 0
end
puts '' if created_count > 0
created_count
end
def create_areas(user, count)
area_names = [
'Home', 'Work', 'Gym', 'Parents House', 'Favorite Restaurant',
'Coffee Shop', 'Park', 'Library', 'Shopping Center', 'Friend\'s Place'
]
# Get random points spread across the dataset
total_points = Point.where(user_id: user.id).count
step = [total_points / count, 1].max
sample_points = Point.where(user_id: user.id).order(:timestamp).each_slice(step).map(&:first).first(count)
created_count = 0
sample_points.each_with_index do |point, index|
# Random radius between 50-500 meters
radius = rand(50..500)
user.areas.create!(
name: area_names[index] || "Area #{index + 1}",
latitude: point.lat,
longitude: point.lon,
radius: radius
)
created_count += 1
end
created_count
end
def distance_between(point1, point2)
# Haversine formula to calculate distance in meters
lat1 = point1.lat
lon1 = point1.lon
lat2 = point2.lat
lon2 = point2.lon
rad_per_deg = Math::PI / 180
rkm = 6371 # Earth radius in kilometers
rm = rkm * 1000 # Earth radius in meters
dlat_rad = (lat2 - lat1) * rad_per_deg
dlon_rad = (lon2 - lon1) * rad_per_deg
lat1_rad = lat1 * rad_per_deg
lat2_rad = lat2 * rad_per_deg
a = Math.sin(dlat_rad / 2)**2 + Math.cos(lat1_rad) * Math.cos(lat2_rad) * Math.sin(dlon_rad / 2)**2
c = 2 * Math.atan2(Math.sqrt(a), Math.sqrt(1 - a))
rm * c # Distance in meters
end
def create_family_with_members(owner)
# Create or find family
family = Family.find_or_initialize_by(creator: owner)
if family.new_record?
family.name = 'Demo Family'
family.save!
puts " Created family: #{family.name}"
else
puts " Family already exists: #{family.name}"
end
# Create or find owner membership
owner_membership = Family::Membership.find_or_create_by!(
family: family,
user: owner,
role: :owner
)
# Create 3 family members with location data
member_emails = [
'family.member1@dawarich.app',
'family.member2@dawarich.app',
'family.member3@dawarich.app'
]
family_members = []
# Get some sample points from the owner's data to create realistic locations
sample_points = Point.where(user_id: owner.id).order('RANDOM()').limit(10)
member_emails.each_with_index do |email, index|
# Create or find family member user
member = User.find_or_initialize_by(email: email)
if member.new_record?
member.password = 'password'
member.password_confirmation = 'password'
member.save!
member.update!(status: :active, active_until: 1000.years.from_now)
puts " Created family member: #{member.email}"
else
puts " Family member already exists: #{member.email}"
end
# Add member to family
Family::Membership.find_or_create_by!(
family: family,
user: member,
role: :member
)
# Enable location sharing for this member (permanent)
member.update_family_location_sharing!(true, duration: 'permanent')
# Create some points for this family member near owner's locations
if sample_points.any?
# Get a different sample point for each member
base_point = sample_points[index % sample_points.length]
# Create 3-5 recent points for this member within 1km of base location
points_count = rand(3..5)
points_count.times do |point_index|
# Add random offset (within ~1km)
lat_offset = (rand(-0.01..0.01) * 100) / 100.0
lon_offset = (rand(-0.01..0.01) * 100) / 100.0
# Calculate new coordinates
lat = base_point.lat + lat_offset
lon = base_point.lon + lon_offset
# Create point with recent timestamp (last 24 hours)
timestamp = (Time.current - rand(0..24).hours).to_i
Point.create!(
user: member,
latitude: lat,
longitude: lon,
lonlat: "POINT(#{lon} #{lat})",
timestamp: timestamp,
altitude: base_point.altitude || 0,
velocity: rand(0..50),
battery: rand(20..100),
battery_status: %w[charging connected_not_charging full].sample,
tracker_id: "demo_tracker_#{member.id}",
import_id: nil
)
end
puts " Created #{points_count} location points for #{member.email}"
end
family_members << member
end
family_members
end
end