mirror of
https://github.com/Freika/dawarich.git
synced 2026-01-09 08:47:11 -05:00
* fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements * Pull only necessary data for map v2 points * Feature/raw data archive (#2009) * 0.36.2 (#2007) * fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Remove esbuild scripts from package.json * Remove sideEffects field from package.json * Raw data archivation * Add tests * Fix tests * Fix tests * Update ExceptionReporter * Add schedule to run raw data archival job monthly * Change file structure for raw data archival feature * Update changelog and version for raw data archival feature --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Set raw_data to an empty hash instead of nil when archiving * Fix storage configuration and file extraction * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation (#2018) * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation * Remove raw data from visited cities api endpoint * Use user timezone to show dates on maps (#2020) * Fix/pre epoch time (#2019) * Use user timezone to show dates on maps * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Fix tests failing due to new index on stats table * Fix failing specs * Update redis client configuration to support unix socket connection * Update changelog * Fix kml kmz import issues (#2023) * Fix kml kmz import issues * Refactor KML importer to improve readability and maintainability * Implement moving points in map v2 and fix route rendering logic to ma… (#2027) * Implement moving points in map v2 and fix route rendering logic to match map v1. * Fix route spec * fix(maplibre): update date format to ISO 8601 (#2029) * Add verification step to raw data archival process (#2028) * Add verification step to raw data archival process * Add actual verification of raw data archives after creation, and only clear raw_data for verified archives. * Fix failing specs * Eliminate zip-bomb risk * Fix potential memory leak in js * Return .keep files * Use Toast instead of alert for notifications * Add help section to navbar dropdown * Update changelog * Remove raw_data_archival_job * Ensure file is being closed properly after reading in Archivable concern * Add composite index to stats table if not exists * Update changelog * Update entrypoint to always sync static assets (not only new ones) * Add family layer to MapLibre maps (#2055) * Add family layer to MapLibre maps * Update migration * Don't show family toggle if feature is disabled * Update changelog * Return changelog * Update changelog * Update tailwind file --------- Co-authored-by: Robin Tuszik <mail@robin.gg>
324 lines
10 KiB
Ruby
324 lines
10 KiB
Ruby
# frozen_string_literal: true
|
||
|
||
namespace :demo do
|
||
desc 'Seed demo data: user, points from GeoJSON, visits, and areas'
|
||
task :seed_data, [:geojson_path] => :environment do |_t, args|
|
||
geojson_path = args[:geojson_path] || Rails.root.join('tmp/demo_data.geojson').to_s
|
||
|
||
unless File.exist?(geojson_path)
|
||
puts "Error: GeoJSON file not found at #{geojson_path}"
|
||
puts 'Usage: rake demo:seed_data[path/to/file.geojson]'
|
||
puts 'Or place file at tmp/demo_data.geojson'
|
||
exit 1
|
||
end
|
||
|
||
puts '🚀 Starting demo data generation...'
|
||
puts '=' * 60
|
||
|
||
# 1. Create demo user
|
||
puts "\n📝 Creating demo user..."
|
||
user = User.find_or_initialize_by(email: 'demo@dawarich.app')
|
||
|
||
if user.new_record?
|
||
user.password = 'password'
|
||
user.password_confirmation = 'password'
|
||
user.save!
|
||
user.update!(status: :active, active_until: 1000.years.from_now)
|
||
puts "✅ User created: #{user.email}"
|
||
puts ' Password: password'
|
||
puts " API Key: #{user.api_key}"
|
||
else
|
||
puts "ℹ️ User already exists: #{user.email}"
|
||
end
|
||
|
||
# 2. Import GeoJSON data
|
||
puts "\n📍 Importing GeoJSON data from #{geojson_path}..."
|
||
import = user.imports.create!(
|
||
name: "Demo Data Import - #{Time.current.strftime('%Y-%m-%d %H:%M')}",
|
||
source: :geojson
|
||
)
|
||
|
||
begin
|
||
Geojson::Importer.new(import, user.id, geojson_path).call
|
||
import.update!(status: :completed)
|
||
points_count = user.points.count
|
||
puts "✅ Imported #{points_count} points"
|
||
rescue StandardError => e
|
||
import.update!(status: :failed)
|
||
puts "❌ Import failed: #{e.message}"
|
||
exit 1
|
||
end
|
||
|
||
# Check if points were imported
|
||
points_count = Point.where(user_id: user.id).count
|
||
|
||
if points_count.zero?
|
||
puts '❌ No points found after import. Cannot create visits and areas.'
|
||
exit 1
|
||
end
|
||
|
||
# 3. Create suggested visits
|
||
puts "\n🏠 Creating 50 suggested visits..."
|
||
created_suggested = create_visits(user, 50, :suggested)
|
||
puts "✅ Created #{created_suggested} suggested visits"
|
||
|
||
# 4. Create confirmed visits
|
||
puts "\n✅ Creating 50 confirmed visits..."
|
||
created_confirmed = create_visits(user, 50, :confirmed)
|
||
puts "✅ Created #{created_confirmed} confirmed visits"
|
||
|
||
# 5. Create areas
|
||
puts "\n📍 Creating 10 areas..."
|
||
created_areas = create_areas(user, 10)
|
||
puts "✅ Created #{created_areas} areas"
|
||
|
||
# 6. Create family with members
|
||
puts "\n👨👩👧👦 Creating demo family..."
|
||
family_members = create_family_with_members(user)
|
||
puts "✅ Created family with #{family_members.count} members"
|
||
|
||
puts "\n" + '=' * 60
|
||
puts '🎉 Demo data generation complete!'
|
||
puts '=' * 60
|
||
puts "\n📊 Summary:"
|
||
puts " User: #{user.email}"
|
||
puts " Points: #{Point.where(user_id: user.id).count}"
|
||
puts " Places: #{user.visits.joins(:place).select('DISTINCT places.id').count}"
|
||
puts " Suggested Visits: #{user.visits.suggested.count}"
|
||
puts " Confirmed Visits: #{user.visits.confirmed.count}"
|
||
puts " Areas: #{user.areas.count}"
|
||
puts " Family Members: #{family_members.count}"
|
||
puts "\n🔐 Login credentials:"
|
||
puts ' Email: demo@dawarich.app'
|
||
puts ' Password: password'
|
||
puts "\n👨👩👧👦 Family member credentials:"
|
||
family_members.each_with_index do |member, index|
|
||
puts " Member #{index + 1}: #{member.email} / password"
|
||
end
|
||
end
|
||
|
||
def create_visits(user, count, status)
|
||
area_names = [
|
||
'Home', 'Work', 'Gym', 'Coffee Shop', 'Restaurant',
|
||
'Park', 'Library', 'Shopping Mall', 'Friend\'s House',
|
||
'Doctor\'s Office', 'Supermarket', 'School', 'Cinema',
|
||
'Beach', 'Museum', 'Airport', 'Train Station', 'Hotel'
|
||
]
|
||
|
||
# Get random points, excluding already used ones
|
||
used_point_ids = user.visits.pluck(:id).flat_map { |v| Visit.find(v).points.pluck(:id) }.uniq
|
||
available_points = Point.where(user_id: user.id).where.not(id: used_point_ids).order('RANDOM()').limit(count * 2)
|
||
|
||
if available_points.empty?
|
||
puts "⚠️ No available points for #{status} visits"
|
||
return 0
|
||
end
|
||
|
||
created_count = 0
|
||
available_points.first(count).each_with_index do |point, index|
|
||
# Random duration between 1-6 hours
|
||
duration_hours = rand(1..6)
|
||
started_at = point.recorded_at
|
||
ended_at = started_at + duration_hours.hours
|
||
|
||
# Create or find a place at this location
|
||
# Round coordinates to 5 decimal places (~1 meter precision)
|
||
rounded_lat = point.lat.round(5)
|
||
rounded_lon = point.lon.round(5)
|
||
|
||
place = Place.find_or_initialize_by(
|
||
latitude: rounded_lat,
|
||
longitude: rounded_lon
|
||
)
|
||
|
||
if place.new_record?
|
||
place.name = area_names.sample
|
||
place.lonlat = "POINT(#{rounded_lon} #{rounded_lat})"
|
||
place.save!
|
||
end
|
||
|
||
# Create visit with place
|
||
visit = user.visits.create!(
|
||
name: place.name,
|
||
place: place,
|
||
started_at: started_at,
|
||
ended_at: ended_at,
|
||
duration: (ended_at - started_at).to_i,
|
||
status: status
|
||
)
|
||
|
||
# Associate the point with the visit
|
||
point.update!(visit: visit)
|
||
|
||
# Find nearby points within 100 meters and associate them
|
||
nearby_points = Point.where(user_id: user.id)
|
||
.where.not(id: point.id)
|
||
.where.not(id: used_point_ids)
|
||
.where('timestamp BETWEEN ? AND ?', started_at.to_i, ended_at.to_i)
|
||
.select { |p| distance_between(point, p) < 100 }
|
||
.first(10)
|
||
|
||
nearby_points.each do |nearby_point|
|
||
nearby_point.update!(visit: visit)
|
||
used_point_ids << nearby_point.id
|
||
end
|
||
|
||
created_count += 1
|
||
print '.' if (index + 1) % 10 == 0
|
||
end
|
||
|
||
puts '' if created_count > 0
|
||
created_count
|
||
end
|
||
|
||
def create_areas(user, count)
|
||
area_names = [
|
||
'Home', 'Work', 'Gym', 'Parents House', 'Favorite Restaurant',
|
||
'Coffee Shop', 'Park', 'Library', 'Shopping Center', 'Friend\'s Place'
|
||
]
|
||
|
||
# Get random points spread across the dataset
|
||
total_points = Point.where(user_id: user.id).count
|
||
step = [total_points / count, 1].max
|
||
sample_points = Point.where(user_id: user.id).order(:timestamp).each_slice(step).map(&:first).first(count)
|
||
|
||
created_count = 0
|
||
sample_points.each_with_index do |point, index|
|
||
# Random radius between 50-500 meters
|
||
radius = rand(50..500)
|
||
|
||
user.areas.create!(
|
||
name: area_names[index] || "Area #{index + 1}",
|
||
latitude: point.lat,
|
||
longitude: point.lon,
|
||
radius: radius
|
||
)
|
||
|
||
created_count += 1
|
||
end
|
||
|
||
created_count
|
||
end
|
||
|
||
def distance_between(point1, point2)
|
||
# Haversine formula to calculate distance in meters
|
||
lat1 = point1.lat
|
||
lon1 = point1.lon
|
||
lat2 = point2.lat
|
||
lon2 = point2.lon
|
||
|
||
rad_per_deg = Math::PI / 180
|
||
rkm = 6371 # Earth radius in kilometers
|
||
rm = rkm * 1000 # Earth radius in meters
|
||
|
||
dlat_rad = (lat2 - lat1) * rad_per_deg
|
||
dlon_rad = (lon2 - lon1) * rad_per_deg
|
||
|
||
lat1_rad = lat1 * rad_per_deg
|
||
lat2_rad = lat2 * rad_per_deg
|
||
|
||
a = Math.sin(dlat_rad / 2)**2 + Math.cos(lat1_rad) * Math.cos(lat2_rad) * Math.sin(dlon_rad / 2)**2
|
||
c = 2 * Math.atan2(Math.sqrt(a), Math.sqrt(1 - a))
|
||
|
||
rm * c # Distance in meters
|
||
end
|
||
|
||
def create_family_with_members(owner)
|
||
# Create or find family
|
||
family = Family.find_or_initialize_by(creator: owner)
|
||
|
||
if family.new_record?
|
||
family.name = 'Demo Family'
|
||
family.save!
|
||
puts " Created family: #{family.name}"
|
||
else
|
||
puts " ℹ️ Family already exists: #{family.name}"
|
||
end
|
||
|
||
# Create or find owner membership
|
||
owner_membership = Family::Membership.find_or_create_by!(
|
||
family: family,
|
||
user: owner,
|
||
role: :owner
|
||
)
|
||
|
||
# Create 3 family members with location data
|
||
member_emails = [
|
||
'family.member1@dawarich.app',
|
||
'family.member2@dawarich.app',
|
||
'family.member3@dawarich.app'
|
||
]
|
||
|
||
family_members = []
|
||
|
||
# Get some sample points from the owner's data to create realistic locations
|
||
sample_points = Point.where(user_id: owner.id).order('RANDOM()').limit(10)
|
||
|
||
member_emails.each_with_index do |email, index|
|
||
# Create or find family member user
|
||
member = User.find_or_initialize_by(email: email)
|
||
|
||
if member.new_record?
|
||
member.password = 'password'
|
||
member.password_confirmation = 'password'
|
||
member.save!
|
||
member.update!(status: :active, active_until: 1000.years.from_now)
|
||
puts " Created family member: #{member.email}"
|
||
else
|
||
puts " ℹ️ Family member already exists: #{member.email}"
|
||
end
|
||
|
||
# Add member to family
|
||
Family::Membership.find_or_create_by!(
|
||
family: family,
|
||
user: member,
|
||
role: :member
|
||
)
|
||
|
||
# Enable location sharing for this member (permanent)
|
||
member.update_family_location_sharing!(true, duration: 'permanent')
|
||
|
||
# Create some points for this family member near owner's locations
|
||
if sample_points.any?
|
||
# Get a different sample point for each member
|
||
base_point = sample_points[index % sample_points.length]
|
||
|
||
# Create 3-5 recent points for this member within 1km of base location
|
||
points_count = rand(3..5)
|
||
|
||
points_count.times do |point_index|
|
||
# Add random offset (within ~1km)
|
||
lat_offset = (rand(-0.01..0.01) * 100) / 100.0
|
||
lon_offset = (rand(-0.01..0.01) * 100) / 100.0
|
||
|
||
# Calculate new coordinates
|
||
lat = base_point.lat + lat_offset
|
||
lon = base_point.lon + lon_offset
|
||
|
||
# Create point with recent timestamp (last 24 hours)
|
||
timestamp = (Time.current - rand(0..24).hours).to_i
|
||
|
||
Point.create!(
|
||
user: member,
|
||
latitude: lat,
|
||
longitude: lon,
|
||
lonlat: "POINT(#{lon} #{lat})",
|
||
timestamp: timestamp,
|
||
altitude: base_point.altitude || 0,
|
||
velocity: rand(0..50),
|
||
battery: rand(20..100),
|
||
battery_status: %w[charging connected_not_charging full].sample,
|
||
tracker_id: "demo_tracker_#{member.id}",
|
||
import_id: nil
|
||
)
|
||
end
|
||
|
||
puts " Created #{points_count} location points for #{member.email}"
|
||
end
|
||
|
||
family_members << member
|
||
end
|
||
|
||
family_members
|
||
end
|
||
end
|