2026-01-01 04:00:01 - --- Starting daily update run --- 2026-01-01 04:00:01 - Running single_state.py... 2026-01-01 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 517 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1107 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 569 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1328 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 359 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 49 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 289 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 662 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 342 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1248 INFO: Document for state_id 13 was found, but no changes were needed. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1002 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 448 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 561 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 382 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 494 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 299 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 59 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 217 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 548 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 795 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 170 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 394 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 409 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 21 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 247 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1122 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 188 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 270 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 122 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 789 INFO: Document for state_id 35 was found, but no changes were needed. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 628 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 654 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 251 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 163 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 714 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1854 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 499 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 461 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 348 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 318 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 284 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-01 04:01:21 - Pausing for 120 seconds... 2026-01-01 04:03:21 - Running update_users.py... 2026-01-01 04:09:19 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1487 users in API response. Starting sync with database. --- Synchronization Complete --- Total users from API: 1487 New users inserted: 0 Existing users updated: 0 Users unchanged: 1487 ----------------------------- Script finished. 2026-01-01 04:09:19 - Pausing for 120 seconds... 2026-01-01 04:11:19 - Running insert_allTrucks.py... 2026-01-01 04:11:31 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 739 trucks in MongoDB 2026-01-01 04:11:31 - Pausing for 120 seconds... 2026-01-01 04:13:31 - Running insert_companies.py... 2026-01-01 04:13:39 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 117 carriers... Successfully stored 117 carriers in MongoDB MongoDB connection closed 2026-01-01 04:13:39 - Pausing for 120 seconds... 2026-01-01 04:15:39 - Running insert_trailer.py... 2026-01-01 04:16:00 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1330 trailers... Successfully stored 1330 trailers in MongoDB MongoDB connection closed 2026-01-01 04:16:00 - --- All scripts completed successfully. --- 2026-01-02 04:00:01 - --- Starting daily update run --- 2026-01-02 04:00:01 - Running single_state.py... 2026-01-02 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 517 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1107 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 569 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1328 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 359 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 49 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 289 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 662 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 342 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1248 INFO: Document for state_id 13 was found, but no changes were needed. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1002 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 448 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 561 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 382 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 494 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 299 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 59 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 217 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 548 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 795 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 170 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 394 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 409 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 21 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 247 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1122 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 188 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 270 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 122 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 789 INFO: Document for state_id 35 was found, but no changes were needed. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 628 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 654 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 251 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 163 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 714 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1854 INFO: Document for state_id 43 was found, but no changes were needed. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 499 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 461 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 348 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 318 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 284 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-02 04:01:21 - Pausing for 120 seconds... 2026-01-02 04:03:21 - Running update_users.py... 2026-01-02 04:09:20 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1487 users in API response. Starting sync with database. --- Synchronization Complete --- Total users from API: 1487 New users inserted: 0 Existing users updated: 0 Users unchanged: 1487 ----------------------------- Script finished. 2026-01-02 04:09:20 - Pausing for 120 seconds... 2026-01-02 04:11:20 - Running insert_allTrucks.py... 2026-01-02 04:11:30 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 739 trucks in MongoDB 2026-01-02 04:11:30 - Pausing for 120 seconds... 2026-01-02 04:13:30 - Running insert_companies.py... 2026-01-02 04:13:39 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 117 carriers... Successfully stored 117 carriers in MongoDB MongoDB connection closed 2026-01-02 04:13:39 - Pausing for 120 seconds... 2026-01-02 04:15:39 - Running insert_trailer.py... 2026-01-02 04:15:59 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1330 trailers... Successfully stored 1330 trailers in MongoDB MongoDB connection closed 2026-01-02 04:15:59 - --- All scripts completed successfully. --- 2026-01-03 04:00:01 - --- Starting daily update run --- 2026-01-03 04:00:01 - Running single_state.py... 2026-01-03 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 517 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1107 INFO: Document for state_id 3 was found, but no changes were needed. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 570 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1330 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 363 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 49 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 290 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 662 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 343 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1249 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1002 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 448 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 562 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 382 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 496 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 300 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 59 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 221 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 550 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 796 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 175 SUCCESS: Document for state_id 26 was updated. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 395 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 409 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 21 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 248 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1123 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 188 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 270 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 127 SUCCESS: Document for state_id 34 was updated. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 791 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 631 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 655 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 251 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 164 SUCCESS: Document for state_id 41 was updated. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 714 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1860 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 500 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 462 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 348 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 319 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 285 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-03 04:01:20 - Pausing for 120 seconds... 2026-01-03 04:03:20 - Running update_users.py... 2026-01-03 04:09:21 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1493 users in API response. Starting sync with database. - INSERTED new user with user_id: 1691 - INSERTED new user with user_id: 1692 - INSERTED new user with user_id: 1690 - INSERTED new user with user_id: 1689 - INSERTED new user with user_id: 1688 - INSERTED new user with user_id: 1687 - UPDATED existing user with user_id: 1672 - UPDATED existing user with user_id: 1673 - UPDATED existing user with user_id: 1670 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1639 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1617 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1538 - UPDATED existing user with user_id: 1528 - UPDATED existing user with user_id: 1500 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1232 - UPDATED existing user with user_id: 1022 - UPDATED existing user with user_id: 992 - UPDATED existing user with user_id: 991 - UPDATED existing user with user_id: 860 - UPDATED existing user with user_id: 782 - UPDATED existing user with user_id: 697 - UPDATED existing user with user_id: 680 - UPDATED existing user with user_id: 619 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 520 - UPDATED existing user with user_id: 462 - UPDATED existing user with user_id: 461 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 292 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 47 --- Synchronization Complete --- Total users from API: 1493 New users inserted: 6 Existing users updated: 36 Users unchanged: 1451 ----------------------------- Script finished. 2026-01-03 04:09:21 - Pausing for 120 seconds... 2026-01-03 04:11:21 - Running insert_allTrucks.py... 2026-01-03 04:11:32 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 750 trucks in MongoDB 2026-01-03 04:11:32 - Pausing for 120 seconds... 2026-01-03 04:13:32 - Running insert_companies.py... 2026-01-03 04:13:41 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 118 carriers... Successfully stored 118 carriers in MongoDB MongoDB connection closed 2026-01-03 04:13:41 - Pausing for 120 seconds... 2026-01-03 04:15:41 - Running insert_trailer.py... 2026-01-03 04:16:01 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1333 trailers... Successfully stored 1333 trailers in MongoDB MongoDB connection closed 2026-01-03 04:16:01 - --- All scripts completed successfully. --- 2026-01-04 04:00:02 - --- Starting daily update run --- 2026-01-04 04:00:02 - Running single_state.py... 2026-01-04 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 517 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1107 INFO: Document for state_id 3 was found, but no changes were needed. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 570 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1330 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 364 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 49 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 290 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 662 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 345 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1251 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1003 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 448 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 562 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 382 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 496 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 59 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 221 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 550 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 796 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 175 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 395 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 409 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 21 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 248 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1123 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 188 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 270 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 127 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 792 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 631 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 656 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 251 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 164 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 714 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1860 INFO: Document for state_id 43 was found, but no changes were needed. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 501 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 462 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 352 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 320 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 326 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 285 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-04 04:01:20 - Pausing for 120 seconds... 2026-01-04 04:03:20 - Running update_users.py... 2026-01-04 04:09:12 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1493 users in API response. Starting sync with database. --- Synchronization Complete --- Total users from API: 1493 New users inserted: 0 Existing users updated: 0 Users unchanged: 1493 ----------------------------- Script finished. 2026-01-04 04:09:12 - Pausing for 120 seconds... 2026-01-04 04:11:12 - Running insert_allTrucks.py... 2026-01-04 04:11:23 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 750 trucks in MongoDB 2026-01-04 04:11:23 - Pausing for 120 seconds... 2026-01-04 04:13:23 - Running insert_companies.py... 2026-01-04 04:13:31 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 118 carriers... Successfully stored 118 carriers in MongoDB MongoDB connection closed 2026-01-04 04:13:31 - Pausing for 120 seconds... 2026-01-04 04:15:31 - Running insert_trailer.py... 2026-01-04 04:15:51 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1333 trailers... Successfully stored 1333 trailers in MongoDB MongoDB connection closed 2026-01-04 04:15:51 - --- All scripts completed successfully. --- 2026-01-05 04:00:01 - --- Starting daily update run --- 2026-01-05 04:00:01 - Running single_state.py... 2026-01-05 04:01:19 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 517 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1107 INFO: Document for state_id 3 was found, but no changes were needed. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 570 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1330 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 364 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 49 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 290 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 662 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 345 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1251 INFO: Document for state_id 13 was found, but no changes were needed. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1003 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 448 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 562 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 382 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 496 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 59 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 221 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 550 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 796 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 175 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 395 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 409 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 21 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 248 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1123 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 188 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 270 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 127 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 792 INFO: Document for state_id 35 was found, but no changes were needed. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 631 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 656 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 251 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 164 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 714 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1860 INFO: Document for state_id 43 was found, but no changes were needed. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 501 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 462 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 352 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 320 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 326 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 285 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-05 04:01:19 - Pausing for 120 seconds... 2026-01-05 04:03:19 - Running update_users.py... 2026-01-05 04:09:17 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1493 users in API response. Starting sync with database. --- Synchronization Complete --- Total users from API: 1493 New users inserted: 0 Existing users updated: 0 Users unchanged: 1493 ----------------------------- Script finished. 2026-01-05 04:09:17 - Pausing for 120 seconds... 2026-01-05 04:11:17 - Running insert_allTrucks.py... 2026-01-05 04:11:28 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 750 trucks in MongoDB 2026-01-05 04:11:28 - Pausing for 120 seconds... 2026-01-05 04:13:28 - Running insert_companies.py... 2026-01-05 04:13:37 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 118 carriers... Successfully stored 118 carriers in MongoDB MongoDB connection closed 2026-01-05 04:13:37 - Pausing for 120 seconds... 2026-01-05 04:15:37 - Running insert_trailer.py... 2026-01-05 04:15:56 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1333 trailers... Successfully stored 1333 trailers in MongoDB MongoDB connection closed 2026-01-05 04:15:56 - --- All scripts completed successfully. --- 2026-01-06 04:00:01 - --- Starting daily update run --- 2026-01-06 04:00:01 - Running single_state.py... 2026-01-06 04:01:25 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 520 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1112 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 571 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1334 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 365 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 49 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 291 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 665 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 345 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1256 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1008 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 448 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 566 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 382 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 497 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 304 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 60 SUCCESS: Document for state_id 21 was updated. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 356 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 222 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 551 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 800 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 175 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 395 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 410 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 SUCCESS: Document for state_id 29 was updated. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 250 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1132 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 189 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 273 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 127 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 797 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 635 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 299 SUCCESS: Document for state_id 37 was updated. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 664 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 254 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 164 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 715 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1869 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 502 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 465 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 353 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 321 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 327 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 285 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-06 04:01:25 - Pausing for 120 seconds... 2026-01-06 04:03:25 - Running update_users.py... 2026-01-06 04:09:24 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1497 users in API response. Starting sync with database. - INSERTED new user with user_id: 1696 - INSERTED new user with user_id: 1695 - INSERTED new user with user_id: 1694 - INSERTED new user with user_id: 1693 - UPDATED existing user with user_id: 1692 - UPDATED existing user with user_id: 1682 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1636 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1617 - UPDATED existing user with user_id: 1592 - UPDATED existing user with user_id: 1591 - UPDATED existing user with user_id: 1573 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1500 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1070 - UPDATED existing user with user_id: 1010 - UPDATED existing user with user_id: 1008 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 860 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 404 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 342 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 32 - UPDATED existing user with user_id: 30 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1497 New users inserted: 4 Existing users updated: 36 Users unchanged: 1457 ----------------------------- Script finished. 2026-01-06 04:09:24 - Pausing for 120 seconds... 2026-01-06 04:11:24 - Running insert_allTrucks.py... 2026-01-06 04:11:35 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 752 trucks in MongoDB 2026-01-06 04:11:35 - Pausing for 120 seconds... 2026-01-06 04:13:35 - Running insert_companies.py... 2026-01-06 04:13:43 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 119 carriers... Successfully stored 119 carriers in MongoDB MongoDB connection closed 2026-01-06 04:13:43 - Pausing for 120 seconds... 2026-01-06 04:15:43 - Running insert_trailer.py... 2026-01-06 04:16:04 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1335 trailers... Successfully stored 1335 trailers in MongoDB MongoDB connection closed 2026-01-06 04:16:04 - --- All scripts completed successfully. --- 2026-01-07 04:00:01 - --- Starting daily update run --- 2026-01-07 04:00:01 - Running single_state.py... 2026-01-07 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 520 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1116 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 574 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1335 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 368 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 49 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 292 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 668 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 347 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1259 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1012 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 451 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 568 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 384 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 497 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 304 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 60 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 223 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 551 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 805 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 SUCCESS: Document for state_id 26 was updated. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 396 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 410 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 253 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1139 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 189 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 274 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 127 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 803 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 637 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 300 SUCCESS: Document for state_id 37 was updated. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 669 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 256 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 164 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 717 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1875 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 504 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 SUCCESS: Document for state_id 45 was updated. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 465 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 354 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 322 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 329 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 287 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-07 04:01:20 - Pausing for 120 seconds... 2026-01-07 04:03:20 - Running update_users.py... 2026-01-07 04:09:29 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1512 users in API response. Starting sync with database. - INSERTED new user with user_id: 1711 - INSERTED new user with user_id: 1710 - INSERTED new user with user_id: 1709 - INSERTED new user with user_id: 1708 - INSERTED new user with user_id: 1707 - INSERTED new user with user_id: 1706 - INSERTED new user with user_id: 1705 - INSERTED new user with user_id: 1704 - INSERTED new user with user_id: 1703 - INSERTED new user with user_id: 1702 - INSERTED new user with user_id: 1701 - INSERTED new user with user_id: 1700 - INSERTED new user with user_id: 1699 - INSERTED new user with user_id: 1698 - INSERTED new user with user_id: 1697 - UPDATED existing user with user_id: 1695 - UPDATED existing user with user_id: 1673 - UPDATED existing user with user_id: 1664 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1643 - UPDATED existing user with user_id: 1630 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1583 - UPDATED existing user with user_id: 1568 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1528 - UPDATED existing user with user_id: 1500 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1475 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1229 - UPDATED existing user with user_id: 1070 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 909 - UPDATED existing user with user_id: 782 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 619 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 466 - UPDATED existing user with user_id: 437 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 314 - UPDATED existing user with user_id: 295 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 111 - UPDATED existing user with user_id: 109 - UPDATED existing user with user_id: 77 - UPDATED existing user with user_id: 32 --- Synchronization Complete --- Total users from API: 1512 New users inserted: 15 Existing users updated: 44 Users unchanged: 1453 ----------------------------- Script finished. 2026-01-07 04:09:29 - Pausing for 120 seconds... 2026-01-07 04:11:29 - Running insert_allTrucks.py... 2026-01-07 04:11:41 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 752 trucks in MongoDB 2026-01-07 04:11:41 - Pausing for 120 seconds... 2026-01-07 04:13:41 - Running insert_companies.py... 2026-01-07 04:13:49 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 119 carriers... Successfully stored 119 carriers in MongoDB MongoDB connection closed 2026-01-07 04:13:49 - Pausing for 120 seconds... 2026-01-07 04:15:49 - Running insert_trailer.py... 2026-01-07 04:16:10 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1336 trailers... Successfully stored 1336 trailers in MongoDB MongoDB connection closed 2026-01-07 04:16:10 - --- All scripts completed successfully. --- 2026-01-08 04:00:01 - --- Starting daily update run --- 2026-01-08 04:00:01 - Running single_state.py... 2026-01-08 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 523 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1121 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 574 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1341 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 369 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 50 SUCCESS: Document for state_id 7 was updated. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 292 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 672 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 347 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1261 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1013 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 452 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 569 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 387 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 503 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 20 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 61 SUCCESS: Document for state_id 21 was updated. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 224 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 554 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 809 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 397 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 411 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 253 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1145 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 190 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 277 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 128 SUCCESS: Document for state_id 34 was updated. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 806 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 640 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 300 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 674 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 257 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 164 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 718 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1885 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 505 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 468 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 324 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 330 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 288 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-08 04:01:21 - Pausing for 120 seconds... 2026-01-08 04:03:21 - Running update_users.py... 2026-01-08 04:09:33 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1516 users in API response. Starting sync with database. - INSERTED new user with user_id: 1715 - INSERTED new user with user_id: 1714 - INSERTED new user with user_id: 1713 - INSERTED new user with user_id: 1712 - UPDATED existing user with user_id: 1700 - UPDATED existing user with user_id: 1689 - UPDATED existing user with user_id: 1679 - UPDATED existing user with user_id: 1670 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1646 - UPDATED existing user with user_id: 1639 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1617 - UPDATED existing user with user_id: 1616 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1554 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1523 - UPDATED existing user with user_id: 1517 - UPDATED existing user with user_id: 1474 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1415 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1339 - UPDATED existing user with user_id: 1141 - UPDATED existing user with user_id: 1022 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 992 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 697 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 646 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 619 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 328 - UPDATED existing user with user_id: 317 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 83 - UPDATED existing user with user_id: 30 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1516 New users inserted: 4 Existing users updated: 47 Users unchanged: 1465 ----------------------------- Script finished. 2026-01-08 04:09:33 - Pausing for 120 seconds... 2026-01-08 04:11:33 - Running insert_allTrucks.py... 2026-01-08 04:11:44 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 756 trucks in MongoDB 2026-01-08 04:11:44 - Pausing for 120 seconds... 2026-01-08 04:13:44 - Running insert_companies.py... 2026-01-08 04:13:53 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 120 carriers... Successfully stored 120 carriers in MongoDB MongoDB connection closed 2026-01-08 04:13:53 - Pausing for 120 seconds... 2026-01-08 04:15:53 - Running insert_trailer.py... 2026-01-08 04:16:13 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1342 trailers... Successfully stored 1342 trailers in MongoDB MongoDB connection closed 2026-01-08 04:16:13 - --- All scripts completed successfully. --- 2026-01-09 04:00:01 - --- Starting daily update run --- 2026-01-09 04:00:01 - Running single_state.py... 2026-01-09 04:01:22 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 525 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1123 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 574 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1345 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 370 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 51 SUCCESS: Document for state_id 7 was updated. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 293 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 673 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 349 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1264 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1017 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 455 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 572 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 388 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 504 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 SUCCESS: Document for state_id 19 was updated. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 308 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 64 SUCCESS: Document for state_id 21 was updated. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 365 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 225 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 556 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 810 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 399 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 411 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 SUCCESS: Document for state_id 29 was updated. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 256 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1147 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 193 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 278 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 129 SUCCESS: Document for state_id 34 was updated. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 811 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 642 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 SUCCESS: Document for state_id 37 was updated. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 679 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 259 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 165 SUCCESS: Document for state_id 41 was updated. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 718 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1890 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 508 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 469 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 356 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 331 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 290 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-09 04:01:22 - Pausing for 120 seconds... 2026-01-09 04:03:22 - Running update_users.py... 2026-01-09 04:09:31 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1524 users in API response. Starting sync with database. - INSERTED new user with user_id: 1721 - INSERTED new user with user_id: 1723 - INSERTED new user with user_id: 1722 - INSERTED new user with user_id: 1720 - INSERTED new user with user_id: 1719 - INSERTED new user with user_id: 1718 - INSERTED new user with user_id: 1717 - INSERTED new user with user_id: 1716 - UPDATED existing user with user_id: 1677 - UPDATED existing user with user_id: 1664 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1617 - UPDATED existing user with user_id: 1592 - UPDATED existing user with user_id: 1583 - UPDATED existing user with user_id: 1573 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1474 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1426 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1010 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 906 - UPDATED existing user with user_id: 790 - UPDATED existing user with user_id: 773 - UPDATED existing user with user_id: 713 - UPDATED existing user with user_id: 711 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 619 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 301 - UPDATED existing user with user_id: 295 - UPDATED existing user with user_id: 204 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 96 - UPDATED existing user with user_id: 69 - UPDATED existing user with user_id: 47 - UPDATED existing user with user_id: 32 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1524 New users inserted: 8 Existing users updated: 44 Users unchanged: 1472 ----------------------------- Script finished. 2026-01-09 04:09:31 - Pausing for 120 seconds... 2026-01-09 04:11:31 - Running insert_allTrucks.py... 2026-01-09 04:11:42 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 761 trucks in MongoDB 2026-01-09 04:11:42 - Pausing for 120 seconds... 2026-01-09 04:13:42 - Running insert_companies.py... 2026-01-09 04:13:51 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 120 carriers... Successfully stored 120 carriers in MongoDB MongoDB connection closed 2026-01-09 04:13:51 - Pausing for 120 seconds... 2026-01-09 04:15:51 - Running insert_trailer.py... 2026-01-09 04:16:11 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1348 trailers... Successfully stored 1348 trailers in MongoDB MongoDB connection closed 2026-01-09 04:16:11 - --- All scripts completed successfully. --- 2026-01-10 04:00:01 - --- Starting daily update run --- 2026-01-10 04:00:01 - Running single_state.py... 2026-01-10 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 529 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1131 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 578 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1352 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 370 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 51 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 294 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 678 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1272 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1026 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 459 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 577 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 391 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 508 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 310 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 64 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 374 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 225 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 560 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 822 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 400 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 411 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 263 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1159 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 193 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 278 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 129 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 819 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 650 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 689 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 259 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 165 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 722 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1906 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 510 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 470 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 356 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 327 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 334 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 291 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-10 04:01:21 - Pausing for 120 seconds... 2026-01-10 04:03:21 - Running update_users.py... 2026-01-10 04:09:34 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1530 users in API response. Starting sync with database. - INSERTED new user with user_id: 1732 - INSERTED new user with user_id: 1728 - INSERTED new user with user_id: 1733 - INSERTED new user with user_id: 1731 - INSERTED new user with user_id: 1730 - INSERTED new user with user_id: 1729 - UPDATED existing user with user_id: 1713 - UPDATED existing user with user_id: 1695 - UPDATED existing user with user_id: 1655 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1643 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1603 - UPDATED existing user with user_id: 1591 - UPDATED existing user with user_id: 1571 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1554 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1545 - UPDATED existing user with user_id: 1538 - UPDATED existing user with user_id: 1517 - UPDATED existing user with user_id: 1505 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1482 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1372 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1304 - UPDATED existing user with user_id: 1092 - UPDATED existing user with user_id: 1087 - UPDATED existing user with user_id: 1066 - UPDATED existing user with user_id: 1052 - UPDATED existing user with user_id: 1046 - UPDATED existing user with user_id: 1008 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 991 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 901 - UPDATED existing user with user_id: 896 - UPDATED existing user with user_id: 877 - UPDATED existing user with user_id: 782 - UPDATED existing user with user_id: 713 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 646 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 619 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 462 - UPDATED existing user with user_id: 406 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 328 - UPDATED existing user with user_id: 325 - UPDATED existing user with user_id: 295 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 95 - UPDATED existing user with user_id: 93 - UPDATED existing user with user_id: 69 - UPDATED existing user with user_id: 32 --- Synchronization Complete --- Total users from API: 1530 New users inserted: 6 Existing users updated: 60 Users unchanged: 1464 ----------------------------- Script finished. 2026-01-10 04:09:34 - Pausing for 120 seconds... 2026-01-10 04:11:34 - Running insert_allTrucks.py... 2026-01-10 04:11:45 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 766 trucks in MongoDB 2026-01-10 04:11:45 - Pausing for 120 seconds... 2026-01-10 04:13:45 - Running insert_companies.py... 2026-01-10 04:13:54 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-10 04:13:54 - Pausing for 120 seconds... 2026-01-10 04:15:54 - Running insert_trailer.py... 2026-01-10 04:16:15 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1362 trailers... Successfully stored 1362 trailers in MongoDB MongoDB connection closed 2026-01-10 04:16:15 - --- All scripts completed successfully. --- 2026-01-11 04:00:01 - --- Starting daily update run --- 2026-01-11 04:00:01 - Running single_state.py... 2026-01-11 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 529 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1132 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 579 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1355 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 371 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 51 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 294 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 678 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1274 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1027 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 459 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 578 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 392 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 509 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 310 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 64 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 374 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 225 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 560 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 823 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 400 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 412 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 263 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1160 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 193 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 278 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 129 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 820 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 653 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 689 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 259 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 165 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 723 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1913 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 512 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 470 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 356 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 327 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 334 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 291 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-11 04:01:21 - Pausing for 120 seconds... 2026-01-11 04:03:21 - Running update_users.py... 2026-01-11 04:09:29 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1530 users in API response. Starting sync with database. - UPDATED existing user with user_id: 646 - UPDATED existing user with user_id: 546 --- Synchronization Complete --- Total users from API: 1530 New users inserted: 0 Existing users updated: 2 Users unchanged: 1528 ----------------------------- Script finished. 2026-01-11 04:09:29 - Pausing for 120 seconds... 2026-01-11 04:11:29 - Running insert_allTrucks.py... 2026-01-11 04:11:40 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 766 trucks in MongoDB 2026-01-11 04:11:40 - Pausing for 120 seconds... 2026-01-11 04:13:40 - Running insert_companies.py... 2026-01-11 04:13:49 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-11 04:13:49 - Pausing for 120 seconds... 2026-01-11 04:15:49 - Running insert_trailer.py... 2026-01-11 04:16:11 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1362 trailers... Successfully stored 1362 trailers in MongoDB MongoDB connection closed 2026-01-11 04:16:11 - --- All scripts completed successfully. --- 2026-01-12 04:00:01 - --- Starting daily update run --- 2026-01-12 04:00:01 - Running single_state.py... 2026-01-12 04:01:22 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 529 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1132 INFO: Document for state_id 3 was found, but no changes were needed. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 580 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1355 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 371 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 51 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 294 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 678 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1274 INFO: Document for state_id 13 was found, but no changes were needed. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1027 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 459 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 578 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 392 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 509 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 310 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 64 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 374 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 225 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 560 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 823 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 400 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 412 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 263 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1161 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 193 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 278 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 130 SUCCESS: Document for state_id 34 was updated. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 821 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 653 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 689 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 259 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 166 SUCCESS: Document for state_id 41 was updated. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 723 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1913 INFO: Document for state_id 43 was found, but no changes were needed. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 512 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 470 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 357 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 327 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 334 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 291 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-12 04:01:22 - Pausing for 120 seconds... 2026-01-12 04:03:22 - Running update_users.py... 2026-01-12 04:09:29 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1530 users in API response. Starting sync with database. - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 --- Synchronization Complete --- Total users from API: 1530 New users inserted: 0 Existing users updated: 2 Users unchanged: 1528 ----------------------------- Script finished. 2026-01-12 04:09:29 - Pausing for 120 seconds... 2026-01-12 04:11:29 - Running insert_allTrucks.py... 2026-01-12 04:11:41 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 766 trucks in MongoDB 2026-01-12 04:11:41 - Pausing for 120 seconds... 2026-01-12 04:13:41 - Running insert_companies.py... 2026-01-12 04:13:49 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-12 04:13:49 - Pausing for 120 seconds... 2026-01-12 04:15:49 - Running insert_trailer.py... 2026-01-12 04:16:09 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1362 trailers... Successfully stored 1362 trailers in MongoDB MongoDB connection closed 2026-01-12 04:16:09 - --- All scripts completed successfully. --- 2026-01-13 04:00:01 - --- Starting daily update run --- 2026-01-13 04:00:01 - Running single_state.py... 2026-01-13 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 531 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1134 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 585 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1357 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 371 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 51 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 43 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 294 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 680 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 350 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1282 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1035 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 462 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 579 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 393 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 510 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 22 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 311 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 64 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 375 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 227 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 561 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 825 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 400 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 412 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 265 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1162 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 194 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 278 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 132 SUCCESS: Document for state_id 34 was updated. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 825 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 655 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 691 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 6 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 261 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 166 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 725 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1918 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 512 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 471 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 358 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 327 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 337 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 291 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-13 04:01:21 - Pausing for 120 seconds... 2026-01-13 04:03:21 - Running update_users.py... 2026-01-13 04:09:33 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1534 users in API response. Starting sync with database. - INSERTED new user with user_id: 1736 - INSERTED new user with user_id: 1735 - INSERTED new user with user_id: 1734 - INSERTED new user with user_id: 1737 - UPDATED existing user with user_id: 1729 - UPDATED existing user with user_id: 1716 - UPDATED existing user with user_id: 1664 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1641 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1617 - UPDATED existing user with user_id: 1592 - UPDATED existing user with user_id: 1591 - UPDATED existing user with user_id: 1575 - UPDATED existing user with user_id: 1573 - UPDATED existing user with user_id: 1571 - UPDATED existing user with user_id: 1570 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1545 - UPDATED existing user with user_id: 1528 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1474 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1435 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1332 - UPDATED existing user with user_id: 1245 - UPDATED existing user with user_id: 1220 - UPDATED existing user with user_id: 1168 - UPDATED existing user with user_id: 1105 - UPDATED existing user with user_id: 952 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 931 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 906 - UPDATED existing user with user_id: 879 - UPDATED existing user with user_id: 805 - UPDATED existing user with user_id: 682 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 652 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 310 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 32 - UPDATED existing user with user_id: 4 --- Synchronization Complete --- Total users from API: 1534 New users inserted: 4 Existing users updated: 52 Users unchanged: 1478 ----------------------------- Script finished. 2026-01-13 04:09:33 - Pausing for 120 seconds... 2026-01-13 04:11:33 - Running insert_allTrucks.py... 2026-01-13 04:11:44 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 770 trucks in MongoDB 2026-01-13 04:11:44 - Pausing for 120 seconds... 2026-01-13 04:13:44 - Running insert_companies.py... 2026-01-13 04:13:53 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-13 04:13:53 - Pausing for 120 seconds... 2026-01-13 04:15:53 - Running insert_trailer.py... 2026-01-13 04:16:13 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1367 trailers... Successfully stored 1367 trailers in MongoDB MongoDB connection closed 2026-01-13 04:16:13 - --- All scripts completed successfully. --- 2026-01-14 04:00:01 - --- Starting daily update run --- 2026-01-14 04:00:01 - Running single_state.py... 2026-01-14 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 531 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1135 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 585 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1360 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 371 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 SUCCESS: Document for state_id 7 was updated. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 SUCCESS: Document for state_id 8 was updated. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 297 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 684 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 352 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1288 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1040 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 462 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 580 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 396 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 511 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 SUCCESS: Document for state_id 19 was updated. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 315 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 SUCCESS: Document for state_id 21 was updated. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 381 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 229 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 561 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 826 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 176 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 402 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 415 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1162 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 195 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 282 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 SUCCESS: Document for state_id 34 was updated. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 834 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 658 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 303 SUCCESS: Document for state_id 37 was updated. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 696 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 SUCCESS: Document for state_id 39 was updated. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 265 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 167 SUCCESS: Document for state_id 41 was updated. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 728 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1921 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 514 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 475 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 359 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 330 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 339 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 292 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-14 04:01:21 - Pausing for 120 seconds... 2026-01-14 04:03:21 - Running update_users.py... 2026-01-14 04:09:27 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1535 users in API response. Starting sync with database. - INSERTED new user with user_id: 1738 - UPDATED existing user with user_id: 1718 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1617 - UPDATED existing user with user_id: 1611 - UPDATED existing user with user_id: 1591 - UPDATED existing user with user_id: 1583 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1538 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1483 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1426 - UPDATED existing user with user_id: 1372 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1202 - UPDATED existing user with user_id: 1105 - UPDATED existing user with user_id: 1022 - UPDATED existing user with user_id: 1010 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 790 - UPDATED existing user with user_id: 775 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 652 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 462 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 370 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 325 - UPDATED existing user with user_id: 204 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 95 - UPDATED existing user with user_id: 32 --- Synchronization Complete --- Total users from API: 1535 New users inserted: 1 Existing users updated: 44 Users unchanged: 1490 ----------------------------- Script finished. 2026-01-14 04:09:27 - Pausing for 120 seconds... 2026-01-14 04:11:27 - Running insert_allTrucks.py... 2026-01-14 04:11:38 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 771 trucks in MongoDB 2026-01-14 04:11:38 - Pausing for 120 seconds... 2026-01-14 04:13:38 - Running insert_companies.py... 2026-01-14 04:13:46 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-14 04:13:46 - Pausing for 120 seconds... 2026-01-14 04:15:46 - Running insert_trailer.py... 2026-01-14 04:16:08 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1370 trailers... Successfully stored 1370 trailers in MongoDB MongoDB connection closed 2026-01-14 04:16:08 - --- All scripts completed successfully. --- 2026-01-15 04:00:01 - --- Starting daily update run --- 2026-01-15 04:00:01 - Running single_state.py... 2026-01-15 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 534 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1139 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 587 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1362 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 373 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 299 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 687 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 354 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1299 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1049 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 463 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 584 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 401 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 516 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 317 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 383 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 231 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 564 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 832 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 177 SUCCESS: Document for state_id 26 was updated. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 404 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 416 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 273 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1165 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 195 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 284 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 845 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 659 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 SUCCESS: Document for state_id 37 was updated. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 704 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 267 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 SUCCESS: Document for state_id 41 was updated. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 733 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1925 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 519 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 477 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 361 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 333 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 341 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 294 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-15 04:01:20 - Pausing for 120 seconds... 2026-01-15 04:03:20 - Running update_users.py... 2026-01-15 04:09:33 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1539 users in API response. Starting sync with database. - INSERTED new user with user_id: 1742 - INSERTED new user with user_id: 1741 - INSERTED new user with user_id: 1740 - INSERTED new user with user_id: 1739 - UPDATED existing user with user_id: 1715 - UPDATED existing user with user_id: 1714 - UPDATED existing user with user_id: 1713 - UPDATED existing user with user_id: 1664 - UPDATED existing user with user_id: 1655 - UPDATED existing user with user_id: 1652 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1649 - UPDATED existing user with user_id: 1636 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1617 - UPDATED existing user with user_id: 1592 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1475 - UPDATED existing user with user_id: 1474 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1415 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1229 - UPDATED existing user with user_id: 1205 - UPDATED existing user with user_id: 1192 - UPDATED existing user with user_id: 1070 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 992 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 906 - UPDATED existing user with user_id: 905 - UPDATED existing user with user_id: 719 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 399 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 360 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 331 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 96 - UPDATED existing user with user_id: 95 - UPDATED existing user with user_id: 32 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1539 New users inserted: 4 Existing users updated: 47 Users unchanged: 1488 ----------------------------- Script finished. 2026-01-15 04:09:33 - Pausing for 120 seconds... 2026-01-15 04:11:33 - Running insert_allTrucks.py... 2026-01-15 04:11:44 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 776 trucks in MongoDB 2026-01-15 04:11:44 - Pausing for 120 seconds... 2026-01-15 04:13:44 - Running insert_companies.py... 2026-01-15 04:13:52 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-15 04:13:52 - Pausing for 120 seconds... 2026-01-15 04:15:52 - Running insert_trailer.py... 2026-01-15 04:16:13 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1375 trailers... Successfully stored 1375 trailers in MongoDB MongoDB connection closed 2026-01-15 04:16:13 - --- All scripts completed successfully. --- 2026-01-16 04:00:01 - --- Starting daily update run --- 2026-01-16 04:00:01 - Running single_state.py... 2026-01-16 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 537 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1143 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 589 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1362 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 375 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 301 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 690 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1301 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1053 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 464 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 587 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 403 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 521 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 319 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 385 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 232 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 571 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 835 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 177 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 404 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 417 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 275 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1167 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 196 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 288 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 850 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 664 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 709 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 737 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1936 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 522 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 482 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 361 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 337 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 342 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 294 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-16 04:01:20 - Pausing for 120 seconds... 2026-01-16 04:03:20 - Running update_users.py... 2026-01-16 04:09:43 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1545 users in API response. Starting sync with database. - INSERTED new user with user_id: 1748 - INSERTED new user with user_id: 1747 - INSERTED new user with user_id: 1746 - INSERTED new user with user_id: 1745 - INSERTED new user with user_id: 1744 - INSERTED new user with user_id: 1743 - UPDATED existing user with user_id: 1741 - UPDATED existing user with user_id: 1739 - UPDATED existing user with user_id: 1688 - UPDATED existing user with user_id: 1679 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1646 - UPDATED existing user with user_id: 1639 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1570 - UPDATED existing user with user_id: 1568 - UPDATED existing user with user_id: 1563 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1545 - UPDATED existing user with user_id: 1534 - UPDATED existing user with user_id: 1517 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1474 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1199 - UPDATED existing user with user_id: 1104 - UPDATED existing user with user_id: 1100 - UPDATED existing user with user_id: 1092 - UPDATED existing user with user_id: 1091 - UPDATED existing user with user_id: 1070 - UPDATED existing user with user_id: 1008 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 936 - UPDATED existing user with user_id: 931 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 870 - UPDATED existing user with user_id: 719 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 466 - UPDATED existing user with user_id: 404 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 342 - UPDATED existing user with user_id: 325 - UPDATED existing user with user_id: 295 - UPDATED existing user with user_id: 273 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 113 - UPDATED existing user with user_id: 95 - UPDATED existing user with user_id: 94 - UPDATED existing user with user_id: 83 - UPDATED existing user with user_id: 4 --- Synchronization Complete --- Total users from API: 1545 New users inserted: 6 Existing users updated: 55 Users unchanged: 1484 ----------------------------- Script finished. 2026-01-16 04:09:43 - Pausing for 120 seconds... 2026-01-16 04:11:43 - Running insert_allTrucks.py... 2026-01-16 04:11:54 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 780 trucks in MongoDB 2026-01-16 04:11:54 - Pausing for 120 seconds... 2026-01-16 04:13:54 - Running insert_companies.py... 2026-01-16 04:14:03 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-16 04:14:03 - Pausing for 120 seconds... 2026-01-16 04:16:03 - Running insert_trailer.py... 2026-01-16 04:16:24 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1383 trailers... Successfully stored 1383 trailers in MongoDB MongoDB connection closed 2026-01-16 04:16:24 - --- All scripts completed successfully. --- 2026-01-17 04:00:01 - --- Starting daily update run --- 2026-01-17 04:00:01 - Running single_state.py... 2026-01-17 04:01:22 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 542 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1150 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 591 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1365 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 376 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 305 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 693 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1310 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1061 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 466 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 591 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 524 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 319 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 387 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 SUCCESS: Document for state_id 23 was updated. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 574 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 842 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 177 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 404 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 424 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 279 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1176 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 197 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 289 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 854 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 667 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 711 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 743 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1948 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 525 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 483 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 SUCCESS: Document for state_id 47 was updated. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 337 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 343 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 295 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-17 04:01:22 - Pausing for 120 seconds... 2026-01-17 04:03:22 - Running update_users.py... 2026-01-17 04:09:31 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1547 users in API response. Starting sync with database. - INSERTED new user with user_id: 1750 - INSERTED new user with user_id: 1749 - UPDATED existing user with user_id: 1745 - UPDATED existing user with user_id: 1716 - UPDATED existing user with user_id: 1690 - UPDATED existing user with user_id: 1670 - UPDATED existing user with user_id: 1655 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1615 - UPDATED existing user with user_id: 1599 - UPDATED existing user with user_id: 1591 - UPDATED existing user with user_id: 1583 - UPDATED existing user with user_id: 1580 - UPDATED existing user with user_id: 1573 - UPDATED existing user with user_id: 1570 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1545 - UPDATED existing user with user_id: 1528 - UPDATED existing user with user_id: 1517 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1462 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1435 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1312 - UPDATED existing user with user_id: 1229 - UPDATED existing user with user_id: 1039 - UPDATED existing user with user_id: 1011 - UPDATED existing user with user_id: 1010 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 952 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 931 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 915 - UPDATED existing user with user_id: 906 - UPDATED existing user with user_id: 870 - UPDATED existing user with user_id: 812 - UPDATED existing user with user_id: 805 - UPDATED existing user with user_id: 697 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 406 - UPDATED existing user with user_id: 404 - UPDATED existing user with user_id: 399 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 204 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 122 - UPDATED existing user with user_id: 102 - UPDATED existing user with user_id: 101 - UPDATED existing user with user_id: 96 - UPDATED existing user with user_id: 32 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1547 New users inserted: 2 Existing users updated: 57 Users unchanged: 1488 ----------------------------- Script finished. 2026-01-17 04:09:31 - Pausing for 120 seconds... 2026-01-17 04:11:31 - Running insert_allTrucks.py... 2026-01-17 04:11:41 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 781 trucks in MongoDB 2026-01-17 04:11:41 - Pausing for 120 seconds... 2026-01-17 04:13:41 - Running insert_companies.py... 2026-01-17 04:13:50 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-17 04:13:50 - Pausing for 120 seconds... 2026-01-17 04:15:50 - Running insert_trailer.py... 2026-01-17 04:16:11 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1389 trailers... Successfully stored 1389 trailers in MongoDB MongoDB connection closed 2026-01-17 04:16:11 - --- All scripts completed successfully. --- 2026-01-18 04:00:01 - --- Starting daily update run --- 2026-01-18 04:00:01 - Running single_state.py... 2026-01-18 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 542 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1150 INFO: Document for state_id 3 was found, but no changes were needed. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 591 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1367 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 376 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 305 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 693 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1311 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1062 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 466 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 591 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 524 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 321 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 387 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 574 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 843 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 177 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 SUCCESS: Document for state_id 27 was updated. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 424 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 279 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1176 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 197 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 289 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 854 INFO: Document for state_id 35 was found, but no changes were needed. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 667 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 711 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 744 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1948 INFO: Document for state_id 43 was found, but no changes were needed. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 526 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 483 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 338 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 343 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 296 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-18 04:01:21 - Pausing for 120 seconds... 2026-01-18 04:03:21 - Running update_users.py... 2026-01-18 04:09:38 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1547 users in API response. Starting sync with database. - UPDATED existing user with user_id: 1750 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 812 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 314 - UPDATED existing user with user_id: 295 - UPDATED existing user with user_id: 111 - UPDATED existing user with user_id: 83 --- Synchronization Complete --- Total users from API: 1547 New users inserted: 0 Existing users updated: 9 Users unchanged: 1538 ----------------------------- Script finished. 2026-01-18 04:09:38 - Pausing for 120 seconds... 2026-01-18 04:11:38 - Running insert_allTrucks.py... 2026-01-18 04:11:48 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 781 trucks in MongoDB 2026-01-18 04:11:48 - Pausing for 120 seconds... 2026-01-18 04:13:48 - Running insert_companies.py... 2026-01-18 04:13:57 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-18 04:13:57 - Pausing for 120 seconds... 2026-01-18 04:15:57 - Running insert_trailer.py... 2026-01-18 04:16:18 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1389 trailers... Successfully stored 1389 trailers in MongoDB MongoDB connection closed 2026-01-18 04:16:18 - --- All scripts completed successfully. --- 2026-01-19 04:00:01 - --- Starting daily update run --- 2026-01-19 04:00:01 - Running single_state.py... 2026-01-19 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 542 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1152 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 591 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1367 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 376 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 305 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 693 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1311 INFO: Document for state_id 13 was found, but no changes were needed. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1062 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 466 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 592 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 524 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 321 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 387 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 574 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 843 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 177 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 424 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 279 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1176 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 197 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 289 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 854 INFO: Document for state_id 35 was found, but no changes were needed. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 667 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 711 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 744 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1948 INFO: Document for state_id 43 was found, but no changes were needed. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 526 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 483 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 338 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 343 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 296 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-19 04:01:20 - Pausing for 120 seconds... 2026-01-19 04:03:20 - Running update_users.py... 2026-01-19 04:09:40 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1548 users in API response. Starting sync with database. - INSERTED new user with user_id: 1751 --- Synchronization Complete --- Total users from API: 1548 New users inserted: 1 Existing users updated: 0 Users unchanged: 1547 ----------------------------- Script finished. 2026-01-19 04:09:40 - Pausing for 120 seconds... 2026-01-19 04:11:40 - Running insert_allTrucks.py... 2026-01-19 04:11:51 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 781 trucks in MongoDB 2026-01-19 04:11:51 - Pausing for 120 seconds... 2026-01-19 04:13:51 - Running insert_companies.py... 2026-01-19 04:13:59 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-19 04:13:59 - Pausing for 120 seconds... 2026-01-19 04:15:59 - Running insert_trailer.py... 2026-01-19 04:16:20 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1389 trailers... Successfully stored 1389 trailers in MongoDB MongoDB connection closed 2026-01-19 04:16:20 - --- All scripts completed successfully. --- 2026-01-20 04:00:01 - --- Starting daily update run --- 2026-01-20 04:00:01 - Running single_state.py... 2026-01-20 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 542 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1153 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 591 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1367 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 377 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 305 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 693 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1312 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1065 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 466 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 594 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 406 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 525 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 322 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 387 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 577 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 844 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 178 SUCCESS: Document for state_id 26 was updated. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 424 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 280 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1176 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 197 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 290 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 857 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 669 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 711 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 745 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1950 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 527 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 485 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 339 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 343 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 296 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-20 04:01:20 - Pausing for 120 seconds... 2026-01-20 04:03:20 - Running update_users.py... 2026-01-20 04:09:21 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1549 users in API response. Starting sync with database. - INSERTED new user with user_id: 1752 - UPDATED existing user with user_id: 1730 - UPDATED existing user with user_id: 1729 - UPDATED existing user with user_id: 1670 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1648 - UPDATED existing user with user_id: 1647 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1555 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1475 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1315 - UPDATED existing user with user_id: 1166 - UPDATED existing user with user_id: 1008 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 906 - UPDATED existing user with user_id: 646 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 462 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 328 - UPDATED existing user with user_id: 310 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 83 - UPDATED existing user with user_id: 4 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1549 New users inserted: 1 Existing users updated: 35 Users unchanged: 1513 ----------------------------- Script finished. 2026-01-20 04:09:21 - Pausing for 120 seconds... 2026-01-20 04:11:21 - Running insert_allTrucks.py... 2026-01-20 04:11:33 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 781 trucks in MongoDB 2026-01-20 04:11:33 - Pausing for 120 seconds... 2026-01-20 04:13:33 - Running insert_companies.py... 2026-01-20 04:13:42 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-20 04:13:42 - Pausing for 120 seconds... 2026-01-20 04:15:42 - Running insert_trailer.py... 2026-01-20 04:16:02 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1389 trailers... Successfully stored 1389 trailers in MongoDB MongoDB connection closed 2026-01-20 04:16:02 - --- All scripts completed successfully. --- 2026-01-21 04:00:01 - --- Starting daily update run --- 2026-01-21 04:00:01 - Running single_state.py... 2026-01-21 04:01:19 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 546 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1156 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 591 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1371 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 378 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 44 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 308 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 695 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1316 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1069 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 466 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 595 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 407 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 526 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 323 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 388 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 579 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 845 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 178 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 431 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 283 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1179 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 197 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 290 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 860 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 671 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 718 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 745 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1952 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 532 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 487 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 340 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 SUCCESS: Document for state_id 49 was updated. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 297 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-21 04:01:19 - Pausing for 120 seconds... 2026-01-21 04:03:19 - Running update_users.py... 2026-01-21 04:11:02 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1552 users in API response. Starting sync with database. - INSERTED new user with user_id: 1755 - INSERTED new user with user_id: 1754 - INSERTED new user with user_id: 1753 - UPDATED existing user with user_id: 1752 - UPDATED existing user with user_id: 1662 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1633 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1614 - UPDATED existing user with user_id: 1586 - UPDATED existing user with user_id: 1573 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1419 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1166 - UPDATED existing user with user_id: 1141 - UPDATED existing user with user_id: 1114 - UPDATED existing user with user_id: 1070 - UPDATED existing user with user_id: 1065 - UPDATED existing user with user_id: 1022 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 992 - UPDATED existing user with user_id: 991 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 931 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 906 - UPDATED existing user with user_id: 870 - UPDATED existing user with user_id: 697 - UPDATED existing user with user_id: 682 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 470 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 331 - UPDATED existing user with user_id: 295 - UPDATED existing user with user_id: 134 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 122 - UPDATED existing user with user_id: 96 - UPDATED existing user with user_id: 32 - UPDATED existing user with user_id: 30 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1552 New users inserted: 3 Existing users updated: 47 Users unchanged: 1502 ----------------------------- Script finished. 2026-01-21 04:11:02 - Pausing for 120 seconds... 2026-01-21 04:13:02 - Running insert_allTrucks.py... 2026-01-21 04:13:12 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 785 trucks in MongoDB 2026-01-21 04:13:12 - Pausing for 120 seconds... 2026-01-21 04:15:12 - Running insert_companies.py... 2026-01-21 04:15:20 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-21 04:15:20 - Pausing for 120 seconds... 2026-01-21 04:17:20 - Running insert_trailer.py... 2026-01-21 04:17:41 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1392 trailers... Successfully stored 1392 trailers in MongoDB MongoDB connection closed 2026-01-21 04:17:41 - --- All scripts completed successfully. --- 2026-01-22 04:00:02 - --- Starting daily update run --- 2026-01-22 04:00:02 - Running single_state.py... 2026-01-22 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 548 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1159 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 592 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1376 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 379 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 45 SUCCESS: Document for state_id 8 was updated. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 308 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 697 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1319 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1071 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 467 SUCCESS: Document for state_id 15 was updated. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 596 SUCCESS: Document for state_id 16 was updated. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 408 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 530 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 324 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 388 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 581 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 846 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 178 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 432 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 285 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1181 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 198 SUCCESS: Document for state_id 32 was updated. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 293 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 865 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 672 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 722 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 748 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1955 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 533 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 489 SUCCESS: Document for state_id 46 was updated. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 342 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 296 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-22 04:01:21 - Pausing for 120 seconds... 2026-01-22 04:03:21 - Running update_users.py... 2026-01-22 04:09:33 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1553 users in API response. Starting sync with database. - INSERTED new user with user_id: 1756 - UPDATED existing user with user_id: 1730 - UPDATED existing user with user_id: 1729 - UPDATED existing user with user_id: 1664 - UPDATED existing user with user_id: 1655 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1605 - UPDATED existing user with user_id: 1591 - UPDATED existing user with user_id: 1581 - UPDATED existing user with user_id: 1580 - UPDATED existing user with user_id: 1568 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1545 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1475 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1229 - UPDATED existing user with user_id: 1226 - UPDATED existing user with user_id: 1104 - UPDATED existing user with user_id: 1070 - UPDATED existing user with user_id: 1052 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 952 - UPDATED existing user with user_id: 906 - UPDATED existing user with user_id: 896 - UPDATED existing user with user_id: 805 - UPDATED existing user with user_id: 697 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 650 - UPDATED existing user with user_id: 646 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 328 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 95 - UPDATED existing user with user_id: 2 --- Synchronization Complete --- Total users from API: 1553 New users inserted: 1 Existing users updated: 43 Users unchanged: 1509 ----------------------------- Script finished. 2026-01-22 04:09:33 - Pausing for 120 seconds... 2026-01-22 04:11:33 - Running insert_allTrucks.py... 2026-01-22 04:11:44 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 786 trucks in MongoDB 2026-01-22 04:11:44 - Pausing for 120 seconds... 2026-01-22 04:13:44 - Running insert_companies.py... 2026-01-22 04:13:53 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-22 04:13:53 - Pausing for 120 seconds... 2026-01-22 04:15:53 - Running insert_trailer.py... 2026-01-22 04:16:14 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1393 trailers... Successfully stored 1393 trailers in MongoDB MongoDB connection closed 2026-01-22 04:16:14 - --- All scripts completed successfully. --- 2026-01-23 04:00:01 - --- Starting daily update run --- 2026-01-23 04:00:01 - Running single_state.py... 2026-01-23 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 549 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1164 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 593 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1380 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 380 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 46 SUCCESS: Document for state_id 8 was updated. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 309 SUCCESS: Document for state_id 9 was updated. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 700 SUCCESS: Document for state_id 10 was updated. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 355 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1323 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1075 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 467 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 596 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 412 SUCCESS: Document for state_id 17 was updated. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 531 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 SUCCESS: Document for state_id 20 was updated. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 389 SUCCESS: Document for state_id 22 was updated. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 582 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 847 SUCCESS: Document for state_id 25 was updated. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 178 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 433 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 290 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1185 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 198 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 294 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 872 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 673 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 731 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 269 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 751 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1961 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 535 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 489 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 SUCCESS: Document for state_id 48 was updated. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 296 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-23 04:01:21 - Pausing for 120 seconds... 2026-01-23 04:03:21 - Running update_users.py... 2026-01-23 04:09:34 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1556 users in API response. Starting sync with database. - INSERTED new user with user_id: 1759 - INSERTED new user with user_id: 1758 - INSERTED new user with user_id: 1757 - UPDATED existing user with user_id: 1741 - UPDATED existing user with user_id: 1730 - UPDATED existing user with user_id: 1729 - UPDATED existing user with user_id: 1716 - UPDATED existing user with user_id: 1689 - UPDATED existing user with user_id: 1670 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1645 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1599 - UPDATED existing user with user_id: 1593 - UPDATED existing user with user_id: 1562 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1538 - UPDATED existing user with user_id: 1536 - UPDATED existing user with user_id: 1534 - UPDATED existing user with user_id: 1502 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1415 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1336 - UPDATED existing user with user_id: 1328 - UPDATED existing user with user_id: 1316 - UPDATED existing user with user_id: 1315 - UPDATED existing user with user_id: 1308 - UPDATED existing user with user_id: 1305 - UPDATED existing user with user_id: 1303 - UPDATED existing user with user_id: 1297 - UPDATED existing user with user_id: 1295 - UPDATED existing user with user_id: 1292 - UPDATED existing user with user_id: 1285 - UPDATED existing user with user_id: 1284 - UPDATED existing user with user_id: 1272 - UPDATED existing user with user_id: 1255 - UPDATED existing user with user_id: 1247 - UPDATED existing user with user_id: 1236 - UPDATED existing user with user_id: 1234 - UPDATED existing user with user_id: 1233 - UPDATED existing user with user_id: 1232 - UPDATED existing user with user_id: 1231 - UPDATED existing user with user_id: 1228 - UPDATED existing user with user_id: 1226 - UPDATED existing user with user_id: 1141 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 870 - UPDATED existing user with user_id: 844 - UPDATED existing user with user_id: 840 - UPDATED existing user with user_id: 791 - UPDATED existing user with user_id: 755 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 648 - UPDATED existing user with user_id: 619 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 545 - UPDATED existing user with user_id: 462 - UPDATED existing user with user_id: 404 - UPDATED existing user with user_id: 399 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 325 - UPDATED existing user with user_id: 310 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 124 - UPDATED existing user with user_id: 95 - UPDATED existing user with user_id: 32 --- Synchronization Complete --- Total users from API: 1556 New users inserted: 3 Existing users updated: 70 Users unchanged: 1483 ----------------------------- Script finished. 2026-01-23 04:09:34 - Pausing for 120 seconds... 2026-01-23 04:11:34 - Running insert_allTrucks.py... 2026-01-23 04:11:44 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 789 trucks in MongoDB 2026-01-23 04:11:44 - Pausing for 120 seconds... 2026-01-23 04:13:44 - Running insert_companies.py... 2026-01-23 04:13:53 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-23 04:13:53 - Pausing for 120 seconds... 2026-01-23 04:15:53 - Running insert_trailer.py... 2026-01-23 04:16:14 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1399 trailers... Successfully stored 1399 trailers in MongoDB MongoDB connection closed 2026-01-23 04:16:14 - --- All scripts completed successfully. --- 2026-01-24 04:00:02 - --- Starting daily update run --- 2026-01-24 04:00:02 - Running single_state.py... 2026-01-24 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 551 SUCCESS: Document for state_id 1 was updated. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1171 SUCCESS: Document for state_id 3 was updated. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 595 SUCCESS: Document for state_id 4 was updated. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1381 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 383 SUCCESS: Document for state_id 6 was updated. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 46 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 309 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 700 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 356 SUCCESS: Document for state_id 12 was updated. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1337 SUCCESS: Document for state_id 13 was updated. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1083 SUCCESS: Document for state_id 14 was updated. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 467 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 596 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 412 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 531 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 389 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 582 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 847 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 180 SUCCESS: Document for state_id 26 was updated. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 437 SUCCESS: Document for state_id 28 was updated. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 295 SUCCESS: Document for state_id 30 was updated. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1190 SUCCESS: Document for state_id 31 was updated. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 198 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 295 SUCCESS: Document for state_id 33 was updated. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 880 SUCCESS: Document for state_id 35 was updated. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 676 SUCCESS: Document for state_id 36 was updated. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 307 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 740 SUCCESS: Document for state_id 38 was updated. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 272 SUCCESS: Document for state_id 40 was updated. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 752 SUCCESS: Document for state_id 42 was updated. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1966 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 541 SUCCESS: Document for state_id 44 was updated. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 489 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 SUCCESS: Document for state_id 50 was updated. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-24 04:01:20 - Pausing for 120 seconds... 2026-01-24 04:03:20 - Running update_users.py... 2026-01-24 04:09:41 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1559 users in API response. Starting sync with database. - INSERTED new user with user_id: 1762 - INSERTED new user with user_id: 1761 - INSERTED new user with user_id: 1760 - UPDATED existing user with user_id: 1718 - UPDATED existing user with user_id: 1677 - UPDATED existing user with user_id: 1651 - UPDATED existing user with user_id: 1650 - UPDATED existing user with user_id: 1618 - UPDATED existing user with user_id: 1615 - UPDATED existing user with user_id: 1571 - UPDATED existing user with user_id: 1552 - UPDATED existing user with user_id: 1528 - UPDATED existing user with user_id: 1489 - UPDATED existing user with user_id: 1475 - UPDATED existing user with user_id: 1448 - UPDATED existing user with user_id: 1444 - UPDATED existing user with user_id: 1434 - UPDATED existing user with user_id: 1429 - UPDATED existing user with user_id: 1413 - UPDATED existing user with user_id: 1396 - UPDATED existing user with user_id: 1392 - UPDATED existing user with user_id: 1386 - UPDATED existing user with user_id: 1384 - UPDATED existing user with user_id: 1360 - UPDATED existing user with user_id: 1355 - UPDATED existing user with user_id: 1340 - UPDATED existing user with user_id: 1339 - UPDATED existing user with user_id: 1093 - UPDATED existing user with user_id: 1046 - UPDATED existing user with user_id: 1022 - UPDATED existing user with user_id: 1008 - UPDATED existing user with user_id: 1002 - UPDATED existing user with user_id: 950 - UPDATED existing user with user_id: 920 - UPDATED existing user with user_id: 879 - UPDATED existing user with user_id: 680 - UPDATED existing user with user_id: 677 - UPDATED existing user with user_id: 648 - UPDATED existing user with user_id: 621 - UPDATED existing user with user_id: 619 - UPDATED existing user with user_id: 548 - UPDATED existing user with user_id: 547 - UPDATED existing user with user_id: 546 - UPDATED existing user with user_id: 404 - UPDATED existing user with user_id: 399 - UPDATED existing user with user_id: 383 - UPDATED existing user with user_id: 343 - UPDATED existing user with user_id: 295 - UPDATED existing user with user_id: 275 - UPDATED existing user with user_id: 156 - UPDATED existing user with user_id: 96 - UPDATED existing user with user_id: 95 - UPDATED existing user with user_id: 94 - UPDATED existing user with user_id: 32 --- Synchronization Complete --- Total users from API: 1559 New users inserted: 3 Existing users updated: 51 Users unchanged: 1505 ----------------------------- Script finished. 2026-01-24 04:09:41 - Pausing for 120 seconds... 2026-01-24 04:11:41 - Running insert_allTrucks.py... 2026-01-24 04:11:51 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 792 trucks in MongoDB 2026-01-24 04:11:51 - Pausing for 120 seconds... 2026-01-24 04:13:51 - Running insert_companies.py... 2026-01-24 04:14:00 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-24 04:14:00 - Pausing for 120 seconds... 2026-01-24 04:16:00 - Running insert_trailer.py... 2026-01-24 04:16:22 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1403 trailers... Successfully stored 1403 trailers in MongoDB MongoDB connection closed 2026-01-24 04:16:22 - --- All scripts completed successfully. --- 2026-01-25 04:00:01 - --- Starting daily update run --- 2026-01-25 04:00:01 - Running single_state.py... 2026-01-25 04:01:20 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 551 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1171 INFO: Document for state_id 3 was found, but no changes were needed. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 595 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1387 SUCCESS: Document for state_id 5 was updated. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 383 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 46 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 309 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 700 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 356 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1337 INFO: Document for state_id 13 was found, but no changes were needed. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1083 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 467 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 596 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 412 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 532 SUCCESS: Document for state_id 18 was updated. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 389 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 583 SUCCESS: Document for state_id 24 was updated. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 847 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 180 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 437 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 295 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1190 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 198 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 295 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 880 INFO: Document for state_id 35 was found, but no changes were needed. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 676 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 308 SUCCESS: Document for state_id 37 was updated. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 740 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 272 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 752 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1967 SUCCESS: Document for state_id 43 was updated. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 541 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 489 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-25 04:01:20 - Pausing for 120 seconds... 2026-01-25 04:03:20 - Running update_users.py... 2026-01-25 04:09:46 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1559 users in API response. Starting sync with database. --- Synchronization Complete --- Total users from API: 1559 New users inserted: 0 Existing users updated: 0 Users unchanged: 1559 ----------------------------- Script finished. 2026-01-25 04:09:46 - Pausing for 120 seconds... 2026-01-25 04:11:46 - Running insert_allTrucks.py... 2026-01-25 04:11:57 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 792 trucks in MongoDB 2026-01-25 04:11:57 - Pausing for 120 seconds... 2026-01-25 04:13:57 - Running insert_companies.py... 2026-01-25 04:14:05 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-25 04:14:05 - Pausing for 120 seconds... 2026-01-25 04:16:05 - Running insert_trailer.py... 2026-01-25 04:16:27 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1403 trailers... Successfully stored 1403 trailers in MongoDB MongoDB connection closed 2026-01-25 04:16:27 - --- All scripts completed successfully. --- 2026-01-26 04:00:01 - --- Starting daily update run --- 2026-01-26 04:00:01 - Running single_state.py... 2026-01-26 04:01:21 - Output from single_state.py: --- Starting bulk update for all states (1-60) --- --- Processing State ID: 1 --- Found existing document for state_id 1. Successfully fetched data for state_id 1 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 551 INFO: Document for state_id 1 was found, but no changes were needed. --- Processing State ID: 2 --- Found existing document for state_id 2. Successfully fetched data for state_id 2 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 12 INFO: Document for state_id 2 was found, but no changes were needed. --- Processing State ID: 3 --- Found existing document for state_id 3. Successfully fetched data for state_id 3 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1171 INFO: Document for state_id 3 was found, but no changes were needed. --- Processing State ID: 4 --- Found existing document for state_id 4. Successfully fetched data for state_id 4 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 595 INFO: Document for state_id 4 was found, but no changes were needed. --- Processing State ID: 5 --- Found existing document for state_id 5. Successfully fetched data for state_id 5 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1387 INFO: Document for state_id 5 was found, but no changes were needed. --- Processing State ID: 6 --- Found existing document for state_id 6. Successfully fetched data for state_id 6 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 383 INFO: Document for state_id 6 was found, but no changes were needed. --- Processing State ID: 7 --- Found existing document for state_id 7. Successfully fetched data for state_id 7 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 53 INFO: Document for state_id 7 was found, but no changes were needed. --- Processing State ID: 8 --- Found existing document for state_id 8. Successfully fetched data for state_id 8 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 46 INFO: Document for state_id 8 was found, but no changes were needed. --- Processing State ID: 9 --- Found existing document for state_id 9. Successfully fetched data for state_id 9 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 309 INFO: Document for state_id 9 was found, but no changes were needed. --- Processing State ID: 10 --- Found existing document for state_id 10. Successfully fetched data for state_id 10 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 700 INFO: Document for state_id 10 was found, but no changes were needed. --- Processing State ID: 11 --- Found existing document for state_id 11. Successfully fetched data for state_id 11 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 11 was found, but no changes were needed. --- Processing State ID: 12 --- Found existing document for state_id 12. Successfully fetched data for state_id 12 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 356 INFO: Document for state_id 12 was found, but no changes were needed. --- Processing State ID: 13 --- Found existing document for state_id 13. Successfully fetched data for state_id 13 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1337 INFO: Document for state_id 13 was found, but no changes were needed. --- Processing State ID: 14 --- Found existing document for state_id 14. Successfully fetched data for state_id 14 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1083 INFO: Document for state_id 14 was found, but no changes were needed. --- Processing State ID: 15 --- Found existing document for state_id 15. Successfully fetched data for state_id 15 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 467 INFO: Document for state_id 15 was found, but no changes were needed. --- Processing State ID: 16 --- Found existing document for state_id 16. Successfully fetched data for state_id 16 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 596 INFO: Document for state_id 16 was found, but no changes were needed. --- Processing State ID: 17 --- Found existing document for state_id 17. Successfully fetched data for state_id 17 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 412 INFO: Document for state_id 17 was found, but no changes were needed. --- Processing State ID: 18 --- Found existing document for state_id 18. Successfully fetched data for state_id 18 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 532 INFO: Document for state_id 18 was found, but no changes were needed. --- Processing State ID: 19 --- Found existing document for state_id 19. Successfully fetched data for state_id 19 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 23 INFO: Document for state_id 19 was found, but no changes were needed. --- Processing State ID: 20 --- Found existing document for state_id 20. Successfully fetched data for state_id 20 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 325 INFO: Document for state_id 20 was found, but no changes were needed. --- Processing State ID: 21 --- Found existing document for state_id 21. Successfully fetched data for state_id 21 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 65 INFO: Document for state_id 21 was found, but no changes were needed. --- Processing State ID: 22 --- Found existing document for state_id 22. Successfully fetched data for state_id 22 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 389 INFO: Document for state_id 22 was found, but no changes were needed. --- Processing State ID: 23 --- Found existing document for state_id 23. Successfully fetched data for state_id 23 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 233 INFO: Document for state_id 23 was found, but no changes were needed. --- Processing State ID: 24 --- Found existing document for state_id 24. Successfully fetched data for state_id 24 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 583 INFO: Document for state_id 24 was found, but no changes were needed. --- Processing State ID: 25 --- Found existing document for state_id 25. Successfully fetched data for state_id 25 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 847 INFO: Document for state_id 25 was found, but no changes were needed. --- Processing State ID: 26 --- Found existing document for state_id 26. Successfully fetched data for state_id 26 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 180 INFO: Document for state_id 26 was found, but no changes were needed. --- Processing State ID: 27 --- Found existing document for state_id 27. Successfully fetched data for state_id 27 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 405 INFO: Document for state_id 27 was found, but no changes were needed. --- Processing State ID: 28 --- Found existing document for state_id 28. Successfully fetched data for state_id 28 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 437 INFO: Document for state_id 28 was found, but no changes were needed. --- Processing State ID: 29 --- Found existing document for state_id 29. Successfully fetched data for state_id 29 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 25 INFO: Document for state_id 29 was found, but no changes were needed. --- Processing State ID: 30 --- Found existing document for state_id 30. Successfully fetched data for state_id 30 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 295 INFO: Document for state_id 30 was found, but no changes were needed. --- Processing State ID: 31 --- Found existing document for state_id 31. Successfully fetched data for state_id 31 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1190 INFO: Document for state_id 31 was found, but no changes were needed. --- Processing State ID: 32 --- Found existing document for state_id 32. Successfully fetched data for state_id 32 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 198 INFO: Document for state_id 32 was found, but no changes were needed. --- Processing State ID: 33 --- Found existing document for state_id 33. Successfully fetched data for state_id 33 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 295 INFO: Document for state_id 33 was found, but no changes were needed. --- Processing State ID: 34 --- Found existing document for state_id 34. Successfully fetched data for state_id 34 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 133 INFO: Document for state_id 34 was found, but no changes were needed. --- Processing State ID: 35 --- Found existing document for state_id 35. Successfully fetched data for state_id 35 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 880 INFO: Document for state_id 35 was found, but no changes were needed. --- Processing State ID: 36 --- Found existing document for state_id 36. Successfully fetched data for state_id 36 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 676 INFO: Document for state_id 36 was found, but no changes were needed. --- Processing State ID: 37 --- Found existing document for state_id 37. Successfully fetched data for state_id 37 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 308 INFO: Document for state_id 37 was found, but no changes were needed. --- Processing State ID: 38 --- Found existing document for state_id 38. Successfully fetched data for state_id 38 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 740 INFO: Document for state_id 38 was found, but no changes were needed. --- Processing State ID: 39 --- Found existing document for state_id 39. Successfully fetched data for state_id 39 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 7 INFO: Document for state_id 39 was found, but no changes were needed. --- Processing State ID: 40 --- Found existing document for state_id 40. Successfully fetched data for state_id 40 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 272 INFO: Document for state_id 40 was found, but no changes were needed. --- Processing State ID: 41 --- Found existing document for state_id 41. Successfully fetched data for state_id 41 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 169 INFO: Document for state_id 41 was found, but no changes were needed. --- Processing State ID: 42 --- Found existing document for state_id 42. Successfully fetched data for state_id 42 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 752 INFO: Document for state_id 42 was found, but no changes were needed. --- Processing State ID: 43 --- Found existing document for state_id 43. Successfully fetched data for state_id 43 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 1967 INFO: Document for state_id 43 was found, but no changes were needed. --- Processing State ID: 44 --- Found existing document for state_id 44. Successfully fetched data for state_id 44 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 541 INFO: Document for state_id 44 was found, but no changes were needed. --- Processing State ID: 45 --- Found existing document for state_id 45. Successfully fetched data for state_id 45 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 13 INFO: Document for state_id 45 was found, but no changes were needed. --- Processing State ID: 46 --- Found existing document for state_id 46. Successfully fetched data for state_id 46 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 489 INFO: Document for state_id 46 was found, but no changes were needed. --- Processing State ID: 47 --- Found existing document for state_id 47. Successfully fetched data for state_id 47 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 362 INFO: Document for state_id 47 was found, but no changes were needed. --- Processing State ID: 48 --- Found existing document for state_id 48. Successfully fetched data for state_id 48 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 48 was found, but no changes were needed. --- Processing State ID: 49 --- Found existing document for state_id 49. Successfully fetched data for state_id 49 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 344 INFO: Document for state_id 49 was found, but no changes were needed. --- Processing State ID: 50 --- Found existing document for state_id 50. Successfully fetched data for state_id 50 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 298 INFO: Document for state_id 50 was found, but no changes were needed. --- Processing State ID: 51 --- Found existing document for state_id 51. Successfully fetched data for state_id 51 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 51 was found, but no changes were needed. --- Processing State ID: 52 --- Found existing document for state_id 52. Successfully fetched data for state_id 52 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 52 was found, but no changes were needed. --- Processing State ID: 53 --- Found existing document for state_id 53. Successfully fetched data for state_id 53 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 53 was found, but no changes were needed. --- Processing State ID: 54 --- Found existing document for state_id 54. Successfully fetched data for state_id 54 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 54 was found, but no changes were needed. --- Processing State ID: 55 --- Found existing document for state_id 55. Successfully fetched data for state_id 55 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 55 was found, but no changes were needed. --- Processing State ID: 56 --- Found existing document for state_id 56. Successfully fetched data for state_id 56 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 56 was found, but no changes were needed. --- Processing State ID: 57 --- Found existing document for state_id 57. Successfully fetched data for state_id 57 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 57 was found, but no changes were needed. --- Processing State ID: 58 --- Found existing document for state_id 58. Successfully fetched data for state_id 58 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 58 was found, but no changes were needed. --- Processing State ID: 59 --- Found existing document for state_id 59. Successfully fetched data for state_id 59 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 59 was found, but no changes were needed. --- Processing State ID: 60 --- Found existing document for state_id 60. Successfully fetched data for state_id 60 from API. Filtered 33 fields to update. Adding/Updating 'total_permit' with value: 0 INFO: Document for state_id 60 was found, but no changes were needed. --- Bulk update process finished. --- All states processed successfully. 2026-01-26 04:01:21 - Pausing for 120 seconds... 2026-01-26 04:03:21 - Running update_users.py... 2026-01-26 04:09:42 - Output from update_users.py: Starting user synchronization script... Successfully connected to MongoDB. Fetching user data from API... Found 1559 users in API response. Starting sync with database. --- Synchronization Complete --- Total users from API: 1559 New users inserted: 0 Existing users updated: 0 Users unchanged: 1559 ----------------------------- Script finished. 2026-01-26 04:09:42 - Pausing for 120 seconds... 2026-01-26 04:11:42 - Running insert_allTrucks.py... 2026-01-26 04:11:53 - Output from insert_allTrucks.py: Cleared existing trucks collection Successfully stored 792 trucks in MongoDB 2026-01-26 04:11:53 - Pausing for 120 seconds... 2026-01-26 04:13:53 - Running insert_companies.py... 2026-01-26 04:14:02 - Output from insert_companies.py: Cleared existing carriers collection Fetching carrier data from API... Processing 121 carriers... Successfully stored 121 carriers in MongoDB MongoDB connection closed 2026-01-26 04:14:02 - Pausing for 120 seconds... 2026-01-26 04:16:02 - Running insert_trailer.py... 2026-01-26 04:16:22 - Output from insert_trailer.py: Cleared existing trailers collection Fetching data from API... Processing 1403 trailers... Successfully stored 1403 trailers in MongoDB MongoDB connection closed 2026-01-26 04:16:22 - --- All scripts completed successfully. ---