Commit Graph

17 Commits

Author SHA1 Message Date
Jake Pullen 9e7ff808a5 tidied up dimensions and removed duplicated columns 2024-08-29 09:23:30 +01:00
Jake Pullen 845f6a28cc separation of areas 2024-08-28 12:54:01 +01:00
Jake Pullen 7b80b52998 changes to make dash app work 2024-08-27 15:12:44 +01:00
Jake Pullen a966ad5ebd better handling of merging the data in the combine, lead to not needing to handle duplicates 2024-08-12 16:51:06 +01:00
Jake Pullen e54d48de5d added a log for start and end of base processing 2024-08-11 10:44:30 +01:00
Jake Pullen 19b633eb40 added error handling to facts and dimensions transformations 2024-08-10 19:45:17 +01:00
Jake Pullen 861ccd0dc4 bug fix, a sucessful pipeline completion resulted in error message...
bug fix, a successful dimension save resulted in failed save and skip the rest of processing
2024-08-10 18:47:06 +01:00
Jake Pullen 812e107013 Added more error handling in for raw to base 2024-08-10 18:36:39 +01:00
Jake Pullen c5cdb16a8a JP is stupid 2024-08-10 17:13:51 +01:00
Jake Pullen 24cc006ef5 Added more error handling and logic to ingest 2024-08-10 17:11:57 +01:00
Jake Pullen d25136fbb0 Added some more error handling and request limit handling 2024-08-10 15:54:31 +01:00
Jake Pullen b29b738a7a ready for open source 2024-08-10 09:50:37 +01:00
Jake Pullen c9b01e85d5 fixed scheduled transactions 2024-08-10 08:29:50 +01:00
Jake Pullen 696b72988d added facts 2024-08-10 08:07:14 +01:00
Jake Pullen b7b6f8887c dimensions done, still need to fully test 2024-08-09 16:27:36 +01:00
Jake Pullen da5cf943d6 accounts into dimension 2024-08-09 15:14:04 +01:00
Jake Pullen 165464820b starting to build the warehouse 2024-08-09 14:23:52 +01:00