WIP: feature: Add fetch-spacetrack-hist#2
Conversation
|
Wow ! My first pull request ! This feature can certainly be useful, and you raise a good point on the size of the tle.py file. Concerning the issues, I had the same ones, but as I rarely download large files from space-track, this did not bother me that much. I will look more closely into this, but I'm afraid that the only way to manage this would be to split the files in batches on few 1000's TLEs. That or change the whole database structure, which was not designed to handle that much data insertion, as my primary source is celestrak. Anyway, thank you very much for this proposal. I will try to review it during the next few days. I ask for your patience, as I'm not very used to the github process for handling PR. |
It's working but there are several todos:
spacetrackis required. If yes, consider re-writing the existing spacetrack code to use this dependency as welltle_dir-hack, and split-upspace/tle.pyinstead (it's >0.5k lines already)TleDbIssues:
peewee.IntegrityError: UNIQUE constraint failed: tlemodel.norad_id, tlemodel.epochpeewee.OperationalError: too many SQL variables