1. 19 Jul, 2019 1 commit
  2. 12 Jun, 2019 1 commit
  3. 20 May, 2019 4 commits
  4. 10 May, 2019 1 commit
  5. 07 May, 2019 1 commit
    • Aurélien Campéas's avatar
      api: switch to the new api · dea92f8abab3
      Aurélien Campéas authored
      Little has changed yet.
      
      We have:
      * TimeSerie -> timeseries
      * .get_history -> .history
      * .get_delta  -> .staircase
      
      closes #47
      dea92f8abab3
  6. 02 May, 2019 1 commit
  7. 06 May, 2019 1 commit
  8. 18 Mar, 2019 1 commit
  9. 27 Feb, 2019 1 commit
  10. 22 Feb, 2019 1 commit
    • Aurélien Campéas's avatar
      schema: refine the cooperation mechanisme between components · 3ef71c26f1ed
      Aurélien Campéas authored
      tshistory plugins/extensions that will need their own schema extension
      have now a more principled system to use
      
      Instantiating a schema object will add it to a registration list.
      
      When all schemas have been declared (in dependency order), one
      will have to invoke `register_schemas`, and also (but more for tests)
      `delete_schemas` (in reverse order).
      3ef71c26f1ed
  11. 21 Dec, 2018 1 commit
  12. 18 Dec, 2018 1 commit
  13. 05 Dec, 2018 1 commit
  14. 14 Nov, 2018 1 commit
  15. 13 Nov, 2018 2 commits
  16. 09 Oct, 2018 2 commits
  17. 25 Sep, 2018 1 commit
  18. 14 Sep, 2018 1 commit
  19. 07 Sep, 2018 2 commits
  20. 04 Sep, 2018 1 commit
  21. 30 Aug, 2018 2 commits
  22. 03 Sep, 2018 1 commit
    • Aurélien Campéas's avatar
      snapshot/storage: low-level optimisation · dbce79810ccf
      Aurélien Campéas authored
      Json serialization is replaced with a more low-level scheme,
      affecting both string and numeric series.
      
      Purpose is to drop the cost of de-serialization, which is
      currently quite high.
      
      For numerical values, we serialize the underlying C array
      (while recording the in-memory layout/dtype).
      
      Perf improvement on the reading phase is quite worthwhile:
      
      Before:
      
      TSH GET 0.005136966705322266
      TSH HIST 0.5647647380828857
      DELTA all value dates 2.0582079887390137
      DELTA 1 day  0.20743083953857422
      
             class                      test      time
      0  TimeSerie            bigdata_insert  1.332391
      1  TimeSerie       bigdata_history_all  1.718589
      2  TimeSerie    bigdata_history_chunks  1.613754
      3  TimeSerie          manydiffs_insert  0.940170
      4  TimeSerie     manydiffs_history_all  0.996268
      5  TimeSerie  manydiffs_history_chunks  2.115351
      
      After:
      
      TSH GET 0.004252910614013672
      TSH HIST 0.11956286430358887
      DELTA all value dates 1.7346818447113037
      DELTA 1 day  0.16817998886108398
      
             class                      test      time
      0  TimeSerie            bigdata_insert  1.297348
      1  TimeSerie       bigdata_history_all  0.173700
      2  TimeSerie    bigdata_history_chunks  0.181005
      3  TimeSerie          manydiffs_insert  0.846298
      4  TimeSerie     manydiffs_history_all  0.084483
      5  TimeSerie  manydiffs_history_chunks  0.216825
      
      
      A few notes:
      
      * serialization of strings is a bit tricky since we need to
        encode None/nans in its serialization and have a separator
        for their concatenation (we forbid ascii control characters
        0 and 3 to be ever used)
      
      * we have to wrap the `index` low-level bytes string into
        a python array to work around an obscure pandas bug in
        index.isin computation (isin is attempting a mutation !)
      
      
      Thanks to Alain Leufroy for the proposal !
      
      Resolves #49.
      dbce79810ccf
  23. 21 Aug, 2018 1 commit
  24. 08 Jun, 2018 1 commit
  25. 04 Jun, 2018 1 commit
  26. 18 May, 2018 2 commits
  27. 12 Apr, 2018 1 commit
    • Aurélien Campéas's avatar
      tsio/snapshots: we now have chunked snapshots · ba11d01bcfd1
      Aurélien Campéas authored
      This should provide a significant speed bonus for many common operatiions.
      Notes below about this commit contents:
      
      * conftest: more robust cleanup at test startup time
        When debugging, we might have got phantom inserts of a previous
        session because of an unclean exit.
      
      * tsio: remove customization entry point
        It was not a good idea.
      
      * tsio, snapshot: cache the sqlachemy Table objects
        It turns out these are very expensive to instantiate,
        and we do that a lot.
      
      * tests/perf: becnhmark a forecast-like insertion
      
      * tsio: slight optimisation in _create
      
      
      Resolves #32.
      ba11d01bcfd1
  28. 14 Feb, 2018 2 commits