Skip to content

📎 Changelog

2.3.0 - 2025-12-22

Authors: Bruno Macedo

Changes:

  • Upgraded to Python 3.13.

2.2.3 - 2025-12-02

Authors: Bruno Macedo

Changes:

  • Minor bug fix in OnsOpenDataSiteLimitations.import_database to correctly pivot the DataFrame using polars.

2.2.2 - 2025-11-25

Authors: Bruno Macedo

Changes:

  • Bugfix in limitations_lost_energy.py to set correct dtype for new columns created in the DataFrame.

2.2.1 - 2025-11-07

Authors: Bruno Macedo

Changes:

  • Bugfix in OnsOpenDataSiteLimitations.get and improvements to use polars in it.

2.2.0 - 2025-09-29

Authors: Bruno Macedo

Changes:

  • Changed CceeOpenDataEnergyGc to get data in hourly resolution.
  • Adjusted all methods to use validate_call decorator to validate input parameters.

2.1.2 - 2025-09-29

Authors: Bruno Macedo

Changes:

  • Bugfix in CceeOpenDataDatasetsResourcesValues.get to use POST instead of GET when requesting data from CCEE open data API.

2.1.1 - 2025-09-29

Authors: Bruno Macedo

Changes:

  • Bugfix in OnsOpenDataSiteLimitations.get to correctly convert string columns to numeric when the values use commas as decimal separators.

2.1.0 - 2025-09-11

Authors: Bruno Macedo

Changes:

  • OnsOpenDataSites now imports the relations from SPE to Site considering its start and end.

2.0.0 - 2025-08-13

Authors: Bruno Macedo

Changes:

  • Completely refactored Sager functionality. Now it's better handled by classes below OnsSager.
  • Sager method of connection rewritten to avoid using selenium.

1.2.9 - 2025-07-31

Authors: Bruno Macedo

Changes:

  • Reorganized tests folder structure to follow the same pattern as echo-postgres.
  • Minor bug fixes in OnsOpenDataSites and sager_importer.

1.2.8 - 2025-07-12

Authors: Bruno Macedo

Changes:

  • Changed build backend to uv_build for better packaging and deployment.
  • Added ruff.toml for code formatting and linting.

1.2.7 - 2025-07-09

Authors: Bruno Macedo

Changes:

  • Changed standardized_name to name due to changes in feature values table in database.

1.2.6 - 2025-06-17

Authors: Bruno Macedo

Changes:

  • Bug fix related to creation of distributed generation SPEs.

1.2.5 - 2025-06-09

Authors: Bruno Macedo

Changes:

  • Changed all str[pyarrow] dtypes to string[pyarrow] for compatibility with newer versions of Pandas.

1.2.4 - 2025-04-04

Authors: Bruno Macedo

Changes:

  • Bug fix in sager_importer due to changes in database tables.

1.2.3 - 2025-04-02

Authors: Bruno Macedo

Changes:

  • Bug fix in CceeOpenDataEnergyGc.import_database when no data is returned from the API.

1.2.2 - 2025-02-04

Authors: Bruno Macedo

Changes:

  • Changed calc_limitation_events_lost_energy to get site limitations from realtime view, not relying on materialized view.

1.2.1 - 2025-01-30

Authors: Bruno Macedo

Changes:

  • Changes in sager_importer related to feature renames in database.

1.2.0 - 2025-01-30

Authors: Bruno Macedo

Changes:

  • Added IPCA data acquisition to CCEE open data.

1.1.0 - 2025-01-28

Authors: Bruno Macedo

Changes:

  • Added PLD data acquisition from CCEE open data.

1.0.0 - 2025-01-22

Authors: Bruno Macedo

Changes:

  • Major refactor to structure the methods in classes and subclasses. SAGER data acquisition still in legacy code.
  • Added Ccee class to get data from CCEE open data. Currently allows access to any dataset and also has a specific subclass for acquiring energy at gravity center.

0.3.5 - 2024-11-11

Authors: Bruno Macedo

Changes:

  • Increased sleep time when connecting to SAGER to avoid connection issues.

0.3.4 - 2024-10-08

Authors: Bruno Macedo

Changes:

  • Improved getting data from SAGER. Now it reconnects in case the connection is lost.

0.3.3 - 2024-10-08

Authors: Bruno Macedo

Changes:

  • Improved the way we use selenium to log in to SAGER, avoiding page refreshes.
  • Fixed insertion of new objects in ONS open data.

0.3.2 - 2024-10-07

Authors: Bruno Macedo

Changes:

  • Changed the way we log into SAGER to use Selenium.

0.3.1 - 2024-08-22

Authors: Bruno Macedo

Changes:

  • Added import of connection point and latitude and longitude to ons sites.

0.3.0 - 2024-08-22

Authors: Bruno Macedo

Changes:

  • Added classes to get ONS open data related to constrained-off events.
  • Added documentation using mkdocs.
  • Removed import_echo_sager_data module.
  • Removed dependency on legacy echo-postgres code.

0.2.6 - 2024-07-16

Authors: Bruno Macedo

Changes:

  • Forced type casting to timestamp without time zone in generate_ons_sheet to avoid errors with time zone aware timestamps when saving to excel.

0.2.5 - 2024-07-14

Authors: Bruno Macedo

Changes:

  • Upgraded to Python 3.12.
  • Changes in time columns due to changes in database.

0.2.4 - 2024-06-21

Authors: Bruno Macedo

Changes:

  • Major bug fixes an improvements on ons_status_importer.

0.2.3 - 2024-06-20

Authors: Nicole Tometich

Changes:

  • Minor change regarding how ONS calculated data is inserted to performance.db.

0.2.2 - 2024-06-20

Authors: Nicole Tometich

Changes:

  • Changed features time series acquisition from Performance.db to Bazefield API.

0.2.1 - 2024-04-25

Authors: Max Daniel

Changes:

  • Minor bug fix

0.2.0 - 2024-04-10

Authors: Bruno Macedo

Changes:

  • Major refactor to make it almost 100% compatible with version 2.0 of echo-postgres.

0.1.2 - 2023-12-28

Authors: Max Daniel

Changes:

  • renamed import_ons_status() to ons_status_importer().
  • Added object validation and changed the arguments to ons_status_importer() in order to improve it.
  • Minor fixes to impor_echo_sager_data().

0.1.1 - 2023-12-19

Authors: Max Daniel

Changes:

  • added import_ons_status(). This will be used to import and keep track of the statuses of all ONS limitations.

0.1.0 - 2023-12-09

Authors: Bruno Macedo

Changes:

  • Renamed sager_import.py to sager.py.
  • Major refactor of sager_importer() to allow for easier use.
  • Added calc_limitation_events_lost_energy() to calculate the energy lost due to limitations and save it to the database.

0.0.16 - 2023-12-08

Authors: Bruno Macedo

Changes:

  • Adjusted sager_import to always put the end time of a restriction with 59 seconds. This was done because ONS returns the end time of a restriction with 00 seconds, which would create a gap between the end of a restriction and the start of the next one.
  • Minor documentation improvements.

0.0.15 - 2023-12-05

Authors: Max Daniel

Changes:

  • Fixed some minor bugs that happened while importing limitations

0.0.14 - 2023-11-24

Authors: Max Daniel

Changes:

  • Fixed some minor bugs that happened while importing data

0.0.13 - 2023-11-07

Authors: Max Daniel

Changes:

  • New sager_import is properly importing SAGER data to our database.
  • Sheet generator added. This is a new implementation of import_echo_ons_data and will be replaced soon.
  • Other minor changes

0.0.12 - 2023-11-01

Authors: Max Daniel

Changes:

  • Added sager_import. This is a simple function that imports data from SAGER, which is the SAGIC successor(it is not used anymore).

0.0.11 - 2023-08-30

Authors: Bruno Macedo

Changes:

  • Bug fix in get_ons_data_by_object that wasn't dropping rows where end was before or equal to start.
  • Standardized period in get_ons_data_period to start at 00:00:00 and end at 23:59:59 to avoid errors.

0.0.10 - 2023-07-07

Authors: Bruno Macedo

Changes:

  • Changed echo_ons_sagic_import.py to sagic_import.py.

0.0.9 - 2023-07-07

Authors: Bruno Macedo

Changes:

  • Documentation improvements.
  • Made all functions raise errors when something failed while importing data.
  • Added auto_test.py to test the package using pytest.

0.0.8 - 2023-07-04

Authors: Nicole Tometich

Changes:

  • Minor change.

0.0.7 - 2023-07-04

Authors: Nicole Tometich

Changes:

  • Minor change on a if statement for logger debug.

0.0.6 - 2023-07-04

Authors: Nicole Tometich

Changes:

  • Minor change on a if statement for logger debug.

0.0.5 - 2023-06-30

Authors: Nicole Tometich

Changes:

  • New file added to echo-ons "echo_ons_sagic_import.py" to get data directly from SAGIC system and insert it to performance_db.

0.0.3 - 2023-01-16

Authors: Max Daniel

Changes:

  • The script was passing a timeout parameter to the fetch function in order to request data from ONS, but instead of returning the data, it was returning an error. This was fixed by simply removing the timeout. For some reason, the function considers the parameter as a duplicate.

0.0.2 - 2022-10-25

Authors: Max Daniel

Changes:

  • The script cannot send emails now. Instead, it will return a dictionary with the filename, filepath and the email body, then the script ons_data_importer.py(available on our server on auto_routines/sender_ons_curtailments) will send the email.

0.0.1 - 2022-10-25

Authors: Max Daniel

Changes:

  • This old package was running inside echo-performance, but was not standardized and not using the echo_baze package, so it had to be updated before uploading.