Calls to get_facility_data with >30 facilities --> API Error

[AndrewStyan]

Calls to get_facility_data that have more than 30 facilities fail to run.

Dealing with this by breaking calls up into groups of <=30, but should be rectified.

[2025-04-16 16:41:28] DEBUG [openelectricity.client._async_get_facility_data:198] Request parameters: {'facility_code': ['ALDGASF', 'AVLSF', 'BANNSP', 'BLUEGSF', 'BOMENSF', 'BNGSF1', 'BNGSF2', 'CLARESF', 'COLEASF', 'COLUMSF', 'DDSF', 'DARLSF', 'DAYDSF', 'EDENVSF', 'FINLEYSF', 'GANGARR', 'GLENSF', 'GLRWNSF', 'GNNDHSF', 'HAUGHT1', 'HILLSTN', 'KARSF', 'KIAMSF1', 'LILYVASF', 'LIMOSF1', 'METZSF', 'NEVERSF', 'NEWENSF', 'NUMURKSF', 'NYNGAN', 'RRSF', 'SEBSF', '0STUBBOSF', 'SMCSF', 'SUNRSF1'], 'metrics': ['power'], 'interval': '5m', 'date_start': '2025-04-16T14:41:00', 'date_end': '2025-04-16T16:41:00'}
[2025-04-16 16:41:34] ERROR [openelectricity.client._handle_response:105] API error: 400 - Bad Request

[nc9]

I must admit that was a mildly superficial limit put in place because I was worried about infra. This is a kinda-expensive query and we're still in beta. Obviously long-term the plan is to open it up a bit, but the idea was you could page through facility records.

This is good feedback - always wanted to adapt the API around use-cases. I'll see what I can do on a next release.

[AndrewStyan]

Yes, I imagine there is a lot of work going on behind the scenes to retrieve that data from 500+ units for the date range and criteria specified.

I'm not sure that my use case is typical but I imagine anyone using the real-time date would be doing something similar across many/all units. For these users it may be worthwhile setting up a rolling 24 hour cache of, say, all power/energy values for all operating units. Perhaps a different buffer for 5min, 30min and each region. A single call returns the entire relevant cache and it is left to the user to filter which data they actually want from the response. Hard to pick a generic use case though. At the moment I'm interested in the 24 hour cycle of generation to reveal the solar/consumption/fueltech pattern. I might eventually also want to show the seasonal cycle (days over 12 months) to reveal the season/sun angle pattern. But then mine is more of an informational than an analytic application.