How to replicate Growatt Web Interface/App key metrics in Home Assistant

[dg362]

As I'm working towards using grottserver and dropping growatt.com (and ShinePhone App), I would like to replicate some key statistics that Growatt provide in the Web Interface/App but for the life of me I can't get numbers to even vaguely align for the 6 key metrics.

Taking September as the month, Growatt WI/App has

System Production: 394.7 kWh
Solar: 367.9 kWh
Load Consumption: 319.5 kWh
Self-Consumption: 270.2 kWh
Exported To Grid: 124.5 kWh
Imported From Grid: 49.3 kWh

From Home Assistant, via grott and grott_ha.py version 0.0.7, plus mqtt_growatt_en.yaml from this repo with additions for battery and load as discussed in issues #142 and #159, I am using the following sensors to match those 6 key metrics. With oocxxxxxx being my inverter

System Production from sensor.oocxxxxxx_system_output_self_consumption_export_today_calculated
Solar from sensor.oocxxxxxx_pv_all_energy_today_calculated
Load Consumption from sensor.oocxxxxxx_load_consumption_energy_today
Self-Consumption from sensor.oocxxxxxx_self_consumption_solar_battery_energy_today_eactoday
Exported to Grid from sensor.oocxxxxxx_export_to_grid_energy_today
Imported from Grid from sensor.oocxxxxxx_import_from_grid_energy_today

I get different values, wildly different for consumption and import, with the exception of Solar which is 100% accurate.
I am using History Explorer to view the totals, as it is easy to define the month view, plus the statistics graph never seems to work for me with monthly data sampling. Clearly I'm doing something wrong there, but that's another question for another day.

System Production: 396.6 kWh
Solar: 367.9 kWh
Load Consumption: 306.7 kWh  <-wildly inaccurate
Self-Consumption: 328.8 kWh  <-wildly inaccurate
Exported To Grid: 126.5 kWh
Imported From Grid: 64.2 kWh  <-wildly inaccurate

Has anyone, with an SPH inverter, managed to replicate the key statistics and metrics from the Growatt WI/App in their Home Assistant setup?
This is in relation to Energy Trend graph, which from the Growatt WI is defined as per below (Chart is the 2nd half of the table).

If so, what are your sensor definitions and can you share the .yaml file(s) to match.
I have an SPH3600 hybrid inverter with 2 x GBLI6532 batteries, and a ShineWiFi-S datalogger.

I'm getting the following values into mqtt via grott

{
    "device": "OOCxxxxxxx",
    "time": "2023-10-13T16:58:22",
    "buffered": "no",
    "values": {
        "datalogserial": "JPCxxxxxxx",
        "pvserial": "OOCxxxxxxx",
        "pvstatus": 5,
        "pvpowerin": 1900,
        "pv1voltage": 2066,
        "pv1current": 6,
        "pv1watt": 1441,
        "pv2voltage": 2018,
        "pv2current": 2,
        "pv2watt": 460,
        "pvpowerout": 2989,
        "pvfrequentie": 4999,
        "pvgridvoltage": 2441,
        "pvgridcurrent": 16,
        "pvgridpower": 2941,
        "pvgridvoltage2": 0,
        "pvgridcurrent2": 0,
        "pvgridpower2": 0,
        "pvgridvoltage3": 0,
        "pvgridcurrent3": 0,
        "pvgridpower3": 0,
        "totworktime": 89538180,
        "eactoday": 38,
        "pvenergytoday": 38,
        "eactotal": 62015,
        "epvtotal": 65620,
        "epv1today": 25,
        "epv1total": 28486,
        "epv2today": 22,
        "epv2total": 36965,
        "pvtemperature": 335,
        "pvipmtemperature": 299,
        "pvboosttemp": 325,
        "bat_dsp": 538,
        "eacharge_today": 35,
        "eacharge_total": 5711,
        "batterytype": 1,
        "uwsysworkmode": 5,
        "systemfaultword0": 0,
        "systemfaultword1": 0,
        "systemfaultword2": 0,
        "systemfaultword3": 0,
        "systemfaultword4": 0,
        "systemfaultword5": 0,
        "systemfaultword6": 0,
        "systemfaultword7": 256,
        "pdischarge1": 0,
        "p1charge1": 0,
        "vbat": 540,
        "SOC": 100,
        "pactouserr": 0,
        "pactousertot": 0,
        "pactogridr": 219,
        "pactogridtot": 219,
        "plocaloadr": 2000,
        "plocaloadtot": 2000,
        "spdspstatus": 5,
        "spbusvolt": 3064,
        "etouser_tod": 47,
        "etouser_tot": 17156,
        "etogrid_tod": 6,
        "etogrid_tot": 30412,
        "edischarge1_tod": 29,
        "edischarge1_tot": 22041,
        "eharge1_tod": 59,
        "eharge1_tot": 18963,
        "elocalload_tod": 57,
        "elocalload_tot": 55442
    }
} 

[dg362]

So I decided to do a validation against what Growatt states as the calculation for the non-new inverters of which my SPH3600 is one.

System Production = (Epvtoday + Edischarge1Today - Echarge1Today)

• Epvtoday is not present in grott for my SPH3600, but would be epv1today + epv2today so can be calculated
• Edischarge1Today is edischarge1_tod = growatt_battery_discharged_today
• Echarge1Today is probably eharge1_tod = growatt_battery_charged_today

Using sensor data in Home Assistant, for a specific time today that calculation results in
((2.4+2.3) + 4.3 - 5.6) = 3.4kWh

At the same time, the Growatt web portal shows the System Production as 6.8kWh
Again, a very different number. Yet I can see the numbers align in terms of the battery charge and discharge, and the PV today as well. So the numbers are correct from the sensors.

So using what are apparently the same sensors and the same calculation, an entirely different result. Suggesting the calculation method that Growatt states is not how it actually calculates this particular sensor.

So whilst I did create a template to define this for myself (as below), it is fairly pointless if the numbers are going to be wildly inaccurate still.

  - name: System Production (Today)
    state: "{{ ( states('sensor.oocxxxxxxx_pv1_energy_today')|float(2) + states('sensor.oocxxxxxxx_pv2_energy_today')|float(2) + states('sensor.oocxxxxxxx_battery_discharge_today')|float(2) - states('sensor.oocxxxxxxx_battery_charge_today')|float(2) )|round(2) }}"
    state_class: "measurement"
    unit_of_measurement: "kWh"
    icon: "mdi:flash"

[dg362]

After spending some time checking sensor values at different times of the day with the Growatt portal/App, I believe I've now got a reasonable set of sensors to use. They are rarely an exact match for what the Growatt portal/App shows, but they're close enough to consider as authoritative values to work from going forward if I move to grottserver.

To make it much easier for me to track these, I have set up Helpers in Home Assistant of the Utility Meter type.

So the virtual Utility Meters are created as below, but all with the base configuration of
Reset Cycle: Monthly
Net consumption: false
Delta values: false
Periodically resetting: true

UM System Production
Name: sensor.um_system_production
Input Sensor: sensor.oocxxxxxxx_system_output_self_consumption_export_today_calculated

UM Solar Generation
Name: sensor.um_solar_generation
Input Sensor: sensor.oocxxxxxxx_pv_all_energy_today_calculated

UM Load Consumption
Name: sensor.um_load_consumption
Input Sensor: sensor.oocxxxxxxx_load_consumption_energy_today

UM Self Consumption
Name: sensor.um_self_consumption
Input Sensor: sensor.oocxxxxxxx_load_consumption_energy_pv_battery_today_calculated

UM Export to Grid
Name: sensor.um_export_to_grid
Input Sensor: sensor.oocxxxxxxx_export_to_grid_energy_today

For Import, the Growatt portal/App doesn't classify grid import used to charge the battery as import, hence why normal import sensors are wildly different.
Therefore I've created a custom template and will consume that custom template instead of the sensors from Grott directly.

UM Import from Grid
Name: sensor.um_import_from_grid
Input Sensor: sensor.import_from_grid_actual_today

- name: Import from grid (Actual) (Today)
  state: "{{ ( states('sensor.oocxxxxxxx_import_from_grid_energy_today')|float(2) - states('sensor.oocxxxxxxx_battery_ac_charge_energy_today')|float(2) )|round(1) }}"
  state_class: "measurement"
  unit_of_measurement: "kWh"
  icon: "mdi:home-import-outline"
  unique_id: "custom_import_from_grid_actual_today"