An Analysis of Data Quality and Time Resolution in Clustering Based on Polish Prosumer Real World Data

Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F61989100%3A27240%2F25%3A10260636" target="_blank" >RIV/61989100:27240/25:10260636 - isvavai.cz</a>
Result on the web
<a href="https://ieeexplore.ieee.org/document/11169161" target="_blank" >https://ieeexplore.ieee.org/document/11169161</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1109/EEEIC/ICPSEurope64998.2025.11169161" target="_blank" >10.1109/EEEIC/ICPSEurope64998.2025.11169161</a>

Result language
angličtina
Original language name
An Analysis of Data Quality and Time Resolution in Clustering Based on Polish Prosumer Real World Data
Original language description
This study investigates the impact of data preprocessing techniques on the reliability and clustering outcomes of real-world electricity generation and consumption data from prosumers with PV installation, which are located in Poland. Utilizing a dataset spanning 2023, collected at threeminute intervals, key challenges such as missing data, inconsistencies, and quality issues were addressed. Missing measurements were handled through linear interpolation, and a novel time-difference metric was introduced to identify and exclude days with substantial data gaps. Weather data from an open-source API was integrated and aligned through timeaggregation methods. Clustering analyses, employing k-means, were conducted on datasets with 15 -minute and hourly resolutions, with the optimal number of clusters determined using the elbow method. Results highlighted discrepancies in energy records, underscoring the importance of preprocessing for enhanced data reliability and analysis. This work demonstrates that preprocessing steps significantly influence the clustering process and its outcomes, offering insights for improving data-driven energy management strategies.
Czech name
—
Czech description
—

Publication year
2025
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection
2025 IEEE International Conference on Environment and Electrical Engineering and 2025 IEEE Industrial and Commercial Power Systems Europe, EEEIC / I and CPS Europe 2025 : conference proceedings : 15-18 July 2025, Chania, Crete-Greece
ISBN
979-8-3315-9516-6
ISSN
2994-9440
e-ISSN
2994-9467
Number of pages
8
Pages from-to
1-8
Publisher name
IEEE
Place of publication
Piscataway
Event location
Chania
Event date
Jul 15, 2025
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—

Similar results(10)