Application has 3 layers for extracting HU data from various provider – following are the details:
This is the dashboard of application, which shows progress of EDI/Web scraper Request. User can see list of status of jobs running.
Using this feature user can view list of jobs that has been queued by user. For requesting jobs, user can click on Add Request or alternatively an API is available using which user can submit the batch request -
User can also view completed HU request, by switching to View Completed HU Request
Using this feature user can view list of EDI files which has been received from electricity provider for further processing –
User can also view completed EDI request, by switching to View Completed EDI Request
Historical/Interval Usage data – using this feature user can search for data captured using ETL process. User can search by single/multiple account number. Alternatively, user can search using consumer service provider –
Using this feature user can manage configuration related to service provider –
These are the background service, responsible for processing the requested jobs. There are separate jobs for processing webscrapper and EDI processing.
EDI Jobs – EDI files are uploaded by 3rd party service provider on box.com ftp location. Box.com triggers EDI Jobs schedular which is responsible for processing EDI ETL request.
Webscrapper Jobs – This job is responsible for fetching electricity data from website. There are multiple website from which we fetch the electricity data.