2b:null 2c:["$","title",null,{"children":"STSC Date and Time | Joshua Cooper | Observable"}] 31:T40c,md`# STSC Date and Time The Luxon library is used for calculating date and time offsets for moving through the timeseries. There are two assumptions 1. timeseries objects are stored in UTC or at least will be interpreted as UTC, using epoch time and interval definitions as time offsets between values 2. half hourly data within the day uses UTC to mark the beginning of the time slot, if this was not the case, there would be holes in the data or "extra" data as a result of changes in GMT to BST for instance All aggregation and presentation then needs to be consistent and understandable within the user's expectations of local time. This work book shows some of the internal workings of aggregation to at least be clear to someone using the library as to what to expect. It is up to the application to to decide if it is appropriate. If you want data to work with, then you can download the raw data in CSV format with the button below. Note if you put in your own token, then you are able to work with your personalised data.`32:[] 2f:{"id":"b59dcb50cde5933a","slug":"stsc-date-and-time","title":"STSC Date and Time","thumbnail":"7a0b5ef3f5f84b7b3bb07dbd7565280d7efe5aacdfcf7c9892204d1be571fd5d","access_level":"public","create_time":"$D2021-04-02T05:58:53.391Z","update_time":"$D2021-04-17T06:28:23.742Z","view_time":null,"first_public_time":"$D2021-04-03T08:05:49.641Z","fork":false,"stars":0,"starred":false,"owner":{"type":"team","id":"20e510411e88c2f1","login":"joshuacooper","name":"Joshua Cooper","avatar_url":"https://avatars-next.observableusercontent.com/814f458da4ea4bcfddd1fc64693fcb58da584f45f67098626643f24a0432a1c4","tier":"starter_2024"},"version":295,"publish_version":295,"role":null,"authored":false,"authors":[{"type":"individual","id":"5514a468c7245fb1","login":"joshuacooper","name":"Joshua Cooper","avatar_url":"https://avatars-next.observableusercontent.com/814f458da4ea4bcfddd1fc64693fcb58da584f45f67098626643f24a0432a1c4","tier":null}],"members":[{"type":"individual","id":"5514a468c7245fb1","login":"joshuacooper","name":"Joshua Cooper","avatar_url":"https://avatars-next.observableusercontent.com/814f458da4ea4bcfddd1fc64693fcb58da584f45f67098626643f24a0432a1c4","tier":null,"role":"editor"}],"comments":[],"custom_thumbnail":false,"trashed":false,"subscribed":null,"forks":1,"collection":{"id":"04adf3cf439dcfe5","slug":"smart-tariff-smart-comparison","title":"Smart Tariff Smart Comparison","owner":{"id":"20e510411e88c2f1","login":"joshuacooper","name":"Joshua Cooper"}},"type":"notebook","body":{"title":"STSC Date and Time","cells":[{"id":0,"value":"$31","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":176,"value":"DOM.download(serialize(myAnnualEnergy.data), \"all\", \"Download CSV\")","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":26,"value":"md`#### Cost->byMonth the Monthly Cost\nThe attribute byMonth returns an array of 12 values corresponding to the cost within the 12 months. It is an override of the general Timeseries byMonth attribute in order to be able to have transparency in the calculation of standing charges in particular. Note, there may be a case to consolidate part of the calculation into the general Timeseries.\n\nFor testing, 16 months of history will be used to look at leap year effects. The code has been extracted from source to show the workings of the method.`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":34,"value":"monthBoundaries = {\n let intervalsDateTime = [];\n let durMonth = luxon.Duration.fromISO('P1M');\n let startThisMonth = luxon.DateTime.utc().startOf('month');\n \n // fix to 16 months back from now\n let howManyMonths = 16;\n\n for(let j=0; j < (howManyMonths); j++) {\n \n intervalsDateTime.push(luxon.Interval.before(startThisMonth, durMonth));\n \n let timeparams = { start: luxon.Interval.before(startThisMonth, durMonth).s.ts, end: luxon.Interval.before(startThisMonth, durMonth).e.ts };\n\n startThisMonth = startThisMonth.minus(durMonth);\n }\n return intervalsDateTime;\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":39,"value":"md`The month boundaries are contiguous and will be used to extract the sections of the consumption values and tariffs for the appropriate time range. With the array working backwards. \n\nNote the method of defining the boundary is to use start of month as it is safe for every month, then the luxon Duration object to offset the time stamp to be the duration of a month. The range is formally [ start, end ) within the Timeseries definition. \n`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":22,"value":"durMonth = luxon.Duration.fromISO('P1M');","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":42,"value":"`\nStart ${ monthBoundaries[0].s.toISO() } End ${ monthBoundaries[0].e.toISO() }\n...\nStart ${ monthBoundaries[11].s.toISO() } End ${ monthBoundaries[11].e.toISO() }\n`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":68,"value":"md`As a check, look at Feb 2021 and note that the boundary is at the start of the month.`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":71,"value":"`\nFeb 2021\nStart ${ monthBoundaries[1].s.ts } End ${ monthBoundaries[1].e.ts }\nStart ${ monthBoundaries[1].s.toISO() } End ${ monthBoundaries[1].e.toISO() }\nNumber of milliseconds ${ monthBoundaries[1].e.ts - monthBoundaries[1].s.ts }\n\nFeb 2020\nStart ${ monthBoundaries[13].s.ts } End ${ monthBoundaries[13].e.ts }\nStart ${ monthBoundaries[13].s.toISO() } End ${ monthBoundaries[13].e.toISO() }\nNumber of milliseconds ${ monthBoundaries[13].e.ts - monthBoundaries[13].s.ts }\n`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":81,"value":"md`The next part of the calculation is then using the _consumption method to extract the energy for the month as defined by the boundaries`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":95,"value":"md`Within _consumption there is a call to get the range of values corresponding to the month. Running those independently:`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":129,"value":"myAnnualEnergyByMonth = {\n \n let energy = new my.Energy();\n let monthlyenergy = [];\n energy._token = 'resource_test';\n await energy.load();\n \n monthBoundaries.forEach((interval) => {\n let e = energy.range({from: interval.s.toISO(), to: interval.e.toISO() , interval: 1800000 });\n monthlyenergy.push({ source: e, count: e.count(), sum: e.sum(), min: e.min(), max: e.max(), mean: e.mean() });\n });\n\n return monthlyenergy; \n \n}","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":199,"value":"table(myAnnualEnergyByMonth.map((obj) => { \n let rObj = {};\n rObj.month = luxon.DateTime.fromMillis(obj.source.start).toISO();\n rObj.sum = obj.sum;\n rObj.count = obj.count;\n rObj.min = obj.min;\n rObj.max = obj.max; \n return rObj \n}), { title: \"Monthly consumption\"});","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":183,"value":"md`Zooming in to the 30min data, the effects of daylight savings can be seen in the time stamp. Choose a month to export for running Excel checks`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":185,"value":"viewof selectedMonth = slider({\n min: 0,\n max: 15,\n step: 1,\n value: 0,\n format: \",\",\n description:\n \"Select month number\"\n})","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":190,"value":"DOM.download(serialize(myAnnualEnergyByMonth[selectedMonth].source.data), \"month\"+selectedMonth, \"Download month CSV\")","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":222,"value":"table(myAnnualEnergyByMonth[selectedMonth].source.data.map((obj) => { \n let rObj = {};\n rObj.isotime = luxon.DateTime.fromMillis(obj[0]).toISO();\n rObj.zone = luxon.DateTime.fromMillis(obj[0]).zoneName;\n rObj.value = obj[1];\n return rObj \n}), {\n page: 86,\n title: \"Detailed consumption\"\n});","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":230,"value":"myAnnualEnergyByMonth[selectedMonth].source.data","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":260,"value":"md`The XML that communicates the rates from the meter is shown as:\n\n\\`\\`\\`xml\n \n 1\n \n 00:00:00.00Z\n 1\n \n \n 00:30:00.00Z\n 2\n \n \n 04:30:00.00Z\n 1\n \n \n\\`\\`\\`\n`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":266,"value":"md`Where as the Octopus API for the same meter indicate that the time if expressed in GMT/Z/UTC should change to 03:30Z when British Summer Time (BST) is in effect.\n\n\\`\\`\\`json\n {\n value_exc_vat: 4.76,\n value_inc_vat: 4.998,\n valid_from: \"2021-03-28T23:30:00Z\",\n valid_to: \"2021-03-29T03:30:00Z\"\n },\n {\n value_exc_vat: 13.45,\n value_inc_vat: 14.1225,\n valid_from: \"2021-03-28T03:30:00Z\",\n valid_to: \"2021-03-28T23:30:00Z\"\n },\n {\n value_exc_vat: 4.76,\n value_inc_vat: 4.998,\n valid_from: \"2021-03-28T00:30:00Z\",\n valid_to: \"2021-03-28T03:30:00Z\"\n },\n {\n value_exc_vat: 13.45,\n value_inc_vat: 14.1225,\n valid_from: \"2021-03-27T04:30:00Z\",\n valid_to: \"2021-03-28T00:30:00Z\"\n }\n \\`\\`\\`\n`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":271,"value":"md`the API is delivering the marketing promise:\n\n*The smart tariff with **super cheap electricity for 5p/kWh between 00:30 - 04:30 every night*** \n\nWhen BST is in effect, the start time of the peak tariff is 4:30am local time or 03:30 UTC and when GMT is in effect 4:30am or 04:30 UTC. Octopus is consistently publishing the time to correspond to the marketing and sales description, whereas the price on the smart meter is inconsistent with the marketing.`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":277,"value":"listOfProducts = {\n\n let suppliers = new my.Suppliers();\n await suppliers.load();\n \n let products = new my.Products();\n products.gsp = \"J\";\n products.setSuppliers(suppliers);\n await products.load();\n \n products.predictedEnergy = myAnnualEnergy;\n \n await products.loadtariffs();\n \n return products;\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":284,"value":"costs = { \n listOfProducts.tariffs.forEach((tariff) => { \n let cost = new my.Cost();\n cost.init({ energy: listOfProducts.predictedEnergy, tariff: tariff});\n console.log(cost);\n });\n}","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":9,"value":"luxon.DateTime.fromISO('2021-03-27T23:00:00Z')","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":89,"value":"myAnnualEnergy = {\n let energy = new my.Energy();\n energy._token = 'resource_test';\n await energy.load();\n return energy.range({from: '2020-02-01T00:00:00.000+00:00', to: '2021-03-01T00:00:00.000+00:00' , interval: 1800000 });\n}","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":174,"value":"import {serialize} from '@palewire/saving-csv'","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":85,"value":"my = require('https://bundle.run/stsc-tsc@1.0.13');","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":204,"value":"import {table} from '@tmcw/tables/2'","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":2,"value":"luxon = require(\"luxon/build/amd/luxon.js\")","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":187,"value":"import {slider} from \"@jashkenas/inputs\"","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"}],"files":"$W32","stdlib":"1","titling":"auto"}} 30:"$2f:body"