25:["$","title",null,{"children":"CS7295 HW2 - Explore when City Hall uses most of the electricity in a day | Zhenyu Chen | Observable"}] 49:Td2e,### 2. define the users and the tasks #### Three example made-up insights with consideration 1. #### City Hall uses 10% more electricity in July and December compared to other months. #### Consideration For me to test this, I need to have enough data from City Hall electricity consumption all year round. I need each month's electricity consumption (quant) for at least 3 years. Then I need to calculate the average usage of electricity in each month and after that I need to calculate the average usage of electricity in the whole year. After that, I can see if this insight is correct. In terms of the visualization, I would need to display the average electricity usage in the whole year and provide a way of comparing July and Dec electricity usage again the overall average. I can use bar chart to display each month's electricity usage, a line chart to display the overall average and July & Dec's average. - User: Data Scientist / City Hall managers - Task: Compare the average electricity usage of July and Dec to the overall average electricity in a year. 2. #### City Hall use more and more electricity every year. #### Consideration For me to test this, I need to have enough data from City Hall electricity consumption for at least 3 years. Then I need to calculate the total usage of electricity in each year (quant) and see if the usage of electricity increased in each year. In terms of the visualization, I would need to display the each year's electricity usage and provide a way of comparing electricity usage in each year. I can use a line chart to display the electricity usage in different years and see how the line goes. - User: Data Scientist / City Hall managers - Task: Compare the each year's total electricity usage. 3. #### City Hall consumes most of the electricity in the afternoon. #### Consideration For me to test this, I need to have enough data from City Hall electricity consumption in different time for at least 1 year. For each month, I need to calculate the electricity usage(quant) in the morning (4-12pm), in the afternoon (12 - 8pm) and at night (8-4am). After that, I need to see if the afternoon electricity usage is the most of 3 time periods. In terms of the visualization, I would need to display the different time periods' electricity usage in each month and provide a way of comparing electricity usage in different time period. I can use bar chart to display each month's electricity usage, with different colors occupying the percentage of different time period. - User: Data Scientist / City Hall managers - Task: Compare different time period's electricity usage in each month throughout the whole year; Identify the time period that burns the most of electricity #### Conclusion I will choose the third insight to implement. #### Main Task - Visualize each month's electricity usage in bar chart - Differentiate different time period's electricity usage in different color - See which time period burns most of the electricity in a day **(Compare, trends/features)** #### Secondary Task - See if there is always a month that use most of the electricity in a year - If so, which month it is **(Identify, features/outliwea)** #### Target Audience City Hall's managers who are interested in city hall's expenses or those who are in charge of making budget for the coming year.4a:T428,### First Visualization Analysis My tasks: #### Main Task - Visualize each month's electricity usage in bar chart ✅ - Differentiate different time period's electricity usage in different color ✅ - See which time period burns most of the electricity in a day #### Secondary Task - See if there is always a month that use most of the electricity in a year ✅ - If so, which month it is ✅ In this visualization, I successfully visualized each month's electricity usage in bar chart and use different colors represent different time period. After see the bar chart, I can't really find a month that always burns more electricity than other months. So we can come to the conclusion that there is not always a month that use more electricity than others. Though we can see each month's electricity usage pretty well, it is still hard to compare the electricity usage in different time period since there is no significant difference between different-color bar. Hence, I need to use a new model to find out which time period uses more electricity.4b:T564,### Second Visualization Analysis I choose the grouped bar chart for the second visualization. In this chart, blue represents afternoon, orange represents morning and red represents night. It is very obvious that afternoon bar is almost always the highest with few exceptions. Therefore, I can say that city hall normally burns more electricity in the afternoon. ### Describe what are marks and channels, linking them to the tasks and data attributes you abstracted before. Explain why these marks and channels are the most expressive and effective choices. - Marks: Bar Lines; - Channels: Color, length; - Dataset type: table, temporal, static; - Dataset Attribute: Date(sequential ordering, ordinal); Electricity usage(quantitative); Time Period(Categorical); Link marks and channels to data attributes: Color represents time period; Length represents electricity usage; Different bar lines represents different dates. Why these marks and channels are good: Because I need to compare the electricity usage, I need a size channel to visualize that. I prefer the height channel because it is easier to observe. There are also three different time periods, so I need color or shape channel to visualize that. Since I chose the height channel, color works better in this case. And for date, different bar means different date. 4c:[{"id":"1ee98b6d56abbe93c5259e15adee7daf426daf10b54da6ec7c5ad153ed74990cb889dcbfc5bc870e76e21d6bf575fc894291640f4f9d7620a9094bb93e3cdcbc","href":"https://static.observableusercontent.com/files/1ee98b6d56abbe93c5259e15adee7daf426daf10b54da6ec7c5ad153ed74990cb889dcbfc5bc870e76e21d6bf575fc894291640f4f9d7620a9094bb93e3cdcbc","name":"tmpq6k6kydy.csv","type":"text/csv","lastModified":1675355892779.876,"size":2638455}] 29:{"id":"ba0a861f27891202","slug":null,"title":"CS7295 HW2 - Explore when City Hall uses most of the electricity in a day","thumbnail":"fc6184a28b2cfd7897b8794d030342b83a040dbff5a713b8688571c1530afb9b","access_level":"public","create_time":"$D2023-02-02T16:38:12.779Z","update_time":"$D2023-02-02T17:17:50.805Z","view_time":null,"first_public_time":"$D2023-02-02T16:38:12.779Z","has_unpublished_edits":null,"fork":{"id":"d29be3d2765866e7","slug":null,"title":"CS7295 HW2 - City Hall uses most of the electricity in the morning during the day","owner":{"id":"132517a03a3dd931","login":"lilyneu","name":"LilyLi"}},"stars":0,"starred":false,"owner":{"type":"team","id":"f9d2e396ea9c36e7","login":"zychen","name":"Zhenyu Chen","avatar_url":"https://avatars-next.observableusercontent.com/bd7f5338dd83e2af26a89fd5f8b3b8f2e371ac3333067f03ed98213201b91502","tier":"starter_2024","bio":"","followed_by_you":false,"follows_you":false},"version":222,"publish_version":null,"role":null,"authored":false,"authors":[{"type":"individual","id":"750bcf843c0f1afd","login":"zychen","name":"Zhenyu Chen","avatar_url":"https://avatars-next.observableusercontent.com/bd7f5338dd83e2af26a89fd5f8b3b8f2e371ac3333067f03ed98213201b91502","tier":null,"bio":"","followed_by_you":false,"follows_you":false}],"members":[{"type":"individual","id":"750bcf843c0f1afd","login":"zychen","name":"Zhenyu Chen","avatar_url":"https://avatars-next.observableusercontent.com/bd7f5338dd83e2af26a89fd5f8b3b8f2e371ac3333067f03ed98213201b91502","tier":null,"role":"editor"}],"comments":[{"id":"5f42ebeecdd96ccf","reply_to_id":null,"content":"Main task and secondary task should also follow the Actions + Target pattern, just like you did in Example Insights section.","create_time":"$D2023-02-02T17:13:51.103Z","update_time":null,"resolved":false,"user":{"type":"individual","id":"750bcf843c0f1afd","login":"zychen","name":"Zhenyu Chen","avatar_url":"https://avatars-next.observableusercontent.com/bd7f5338dd83e2af26a89fd5f8b3b8f2e371ac3333067f03ed98213201b91502","tier":null}}],"custom_thumbnail":false,"trashed":false,"lapsed":null,"subscribed":null,"forks":0,"collection":null,"type":"notebook","body":{"titling":"auto","title":"CS7295 HW2 - Explore when City Hall uses most of the electricity in a day","cells":[{"id":0,"value":"# CS7295 HW2 - Explore when City Hall uses most of the electricity in a day\n\nJiangyan Li","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":175,"value":"## 1. Find data\n\nI got dataset of City Hall electricity usage. [Dataset Link](https://data.boston.gov/dataset/city-hall-electricity-usage)\n\n### Data abstraction\n- Dataset type: table, temporal, static; \n- Data type: Date(sequential ordering, ordinal); Electricity usage(quantitative); Time Period(Categorical);\n\n### Original dataset analysis\nThe dataset contains lots of data points which has date time and total demand value. In order to make the dataset fit into my model, I need to convert it to a dataframe which has date as the key and the value needs to be an object which contains time period and electricity usage. I define morning is from 4am to 12pm, afternoon is from 12pm to 8pm and night is from 8pm to 4am.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":7,"value":"tmpq6k6kydy = await FileAttachment(\"tmpq6k6kydy.csv\").csv({typed: \"auto\"})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"tmpq6k6kydy","database":"$undefined"},{"id":8,"value":"rawData = FileAttachment(\"tmpq6k6kydy.csv\").csv({typed: true});","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":10,"value":"rawData","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":13,"value":"$49","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":35,"value":"// Import the vega-lite api\nimport {vl} from '@vega/vega-lite-api-v5'","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":40,"value":"import {printTable} from '@uwdata/data-utilities'","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":43,"value":"// have a look at the first 10 rows of data\nprintTable(rawData.slice(0,10));","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":70,"value":"dateSet = new Set();","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":49,"value":"// reformat data to {year/Month: {morning: number, afternoon: number, night: number}}\ndata = rawData.map(d => {\n const timeStamp = d[\"DateTime_Measured\"];\n const electricityUsage = d[\"Total_Demand_KW\"];\n\n const year = timeStamp.slice(0, 4);\n const month = timeStamp.slice(5, 7);\n const hour = parseInt(timeStamp.slice(11, 13));\n let timePeriod = null;\n\n // check if it is morning[4-12pm), afternoon[12-8pm) or night[8-4am)\n if (hour >= 4 && hour <12 ){\n timePeriod = 'morning';\n }else if (hour >= 12 && hour < 20){\n timePeriod = 'afternoon';\n }else{\n timePeriod = 'night';\n }\n \n const date = new Date(year, month);\n dateSet.add(date);\n\n return {date, timePeriod, electricityUsage}\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":63,"value":"// group the objects together with the same date and timePeriod in data\ngroupData = new Object;","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":75,"value":"dateSet.forEach(date => groupData[date] = {morning: 0, afternoon: 0, night: 0});","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":212,"value":"groupData","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":66,"value":"data.forEach(d =>{\n groupData[d['date']][d['timePeriod']] += d['electricityUsage'];\n});","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":87,"value":"// have a look at the groupData\ngroupData","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":94,"value":"df = []","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":112,"value":"Object.entries(groupData).forEach(([key, value])=>{\n // df.push({date: key, ...value, total: value['morning']+value['afternoon']+value['night']})\n df.push({date: key, type: 'morning', electricityUsage: value['morning']});\n df.push({date: key, type: 'afternoon', electricityUsage: value['afternoon']});\n df.push({date: key, type: 'night', electricityUsage: value['night']});\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":98,"value":"df","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":92,"value":"// visualiza the data using vega-lite stacked bar chart\nvl.markBar().width(900).height(600).data(df).encode(\n vl.y().aggregate('sum').title('KW').field('electricityUsage'),\n vl.x().timeUnit('yearmonth').field('date').title('Date'),\n vl.color().field('type')\n).render()","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":193,"value":"$4a","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":153,"value":"// visualize the data using vega-lite grouped bar chart\nvl.markBar().data(df).encode(\n vl.column().field(\"date\").timeUnit('yearmonth').header({'orient': 'bottom'}),\n vl.y().field('electricityUsage').type('quantitative'),\n vl.x().field('type').axis(null),\n vl.color().field('type')\n).render()","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":197,"value":"$4b","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":170,"value":"#### What is the real insight?\n\nIn my second visualization chart, we can see from November 2016 to April 2020, electricity usage in the afternoon (blue bar) is always the highest compared to the morning(orange bar) and night(red bar). So the real insight is that City Hall consumes more electricity in the afternoon. And in the first visualization chart, I thought City Hall will need more electricity in July and December because of the extreme heat and coldness. But unfortunately, we can't see that in the first chart. It seems the electricity usage is not related to the month.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"}],"files":"$W4c","stdlib":"1"}} 24:null