<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">ICA</journal-id><journal-title-group><journal-title>Intelligent Control and Automation</journal-title></journal-title-group><issn pub-type="epub">2153-0653</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ica.2019.104012</article-id><article-id pub-id-type="publisher-id">ICA-96574</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Personalized Thermal Comfort Model with Decision Tree
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Yuze</surname><given-names>Jiang</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Cushing Academy, Ashburnham, MA, USA</addr-line></aff><pub-date pub-type="epub"><day>16</day><month>10</month><year>2019</year></pub-date><volume>10</volume><issue>04</issue><fpage>168</fpage><lpage>177</lpage><history><date date-type="received"><day>29,</day>	<month>December</month>	<year>2018</year></date><date date-type="rev-recd"><day>23,</day>	<month>November</month>	<year>2019</year>	</date><date date-type="accepted"><day>26,</day>	<month>November</month>	<year>2019</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Thermal comfort is the expression of people’s satisfaction with the indoor temperature and is related to people’s working efficiency and health. In this way, it is necessary to construct a suitable environment for the user. However, even if adaptive thermal comfort has been developing rapidly for the past decades, most of the models are still developed based on simple statistical analysis such as regression models, which may not capture the complex relations between thermal comfort and the indoor thermal environment as well as differences between individual characteristics. Hence, in order to improve the accuracy of the adaptive thermal comfort model, this paper proposes a decision-tree-based thermal comfort model developed with the subset of the RP884 dataset. Then, a comfort-based HVAC controller was developed with the thermal sensation prediction results with the trained model above. As a result, the proposed controller indeed improves occupant’s thermal comfort model.
 
</p></abstract><kwd-group><kwd>Thermal Comfort</kwd><kwd> Decision Trees</kwd><kwd> HVAC</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Thermal comfort is the expression of people’s satisfaction with the indoor temperature and is related to people’s working efficiency and health. In this way, it is necessary to construct a suitable environment for the user. Thermal comfort is related to six factors, including indoor air temperature, indoor mean radiant temperature, airspeed, relative humidity, clothing insulation, and metabolic rate. Most of the existing HVAC systems are being operated with fixed schedules, pre-assumed occupant activities, pre-assumed clothing, and the assumption of the maximum number of occupants during the peak period. However, the fixed schedule is not good enough since they cannot reflect the dynamic situations and may result in inefficiency of HVAC operations. Therefore, the usage of responsive HVAC operations with real-time occupant related information is necessary and it is able to improve building performances, including energy savings and occupant comfort level. Lu et al. proposed the dynamic HVAC operations based on the number of occupants by occupant recognition with YOLO and taking both energy efficiency and thermal comfort into account and conducted an energy simulation to show the energy savings with the real-time occupant estimation system [<xref ref-type="bibr" rid="scirp.96574-ref1">1</xref>]. In addition, Bing Dong set up a large-scale sensor network to implement a nonlinear model predictive control [<xref ref-type="bibr" rid="scirp.96574-ref2">2</xref>]. Moreover, Zhao has developed and demonstrated the concept of Design-Build-Operate Energy Information Modeling (DBO-EIM) infrastructure, which involves occupant-oriented predictive building control for reducing energy consumption and maintaining occupant thermal comfort [<xref ref-type="bibr" rid="scirp.96574-ref3">3</xref>]. However, most of studies on dynamic HVAC operations apply static thermal comfort model into the control logics, which cannot represent dynamic conditions in the real built environment.</p><sec id="s1_1"><title>1.1. Static Thermal Comfort vs Adaptive Thermal Comfort</title><p>In the course of thermal comfort research, thermal sensation scale is used for quantifying occupants’ thermal sensation. The thermal sensation scale goes from “−3” to “3”. “−3” means the person feels very cold, and “3” means the complete opposite. In addition, thermal comfort models can be classified into mainly 2 categories. One is a static thermal comfort model and the other is an adaptive thermal comfort model.</p><p>In static thermal comfort model, predicted mean vote (PMV) is the most well-known model to predict and evaluate occupant thermal sensation in the indoor environment. The predicted mean vote was developed by Povl Ole Fanger at Kansas State University and the Technical University of Denmark as an empirical fit to the human sensation of thermal comfort [<xref ref-type="bibr" rid="scirp.96574-ref4">4</xref>]. The prediction of thermal comfort involves Fanger’s Equation:</p><p>P W V = [ 0.303 e − 0.036 M + 0 .028 ] { ( M − W ) − 3.96 E − 8 f c l [ ( t c l + 273 ) 4     − ( t r + 273 ) 4 ] − f c l h c ( t c l − t a ) − 3.05 [ 5.73 − 0 .007 ( M − W ) − p a ]     − 0 .42 [ ( M − W ) − 58.15 ] − 0.0173 M ( 5.87 − p a ) − 0.0014 M ( 34 − t a ) } (1)</p><p>where</p><p>PMV is predicted mean vote,</p><p>M is the metabolic rate, [met],</p><p>t<sub>a</sub> is the average indoor air temperature, [˚C].</p><p>In addition, PPD describes the percentage of dissatisfaction:</p><p>P P D = 100 − 95 e [ − ( 0.3353 P M V 4 + 0.2179 P M V 2 ) ] (2)</p></sec><sec id="s1_2"><title>1.2. Adaptive Thermal Comfort vs Adaptive Thermal Comfort</title><p>On the contrary, adaptive thermal comfort adapts to the differences between people, such as gender, age, and nationality. For instance, a bio-sensing mechanical system controls were developed based on the experiments regarding the relations between the individual thermal comfort and the skin temperature of different parts of the human body [<xref ref-type="bibr" rid="scirp.96574-ref5">5</xref>]. Moreover, one of the milestones in adaptive thermal comfort research is the development of the database called ASHRAE RP884 database [<xref ref-type="bibr" rid="scirp.96574-ref6">6</xref>]. The introduction to RP884 helps to examine the thermal sensation, acceptability, and preference.</p><p>Human-in-the-loop (HITL) is a model that requires human interaction. This can be simply interpreted by this project about thermal comfort. The Thermal Comfort is human’s feeling about an environment, which means there has to be someone responding every change in the environment. Human-in-the-loop is efficient in training a model, and it is able to attempt a possible outcome of a specific experiment. HITL is the only way that can reduce the human error in an experiment. Human can judge the process accurately compare to mechanic studies, so that it is necessary to use Human-in-the-loop. Recently, since human-machine interaction has been developed rapidly, researchers tend to focus on developing occupant-centric and intelligent system so as to shape the indoor temperature and humidity and provide comfortable environment. Among different occupant-centric control strategies, rule-based control is one of the simplest yet effective control logics. Rule-based control is a way of using domain knowledge to design the rules so that the system could automatically output the desired actions. The control can be easily used in the investigation of controlling human thermal comfort automatically by adjusting the thermal environment with feedbacks from occupants.</p><p>Moreover, many researchers in HVAC control has investigated much on reinforcement learning control (RL) recently. RL problems involve learning what to do—how to map situations to actions—so as to maximize a numerical reward signal [<xref ref-type="bibr" rid="scirp.96574-ref7">7</xref>]. Similar to rule-based control, reinforcement learning control is also a closed-loop control while it includes the learning process instead of existing rules based on domain knowledge. In occupant-centric control system with reinforcement learning, agent must be able to sense the state of the occupant sensation to some extent and must be able to take actions to affect the state. In addition, the agent must be inspired to reach the optimal occupant thermal comfort state by getting the largest rewards.</p></sec><sec id="s1_3"><title>1.3. Research Contributions</title><p>Even if adaptive thermal comfort has been developing rapidly for the past decades, most of the models are still developed based on simple statistical analysis such as regression models, which may not capture the complex relations between thermal comfort and the indoor thermal environment as well as differences between individual characteristics. Hence, in order to improve the accuracy of the adaptive thermal comfort model, this paper proposes a decision-tree-based thermal comfort model developed with the subset of the RP884 dataset. Then, a comfort-based HVAC controller was developed with the thermal sensation prediction results with the trained model above.</p></sec></sec><sec id="s2"><title>2. Methodology</title><sec id="s2_1"><title>2.1. Development of Thermal Comfort Model</title><p>In order to do the thermal comfort model, a cleaned dataset with responses from more than 5000 people is used in order to predict the model. The dataset is separated into training data and testing data to see if the model fits various people’s thermal comfort about a certain temperature. The control that used in this model is rule-based control, and that’s commonly used in the control system. Operators can store the model and allow it to be used. The control is related to the method that people can experience the most suitable thermal comfort without the need to control anything themselves. At the end of the project, the goal is to control over temperature set-point automatically.</p><sec id="s2_1_1"><title>2.1.1. Data Description</title><p>The original dataset of RP884 dataset [<xref ref-type="bibr" rid="scirp.96574-ref6">6</xref>] has numerous attributes such as gender, birthdate, time, and their subject number, etc. and over 22,000 sets of data. However, after feature selection and preprocessing, the dataset has been trimmed with the most relative attributes and recorded over 5000 responses. <xref ref-type="table" rid="table1">Table 1</xref> shows the selected attributes of the thermal comfort model and the label used in the development of thermal comfort model. In addition, the labels are recorded based on the thermal sensation scale, as shown in <xref ref-type="table" rid="table2">Table 2</xref>.</p></sec><sec id="s2_1_2"><title>2.1.2. Decision Tree Thermal Comfort Model</title><p>In the decision tree thermal-comfort model, tools such as scikit-learn, pandas and numpy have been used in order to train a suitable model. Scikit-learn is mainly for data mining and data analyzing and the method is built on numpy [<xref ref-type="bibr" rid="scirp.96574-ref8">8</xref>]. Pandas is an open source, BSD-licensed library providing high-performance, easy-to-use data structures and data analysis tools for the Python programming language. Numpy is the fundamental package for scientific computing with Python. It contains a powerful N-dimensional array object, sophisticated (broadcasting) functions, tools for integrating C/C++ and Fortran code, useful linear algebra, Fourier transform, and random number capabilities. These packages are fundamental programming tools in the construction of such statistical thermal comfort model. Decision Trees (DTs) are a non-parametric supervised learning method used for classification and regression. The goal is to create a model that predicts the value of a target variable by learning simple decision rules inferred from the data features [<xref ref-type="bibr" rid="scirp.96574-ref8">8</xref>].</p><p>Decision Trees has some advantages than other methods for classification. It’s easy to understand and interpret as the trees are visualized. The process is also less complicated with less preparation. The decision tree allows it to be possible</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> The feature used in the development of thermal comfort model</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Variable</th><th align="center" valign="middle" >Explanation</th></tr></thead><tr><td align="center" valign="middle" >ash</td><td align="center" valign="middle" >ASHRAE Thermal Sensation Scale</td></tr><tr><td align="center" valign="middle" >met</td><td align="center" valign="middle" >average metabolic rate of subject</td></tr><tr><td align="center" valign="middle" >insul</td><td align="center" valign="middle" >clothing plus upholstery insulation</td></tr><tr><td align="center" valign="middle" >taav</td><td align="center" valign="middle" >average of three heights’ air temperature</td></tr><tr><td align="center" valign="middle" >rh</td><td align="center" valign="middle" >relative humidity</td></tr><tr><td align="center" valign="middle" >dayav_ta</td><td align="center" valign="middle" >average outdoor air temperature</td></tr><tr><td align="center" valign="middle" >dayav_rh</td><td align="center" valign="middle" >outdoor air relative humidity</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Thermal sensation scale</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >−3</th><th align="center" valign="middle" >−2</th><th align="center" valign="middle" >−1</th><th align="center" valign="middle" >0</th><th align="center" valign="middle" >1</th><th align="center" valign="middle" >2</th><th align="center" valign="middle" >3</th></tr></thead><tr><td align="center" valign="middle" >Cold</td><td align="center" valign="middle" >Cool</td><td align="center" valign="middle" >Slightly Cool</td><td align="center" valign="middle" >Neutral</td><td align="center" valign="middle" >Slightly Warm</td><td align="center" valign="middle" >Warm</td><td align="center" valign="middle" >Hot</td></tr></tbody></table></table-wrap><p>to account for the reliability of the model with static test, and the decision trees always perform well. Nevertheless, disadvantages always campaign advantages to exist. It’s possible to overfit the decision tree so that the method does not run well to generate data. The decision tree is also unstable because of small variations in the data, so that a different tree can be possibly generated. There are also specific concepts hard to the decision trees to express. These are all the problems of decision trees. However, it’s the best suited method here in the investigation.</p><p>In order to learn decision tree, different criterions have been utilized to split the trees such as gini and entropy. Gini is commonly used in the classification and regression tree (CART). It measures how often a randomly chosen element from the set would be incorrectly labeled if it was randomly labeled according to the distribution of labels in the subset. On the other hand, information gain is also commonly used to find out the best features for splitting. Information gain measures how much “information” a feature gives us about the class, which consists of entropy, as shown below:</p><p>I ( Y , X i ) = H ( Y ) − H ( Y | X i ) (3)</p><p>where</p><p>I(Y, X<sub>i</sub>): Information gain between label Y and the instance X<sub>i</sub>.</p><p>H(Y): Entropy of Y.</p><p>H(Y|X<sub>i</sub>): Conditional entropy of Y given X<sub>i</sub>.</p><p>Decision tree algorithm is introduced to create a trained model for thermal comfort so that the program is able to predict the thermal comfort of a person by knowing the temperature, humidity, clothing insulation, etc. In this way, the temperature could be automatically changed to reach people’s thermal comfort. Unlike regression model, the thermal comfort model is a classification model where thermal sensation is the discrete classes.</p><p>Model Selection contains a process of cross-validation in order to find out the best model. Hyper-parameters are parameters that are not directly learnt within estimators. In scikit-learn they are passed as arguments to the constructor of the estimator classes. In our model, after 5-fold cross-validation, parameters such as max depth, criterion, are tuned so that the best model can be performed on the test data.</p></sec></sec><sec id="s2_2"><title>2.2. Comfort-Based Temperature Control</title><p>The rule-based control is to allow the program to control a thing depends on a rule provided, which is the comfort-based temperature rule here. With the rule, the temperature is going to keep increasing and decreasing until it reaches a comfortable temperature. The rule-based control is necessary as it’s a huge part in the automation of changing temperature to reach thermal comfort.</p><p>The following <xref ref-type="fig" rid="fig1">Figure 1</xref> describes the rule-based temperature set-point control logic, starting from the thermal sensation prediction from the trained thermal comfort model. In detail, the thermal comfort prediction first tests if the thermal comfort prediction equals 0, which is the comfortable state. If so, the temperature now is the thermal comfort temperature the operator wants. If the thermal comfort prediction is not equal 0, the temperature then goes into the controller and then goes into the actuator to change the value of the temperature. The next step is to test if the thermal comfort prediction of the new temperature is equal to 0. The same step happened again and again until a thermal comfort temperature is found or exited the loop after 1000 iterations.</p></sec></sec><sec id="s3"><title>3. Result Analysis</title><sec id="s3_1"><title>3.1. Evaluation of Thermal Comfort Model</title><p>&#183; parameter tuning</p><p>As shown in <xref ref-type="table" rid="table3">Table 3</xref>, the increasing value of max-depth generally increases the precision of the model and the default gini works better here than entropy. In addition, the best model has max depth of 9, gini criterion whose cross-validation score of 0.43.</p><p>The following <xref ref-type="table" rid="table4">Table 4</xref> shows the F1 score, recall and precision of the best model. Recall is that the true positive divided by the total actual positive. Precision is that the true positive divided by the total predicted positive. It talks about how precise your model is out of those predicted positive. F1 score is harmonic mean of recall and precision. It is used for seeking balance between recall and precision. The F1, recall and precision of this best model is 0.41, 0.49 and 0.43, respectively.</p><p>&#183; confusion matrix</p><p>Confusion matrix is a table that is used to describe the performance of a classification model on a set of test data for which the true values are known. From this confusion matrix of thermal sensation in <xref ref-type="fig" rid="fig2">Figure 2</xref>, it is found that majority of correct classifications comes from the predictions with the true label of 0, which is reasonable since only a few occupants complain about the indoor thermal environment.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Result of model selection</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >max_depth</th><th align="center" valign="middle" >criterion</th><th align="center" valign="middle" >cross-validation score</th><th align="center" valign="middle" >F1</th></tr></thead><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >entropy</td><td align="center" valign="middle" >0.35</td><td align="center" valign="middle" >0.36</td></tr><tr><td align="center" valign="middle" >9</td><td align="center" valign="middle" >entropy</td><td align="center" valign="middle" >0.35</td><td align="center" valign="middle" >0.37</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >gini</td><td align="center" valign="middle" >0.39</td><td align="center" valign="middle" >0.36</td></tr><tr><td align="center" valign="middle" >9</td><td align="center" valign="middle" >gini</td><td align="center" valign="middle" >0.43</td><td align="center" valign="middle" >0.41</td></tr><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >gini</td><td align="center" valign="middle" >0.41</td><td align="center" valign="middle" >0.38</td></tr><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >entropy</td><td align="center" valign="middle" >0.36</td><td align="center" valign="middle" >0.37</td></tr></tbody></table></table-wrap><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Performance of the best model</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >F1</th><th align="center" valign="middle" >recall</th><th align="center" valign="middle" >precision</th></tr></thead><tr><td align="center" valign="middle" >0.41</td><td align="center" valign="middle" >0.49</td><td align="center" valign="middle" >0.43</td></tr></tbody></table></table-wrap><p>As in the office environment, occupant thermal comfort is largely dependent on the changes of indoor air temperature since other factors like humidity, clothing insulation are usually steady. Therefore, it makes sense to select the temperature set-point as the controlled variable to adjust the indoor environment to adapt thermal comfort requirements.</p></sec><sec id="s3_2"><title>3.2. Demonstration of Rule-Based Temperature Control System</title><p>As discussed above, the inputs of the prediction model include the following variables: clothing insulation, temperature set-point, indoor relative humidity, outdoor air temperature, outdoor relative humidity and metabolic rate. Moreover, it is assumed the all variables except the indoor air temperature setpoint are fixed. Moreover, in order to show the control sequences with the proposed rule-based controller, the changes of temperature set-point with a starting state is shown below (<xref ref-type="table" rid="table5">Table 5</xref>).</p></sec></sec><sec id="s4"><title>4. Discussion</title><p>Beyond the work conducted in the paper, it is meaningful to explore in the following aspects to improve the controller’s performances:</p><p>&#183; The goal of ensemble methods is to combine the predictions of several base estimators. In that way, compared to the single model used in the paper, ensemble methods is more adapted to real life environment since the ensemble model improves the accuracy of predictions.</p><p>&#183; Joint control of temperature and humidity set-point is needed because humidity does change due to a lot of factors. For example, people need to breathe that increases vapor in air. In this way, temperature and humidity should be controlled at the same time. Using trained thermal comfort model, we are able to test if the specific temperature and humidity are suitable for people feeling comfortable.</p><p>&#183; Last but not least, compare to rule-based control, reinforcement learning control is smarter and more advanced. It is able to adapt more situations than rule-based control.</p></sec><sec id="s5"><title>5. Conclusions</title><p>This paper aims to propose and evaluate a comfort-based temperature set-point controller with a decision-tree based thermal comfort model. Based on the result and discussions, the following conclusions and future work can be drawn:</p><p>&#183; The model performed well in improving people’s thermal comfort. However, the precision is relatively low. It is expected that with more variables are imported into the model, the precision would grow higher than now.</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> Demonstration of the rule-based temperature set-point control sequence</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >sequence ID</th><th align="center" valign="middle" >clothing insulation [clo]</th><th align="center" valign="middle" >indoor temperature set-point [C]</th><th align="center" valign="middle" >indoor air relative humidity [%]</th><th align="center" valign="middle" >outdoor air temperature [C]</th><th align="center" valign="middle" >outdoor relative humidity [%]</th><th align="center" valign="middle" >metabolic rate [met]</th></tr></thead><tr><td align="center" valign="middle" >1 (starting state)</td><td align="center" valign="middle" >0.784</td><td align="center" valign="middle" >15</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >27.55</td><td align="center" valign="middle" >81.55</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.784</td><td align="center" valign="middle" >16</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >27.55</td><td align="center" valign="middle" >81.55</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0.784</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >27.55</td><td align="center" valign="middle" >81.55</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >4 (end state)</td><td align="center" valign="middle" >0.784</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >27.55</td><td align="center" valign="middle" >81.55</td><td align="center" valign="middle" >1</td></tr></tbody></table></table-wrap><p>&#183; With rule-based temperature set-point control, the system can adjust temperature automatically with the input of thermal comfort model prediction.</p></sec><sec id="s6"><title>Conflicts of Interest</title><p>The author declares no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s7"><title>Cite this paper</title><p>Jiang, Y.Z. (2019) Personalized Thermal Comfort Model with Decision Tree. Intelligent Control and Automation, 10, 168-177. https://doi.org/10.4236/ica.2019.104012</p></sec><sec id="s8"><title>Notation List</title><p>PMV: predicted mean vote</p><p>M: metabolic rate [met]</p><p>t<sub>a</sub>: average indoor air temperature, [˚C]</p><p>PPD: percentage of dissatisfaction</p><p>I(Y, X<sub>i</sub>): Information gain between label Y and the instance X<sub>i</sub></p><p>H(Y): Entropy of Y</p><p>H(Y|X<sub>i</sub>): Conditional entropy of Y given X<sub>i</sub></p></sec></body><back><ref-list><title>References</title><ref id="scirp.96574-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Lu, S., Hameen C.E. and Aziz, A. (2018) Dynamic HVAC Operations with Real-Time Vision-Based Occupant Recognition System. 2018 ASHRAE Winter Conference, 20-24 January 2018, Chicago.</mixed-citation></ref><ref id="scirp.96574-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Dong, B. (2010) Integrated Building Heating, Cooling and Ventilation Control. Ph.D. Thesis, Carnegie Mellon University, 1-174.</mixed-citation></ref><ref id="scirp.96574-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Zhao, J. (2015) Design-Build-Operate Energy Information Modeling for Occupant-Oriented Predictive Building Control.</mixed-citation></ref><ref id="scirp.96574-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Fanger, P.O. (1970) Thermal Comfort. Analysis and Applications in Environmental Engineering.</mixed-citation></ref><ref id="scirp.96574-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Choi, J.H. (2010) CoBi: Bio-Sensing Building Mechanical System Controls for Sustainably Enhancing Individual Thermal Comfort.</mixed-citation></ref><ref id="scirp.96574-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">De Dear, R.J., Brager, G.S., Reardon, J. and Nicol, F. (1998) Developing an Adaptive Model of Thermal Comfort and Preference/Discussion. ASHRAE Transactions, 104, 145.</mixed-citation></ref><ref id="scirp.96574-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Sutton, R.S. and Barto, A.G. (2018) Reinforcement Learning: An Introduction. MIT Press, Boston.</mixed-citation></ref><ref id="scirp.96574-ref8"><label>8</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Pedregosa</surname><given-names> et al. </given-names></name>,<etal>et al</etal>. (<year>2011</year>)<article-title>Scikit-Learn: Machine Learning in Python</article-title><source> JMLR</source><volume> 12</volume>,<fpage> 2825</fpage>-<lpage>2830</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref></ref-list></back></article>