## AutoPV: Automatically Design Your Photovoltaic Power Forecasting Model

Dayin Chen, Xiaodan Shi , Mingkun Jiang, Haoran Zhang, ∗ Senior Member, IEEE, Dongxiao Zhang , ∗ Yuntian Chen, Member, IEEE, and Jinyue Yan ∗

Abstract -Photovoltaic power forecasting (PVPF) is a critical area in time series forecasting (TSF), enabling the efficient utilization of solar energy. With advancements in machine learning and deep learning, various models have been applied to PVPF tasks. However, constructing an optimal predictive architecture for specific PVPF tasks remains challenging, as it requires crossdomain knowledge and significant labor costs. To address this challenge, we introduce AutoPV, a novel framework for the automated search and construction of PVPF models based on neural architecture search (NAS) technology. We develop a brand new NAS search space that incorporates various data processing techniques from state-of-the-art (SOTA) TSF models and typical PVPF deep learning models. The effectiveness of AutoPV is evaluated on diverse PVPF tasks using a dataset from the Daqing Photovoltaic Station in China. Experimental results demonstrate that AutoPV can complete the predictive architecture construction process in a relatively short time, and the newly constructed architecture is superior to SOTA predefined models. This work bridges the gap in applying NAS to TSF problems, assisting nonexperts and industries in automatically designing effective PVPF models.

and non-controllable nature of PV power generation necessitates precise forecasting, which is crucial for maintaining grid balance and offering technical assistance during trading activities [1]. With the advent of deep learning, technologies such as Multi-Layer Perceptron (MLP) [2], Convolutional Neural Networks (CNN) [3], Long Short-Term Memory (LSTM) [4], and Temporal Convolutional Network (TCN) [5] have been extensively applied in the field of PVPF. Even in physics-based PVPF models, deep learning has been leveraged in various applications, such as enhancing numerical weather prediction (NWP) [6] and sky image analysis [7]. These advancements highlight the growing mainstream adoption of deep learning techniques in the field of PVPF.

Index Terms -Neural Architecture Search, AutoML, Photovoltaic power forecasting, Time series forecasting

## I. INTRODUCTION

P Hotovoltaic (PV) power forecasting (PVPF) involves predicting future PV power generation based on historical power data and corresponding weather features. The variable

As known to us, PVPF is inherently a time series forecasting (TSF) problem [8], which is a prominent area within data mining. The recent surge in transformer architectures [9] has led to the development of numerous transformer-based models such as informer [10], Autoformer [11], and FEDformer [12], which have demonstrated exceptional performance in TSF problems. Concurrently, several non-transformer-based TSF models, including DLinear [13] and TSMixer [14], have also been developed and shown strong performance. These typical TSF models have now started to be applied in the context of PVPF tasks as well.

- * Xiaodan Shi Dongxiao Zhang and Jinyue Yan are the corresponding authors.

Xiaodan Shi is with School of Business, Society and Technology, M¨ alardalens University, 72123 V¨ aster˚ as, Sweden; Center for Spatial Information Science, the University of Tokyo, 5-1-5 Kashiwanoha, Kashiwa-shi, Chiba 277-8568, Japan. E-mail: xiaodan.shi@mdu.se

Dayin Chen is with Department of Building Environment and Energy Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; International Centre of Urban Energy Nexus, The Hong Kong Polytechnic University, Hong Kong SAR, China; Research Institute for Smart Energy, The Hong Kong Polytechnic University, Hong Kong SAR, China; Eastern Institute for Advanced Study, Eastern Institute of Technology, Ningbo, China. E-mail: 23038748r@connect.polyu.hk

Mingkun Jiang is with PV Industry Innovation Center, State Power Investment Corporation, 710061 Xi'an, Shaanxi, China. E-mail: jiangmk spic@163.com

Dongxiao Zhang and Yuntian Chen are with Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo, China. E-mail: dzhang@eitech.edu.cn; ychen@eitech.edu.cn

Haoran Zhang is with School of Urban Planning and Design, Peking University, Shenzhen, China. E-mail: h.zhang@pku.edu.cn

Jinyue Yan is with Department of Building Environment and Energy Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; International Centre of Urban Energy Nexus, The Hong Kong Polytechnic University, Hong Kong SAR, China; Research Institute for Smart Energy, The Hong Kong Polytechnic University, Hong Kong SAR, China. E-mail: j-jerry.yan@polyu.edu.hk

Given the plethora of PVPF models available, a significant challenge lies in selecting an optimal model for a specific task. This issue is particularly challenging for non-experts and industries, as building a PVPF model requires expertise across multiple domains such as Energy Engineering and Computer Science. Factors including data granularity, data scale, and data distribution can significantly impact the final model design, thus making the model design process a non-trivial endeavor. A model that performs excellently on one task may not perform as well on another, which can lead to suboptimal decision-making and introduce various risks. Therefore, an efficient and automatic model search and construction strategy is essential in the current landscape of proliferating PVPF models.

Neural Architecture Search (NAS) [15] is an emerging technology aimed at automating the process of model structure discovery and design, which can address the aforementioned issue. It comprises three fundamental elements: the search space, the evaluator, and the search strategy. The search space encompasses a variety of module choices that can be assembled into a cohesive architecture. The search strategy employs a specific algorithm to navigate through and combine these modules, with the goal of identifying an optimal architecture.

Meanwhile, the evaluator is tasked with rating each generated architecture.

However, despite the significant advancements in NAS for many years, there has been limited exploration of NAS specifically for TSF tasks. Instead, most current NAS efforts are predominantly focused on visual tasks. This focus is largely due to the relatively straightforward nature of vision model components, such as convolutional and pooling layers, which lack complex interdependencies and can be seamlessly integrated with other standard modules, including linear layers, activation functions, and softmax layers. In contrast, TSF models are often cohesive, indivisible entities with distinct design principles. For instance, some TSF models employ seasonal-trend decomposition [11]-[13], [16], while others analyze data in the frequency domain [17], [18]. These models are designed from multiple and varied perspectives, making it challenging to decompose them into modular components that can be used to construct an effective search space.

In this study, we introduce AutoPV, a novel NAS system for the automated search and design of predictive architectures tailored to specific PVPF tasks. We construct a novel NAS search space that encompasses various typical data processing techniques from state-of-the-art (SOTA) TSF models, as well as the foundational deep learning models commonly used in PVPF tasks. This meticulously designed search space encompasses four different stages with twelve optional parameters, enabling the exploration of approximately 2 5 . × 10 6 potential architectures.

To evaluate the effectiveness of AutoPV, we designed two distinct PVPF tasks: one utilizing only historical data and the other incorporating future weather information. These tasks further encompass six sub-tasks with different forecasting lengths, ranging from half a day ahead to one month ahead. All the evaluation experiments were conducted using the dataset from the Daqing PV Station in China, covering the period from 2022 to 2023. Experimental results show that AutoPV exhibits outstanding performance across different PVPF tasks compared to other benchmarks. We believe this work could help bridge the gap in applying NAS to PVPF problems and potentially extend to TSF problems.

The principal contributions of this work are outlined as follows:

- 1) We construct a detailed knowledge graph and NAS search space for the domains of PVPF. This helps address the research gap in the automated design of effective PVPF models.
- 3) We conduct extensive experiments on a PV power dataset from the Daqing Photovoltaic Station in China to demonstrate the effectiveness of AutoPV across various PVPF tasks and provide a comprehensive analysis of its characteristics. Results show the new searched architecture improves performance by 4.52% compared to the best baseline model. Furthermore, when incorporating
- 2) Based on the constructed search space, we develop an automated PVPF model design system called AutoPV, which can assist non-experts in searching for effective models for specific PVPF tasks.

future weather information, it could boosts the improvement by 9.88%.

## II. RELATED WORK

## A. Photovoltaic Power Forecasting (PVPF)

PVPF tasks involve using historical PV power generation data along with weather information to model future PV power generation. Existing works involve a wide array of different models and also explore various forecasting lengths. For example, Gao et al. [4] use LSTM for day-ahead PV power prediction based on weather classification. Mellit et al. [3] evaluate short-term PVPF (less than 8 time steps ahead) using deep learning models like LSTM, GRU, and CNN. Li et al. [5] employ a TCN model for hours-ahead utility-scale PV forecasting. However, no single model has consistently outperformed others across different prediction scales or datasets. Efficiently designing an optimal model for a specific PVPF task remains a challenging problem.

## B. Time Series Forecasting (TSF) Models

The following content introduces two main architectural categories of TSF models.

Non-transformer-based Models. Although transformerbased structures are currently popular, their validity and necessity for TSF problems have been questioned by some researchers [13]. They maintain that non-transformer-based models can achieve equally good performance while having a lower computational burden. Typical non-Transformerbased models include DLinear [13], FreTS [17], MICN [21], TSMixer [14], and TimesNet [22], among others. These models employ various time series data processing methods, such as decomposition, multi-scale decomposition, and frequency domain analysis, to extract high-level information from the data. The extracted information is often projected to the output using a fully connected (FC) layer. These models have demonstrated superior performance on a variety of publicly available datasets.

Transformer-based Models. The core idea of the transformer [9] is to allow the model to dynamically focus on different parts of the input by computing attention scores. In recent years, to address the computational complexity of the vanilla transformer [9] and enhance performance, researchers have proposed numerous transformer variants [10]-[12], [16], [19], [20]. Among these, some variants such as Autoformer [11], Informer [10], FEDformer [10], iTransformer [20] and PatchTST [19] are specifically designed for TSF problems. These methods have made various modifications to the vanilla transformer from different perspectives, such as incorporating frequency domain information [12], dividing time tokens into patches [19], and introducing data decomposition [11], [16], to better capture the characteristics of time series data.

In recent years, a new approach of applying diffusion models to TSF has also emerged [23]. However, considering that the diffusion model is fundamentally different in principle from the other two types of methods (i.e., transformer-based models and non-transformer-based models), we have decided not to include diffusion models in the construction of the search space for this study.

## C. Neural Architecture Search (NAS)

NAS was first proposed by Google in the work [15], where they used recurrent neural networks (RNNs) and reinforcement learning to automatically search and construct an image classification model on the CIFAR-10 dataset. The search space included parameters such as the length, width, and stride of the convolution operations. In their follow-up work the next year [15], they refined the approach by searching the structure of a single cell and then repeating it multiple times to build the final network. While this method improved the search efficiency, it still required training on 500 GPUs for 4 days, which is a huge burden for most industries. Additionally, tuning the hyperparameters for the reinforcement learning process is also a complex and tedious task. This motivates people to seek more efficient search algorithm and certain specialized tricks to accelerate the search process of NAS.

One significant challenge in NAS is that most research efforts have focused on searching CV models, as the modules and operations in the CV search space generally do not have complex relationships or restrictions [29]. However, the need for automated network design extends to many other domains as well. In recent years, researchers have gradually explored the application of NAS to other areas, particularly by constructing domain-specific search spaces. For example, Seng et al. apply NAS to search for the federated architecture and hyperparameters in their work [30]. Wang et al. [31] use NAS to search the structure of transformer models for natural language processing (NLP) tasks. Additionally, Wang et al. [29] constructed a NAS search space based on five selected models for trajectory prediction.

Weight sharing is a typical improvement strategy which sharing weights among the different architectures [24]. However, the stability and effectiveness of this method have been questioned [25]. Beyond that, several studies have proposed different search strategies that eliminate the need for tedious hyperparameter tuning, such as evolutionary algorithm [26]. In the work [27], the BANANAS algorithm is introduced, which utilizes Bayesian optimization techniques to search for optimal architectures. Furthermore, in the work [28], the BANANAS algorithm has been extended for multi-objective optimization. This extension, referred to as MoBananas, has been demonstrated to outperform many other existing NAS search algorithms

To the best of our knowledge, there is limited prior work on extending NAS to the TSF or PVPF domain. In this study, we aim to address this gap by building a new search space and implementing an NAS system in the specific context of PVPF.

## III. METHODOLOGY

## A. Problem Description

PVPF. PVPF task can be formally defined as follows: The input is a time series of historical PV power data, denoted as X = { x , x 1 2 , . . . , x t } ∈ R T s × D , where x t represents the data sample at time t , T s is the length of the historical time series, and D is the dimensionality of each data point. A single data point comprises 1 dimension representing PV power generation data and ( D -1) dimensions corresponding to weather information features. The searched predictive model, M ( X ) , takes X as input and outputs a series of future PV power generation predictions, denoted as ˆ Y = { ˆ y t +1 , y ˆ t +2 , . . . , y ˆ t + n } ∈ R T p × 1 . Here, ˆ y t + n indicates the predicted value at step n in the future, and T p is the length of the predicted time series. Each data point in ˆ Y has only 1 dimension, representing the forecasted PV power generation.

Given the current availability of future weather information, in addition to the standard form of PVPF tasks, we have also designed another PVPF senario that utilizes future weather information, which is named PVPF Task 2. As depicted in Fig. 1, the future weather data is appended to the input historical sequence data along the time dimension. To handle the unknown future PV power data, we employ zero padding as a placeholder. In this case, the new input data length becomes T ′ s which equals T s + T p . In real-world scenarios, future weather information is typically obtained from weather reports, which can inherently contain biases. To account for these uncertainties, dynamic Gaussian noise is often added to the appended future weather data. The variance of this noise increases exponentially as the forecasting length grows longer.

NAS. NAS requires first building a search space, which we denote as S . By selecting modules from S , we can construct various PVPF architectures M . The overall goal of the NAS framework is to discover and construct an optimal architecture M ∗ that minimizes the future PV power prediction error. In this work, we uniformly use the L1 loss, also known as mean absolute error (MAE), as the training and evaluation criterion. Let the ground truth of PV power generation from t + 1 to t + n be Y = { y t +1 , y t +2 , . . . , y t + n } ∈ R T p × 1 . The objective function is then:

$$\mathcal { M } ^ { * } = & \arg \min _ { \mathcal { M } \in \mathbb { S } } M A E _ { \mathbb { D } _ { v a l } } ( \mathbf W ^ { * } _ { \mathcal { M } }, \mathcal { M } ) \\ s. t. & \quad W ^ { * } _ { \mathcal { M } } = & \arg \min _ { \mathbf W } \mathcal { L } _ { \mathbb { D } _ { t r a i n } } ( \mathbf W, \mathcal { M } ) \\ \dots & \quad \dots \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot$$

Where L D train ( W , M ) represents the training loss of the selected model M on the training dataset D train with the model parameters W .

## B. Search Space

The search space is the most critical component of the NAS framework. As detailed in Table I, we divide the overall AutoPV search space into four stages and employ a total of 12 parameters to describe the entire searched architecture. This encompasses the complete model-building and training pipeline, including feature selection, data processing, model construction, and training process settings. The optional modules in each stage are derived from either typical PVPF works or SOTA TSF models. To ensure that the constructed models remain relatively lightweight, we exclusively extract processing methods from non-transformer-based models to build our search space. Experimental results demonstrate that the models constructed using these simple modules can outperform predefined SOTA transformer-based models.

In the following sections, we illustrate each stage of the AutoPV search space in detail.

Fig. 1. The pipeline for leveraging AutoPV in PVPF tasks involves two distinct scenarios: PVPF Task 1, which utilizes only historical data series as input, and PVPF Task 2, which incorporates additional unstable future weather information. Zero padding is used to fill in the missing dimension of the future data. The AutoPV system comprises three main components: a search space, an evaluator, and a search strategy. Given a specific task type and dataset, AutoPV automatically searches for an optimal model architecture. This architecture can then directly perform the forecasting task, as the training process is completed during the architecture search.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-d2fef37c-0fee-430e-aa1b-dc45fa22b140.jpg)

TABLE I STAGES AND MODULES OF THE AUTOPV SEARCH SPACE

| Stage                               | Function Description                                                                                 | Operations or Parameters                                                                  | Typical Modules Extracted from Existed Works                                                                                                                                         |
|-------------------------------------|------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Stage 1: Feature Se- lection Stage  | Construct the optimal fea- ture set of the input data.                                               | Feature Selection Method (FSM)                                                            | FSM 1 : No Filter FSM 2 : mRMR [32] FSM 3 : Pearson Correlation [33]                                                                                                                 |
| Stage 1: Feature Se- lection Stage  | Construct the optimal fea- ture set of the input data.                                               | Feature Selection Threshold (FST)                                                         | FST 1 : 0.3 FST 2 : 0.4 FST 3 : 0.5                                                                                                                                                  |
| Stage 2: Data Pro- cessing Stage    | Process the data from dif- ferent perspectives before passing it to the core pre- dictive structure. | Data Generalization Method (DGM) Stationarization Method (SM) Feature Adding Method (FAM) | DGM 1 : None DGM 2 : Adding Gaussian Noise SM 1 : None SM 2 : RevIN [34] SM 3 : DAIN [35] FAM 1 : None FAM : Adding Time Features                                                    |
| Stage 2: Data Pro- cessing Stage    | Process the data from dif- ferent perspectives before passing it to the core pre- dictive structure. | Feature Extraction Method (FEM)                                                           | FEM 1 : None FEM 2 : Linear Embedding FEM 3 : Decomposition [11]-[13] FEM 4 : Multi-Scale Decomposition [21] FEM 5 : Time & Feature Mixing [14] FEM 6 : Frequency Domain Mixing [17] |
| Stage 3: Model Con- struction Stage | Build the core predictive structure of the designed architecture.                                    | Core Predictive Structure (CPS)                                                           | CPS 1 : LSTM CPS 2 : MLP (& linear) CPS 3 : CNN CPS 4 : TCN                                                                                                                          |
| Stage 3: Model Con- struction Stage | Build the core predictive structure of the designed architecture.                                    | Layer Number (LN)                                                                         | LN 1 : 1 LN 2 : 2 LN 3 : 3                                                                                                                                                           |
| Stage 3: Model Con- struction Stage | Build the core predictive structure of the designed architecture.                                    | Hidden Size (HS)                                                                          | HS 1 : 64 HS 2 : 128 HS 3 : 256 HS 4 : 512                                                                                                                                           |
| Stage 4: Model Training Stage       | Set the detailed training settings of the designed architecture.                                     | Learning Rate (LR)                                                                        | LR 1 : 0.0005 LR 2 : 0.001                                                                                                                                                           |
| Stage 4: Model Training Stage       | Set the detailed training settings of the designed architecture.                                     | Optimization Function (OF)                                                                | OF 1 : Adam OF 2 : SGD                                                                                                                                                               |
| Stage 4: Model Training Stage       | Set the detailed training settings of the designed architecture.                                     | Batch Size (BS)                                                                           | BS 1 : 32 BS 2 : 64                                                                                                                                                                  |

Stage 1: Feature Selection. In this initial stage, we refine the data by selecting relevant features, as including irrelevant ones can impair the model's effectiveness. We use two common feature selection methods (FSM) in the PVPF domain: Maximum Relevance and Minimum Redundancy (mRMR) [32], and Pearson Correlation [33]. The Pearson Correlation coefficient measures the linear association between a feature and the target variable, while mRMR evaluates both feature relevance and inter-feature redundancy. We also optimize the feature selection threshold (FST) for these methods, treating it as an additional hyperparameter.

Stage 2: Data Processing. In this phase, a series of pre-

processing operations are applied to the input data to prepare it for the core predictive model.

The first parameter, Data Generalization Method (DGM), determines whether Gaussian noise should be added to the original dataset. This technique is known for enhancing the model's training stability and generalization capability [36].

The second parameter involves two common Stationarization Methods (SM) to address distributional shifts. The first method, RevIN [34], is an adaptable instance normalization technique that normalizes the input data to a meancentered distribution before training. After training, RevIN uses a reverse denormalization procedure to restore the output

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-529b6f26-07ac-4228-a37f-82ea58c0bbfc.jpg)

Model

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-0a21d16e-788b-4581-ae0d-956db0f8dea5.jpg)

- (a) Forecasting process in typical TSF models
- (b) Forecasting process in AutoPV

Fig. 2. A minor modification in the core predictive structure of AutoPV. In typical TSF models, the forecasting results for all features are generated first, then the PV power sequence is selected. In contrast, the AutoPV framework adds a fully connected layer to aggregate all forecasting results of different features and generate the final PV power forecast.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-963c055f-6cac-48f2-adb3-81ef249b2be5.jpg)

Fig. 3. The detailed process of neural architecture search and construction. The FFM and FFT parameters determine the final feature set. The DGM, SM, and FAM parameters conduct data augmentation on the original data. Time embedding features can be optionally added at this stage. The FEM parameter extracts different types of information from the processed data. As an example, FEM 3 decomposes the data into trend and seasonal parts. The seasonal part is then input into the core predictive structure, which is decided by the CPS, LN, and HS parameters. The trend part is embedded by a fully connected (FC) layer and added to the output of the core predictive structure. For other FEM x methods that output only a single tensor, we process the tensor as the pipeline of the seasonal part. Finally, the loss value is calculated using the prediction output and the ground truth, which serves as the evaluation score. The BS, OP, and LR parameters decide the training settings of the overall architecture.

distribution to its original state. The second method, DAIN [35], employs nonlinear neural networks for dynamic adaptive normalization of the data series.

The methodologies corresponding to the entries in Table I are introduced as follows:

We also introduce the Feature Adding Method (FAM) parameter to determine whether to include additional timestamp embedding features. Time series data often exhibit seasonal and periodic variations, making it beneficial to derive predictive insights from timestamps. This kind of feature has been widely used in various transformer-based models, such as Transformer [9], Informer [10], and FEDformer [12].

The Feature Extraction Methods (FEM) parameter plays a crucial role in enhancing the learning efficacy of TSF models. Within our AutoPV search space, we incorporate a diverse array of feature extraction methods from well-established non-transformer-based TSF models to process the input data, thereby obtaining distinct high-level information. These feature extraction methods have demonstrated their efficiency and have been adapted and evolved within certain transformerbased architectures, leading to the creation of novel structures.

- · FEM 1 : This method leaves the data in its original state without applying any modifications.
- · FEM 3 : This method performs a seasonal-trend decomposition on the original time series, segregating it into trend and seasonal components that represent the longterm progression and cyclic patterns of the series, respectively. Such a technique is extensively utilized in several prominent models, including Autoformer [11], FEDformer [12], and DLinear [13]. Following their methodologies, we apply an additional FC layer to process the trend component, while the seasonal component is handled by the core predictive structure selected through
- · FEM 2 : This method employs a single linear layer to embed the input data. It is a common preprocessing step before introducing data into deep learning architectures such as LSTM, representing one of the simplest strategies for extracting multidimensional information.

our search. The outputs of these two components are then aggregated. Fig. 3 shows the complete process.

- · FEM 5 : Inspired by the TSMixer model [14], FEM 5 employs the MLPs on both the time and feature dimensions to integrate information. The similar concept has also been applied in the iTranformer [20].
- · FEM 4 : Unlike the FEM 3 approach, which employs a fixed-size moving average window for data decomposition, FEM 4 introduces a multi-scale hybrid decomposition block that employs multiple moving windows with varying kernel sizes. This approach, inspired by MICN [21], aims to capture a broader and more detailed range of patterns within the time series.
- · FEM 6 : FEM 6 is similar to FEM 5 , with the primary distinction being its application of MLPs in the frequency domain. Specifically, FEM 6 utilizes a frequency channel learner to model inter-series dependencies through a frequency-domain MLP applied across channel dimensions. Concurrently, a frequency temporal learner models temporal dependencies by applying a frequency-domain MLP across time dimensions. This method is from the FreTS model [17].

Stage 3: Model Construction Stage. In this stage, we focus on selecting a series of parameters to build the core predictive structure. We incorporate four of the most representative deep learning architectures commonly used in PVPF tasks: LSTM, MLP, CNN, and TCN. The choice of architecture is determined by the Core Predictive Structure (CPS) parameter. Additionally, the detailed structure is defined by the Layer Number (LN) and Hidden Size (HS), which are also essential components of our search space. It is important to note that within this framework, a 1-layer MLP is conceptualized as a linear layer.

Stage 4: Model Training Stage. This stage involves the calibration of several standard training parameters, including the Learning Rate (LR), Optimization Function (OF), and Batch Size (BS). To improve the search efficiency of the overall architecture, we have constrained the search range for these parameters.

Our AutoPV framework introduces a minor modification to the typical TSF architecture. As illustrated in Fig. 2, conventional TSF models typically generate the future sequence for all input features, with the sequence corresponding to PV power subsequently extracted as the final forecast result. Instead of directly extracting the PV power sequence, AutoPV incorporates an FC layer at the end to aggregate the forecasting results of all features. This design choice is motivated by the nature of the PVPF task, where all input features contribute to PV power generation. By aggregating information from all features, the AutoPV framework can better leverage the interdependencies between the features to produce a more accurate PV power forecast.

Other Hyper-parameters. In addition to the parameters such as layer number and hidden size discussed earlier, there are other hyper-parameters specific to certain modules in Stage 2 and Stage 3. To maintain the universality of the search space and enhance the efficiency of the search process, we assign standardized fixed values to these hyper-parameters.

The details of all fixed hyper-parameters are provided in the Appendix.

## C. Architecture Construction Pipeline

Fig. 3 illustrates the construction of the entire architecture using the 12 parameters defined within the search space. In the initial stage, the parameters FSM and FST execute an input selection operation across the feature dimensions. Subsequently, the DGM, SM, and FAM parameters implement a suite of data augmentation operations, including the addition of noise, data stationarization, and the incorporation of supplementary timestamp embedding features.

The next step involves the FEM parameter. Among the included methods, FEM 3 and FEM 4 decompose the original time series data into two separate streams, whereas FEM 5 and FEM 6 output a single data series with a modified shape. Taking FEM 3 as an example in Fig. 3, the seasonal component is fed into the core predictive structure which is constructed in the subsequent stage, while the trend component is processed by an FC layer. This processing method is based on prior researches that considers the trend component to exhibit relatively simple patterns that do not necessitate a complex model for processing. The outputs of these two components are then aggregated to reconstruct the original sequence. For other feature extraction methods that yield a single processed output, we treat it similarly to the seasonal component in Fig. 3 and omit the flow path for the trend component.

The core predictive structure is defined by the CPS, LN, and HS parameters. It is a straightforward deep learning model that accepts the seasonal component as input. As mentioned earlier, an additional FC layer is added to aggregate the forecasting results of all input features. The generated seasonal prediction result then is added with the trend prediction as the final output. To enhance clarity, all non-essential processes are depicted with dotted lines in Fig. 3.

Finally, the BS, OF, and LR parameters are searched and govern the overall training configuration of the architecture.

## D. Evaluator

Within the NAS framework, the evaluator is responsible for determining the efficacy of the architectures identified through the search process. In our AutoPV system, we assess the performance of an architecture based on its prediction error on the validation dataset.

Specifically, after a neural architecture is constructed, it is initially trained on the training dataset. Here we employ an early stopping strategy with a patience of 3 epochs to control the training process. Subsequently, the trained model is used to perform prediction on the validation dataset. The MAE across the entire validation dataset constitutes the final evaluation score, with a lower value indicating a superior architecture. This metric will be referred to as Measured Error in subsequent sections.

During this evaluation process, a hash map is maintained to prevent the redundant assessment of identical structures. This

helps improve the efficiency of the overall NAS framework by avoiding unnecessary re-evaluations.

Additionally, given the growing interest in device-dependent NAS [37], our evaluator also calculates and optimizes the number of parameters within the searched architecture. This aspect will be elaborated upon in the experimental section.

## E. Search Strategy

Architecture Encoding Method. The majority of existing NAS research treats the search space as a graph, employing an adjacency matrix representation or path encoding [27] to characterize different architectures. This is because these NAS frameworks are primarily tailored to CV tasks, which necessitate the flexible splicing, repetition, and skipping of modules. However, such encoding methods are meaningless to our search space, as the modules for TSF tasks cannot be arbitrarily combined as in visual tasks. Moreover, the option to omit operations (denoted as 'None' in the table) is already incorporated as a selectable module in specific stages, obviating the need to accommodate architectures of dynamic lengths.

Based on these considerations, we adopt a one-hot encoding sequence with a fixed length to represent each architecture. This encoding method enhances the efficiency of the search process and facilitates the inclusion of non-architectural hyperparameters such as learning rate and batch size [28].

MoBananas Search. To evaluate the effectiveness of the constructed search space, we employ the MoBananas algorithm [28] in this work to search for the optimal architecture while simultaneously maintaining a relatively small model scale. It is a multi-objective optimization variant of the Bananas algorithm [27], which utilizes Bayesian optimization to conduct an architecture search.

The MoBananas algorithm is characterized by three key innovative components. First, throughout the process of searching and evaluating different architectures, MoBananas trains a Deep Neural Network (DNN) predictor ˆ f , which is capable of forecasting the performance of new architectures. Second, MoBananas selects the top k p parent architectures for mutation by employing non-dominated sorting [38]. The third innovation is the application of Thompson Sampling [39] by MoBananas to choose the subsequent generation from a pool of new candidate individuals. The comprehensive procedure of MoBananas Search is detailed in Algorithm 1. To save space, we do not repeat the whole process in the main text.

## IV. EXPERIMENTS

## A. Experimental Setup

Datasets. The dataset used in this paper is collected from a PV array located in Daqing city, China. Each data point in the dataset contains 11 dimensions, including PV power output, solar irradiation, wind speed, humidity, and other relevant weather parameters. The data was recorded from August 1, 2022 to October 28, 2023, with a sampling frequency of 1 minute, resulting in a total of 612,059 data points. However,

## Algorithm 1 MoBananas Search

Input: k ini , k p , p m , k m , k l , T max , ˆ f

- 2: Evaluate the initial individuals
- 1: Randomly initialize the population with size of k ini
- 3: repeat
- 5: Sort the population using non-dominated sorting
- 4: Train the predictor ˆ f
- 6: Select the top k p parents
- 8: Evaluate new individuals with predictor ˆ f
- 7: Mutate for k m times with the probability of p m
- 9: Select k l individuals using Thompson Sampling
- 11: until reach maximal iteration number T max
- 10: Evaluate and add the k l individuals into the population

the original dataset contained some missing values and outliers. To address these issues, we performed the following data cleaning and completion procedures:

- · Data Deletion : We first group the data by day. The following two cases of daily recordings are considered abnormal, and the entire day's recordings will be removed: 1) the ratio of missing values and zero values in a given day exceeds 0.8; 2) the same outlier occurs ten or more times consecutively in one day.
- · Data Insertion : For the remaining days of recording in the dataset, we first set the recorded values with timestamps between 21:00 and 24:00, as well as those between 0:00 and 3:00, to 0. This is because there is no solar irradiation during these periods throughout the entire year. Next, starting from one side, for each missing data point, we apply a moving average window of size 3 to calculate the average of the surrounding non-missing values. We then use this average value to impute the missing data.

Following data cleaning and imputation, we retain a complete dataset encompassing 369 days, totaling 8,856 samples. To make the variations between data points more pronounced and to improve the meaningfulness of short-term predictions, we down-sample the original dataset to a resolution of one sample per hour. Detailed information regarding this dataset is presented in Table II.

We partition the dataset in a 6:2:2 ratio. Specifically, the initial 60% of the dataset is allocated for training, the subsequent 20% for validation, and the final 20% for testing. Each training sample was segmented using a sliding window approach, with a window size of ( T s + T p ) and a step size of 1. We ensured that the ( T s + T p ) values within each sample were continuous in time by skipping any discontinuous parts during the sampling process. The first T s data points within each window serve as the historical sequence for input, while the subsequent T p data points represent the actual future PV power output, serving as the ground truth.

## B. Evaluation Metrics

Two evaluation metrics are employed in the experiments: MAE as shown in Eq. 2 and weighted mean absolute percentage error (WMAPE) as shown in Eq. 3. The reason why we do

TABLE II

THE DETAILED INFORMATION OF THE ORIGINAL DATASET AND THE DATASET AFTER PREPROCESSING.

|                                                                     | Original Dataset                                                                                                                                        | Preprocessed Dataset           |
|---------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------|
| Data Granularity                                                    | minute                                                                                                                                                  | hour                           |
| Sample Size                                                         | 612059                                                                                                                                                  | 8856                           |
| Number of Days Included                                             | 454                                                                                                                                                     | 369                            |
| Specification Feature Information Feature Number Time Span Location | 210mm PERC Bifacial Module (Power: 590W, Conversion Efficiency: 20.8%) PV power generation and the corresponding weather information 2022-08-01 Daqing, | 2023-10-28 Heilongjiang, China |

not use the standard mean absolute percentage error (MAPE) metric is that the PV power dataset contained numerous small values, which would lead a to a significant impact on the evaluation result. In these two equations, ˆ Y represents the prediction results, and Y denotes the ground truth.

$$M A E ( \hat { \mathbf Y }, \mathbf Y ) & = \frac { 1 } { N } \sum _ { n = 1 } ^ { N } | \hat { y } _ { n } - y _ { n } | \quad \quad ( 2 ) \quad \stackrel { \xi ^ { 0. \infty } } { 0. 2 8 } | \\ & \quad \longrightarrow N \quad.. \quad.$$

$$\ W M A P E ( \hat { \boldsymbol Y }, \boldsymbol Y ) & = \frac { \sum _ { n = 1 } ^ { N } w _ { n } \left | \hat { y } _ { n } - y _ { n } \right | } { \sum _ { n = 1 } ^ { N } w _ { n } \left | y _ { n } \right | } \quad \text{fig. 4.} \\ w _ { n } & = \left | y _ { n } \right | \\ \overset { \circ. \infty } { \underset { \underset { \underset { \underset { \underset { \neq n } { \geq n } } } } } } \right |$$

## C. Performance Evaluation

The effectiveness of the AutoPV framework is evaluated on both PVPF Task 1 and PVPF Task 2, as described in Section III-A and illustrated in Fig. 1. For each task, six different sub-tasks with varying forecasting lengths are defined: 12-step (half-day) ahead forecasting, 24-step (one-day) ahead forecasting, 48-step (two-day) ahead forecasting, 72step (three-day) ahead forecasting, 168-step (one-week) ahead forecasting, and 336-step (one-month) ahead forecasting. To facilitate the discussion, we will refer to these sub-tasks as DQH-12, DQH-24, DQH-48, DQH-72, DQH-168, and DQH336, respectively. The historical data sequence length for all sub-tasks is fixed at 96.

Search Efficiency Visualization. In our search experiments, all hyperparameters for the MoBananas algorithm are set as follows: k ini = 10 , k p = 10 , p m = 0 2 . , k m = 5 , k l = 10 , T max = 120 . Each search task is executed on an NVIDIA RTX 3090 GPU. Fig. 4 illustrates the entire architecture search process, where the ordinate represents the measured error of the optimal model at each iteration. The results indicate that most search tasks could converge at around 70 iterations. By comparing the search results of PVPF Task 1 and PVPF Task 2, we observe that incorporating future weather information significantly reduces the measured error of the predictive architecture.

Fig. 5 presents the average search time per iteration and the total wall time required to find the optimal architecture across different PVPF tasks. Due to the increased input size from integrating future weather data, PVPF Task 2 requires more time for each iteration of search and evaluation. On average, the AutoPV system takes 6.42 hours to construct an optimal forecasting architecture for a specific task. This time

Fig. 4. Search performance of different PVPF tasks.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-cfc9ca8a-8e44-47a9-ac02-c1e259334a18.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-0a31f758-9a30-4e73-8745-11969a55c987.jpg)

Fig. 5. The average search time of each iteration and the search wall time for finding the optimal architecture across different PVPF tasks.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-5b2780a5-1e2e-4876-9127-f199cd6291f9.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-e3857216-0014-456b-a683-ea14a65bdf74.jpg)

can be further reduced in practice by increasing computational resources and reducing the dataset size.

In the Appendix, we also demonstrate the multi-objective optimization process for different search tasks. In each iteration, the system constructs an optimal architecture set, known as the Pareto Frontier, which includes architectures that either exhibit good forecasting performance or have a small model scale. The results show that as the search progresses, the optimal architectures consistently move towards smaller scales and higher performance. In practical applications, a suitable architecture can be selected from the final Pareto Frontier based on the constraints imposed by the computing hardware.

Baselines Comparison. In this experiment, we select the architecture with the highest performance score (i.e., the lowest measured error) from the final Pareto frontier of each task as the result architecture of AutoPV for evaluation. This selected architecture is then compared with 13 wellrecognized baseline forecasting models, which include: (1) Basic PVPF deep learning models: LSTM, MLP, CNN, and TCN; (2) Transformer-based models: Transformer, Autoformer, Informer, FEDformer, iTransformer and PatchTST; (3) Nontransformer-based models: DLinear, TimesNet and TSMixer.

TABLE III

EVALUATION RESULTS OF AUTOPV AND ALL SELECTED BENCHMARKS FOR PVPF TASK 1 (USING HISTORICAL INFORMATION ONLY). THE INPUT SEQUENCE LENGTH IS FIXED AS 96 AND THE PREDICTION LENGTHS ARE SET AS DIFFERENT VALUES. EACH EXPERIMENT IS CONDUCTED 5 TIMES. THE BEST RESULT IS HIGHLIGHTED IN BOLD , AND THE SECOND IS HIGHLIGHTED IN BLUE.

| Task         | DQH-12 (Half Day)   | DQH-12 (Half Day)   | DQH-24 (One Day)   | DQH-24 (One Day)   | DQH-48 (Two Days)   | DQH-48 (Two Days)   | DQH-72 (Three Days)   | DQH-72 (Three Days)   | DQH-168 (One Week)   | DQH-168 (One Week)   | DQH-336 (One Month)   | DQH-336 (One Month)   |
|--------------|---------------------|---------------------|--------------------|--------------------|---------------------|---------------------|-----------------------|-----------------------|----------------------|----------------------|-----------------------|-----------------------|
| Model        | MAE                 | WMAPE               | MAE                | WMAPE              | MAE                 | WMAPE               | MAE                   | WMAPE                 | MAE                  | WMAPE                | MAE                   | WMAPE                 |
| LSTM         | 105.887 ± 2.735     | 0.209 ± 0.013       | 109.887 ± 4.065    | 0.221 ± 0.006      | 111.591 ± 3.512     | 0.228 ± 0.007       | 116.816 ± 3.431       | 0.240 ± 0.018         | 112.305 ± 1.715      | 0.212 ± 0.006        | 110.623 ± 7.149       | 0.220 ± 0.011         |
| MLP          | 100.150 ± 1.107     | 0.213 ± 0.009       | 105.954 ± 1.470    | 0.209 ± 0.007      | 110.332 ± 0.851     | 0.220 ± 0.010       | 112.153 ± 0.808       | 0.212 ± 0.007         | 107.169 ± 1.238      | 0.192 ± 0.003        | 133.864 ± 1.798       | 0.291 ± 0.006         |
| CNN          | 102.533 ± 3.384     | 0.204 ± 0.005       | 109.660 ± 1.681    | 0.213 ± 0.013      | 110.795 ± 1.305     | 0.214 ± 0.010       | 110.886 ± 3.883       | 0.218 ± 0.017         | 101.103 ± 0.891      | 0.183 ± 0.011        | 119.530 ± 17.926      | 0.281 ± 0.060         |
| TCN          | 150.795 ± 2.653     | 0.242 ± 0.010       | 155.708 ± 12.393   | 0.260 ± 0.008      | 163.646 ± 3.901     | 0.300 ± 0.007       | 170.357 ± 5.770       | 0.313 ± 0.003         | 194.609 ± 15.946     | 0.312 ± 0.018        | 313.508 ± 71.918      | 0.351 ± 0.042         |
| Transformer  | 104.367 ± 4.023     | 0.242 ± 0.009       | 110.051 ± 2.011    | 0.229 ± 0.006      | 114.694 ± 5.927     | 0.258 ± 0.017       | 107.583 ± 2.680       | 0.234 ± 0.016         | 107.845 ± 7.811      | 0.229 ± 0.034        | 266.176 ± 2.116       | 0.959 ± 0.015         |
| Autoformer   | 119.560 ± 1.709     | 0.234 ± 0.009       | 126.347 ± 4.861    | 0.248 ± 0.035      | 121.435 ± 3.529     | 0.222 ± 0.022       | 128.120 ± 8.409       | 0.231 ± 0.044         | 126.358 ± 4.698      | 0.219 ± 0.014        | 123.926 ± 10.835      | 0.236 ± 0.029         |
| Informer     | 130.250 ± 14.545    | 0.299 ± 0.037       | 117.671 ± 4.778    | 0.258 ± 0.023      | 123.558 ± 3.572     | 0.257 ± 0.012       | 126.003 ± 4.208       | 0.293 ± 0.021         | 176.166 ± 23.971     | 0.546 ± 0.127        | 263.370 ± 1.636       | 0.949 ± 0.022         |
| FEDformer    | 113.977 ± 3.710     | 0.217 ± 0.008       | 113.124 ± 1.663    | 0.202 ± 0.006      | 118.267 ± 2.329     | 0.198 ± 0.012       | 119.534 ± 3.887       | 0.191 ± 0.003         | 117.769 ± 4.496      | 0.182 ± 0.007        | 110.853 ± 13.213      | 0.201 ± 0.043         |
| iTransformer | 109.782 ± 1.632     | 0.254 ± 0.012       | 111.457 ± 1.788    | 0.248 ± 0.008      | 112.982 ± 1.086     | 0.238 ± 0.015       | 113.158 ± 0.727       | 0.225 ± 0.006         | 109.275 ± 1.324      | 0.198 ± 0.003        | 96.035 ± 0.701        | 0.173 ± 0.002         |
| PatchTST     | 104.774 ± 3.070     | 0.235 ± 0.008       | 106.689 ± 4.426    | 0.243 ± 0.026      | 110.472 ± 4.456     | 0.258 ± 0.012       | 108.260 ± 2.974       | 0.219 ± 0.018         | 108.750 ± 4.896      | 0.220 ± 0.022        | 102.828 ± 3.663       | 0.196 ± 0.015         |
| TimesNet     | 106.745 ± 2.467     | 0.265 ± 0.003       | 108.891 ± 3.191    | 0.270 ± 0.018      | 111.237 ± 2.051     | 0.259 ± 0.010       | 113.144 ± 4.094       | 0.261 ± 0.028         | 113.493 ± 3.783      | 0.256 ± 0.029        | 108.738 ± 11.966      | 0.255 ± 0.042         |
| DLinear      | 99.975 ± 0.454      | 0.260 ± 0.001       | 100.289 ± 0.567    | 0.268 ± 0.001      | 105.746 ± 0.625     | 0.270 ± 0.000       | 107.764 ± 0.206       | 0.264 ± 0.000         | 102.819 ± 0.304      | 0.223 ± 0.000        | 107.077 ± 2.675       | 0.246 ± 0.012         |
| TSMixer      | 95.888 ± 1.797      | 0.197 ± 0.008       | 98.980 ± 1.424     | 0.196 ± 0.004      | 104.834 ± 0.292     | 0.195 ± 0.005       | 106.230 ± 2.010       | 0.193 ± 0.010         | 107.009 ± 2.829      | 0.186 ± 0.010        | 136.102 ± 22.298      | 0.292 ± 0.065         |
| AutoPV       | 89.865 1.418        | 0.178 0.003         | 94.887 1.160       | 0.206 0.014        | 102.869 1.502       | 0.179 0.007         | 105.084 1.549         | 0.199 0.015           | 100.508 1.155        | 0.180 0.007          | 102.287 2.158         | 0.232 0.009           |

±

±

±

±

±

±

±

±

±

±

±

±

## TABLE IV

EVALUATION RESULTS OF AUTOPV AND ALL SELECTED BENCHMARKS FOR PVPF TASK 2 (WITH FUTURE WEATHER INFORMATION). THE INPUT SEQUENCE LENGTH IS FIXED AS 96 AND THE PREDICTION LENGTHS ARE SET AS DIFFERENT VALUES. EACH EXPERIMENT IS CONDUCTED 5 TIMES. THE BEST RESULT IS HIGHLIGHTED IN BOLD , AND THE SECOND IS HIGHLIGHTED IN BLUE.

| Task         | DQH-12 (Half Day)   | DQH-12 (Half Day)   | DQH-24 (One Day)   | DQH-24 (One Day)   | DQH-48 (Two Days)   | DQH-48 (Two Days)   | DQH-72 (Three Days)   | DQH-72 (Three Days)   | DQH-168 (One Week)   | DQH-168 (One Week)   | DQH-336 (One Month)   | DQH-336 (One Month)   |
|--------------|---------------------|---------------------|--------------------|--------------------|---------------------|---------------------|-----------------------|-----------------------|----------------------|----------------------|-----------------------|-----------------------|
| Model        | MAE                 | WMAPE               | MAE                | WMAPE              | MAE                 | WMAPE               | MAE                   | WMAPE                 | MAE                  | WMAPE                | MAE                   | WMAPE                 |
| LSTM         | 60.047 ± 1.152      | 0.149 ± 0.008       | 56.689 ± 0.687     | 0.139 ± 0.003      | 55.758 ± 0.435      | 0.132 ± 0.002       | 54.132 ± 1.409        | 0.127 ± 0.004         | 52.831 ± 1.657       | 0.113 ± 0.003        | 79.336 ± 1.589        | 0.129 ± 0.003         |
| MLP          | 66.555 ± 1.206      | 0.152 ± 0.003       | 63.700 ± 0.829     | 0.147 ± 0.002      | 63.889 ± 1.585      | 0.142 ± 0.003       | 67.973 ± 1.753        | 0.146 ± 0.004         | 72.463 ± 1.462       | 0.152 ± 0.002        | 92.405 ± 6.545        | 0.154 ± 0.014         |
| CNN          | 65.839 ± 1.727      | 0.154 ± 0.003       | 61.296 ± 0.820     | 0.148 ± 0.002      | 58.680 ± 0.717      | 0.139 ± 0.002       | 57.582 ± 0.875        | 0.138 ± 0.003         | 56.961 ± 1.226       | 0.126 ± 0.002        | 76.315 ± 1.680        | 0.130 ± 0.003         |
| TCN          | 104.235 ± 3.114     | 0.189 ± 0.005       | 91.892 ± 2.068     | 0.182 ± 0.003      | 85.015 ± 2.030      | 0.175 ± 0.002       | 80.460 ± 0.693        | 0.170 ± 0.002         | 93.282 ± 9.748       | 0.163 ± 0.006        | 1758.367 ± 143.650    | 1.864 ± 0.179         |
| Transformer  | 76.503 ± 5.776      | 0.183 ± 0.017       | 71.331 ± 3.263     | 0.180 ± 0.005      | 65.233 ± 1.971      | 0.162 ± 0.010       | 79.034 ± 17.013       | 0.180 ± 0.028         | 105.644 ± 26.242     | 0.246 ± 0.070        | 231.193 ± 64.070      | 0.795 ± 0.295         |
| Autoformer   | 87.423 ± 6.473      | 0.187 ± 0.008       | 96.632 ± 4.223     | 0.248 ± 0.035      | 106.222 ± 12.879    | 0.201 ± 0.016       | 106.778 ± 10.874      | 0.212 ± 0.018         | 105.826 ± 4.426      | 0.184 ± 0.012        | 96.595 ± 13.050       | 0.180 ± 0.043         |
| Informer     | 84.727 ± 8.453      | 0.203 ± 0.025       | 76.643 ± 2.796     | 0.202 ± 0.006      | 78.749 ± 2.848      | 0.205 ± 0.007       | 98.813 ± 32.636       | 0.276 ± 0.125         | 209.240 ± 44.571     | 0.774 ± 0.247        | 263.331 ± 2.248       | 0.950 ± 0.008         |
| FEDformer    | 82.617 ± 5.005      | 0.172 ± 0.008       | 83.332 ± 2.287     | 0.167 ± 0.007      | 88.092 ± 6.028      | 0.170 ± 0.006       | 92.605 ± 4.601        | 0.180 ± 0.008         | 105.320 ± 2.501      | 0.189 ± 0.007        | 136.953 ± 50.086      | 0.347 ± 0.220         |
| iTransformer | 73.102 ± 2.296      | 0.179 ± 0.005       | 69.644 ± 1.371     | 0.170 ± 0.003      | 65.071 ± 0.408      | 0.153 ± 0.002       | 65.751 ± 1.660        | 0.151 ± 0.002         | 66.641 ± 1.035       | 0.145 ± 0.003        | 113.858 ± 8.923       | 0.222 ± 0.034         |
| PatchTST     | 104.500 ± 4.728     | 0.233 ± 0.007       | 102.964 ± 1.600    | 0.227 ± 0.009      | 108.040 ± 3.738     | 0.224 ± 0.020       | 108.285 ± 2.685       | 0.229 ± 0.023         | 110.355 ± 1.538      | 0.216 ± 0.009        | 112.741 ± 11.564      | 0.211 ± 0.031         |
| TimesNet     | 71.038 ± 3.431      | 0.177 ± 0.010       | 65.703 ± 6.692     | 0.167 ± 0.016      | 59.014 ± 2.341      | 0.147 ± 0.013       | 60.839 ± 2.073        | 0.145 ± 0.004         | 58.973 ± 3.392       | 0.141 ± 0.011        | 108.738 ± 11.966      | 0.255 ± 0.042         |
| DLinear      | 100.279 ± 0.913     | 0.262 ± 0.002       | 100.199 ± 0.390    | 0.268 ± 0.001      | 105.236 ± 0.409     | 0.271 ± 0.000       | 107.233 ± 0.240       | 0.265 ± 0.001         | 103.352 ± 0.389      | 0.223 ± 0.000        | 108.505 ± 1.777       | 0.252 ± 0.006         |
| TSMixer      | 65.670 ± 2.994      | 0.158 ± 0.009       | 63.341 ± 1.809     | 0.145 ± 0.004      | 60.722 ± 0.284      | 0.138 ± 0.002       | 60.091 ± 0.992        | 0.136 ± 0.003         | 63.335 ± 2.235       | 0.130 ± 0.004        | 84.873 ± 6.073        | 0.147 ± 0.016         |
| AutoPV       | 57.405 1.306        | 0.140 0.004         | 54.607 0.436       | 0.135 0.003        | 51.582 0.719        | 0.128 0.003         | 50.109 0.531          | 0.121 0.002           | 51.118 1.221         | 0.124 0.004          | 58.525 3.214          | 0.117 0.004           |

±

±

±

±

±

±

±

±

±

±

±

±

The implementation of the models refers to the Time Series Library [40].

For all evaluated benchmarks, the learning rate is set to 0.001, the optimizer used is Adam, and the batch size is 64. Each of the four basic deep learning models has 3 layers with a hidden size of 512. All transformer-based models also have 3 layers, consisting of 2 encoder layers and 1 decoder layer, with a model dimension fixed at 512. It is important to note that some TSF models, particularly the transformer-based models, require setting a portion of the historical sequence as the labeled sequence. For these models, the length of the labeled sequence is set to 48.

especially in short-term and medium-term prediction tasks. This help to suggest that constructing the PVPF search space based on non-Transformer models is reasonable and feasible. Regarding the long-term forecasting tasks (DQH-168 and DQH-336), the latest Transformer variants, PatchTST and iTransformer, begin to show performance advantages, likely because transformer-based models are better at handling of long sequences. Despite this, the AutoPV system still achieves relatively close performance by combining some simple nontransformer elements.

For each task on each model, we fix a global random seed and conduct the training-evaluation experiments five times. The evaluation results including average values and the standard deviations are presented in Table III for PVPF Task 1 and Table IV for PVPF Task 2.

1) Analysis of PVPF Task 1. For PVPF Task 1, as shown in Table III, in the first five sub-tasks, the AutoPV system successfully finds an optimal architecture that outperforms other predefined models. In the remaining task DQH-336, It is only surpassed by iTransformer. This demonstrates that within the current search space, the AutoPV system is able to construct effective architectures for PVPF tasks with varying forecasting lengths. Based on the average MAE across six sub-tasks, we select the top-performing model from each benchmark category: CNN, PatchTST, and DLinear. When compared to these three models, the AutoPV system demonstrates relative performance improvements in MAE of 9.02%, 7.21%, and 4.52%, respectively.

Additionally, it is evident that non-Transformer-based models generally outperform most Transformer-based models,

- 2) Analysis of PVPF Task 2. Table IV presents the forecasting results in PVPF Task 2 where the future weather information is incorporated. The results demonstrate that the weather data appending method described in Section III-A significantly enhances the forecasting performance for most models. Notably, for DLinear and PatchTST, this data appending method does not yield performance improvements. We attribute this to the following reasons: For PatchTST, the attention mechanism between each patch (multiple tokens) is disrupted by zero padding, which affects the attention calculation for the future weather data. In the case of DLinear, since it primarily considers the periodic time series trends of each feature, appending zeros to the power feature does not introduce new trend information.

In comparison, AutoPV has the lowest forecasting error in PVPF Task 2 across all six sub-tasks. We also calculated the performance improvements of AutoPV over three top-performing models: LSTM, iTransformer, and TSMixer. The relative improvements in MAE are 9.88%, 28.79%, and 18.76%, respectively. Compared to PVPF Task 1, AutoPV shows an even greater performance advantage in PVPF Task 2.

Optimal Model of DQH-12

Optimal Model of DQH-24

Optimal Model of DQH-72

Optimal Model of DQH-48

Fig. 6. The complete architecture searched by AutoPV for the different sub-tasks in PVPF Task 1.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-2e633f67-54cb-455d-8445-a725f386d86a.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-d0ca208e-76ba-49a2-a22c-f8ddcb539683.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-4c398053-5ef2-428f-953e-a6242bd11169.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-72715d07-1d44-4118-976b-6ea3d2a594de.jpg)

The standard deviations in Table IV reveal that the forecasting performance becomes highly unstable for long-term tasks in many models, especially the transformer-based models. This instability is due to the future weather data often being noisy and becoming increasingly unreliable as the forecasting length extends. In contrast, the prediction results of AutoPV exhibit significantly greater stability than most baseline models.

occurrence rate. In future work, we may optimize the search space by removing less frequently used modules and adding more powerful ones.

3) Comprehensive Analysis. After analyzing the results in Table III and Table IV, we observe that the predefined models TSMixer and LSTM also exhibit relatively good performance in PVPF Task 1 and PVPF Task 2, respectively. However, there are two reasons that underscore the necessity of AutoPV. Firstly, as shown in Table III, TSMixer loses its performance edge in Task DQH-168 and even utterly fails in Task DQH336. Similarly, in Table IV, the performance of LSTM deteriorates significantly. In contrast, AutoPV consistently maintains high-quality performance across different tasks. Additionally, prior to evaluation, it is uncertain which model will perform well. Even though TSMixer is good at PVPF Task 1, it is outperformed by other models at PVPF Task 2. This indicates that for a new specific task, evaluation experiments are still necessary to select the best model. AutoPV not only automates the process of model construction, effectively reducing labor and time costs, but also provides better-performing models, thereby increasing the accuracy of forecasts.

Architectures Visualization. Figs. 6 and 7 illustrate the structures of all the searched architectures. The results indicate that for PVPF Task 1, the distribution of modules within the architectures is scattered. Different sub-tasks employ various training settings, data processing methods, and core predictive models. In contrast, for PVPF Task 2, the FEM 5 (Time &amp; Feature Mixing) module appears with high frequency. Additionally, a 1-layer MLP or 1-layer LSTM structure is predominantly chosen. To demonstrate the effectiveness of module selection in constructing the search space, we present the module proportions of all 12 parameters in Appendix, based on statistics from the optimal architecture set (Pareto frontier) for all tasks. The result shows that, except for the OF 2 (SGD optimizer) module, all modules have a non-zero

Forecasting Performance Visualization. In Fig. 8, we present the forecasting results of AutoPV across all subtasks, both with and without future weather data utilization. The results clearly demonstrate that the periodic pattern of photovoltaic power output is effectively captured. For PV power forecasting on sunny days, the inclusion of future weather data does not significantly impact the results. While on rainy and cloudy days, forecasting PV power generation proves to be more challenging without future weather data. Even when the future weather data is contaminated with noise, it still contributes to a notable improvement in the accuracy of future PV power forecasting.

## V. CONCLUSION

In this study, we propose AutoPV, an NAS-based framework designed to automatically search and construct efficient TSF models for specific PVPF tasks. We develop a novel search space that incorporates many state-of-the-art TSF and PVPF models. Utilizing a multi-objective optimization method named MoBananas, we search for the best-performing architecture while also controlling the model scale. To the best of our knowledge, this is the first work that bridges the gap between NAS and TSL tasks. Extensive experiments demonstrate the efficiency and effectiveness of AutoPV across various PVPF tasks. In future work, we plan to expand the search space and include more valuable modules to further enhance the performance of AutoPV.

## ACKNOWLEDGMENTS

This work is supported by the RISUD Projects (No. P0042845 and No. 1-BBWW) and the RISE Project (No. P0051003) of The Hong Kong Polytechnic University, International Centre of Urban Energy Nexus of The Hong Kong Polytechnic University (No. P0047700), and KKS Synergy project, Energy flexibility through synergies of big data, novel technologies &amp; systems, and innovative markets (20200073).

Optimal Model of DQH-168

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-8ab534ae-2259-4b30-aa40-1d79edf93c51.jpg)

Optimal Model of DQH-336

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-fc068631-2a90-4ad7-9a5a-d84528d5657e.jpg)

Fig. 7. The complete architecture searched by AutoPV for the different tasks in PVPF Task 2.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-f7174c20-0b4f-433a-aa9f-6cce89943ca7.jpg)

It is also supported by High Performance Computing Center at Eastern Institute of Technology, Ningbo.

- [12] T. Zhou, Z. Ma, Q. Wen, X. Wang, L. Sun, and R. Jin, 'Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting,' in International conference on machine learning . PMLR, 2022, pp. 27 268-27 286.

## REFERENCES

- [1] O. Lindberg, D. Lingfors, J. Arnqvist, D. van Der Meer, and J. Munkhammar, 'Day-ahead probabilistic forecasting at a co-located wind and solar power park in sweden: Trading and forecast verification,' Advances in Applied Energy , vol. 9, p. 100120, 2023.
- [3] A. Mellit, A. M. Pavan, and V. Lughi, 'Deep learning neural networks for short-term photovoltaic power forecasting,' Renewable Energy , vol. 172, pp. 276-288, 2021.
- [2] C. Brester, V. Kallio-Myers, A. V. Lindfors, M. Kolehmainen, and H. Niska, 'Evaluating neural network models in site-specific solar pv forecasting using numerical weather prediction data and weather observations,' Renewable Energy , vol. 207, pp. 266-274, 2023.
- [4] M. Gao, J. Li, F. Hong, and D. Long, 'Day-ahead power forecasting in a large-scale photovoltaic plant based on weather classification using lstm,' Energy , vol. 187, p. 115838, 2019.
- [6] Z. Ben Bouall` egue, M. C. Clare, L. Magnusson, E. Gascon, M. MaierGerber, M. Janouˇ sek, M. Rodwell, F. Pinault, J. S. Dramsch, S. T. Lang et al. , 'The rise of data-driven weather forecasting: A first statistical assessment of machine learning-based weather forecasts in an operational-like context,' Bulletin of the American Meteorological Society , 2024.
- [5] Y. Li, L. Song, S. Zhang, L. Kraus, T. Adcox, R. Willardson, A. Komandur, and N. Lu, 'A tcn-based hybrid forecasting framework for hoursahead utility-scale pv forecasting,' IEEE Transactions on Smart Grid , 2023.
- [7] Y. Nie, E. Zelikman, A. Scott, Q. Paletta, and A. Brandt, 'Skygpt: Probabilistic ultra-short-term solar forecasting using synthetic sky images from physics-constrained videogpt,' Advances in Applied Energy , vol. 14, p. 100172, 2024.
- [9] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, 'Attention is all you need,' Advances in neural information processing systems , vol. 30, 2017.
- [8] R. Ahmed, V. Sreeram, Y. Mishra, and M. Arif, 'A review and evaluation of the state-of-the-art in pv solar power forecasting: Techniques and optimization,' Renewable and Sustainable Energy Reviews , vol. 124, p. 109792, 2020.
- [10] H. Zhou, S. Zhang, J. Peng, S. Zhang, J. Li, H. Xiong, and W. Zhang, 'Informer: Beyond efficient transformer for long sequence time-series forecasting,' in Proceedings of the AAAI conference on artificial intelligence , vol. 35, no. 12, 2021, pp. 11 106-11 115.
- [11] H. Wu, J. Xu, J. Wang, and M. Long, 'Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting,' Advances in neural information processing systems , vol. 34, pp. 22 41922 430, 2021.
- [13] A. Zeng, M. Chen, L. Zhang, and Q. Xu, 'Are transformers effective for time series forecasting?' in Proceedings of the AAAI conference on artificial intelligence , vol. 37, no. 9, 2023, pp. 11 121-11 128.
- [15] B. Zoph and Q. V. Le, 'Neural architecture search with reinforcement learning,' arXiv preprint arXiv:1611.01578 , 2016.
- [14] S.-A. Chen, C.-L. Li, S. O. Arik, N. C. Yoder, and T. Pfister, 'Tsmixer: An all-mlp architecture for time series forecast-ing,' Transactions on Machine Learning Research , 2023.
- [16] J. Gao, W. Hu, and Y. Chen, 'Client: Cross-variable linear integrated enhanced transformer for multivariate long-term time series forecasting,' 2023.
- [18] G. Woo, C. Liu, D. Sahoo, A. Kumar, and S. Hoi, 'Etsformer: Exponential smoothing transformers for time-series forecasting,' arXiv preprint arXiv:2202.01381 , 2022.
- [17] K. Yi, Q. Zhang, W. Fan, S. Wang, P. Wang, H. He, N. An, D. Lian, L. Cao, and Z. Niu, 'Frequency-domain mlps are more effective learners in time series forecasting,' Advances in Neural Information Processing Systems , vol. 36, 2024.
- [19] Y. Nie, N. H. Nguyen, P. Sinthong, and J. Kalagnanam, 'A time series is worth 64 words: Long-term forecasting with transformers,' arXiv preprint arXiv:2211.14730 , 2022.
- [21] H. Wang, J. Peng, F. Huang, J. Wang, J. Chen, and Y. Xiao, 'Micn: Multi-scale local and global context modeling for long-term series forecasting,' in The Eleventh International Conference on Learning Representations , 2022.
- [20] Y. Liu, T. Hu, H. Zhang, H. Wu, S. Wang, L. Ma, and M. Long, 'itransformer: Inverted transformers are effective for time series forecasting,' arXiv preprint arXiv:2310.06625 , 2023.
- [22] H. Wu, T. Hu, Y. Liu, H. Zhou, J. Wang, and M. Long, 'Timesnet: Temporal 2d-variation modeling for general time series analysis,' in The eleventh international conference on learning representations , 2022.
- [24] H. Pham, M. Guan, B. Zoph, Q. Le, and J. Dean, 'Efficient neural architecture search via parameters sharing,' in International conference on machine learning . PMLR, 2018, pp. 4095-4104.
- [23] Y. Yang, M. Jin, H. Wen, C. Zhang, Y. Liang, L. Ma, Y. Wang, C. Liu, B. Yang, Z. Xu et al. , 'A survey on diffusion models for time series and spatio-temporal data,' arXiv preprint arXiv:2404.18886 , 2024.
- [25] Y. Zhang, Z. Lin, J. Jiang, Q. Zhang, Y. Wang, H. Xue, C. Zhang, and Y. Yang, 'Deeper insights into weight sharing in neural architecture search,' arXiv preprint arXiv:2001.01431 , 2020.
- [27] C. White, W. Neiswanger, and Y. Savani, 'Bananas: Bayesian optimization with neural architectures for neural architecture search,' in
- [26] E. Real, A. Aggarwal, Y. Huang, and Q. V. Le, 'Aging evolution for image classifier architecture search,' in AAAI conference on artificial intelligence , vol. 2, 2019, p. 2.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-d8967628-fdb3-4735-80f7-7ad9c5c4f1be.jpg)

(a) DQH-12

(b) DQH-24

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-ca75a280-b810-43fb-b9ca-ff7a598b9def.jpg)

Fig. 8. Visualization of AutoPV forecasting performance: with and without future weather data

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-4a005766-9317-455b-b8ba-ac1ff4925512.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-c2e8824c-cdbd-42e3-8478-d706bcbcb6c4.jpg)

Proceedings of the AAAI conference on artificial intelligence , vol. 35, no. 12, 2021, pp. 10 293-10 301.

- [37] H. Cai, L. Zhu, and S. Han, 'ProxylessNAS: Direct neural architecture search on target task and hardware,' in International Conference on Learning Representations , 2019. [Online]. Available: https://arxiv.org/pdf/1812.00332.pdf
- [29] C. Wang, X. Chen, J. Wang, and H. Wang, 'Atpfl: Automatic trajectory prediction model design under federated learning framework,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 6563-6572.
- [31] H. Wang, Z. Wu, Z. Liu, H. Cai, L. Zhu, C. Gan, and S. Han, 'HAT: Hardware-aware transformers for efficient natural language processing,' in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , D. Jurafsky, J. Chai, N. Schluter, and J. Tetreault, Eds. Online: Association for Computational Linguistics, Jul. 2020, pp. 7675-7688. [Online]. Available: https://aclanthology.org/2020.acl-main.686
- [28] S. Izquierdo, J. Guerrero-Viu, S. Hauns, G. Miotto, S. Schrodi, A. Biedenkapp, T. Elsken, D. Deng, M. Lindauer, and F. Hutter, 'Bag of baselines for multi-objective joint neural architecture search and hyperparameter optimization,' in 8th ICML Workshop on Automated Machine Learning (AutoML) , 2021.
- [30] J. Seng, P. Prasad, M. Mundt, D. S. Dhami, and K. Kersting, 'Feathers: Federated architecture and hyperparameter search,' arXiv preprint arXiv:2206.12342 , 2022.
- [32] C. Scott, M. Ahsan, and A. Albarbar, 'Machine learning for forecasting a photovoltaic (pv) generation system,' Energy , vol. 278, p. 127807, 2023.
- [34] T. Kim, J. Kim, Y. Tae, C. Park, J.-H. Choi, and J. Choo, 'Reversible instance normalization for accurate time-series forecasting against distribution shift,' in International Conference on Learning Representations , 2022. [Online]. Available: https://openreview.net/ forum?id=cGDAkQo1C0p
- [33] I. Jebli, F.-Z. Belouadha, M. I. Kabbaj, and A. Tilioua, 'Prediction of solar energy guided by pearson correlation using machine learning,' Energy , vol. 224, p. 120109, 2021.
- [35] N. Passalis, A. Tefas, J. Kanniainen, M. Gabbouj, and A. Iosifidis, 'Deep adaptive input normalization for time series forecasting,' IEEE Transactions on Neural Networks and Learning Systems , vol. 31, no. 9, pp. 3760-3765, 2020.
- [36] T. Polasek and M. Cadk, 'Predicting photovoltaic power production using high-uncertainty weather forecasts,' Applied Energy , vol. 339, p. 120989, 2023.
- [39] D. J. Russo, B. Van Roy, A. Kazerouni, I. Osband, Z. Wen et al. , 'A tutorial on thompson sampling,' Foundations and Trends® in Machine Learning , vol. 11, no. 1, pp. 1-96, 2018.
- [38] K. Deb, S. Agrawal, A. Pratap, and T. Meyarivan, 'A fast elitist nondominated sorting genetic algorithm for multi-objective optimization: Nsga-ii,' in Parallel Problem Solving from Nature PPSN VI: 6th International Conference Paris, France, September 18-20, 2000 Proceedings 6 . Springer, 2000, pp. 849-858.
- [40] Y. Wang, H. Wu, J. Dong, Y. Liu, M. Long, and J. Wang, 'Deep time series models: A comprehensive survey and benchmark,' 2024.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-b86f4ffe-b71f-4f88-b249-f872583fa62c.jpg)

(c) DQH-48

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-5ff2342a-4d9e-46ad-bb52-f0d616d07fd7.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-733c9731-26be-489e-855d-358203545e1b.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-2375e396-fda2-40c9-9a12-8f03e6f14b28.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-e3a42e44-6785-4773-9b55-26c8454a8254.jpg)

Dayin Chen is currently pursuing his Ph.D. in Building Energy and Environment Engineering at The Hong Kong Polytechnic University. He holds both a Bachelor's and a Master's degree in Computer Science from the Southern University of Science and Technology. His research interests include mobile computing, crowdsourcing, and neural architecture search. Additionally, Chen is exploring the application of computer science technologies in enhancing building energy efficiency.

Xiaodan Shi received the B.E. and M.S. degrees in photogrammetry and remote sensing from Wuhan University, China. She received the Ph.D. degree with the Center for Spatial Information Science, The University of Tokyo, Kashiwa, Japan. She is working as a researcher with the Center for Spatial Information Science, The University of Tokyo. Her current research interests include computer vision and its applications in pedestrian trajectory prediction, human flow monitoring, multi-objects tracking and data mining in GPS.

Mingkun Jiang received the B.E. degree in process equipment and control engineering from Yanshan University, China. He received the M.S. and Ph.D. degrees with the School of Mechanical and Power Engineering, The East China University of Science and Technology, Shanghai, China. He is working as a research engineer with the PV Industry Innovation Center, The State Power Investment Corporation. His current research interests include renewable energy potential evaluation, PV and storage system modelling and its power output prediction.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-bb2390a2-1e57-4688-9043-3eaa42e1c11a.jpg)

Young Achievement, and the Smart 50 Award among others.

Haoran Zhang is a researcher with an interdisciplinary background, holding dual Bachelor's degrees in Engineering and Economics, complemented by two Ph.D. degrees in Oil &amp; Gas Storageand Transportation Engineering ond Environmental science. His research is at the forefront of sustainable development, focusing on clean energy supply chains, green transportation, and smart urban energy systems. His innovative research has garnered prestigious accolades, including the Energy Globe Award, the R&amp;D 100 Award, the John Tiratsoo Award for

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-67412df3-f890-4e21-b96a-db9b3243c29c.jpg)

of Southern California, Los Angeles, CA, USA. From 2010 to 2019, he was the Chair Professor and the Dean of the College of Engineering, Peking University, Beijing, China. He was the Provost and the Chair Professor with the Southern University of Science and Technology, Shenzhen, China. He is currently the Provost and the Chair Professor with the Eastern Institute of Technology, Ningbo, China. His research interests include stochastic uncertainty quantification and inverse modeling, mechanisms for shale-gas and coalbed-methane production, and geological carbon sequestration. Dr. Zhang is a member of the U.S. National Academy of Engineering, a fellow of the Geological Society of America, and an Honorary Member of the Society of Petroleum Engineers.

Dongxiao Zhang received the M.S. and Ph.D. degrees in hydrology from the University of Arizona, Tucson, AZ, USA, in 1992 and 1993, respectively. From 1996 to 2003, he was a Technical Staff Member and the Team Leader with the Los Alamos National Laboratory, Los Alamos, NM, USA. From 2004 to 2007, he was the Miller Chair Professor of petroleum and geological engineering with the University of Oklahoma, Norman, OK, USA. From 2007 to 2010, he was the Marshall Professor of the Petroleum Engineering Program with the University

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-a50a3df0-f72d-4cea-8eba-73a25f1613d3.jpg)

Yuntian Chen is an assistant professor at Eastern Institute of Technology, Ningbo. He received the B.S. degree from Tsinghua University, Beijing, China, in 2015, the dual B.S. degree from Peking University, Beijing, China, in 2015, and the Ph.D. degree with merit from Peking University, Beijing, China, in 2020. His research field includes scientific machine learning and intelligent energy systems. He is interested in the integration of domain knowledge and data-driven models.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-bc067f3c-75c9-48cf-9e59-ba3743384ce9.jpg)

500 papers in renowned journals such as Science, Nature Energy, Nature Climate Change etc and holds more than 10 patents. Having supervised nearly 200 post-doctoral researchers and 50 doctoral candidates, Prof. Yan has secured substantial external grants exceeding 20 million Euros. Prof. Yan's contributions have been acknowledged through prestigious awards, including the Global Human Settlements Award of Green Technology, the EU Energy Islands' Award, Research2Business Top100 and the IAGE Lifetime Achievement Award.

Jerry Yan is a member of the European Academy of Sciences and Arts and the Fellow of Hong Kong Academy of Engineering Sciences, currently serving as a Chair-Professor at the Hong Kong Polytechnic University. With a PhD from the Royal Institute of Technology (KTH), he has held chair professor positions at Lule˚ a University of Technology, M¨ alardalen University, and KTH, Sweden. Prof. Yan's research focuses on renewable energy, advanced energy systems, climate change mitigation, and environmental policies. He has a publication record of over

TABLE I FIXED HYPERPARAMETERS

| Module                                                                                                                                                                                                  | Fixed Parameters                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| DGM 2 : Gaussian Noise SM 3 : DAIN FEM 2 : Linear Embedding FEM 3 : Decomposition FEM 4 : Multi-Scale Decomposition FEM 5 : Time&Feature Mixing FEM 6 : Frequency Domain Mixing CPS 3 : CNN CPS 4 : TCN | mean = 0, standard deviation = 0.05 mean learning rate = 0.00001, gate learning rate = 0.001, scale learning rate = 0.0001 in features = input size, out features = 2 × input size kernel size = round odd(historical length / 3) kernel sizes = [round odd(historical length / 3 1 ), round odd(historical length / 3 2 ), ...] mixer layer number = 2, model dimension = 256, dropout rate = 0.1 embedded size = 128, channel independence = True, sparsity threshold = 0.01, scale = 0.02 convolution kernel size = 3, padding = 1, pool kernel size = 2 kernel size = 2, dropout rate = 0.1, dilation size = 2, 4, 8 (for different layer), stride = 1 |

(a) PVPF Task 1: DQH-12

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-561bb33e-97b1-43e1-939c-5f6460dab76d.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-c6cbdcb0-1c2f-4bf9-8c0e-457e4abf9da6.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-f0b142fe-e027-4d00-b682-dede1133a3c4.jpg)

(b) PVPF Task 1: DQH-24

(c) PVPF Task 1: DQH-48

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-c876db19-07f9-4766-b222-5d1691bef598.jpg)

Fig. 1. The optimal architectures found during each iteration for PVPF Task 1. They constitute the Pareto Frontier. The yellow points on the figures indicate the measured error and model scale of architectures in the final Pareto Frontier.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-00cb2d0e-bb8a-43ad-bc0b-71c2db325831.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-aeab2edd-ca44-4a4b-9665-c7ef826ffac1.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-795f6c3c-6f4d-46e1-8c48-c906d376c8cf.jpg)

(a) PVPF Task 2: DQH-12

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-2053e788-b68b-43c1-b0f0-7ead9602c3bf.jpg)

(b) PVPF Task 2: DQH-24

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-73d41a63-338d-47e0-994a-ec6d8d3d4921.jpg)

(c) PVPF Task 2: DQH-48

Fig. 2. The optimal architectures found during each iteration for PVPF Task 2. They constitute the Pareto Frontier. The yellow points on the figures indicate the measured error and model scale of architectures in the final Pareto Frontier.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-33b9dae4-8cf5-46f8-8666-8666b13930bf.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-8668d3e6-6293-498c-ae0a-3127dda071d6.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-6dfb2d7f-783b-4291-94ea-60e55791933f.jpg)

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-17215e4b-e5da-4cd4-9b43-4f55120c16e4.jpg)

(a) FSM

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-368ebe5f-e129-426b-ad0d-2bff77322c00.jpg)

(e) FAM

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-a704e913-a4d6-4de6-859f-5583dd4a2427.jpg)

(b) FST

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-9e4343f8-f77f-449d-8a08-964e7ca82abf.jpg)

(f) FEM

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-77cacb2f-311b-46d5-987b-e7da0302280a.jpg)

(c) DGM

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-865ae876-369d-49ed-9d75-c34f5aeecc97.jpg)

(g) CPS

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-e6b086f0-7a6e-4acb-98cf-3208e4244682.jpg)

(d) SM

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-bc031e73-9647-4d3d-a164-0bd14b0a6451.jpg)

(h) LN

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-bbf67c40-bde2-4a83-9ff5-7a4eee9c0a37.jpg)

Module Proportions

Module Proportions

Module Proportions

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-18b18bc4-1387-4ad4-ba29-6cc29b1bfa1d.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-03f494eb-9e2d-410b-b6d6-9c8c87cce76d.jpg)

(k) OF

Fig. 3. Proportions of the 12 parameters in the AutoPV search space. The statistics encompass the final optimal set of the searched neural architectures across all 12 subtasks.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00601v1-figure-f882c1bb-4a17-43a2-a981-2ee3a15c7ceb.jpg)
Dayin Chen Xiaodan Shi Mingkun Jiang Haoran Zhang Dongxiao Zhang Yuntian Chen Jinyue Yan
AutoPV: Automatically Design Your Photovoltaic Power Forecasting Model
Photovoltaic power forecasting (PVPF) is a critical area in time series
forecasting (TSF), enabling the efficient utilization of solar energy. With
advancements in machine learning and deep learning, various models have been
applied to PVPF tasks. However, constructing an optimal predictive architecture
for specific PVPF tasks remains challenging, as it requires cross-domain
knowledge and significant labor costs. To address this challenge, we introduce
AutoPV, a novel framework for the automated search and construction of PVPF
models based on neural architecture search (NAS) technology. We develop a brand
new NAS search space that incorporates various data processing techniques from
state-of-the-art (SOTA) TSF models and typical PVPF deep learning models. The
effectiveness of AutoPV is evaluated on diverse PVPF tasks using a dataset from
the Daqing Photovoltaic Station in China. Experimental results demonstrate that
AutoPV can complete the predictive architecture construction process in a
relatively short time, and the newly constructed architecture is superior to
SOTA predefined models. This work bridges the gap in applying NAS to TSF
problems, assisting non-experts and industries in automatically designing
effective PVPF models.