title: Sample-Efficient Learning of Stackelberg Equilibria in General-Sum Games

abstract: Real world applications such as economics and policy making often involve solving multi-agent games with two unique features: (1) The agents are inherently asymmetric and partitioned into leaders and followers; (2) The agents have different reward functions, thus the game is general-sum. The majority of existing results in this field focuses on either symmetric solution concepts (e.g. Nash equilibrium) or zero-sum games. It remains open how to learn the Stackelberg equilibrium -- an asymmetric analog of the Nash equilibrium -- in general-sum games efficiently from noisy samples. This paper initiates the theoretical study of sample-efficient learning of the Stackelberg equilibrium, in the bandit feedback setting where we only observe noisy samples of the reward. We consider three representative two-player general-sum games: bandit games, bandit-reinforcement learning (bandit-RL) games, and linear bandit games. In all these games, we identify a fundamental gap between the exact value of the Stackelberg equilibrium and its estimated version using finitely many noisy samples, which can not be closed information-theoretically regardless of the algorithm. We then establish sharp positive results on sample-efficient learning of Stackelberg equilibrium with value optimal up to the gap identified above, with matching lower bounds in the dependency on the gap, error tolerance, and the size of the action spaces. Overall, our results unveil unique challenges in learning Stackelberg equilibria under noisy bandit feedback, which we hope could shed light on future research on this topic.


title: Anytime Sampling for Autoregressive Models via Ordered Autoencoding

abstract: Autoregressive models are widely used for tasks such as image and audio generation. The sampling process of these models, however, does not allow interruptions and cannot adapt to real-time computational resources. This challenge impedes the deployment of powerful autoregressive models, which involve a slow sampling process that is sequential in nature and typically scales linearly with respect to the data dimension. To address this difficulty, we propose a new family of autoregressive models that enables anytime sampling. Inspired by Principal Component Analysis, we learn a structured representation space where dimensions are ordered based on their importance with respect to reconstruction. Using an autoregressive model in this latent space, we trade off sample quality for computational efficiency by truncating the generation process before decoding into the original data space. Experimentally, we demonstrate in several image and audio generation tasks that sample quality degrades gracefully as we reduce the computational budget for sampling. The approach suffers almost no loss in sample quality (measured by FID) using only 60\% to 80\% of all latent dimensions for image data. Code is available at https://github.com/Newbeeer/Anytime-Auto-Regressive-Model .


title: On almost Cap sets in three variables and the multivariable Cap set problem

abstract: In this note we prove that almost cap sets $A \subset \mathbb{F}_q^n$, i.e., the subsets of $\mathbb{F}_q^n$ that do not contain too many arithmetic progressions of length three, satisfy that $|A| < c_q^n$ for some $c_q < q$. As a corollary we prove a multivariable analogue of Ellenberg-Gijswijt theorem.


title: Controllable and Diverse Text Generation in E-commerce

abstract: In E-commerce, a key challenge in text generation is to find a good trade-off between word diversity and accuracy (relevance) in order to make generated text appear more natural and human-like. In order to improve the relevance of generated results, conditional text generators were developed that use input keywords or attributes to produce the corresponding text. Prior work, however, do not finely control the diversity of automatically generated sentences. For example, it does not control the order of keywords to put more relevant ones first. Moreover, it does not explicitly control the balance between diversity and accuracy. To remedy these problems, we propose a fine-grained controllable generative model, called~\textit{Apex}, that uses an algorithm borrowed from automatic control (namely, a variant of the \textit{proportional, integral, and derivative (PID) controller}) to precisely manipulate the diversity/accuracy trade-off of generated text. The algorithm is injected into a Conditional Variational Autoencoder (CVAE), allowing \textit{Apex} to control both (i) the order of keywords in the generated sentences (conditioned on the input keywords and their order), and (ii) the trade-off between diversity and accuracy. Evaluation results on real-world datasets show that the proposed method outperforms existing generative models in terms of diversity and relevance. Apex is currently deployed to generate production descriptions and item recommendation reasons in Taobao owned by Alibaba, the largest E-commerce platform in China. The A/B production test results show that our method improves click-through rate (CTR) by 13.17\% compared to the existing method for production descriptions. For item recommendation reason, it is able to increase CTR by 6.89\% and 1.42\% compared to user reviews and top-K item recommendation without reviews, respectively.


title: V2W-BERT: A Framework for Effective Hierarchical Multiclass Classification of Software Vulnerabilities

abstract: Weaknesses in computer systems such as faults, bugs and errors in the architecture, design or implementation of software provide vulnerabilities that can be exploited by attackers to compromise the security of a system. Common Weakness Enumerations (CWE) are a hierarchically designed dictionary of software weaknesses that provide a means to understand software flaws, potential impact of their exploitation, and means to mitigate these flaws. Common Vulnerabilities and Exposures (CVE) are brief low-level descriptions that uniquely identify vulnerabilities in a specific product or protocol. Classifying or mapping of CVEs to CWEs provides a means to understand the impact and mitigate the vulnerabilities. Since manual mapping of CVEs is not a viable option, automated approaches are desirable but challenging. We present a novel Transformer-based learning framework (V2W-BERT) in this paper. By using ideas from natural language processing, link prediction and transfer learning, our method outperforms previous approaches not only for CWE instances with abundant data to train, but also rare CWE classes with little or no data to train. Our approach also shows significant improvements in using historical data to predict links for future instances of CVEs, and therefore, provides a viable approach for practical applications. Using data from MITRE and National Vulnerability Database, we achieve up to 97% prediction accuracy for randomly partitioned data and up to 94% prediction accuracy in temporally partitioned data. We believe that our work will influence the design of better methods and training models, as well as applications to solve increasingly harder problems in cybersecurity.


title: Enhancing Direct Exoplanet Spectroscopy with Apodizing and Beam Shaping Optics

abstract: Direct exoplanet spectroscopy aims to measure the spectrum of an exoplanet while simultaneously minimizing the light collected from its host star. Isolating the planet light from the starlight improves the signal-to-noise ratio (S/N) per spectral channel when noise due to the star dominates, which may enable new studies of the exoplanet atmosphere with unprecedented detail at high spectral resolution (>30,000). However, the optimal instrument design depends on the flux level from the planet and star compared to the noise due to other sources, such as detector noise and thermal background. Here we present the design, fabrication, and laboratory demonstration of specially-designed optics to improve the S/N in two potential regimes in direct exoplanet spectroscopy with adaptive optics instruments. The first is a pair of beam-shaping lenses that increase the planet signal by improving the coupling efficiency into a single-mode fiber at the known position of the planet. The second is a grayscale apodizer that reduces the diffracted starlight for planets at small angular separations from their host star. The former especially increases S/N when dominated by detector noise or thermal background, while the latter helps reduce stellar noise. We show good agreement between the theoretical and experimental point spread functions in each case and predict the exposure time reduction ($\sim 33\%$) that each set of optics provides in simulated observations of 51 Eridani b using the Keck Planet Imager and Characterizer instrument at W.M. Keck Observatory.


title: Model-Attentive Ensemble Learning for Sequence Modeling

abstract: Medical time-series datasets have unique characteristics that make prediction tasks challenging. Most notably, patient trajectories often contain longitudinal variations in their input-output relationships, generally referred to as temporal conditional shift. Designing sequence models capable of adapting to such time-varying distributions remains a prevailing problem. To address this we present Model-Attentive Ensemble learning for Sequence modeling (MAES). MAES is a mixture of time-series experts which leverages an attention-based gating mechanism to specialize the experts on different sequence dynamics and adaptively weight their predictions. We demonstrate that MAES significantly out-performs popular sequence models on datasets subject to temporal shift.


title: A Bayesian Spatial Modeling Approach to Mortality Forecasting

abstract: This paper extends Bayesian mortality projection models for multiple populations considering the stochastic structure and the effect of spatial autocorrelation among the observations. We explain high levels of overdispersion according to adjacent locations based on the conditional autoregressive model. In an empirical study, we compare different hierarchical projection models for the analysis of geographical diversity in mortality between the Japanese counties in multiple years, according to age. By a Markov chain Monte Carlo (MCMC) computation, results have demonstrated the flexibility and predictive performance of our proposed model.


title: Oriole: Thwarting Privacy against Trustworthy Deep Learning Models

abstract: Deep Neural Networks have achieved unprecedented success in the field of face recognition such that any individual can crawl the data of others from the Internet without their explicit permission for the purpose of training high-precision face recognition models, creating a serious violation of privacy. Recently, a well-known system named Fawkes (published in USENIX Security 2020) claimed this privacy threat can be neutralized by uploading cloaked user images instead of their original images. In this paper, we present Oriole, a system that combines the advantages of data poisoning attacks and evasion attacks, to thwart the protection offered by Fawkes, by training the attacker face recognition model with multi-cloaked images generated by Oriole. Consequently, the face recognition accuracy of the attack model is maintained and the weaknesses of Fawkes are revealed. Experimental results show that our proposed Oriole system is able to effectively interfere with the performance of the Fawkes system to achieve promising attacking results. Our ablation study highlights multiple principal factors that affect the performance of the Oriole system, including the DSSIM perturbation budget, the ratio of leaked clean user images, and the numbers of multi-cloaks for each uncloaked image. We also identify and discuss at length the vulnerabilities of Fawkes. We hope that the new methodology presented in this paper will inform the security community of a need to design more robust privacy-preserving deep learning models.


title: Two Sides of Meta-Learning Evaluation: In vs. Out of Distribution

abstract: We categorize meta-learning evaluation into two settings: $\textit{in-distribution}$ [ID], in which the train and test tasks are sampled $\textit{iid}$ from the same underlying task distribution, and $\textit{out-of-distribution}$ [OOD], in which they are not. While most meta-learning theory and some FSL applications follow the ID setting, we identify that most existing few-shot classification benchmarks instead reflect OOD evaluation, as they use disjoint sets of train (base) and test (novel) classes for task generation. This discrepancy is problematic because -- as we show on numerous benchmarks -- meta-learning methods that perform better on existing OOD datasets may perform significantly worse in the ID setting. In addition, in the OOD setting, even though current FSL benchmarks seem befitting, our study highlights concerns in 1) reliably performing model selection for a given meta-learning method, and 2) consistently comparing the performance of different methods. To address these concerns, we provide suggestions on how to construct FSL benchmarks to allow for ID evaluation as well as more reliable OOD evaluation. Our work aims to inform the meta-learning community about the importance and distinction of ID vs. OOD evaluation, as well as the subtleties of OOD evaluation with current benchmarks.


title: Equivariant neural networks for inverse problems

abstract: In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into incorporating other symmetries into deep learning methods, in the form of group equivariant convolutional neural networks. Much of this work has been focused on roto-translational symmetry of $\mathbf R^d$, but other examples are the scaling symmetry of $\mathbf R^d$ and rotational symmetry of the sphere. In this work, we demonstrate that group equivariant convolutional operations can naturally be incorporated into learned reconstruction methods for inverse problems that are motivated by the variational regularisation approach. Indeed, if the regularisation functional is invariant under a group symmetry, the corresponding proximal operator will satisfy an equivariance property with respect to the same group symmetry. As a result of this observation, we design learned iterative methods in which the proximal operators are modelled as group equivariant convolutional neural networks. We use roto-translationally equivariant operations in the proposed methodology and apply it to the problems of low-dose computerised tomography reconstruction and subsampled magnetic resonance imaging reconstruction. The proposed methodology is demonstrated to improve the reconstruction quality of a learned reconstruction method with a little extra computational cost at training time but without any extra cost at test time.


title: Effects of ground-state correlations on damping of giant dipole resonaces in $LS$ closed shell nuclei

abstract: The effects of ground-state correlations on the damping of isovector giant dipole resonances in $LS$ closed shell nuclei $^{16}$O and $^{40}$Ca are studied using extended random-phase-approximation (RPA) approaches derived from the time-dependent density-matrix theory. It is pointed out that unconventional two-body amplitudes of one particle--three hole and three particle--one hole types which are neglected in most extended RPA theories play an important role in the fragmentation of isovector dipole strength.


title: Comparative evaluation of CNN architectures for Image Caption Generation

abstract: Aided by recent advances in Deep Learning, Image Caption Generation has seen tremendous progress over the last few years. Most methods use transfer learning to extract visual information, in the form of image features, with the help of pre-trained Convolutional Neural Network models followed by transformation of the visual information using a Caption Generator module to generate the output sentences. Different methods have used different Convolutional Neural Network Architectures and, to the best of our knowledge, there is no systematic study which compares the relative efficacy of different Convolutional Neural Network architectures for extracting the visual information. In this work, we have evaluated 17 different Convolutional Neural Networks on two popular Image Caption Generation frameworks: the first based on Neural Image Caption (NIC) generation model and the second based on Soft-Attention framework. We observe that model complexity of Convolutional Neural Network, as measured by number of parameters, and the accuracy of the model on Object Recognition task does not necessarily co-relate with its efficacy on feature extraction for Image Caption Generation task.


title: Conformal maps in higher dimensions and derived geometry

abstract: By Liouville's theorem, in dimensions 3 or more conformal transformations form a finite-dimensional group, an apparent drastic departure from the 2-dimensional case. We propose a derived enhancement of the conformal Lie algebra which is an infinite-dimensional dg-Lie algebra incorporating not only symmetries but also deformations of the conformal structure. Our approach is based on (derived) deformation theory of the ambitwistor space of complex null-geodesics.


title: Two-dimensional ferroelectric metal for electrocatalysis

abstract: The coexistence of metallicity and ferroelectricity has been an intriguing and controversial phenomenon as these two material properties are considered incompatible in bulk. We clarify the concept of ferroelectric metal by revisiting the original definitions for ferroelectric and metal. Two-dimensional (2D) ferroelectrics with out-of-plane polarization can be engineered via layer stacking to a genuine ferroelectric metal characterized by switchable polarization and non-zero density of states at the Fermi level. We demonstrate that 2D ferroelectric metals can serve as electrically-tunable, high-quality electrocatalysts.


title: Performance Improvement of LoRa Modulation with Signal Combining and Semi-Coherent Detection

abstract: In this paper, we investigate performance improvements of low-power long-range (LoRa) modulation when a gateway is equipped with multiple antennas. We derive the optimal decision rules for both coherent and non-coherent detections when combining signals received from multiple antennas. To provide insights on how signal combining can benefit LoRa systems, we present expressions of the symbol/bit error probabilities of both the coherent and non-coherent detections in AWGN and Rayleigh fading channels, respectively. Moreover, we also propose an iterative semi-coherent detection that does not require any overhead to estimate the channel-state-information (CSI) while its performance can approach that of the ideal coherent detection. Simulation and analytical results show very large power gains, or coverage extension, provided by the use of multiple antennas for all the detection schemes considered.


title: X-ray Spectra of Circumgalactic Medium Around Star-Forming Galaxies: Connecting Simulations to Observations

abstract: The hot component of the circum-galactic medium (CGM) around star forming galaxies is detected as diffuse X-ray emission. The X-ray spectra from the CGM depend on the temperature and metallicity of the emitting plasma, providing important information about the feeding and feedback of the galaxy. The observed spectra are commonly fitted using simple 1-Temperature (1-T) or 2-T models. However, the actual temperature distribution of the gas can be complex because of the interaction between galactic outflows and halo gas. Here we demonstrate this by analysing 3-D hydrodynamical simulations of the CGM with a realistic outflow model. We investigate the physical properties of the simulated hot CGM, which shows a broad distribution in density, temperature, and metallicity. By constructing and fitting the simulated spectra, we show that, while the 1-T and 2-T models are able to fit the synthesized spectra reasonably well, the inferred temperature(s) does not bear much physical meaning. Instead, we propose a log-normal distribution as a more physical model. The log-normal model better fits the simulated spectra while reproducing the gas temperature distribution. We also show that when the star formation rate is high, the spectra inside the bi-conical outflows are distinct from that outside, as outflows are generally hotter and more metal-enriched. Finally, we produce mock spectra for future missions with the eV-level spectral resolution, such as Athena, Lynx, HUBS and XRISM.


title: Bayesian evidence for the tensor-to-scalar ratio $r$ and neutrino masses $m_\nu$: Effects of uniform vs logarithmic priors

abstract: We review the effect that the choice of a uniform or logarithmic prior has on the Bayesian evidence and hence on Bayesian model comparisons when data provide only a one-sided bound on a parameter. We investigate two particular examples: the tensor-to-scalar ratio $r$ of primordial perturbations and the mass of individual neutrinos $m_\nu$, using the cosmic microwave background temperature and polarisation data from Planck 2018 and the NuFIT 5.0 data from neutrino oscillation experiments. We argue that the Kullback-Leibler divergence, also called the relative entropy, mathematically quantifies the Occam penalty. We further show how the Bayesian evidence stays invariant upon changing the lower prior bound of an upper constrained parameter. While a uniform prior on the tensor-to-scalar ratio disfavours the $r$-extension compared to the base LCDM model with odds of about 1:20, switching to a logarithmic prior renders both models essentially equally likely. LCDM with a single massive neutrino is favoured over an extension with variable neutrino masses with odds of 20:1 in case of a uniform prior on the lightest neutrino mass, which decreases to roughly 2:1 for a logarithmic prior. For both prior options we get only a very slight preference for the normal over the inverted neutrino hierarchy with Bayesian odds of about 3:2 at most.


title: Nil-reversible rings

abstract: This paper introduces and studies nil-reversible rings wherein we call a ring R nil-reversible if the left and right annihilators of every nilpotent element of R are equal. Reversible rings (and hence reduced rings) form a proper subclass of nil-reversible rings and hence we provide some conditions for a nil-reversible ring to be reduced. It turns out that nil-reversible rings are abelian, 2-primal, weakly semicommutative and nil-Armendariz. Further, we observe that the polynomial ring over a nil-reversible ring R is not necessarily nil-reversible in general, but it is nil-reversible if R is Armendariz additionally.


title: Mixed Policy Gradient: off-policy reinforcement learning driven jointly by data and model

abstract: Reinforcement learning (RL) shows great potential in sequential decision-making. At present, mainstream RL algorithms are data-driven, which usually yield better asymptotic performance but much slower convergence compared with model-driven methods. This paper proposes mixed policy gradient (MPG) algorithm, which fuses the empirical data and the transition model in policy gradient (PG) to accelerate convergence without performance degradation. Formally, MPG is constructed as a weighted average of the data-driven and model-driven PGs, where the former is the derivative of the learned Q-value function, and the latter is that of the model-predictive return. To guide the weight design, we analyze and compare the upper bound of each PG error. Relying on that, a rule-based method is employed to heuristically adjust the weights. In particular, to get a better PG, the weight of the data-driven PG is designed to grow along the learning process while the other to decrease. Simulation results show that the MPG method achieves the best asymptotic performance and convergence speed compared with other baseline algorithms.


title: Galaxy And Mass Assembly (GAMA): The inferred mass--metallicity relation from z=0 to 3.5 via forensic SED fitting

abstract: We analyse the metallicity histories of ~4,500 galaxies from the GAMA survey at z<0.06 modelled by the SED-fitting code ProSpect using an evolving metallicity implementation. These metallicity histories, in combination with the associated star formation histories, allow us to analyse the inferred gas-phase mass--metallicity relation. Furthermore, we extract the mass--metallicity relation at a sequence of epochs in cosmic history, to track the evolving mass--metallicity relation with time. Through comparison with observations of gas-phase metallicity over a large range of redshifts, we show that, remarkably, our forensic SED analysis has produced an evolving mass--metallicity relationship that is consistent with observations at all epochs. We additionally analyse the three dimensional mass--metallicity--SFR space, showing that galaxies occupy a clearly defined plane. This plane is shown to be subtly evolving, displaying an increased tilt with time caused by general enrichment, and also the slowing down of star formation with cosmic time. This evolution is most apparent at lookback times greater than 7 Gyr. The trends in metallicity recovered in this work highlight that the evolving metallicity implementation used within the SED fitting code ProSpect produces reasonable metallicity results over the history of a galaxy. This is expected to provide a significant improvement to the accuracy of the SED fitting outputs.


title: The irreducible weak modules for the fixed point subalgebra of the vertex algebra associated to a non-degenerate even lattice by an automorphism of order $2$ (Part $1$)

abstract: Let $V_{L}$ be the vertex algebra associated to a non-degenerate even lattice $L$, $\theta$ the automorphism of $V_{L}$ induced from the $-1$-isometry of $L$, and $V_{L}^{+}$ the fixed point subalgebra of $V_{L}$ under the action of $\theta$. In this series of papers, we classify the irreducible weak $V_{L}^{+}$-modules and show that any irreducible weak $V_{L}^{+}$-module is isomorphic to a weak submodule of some irreducible weak $V_{L}$-module or to a submodule of some irreducible $\theta$-twisted $V_{L}$-module. In this paper (Part 1), we show that when the rank of $L$ is $1$, every non-zero weak $V_{L}^{+}$-module contains a non-zero $M(1)^{+}$-module, where $M(1)^{+}$ is the fixed point subalgebra of the Heisenberg vertex operator algebra $M(1)$ under the action of $\theta$.


title: Hilbert series of generic ideals in products of projective spaces

abstract: If $I=(f_1,\ldots,f_r)$ is an ideal in $S=k[x_1,\ldots,x_n]$, and $f_i$ are "general" elements of given degrees, there is a conjecture on the Hilbert series of $S/I$. We are considering the corresponding concepts in bigraded rings.


title: SliceNStitch: Continuous CP Decomposition of Sparse Tensor Streams

abstract: Consider traffic data (i.e., triplets in the form of source-destination-timestamp) that grow over time. Tensors (i.e., multi-dimensional arrays) with a time mode are widely used for modeling and analyzing such multi-aspect data streams. In such tensors, however, new entries are added only once per period, which is often an hour, a day, or even a year. This discreteness of tensors has limited their usage for real-time applications, where new data should be analyzed instantly as it arrives. How can we analyze time-evolving multi-aspect sparse data 'continuously' using tensors where time is'discrete'? We propose SLICENSTITCH for continuous CANDECOMP/PARAFAC (CP) decomposition, which has numerous time-critical applications, including anomaly detection, recommender systems, and stock market prediction. SLICENSTITCH changes the starting point of each period adaptively, based on the current time, and updates factor matrices (i.e., outputs of CP decomposition) instantly as new data arrives. We show, theoretically and experimentally, that SLICENSTITCH is (1) 'Any time': updating factor matrices immediately without having to wait until the current time period ends, (2) Fast: with constant-time updates up to 464x faster than online methods, and (3) Accurate: with fitness comparable (specifically, 72 ~ 100%) to offline methods.


title: Fourier-Jacobi cycles and arithmetic relative trace formula (with an appendix by Chao Li and Yihang Zhu)

abstract: In this article, we develop an arithmetic analogue of Fourier--Jacobi period integrals for a pair of unitary groups of equal rank. We construct the so-called Fourier--Jacobi cycles, which are algebraic cycles on the product of unitary Shimura varieties and abelian varieties. We propose the arithmetic Gan--Gross--Prasad conjecture for these cycles, which is related to central derivatives of certain Rankin--Selberg $L$-functions, and develop a relative trace formula approach toward this conjecture. As a necessary ingredient, we propose the conjecture of the corresponding arithmetic fundamental lemma, and confirm it for unitary groups of rank at most two and for the minuscule case.


title: Classification of Breast Cancer Lesions in Ultrasound Images by using Attention Layer and loss Ensembles in Deep Convolutional Neural Networks

abstract: Reliable classification of benign and malignant lesions in breast ultrasound images can provide an effective and relatively low cost method for early diagnosis of breast cancer. The accuracy of the diagnosis is however highly dependent on the quality of the ultrasound systems and the experience of the users (radiologists). The leverage in deep convolutional neural network approaches provided solutions in efficient analysis of breast ultrasound images. In this study, we proposed a new framework for classification of breast cancer lesions by use of an attention module in modified VGG16 architecture. We also proposed new ensembled loss function which is the combination of binary cross-entropy and logarithm of the hyperbolic cosine loss to improve the model discrepancy between classified lesions and its labels. Networks trained from pretrained ImageNet weights, and subsequently fine-tuned with ultrasound datasets. The proposed model in this study outperformed other modified VGG16 architectures with the accuracy of 93% and also the results are competitive with other state of the art frameworks for classification of breast cancer lesions. In this study, we employed transfer learning approaches with the pre-trained VGG16 architecture. Different CNN models for classification task were trained to predict benign or malignant lesions in breast ultrasound images. Our Experimental results show that the choice of loss function is highly important in classification task and by adding an attention block we could empower the performance our model.


title: Automatic Ship Classification Utilizing Bag of Deep Features

abstract: Detection and classification of ships based on their silhouette profiles in natural imagery is an important undertaking in computer science. This problem can be viewed from a variety of perspectives, including security, traffic control, and even militarism. Therefore, in each of the aforementioned applications, specific processing is required. In this paper, by applying the "bag of words" (BoW), a new method is presented that its words are the features that are obtained using pre-trained models of deep convolutional networks. , Three VGG models are utilized which provide superior accuracy in identifying objects. The regions of the image that are selected as the initial proposals are derived from a greedy algorithm on the key points generated by the Scale Invariant Feature Transform (SIFT) method. Using the deep features in the BOW method provides a good improvement in the recognition and classification of ships. Eventually, we obtained an accuracy of 91.8% in the classification of the ships which shows the improvement of about 5% compared to previous methods.


title: Whole-device entanglement in a 65-qubit superconducting quantum computer

abstract: The ability to generate large-scale entanglement is an important progenitor of quantum information processing capability in noisy intermediate-scale quantum (NISQ) devices. In this paper, we investigate the extent to which entangled quantum states over large numbers of qubits can be prepared on current superconducting quantum devices. We prepared native-graph states on the IBM Quantum 65-qubit $\textit{ibmq_manhattan}$ device and the 53-qubit $\textit{ibmq_rochester}$ device and applied quantum readout-error mitigation (QREM). Connected entanglement graphs spanning each of the full devices were detected, indicating bipartite entanglement over the whole of each device. The application of QREM was shown to increase the observed entanglement within all measurements, in particular, the detected number of entangled pairs of qubits found within $\textit{ibmq_rochester}$ increased from 31 to 56 of the total 58 connected pairs. The results of this work indicate full bipartite entanglement in two of the largest superconducting devices to date.


title: Assessing the Fornax globular cluster timing problem in different models of dark matter

abstract: We investigate what the orbits of globular clusters (GCs) in the Fornax dwarf spheroidal (dSph) galaxy can teach us about dark matter (DM). This problem was recently studied for ultralight dark matter (ULDM). We consider two additional models: (i) fermionic degenerate dark matter (DDM), where Pauli blocking should be taken into account in the dynamical friction computation; and (ii) self-interacting dark matter (SIDM). We give a simple and direct Fokker-Planck derivation of dynamical friction, new in the case of DDM and reproducing previous results in the literature for ULDM and cold DM. ULDM, DDM and SIDM were considered in the past as leading to cores in dSphs, a feature that acts to suppress dynamical friction and prolong GC orbits. For DDM we derive a version of the cosmological free streaming limit that is independent of the DM production mechanism, finding that DDM cannot produce an appreciable core in Fornax without violating Ly-$\alpha$ limits. If the Ly-$\alpha$ limit is discounted for some reason, then stellar kinematics data does allow a DDM core which could prolong GC orbits. For SIDM we find that significant prolongation of GC orbits could be obtained for values of the self-interaction cross section considered in previous works. In addition to reassessing the inspiral time using updated observational data, we give a new perspective on the so-called GC timing problem, demonstrating that for a cuspy cold DM profile dynamical friction predicts a $z=0$ radial distribution for the innermost GCs that is independent of initial conditions. The observed orbits of Fornax GCs are consistent with this expectation with a mild apparent fine-tuning at the level of $\sim25\%$.


title: Formation of rogue waves on the periodic background in a fifth-order nonlinear Schr\"odinger equation

abstract: We construct rogue wave solutions of a fifth-order nonlinear Schr\"odinger equation on the Jacobian elliptic function background. By combining Darboux transformation and the nonlinearization of spectral problem, we generate rogue wave solution on two different periodic wave backgrounds. We analyze the obtained solutions for different values of system parameter and point out certain novel features of our results. We also compute instability growth rate of both $dn$ and $cn$ periodic background waves for the considered system through spectral stability problem. We show that instability growth rate decreases (increases) for $dn$-$(cn)$ periodic waves when we vary the value of the elliptic modulus parameter.


title: A Data-driven Event Generator for Hadron Colliders using Wasserstein Generative Adversarial Network

abstract: Highly reliable Monte-Carlo event generators and detector simulation programs are important for the precision measurement in the high energy physics. Huge amounts of computing resources are required to produce a sufficient number of simulated events. Moreover, simulation parameters have to be fine-tuned to reproduce situations in the high energy particle interactions which is not trivial in some phase spaces in physics interests. In this paper, we suggest a new method based on the Wasserstein Generative Adversarial Network (WGAN) that can learn the probability distribution of the real data. Our method is capable of event generation at a very short computing time compared to the traditional MC generators. The trained WGAN is able to reproduce the shape of the real data with high fidelity.


title: End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend

abstract: Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, severe performance degradation is still observed in the reverberant and noisy scenarios, and there is still a large performance gap between anechoic and reverberant conditions. In this work, we focus on the multichannel multi-speaker reverberant condition, and propose to extend our previous framework for end-to-end dereverberation, beamforming, and speech recognition with improved numerical stability and advanced frontend subnetworks including voice activity detection like masks. The techniques significantly stabilize the end-to-end training process. The experiments on the spatialized wsj1-2mix corpus show that the proposed system achieves about 35% WER relative reduction compared to our conventional multi-channel E2E ASR system, and also obtains decent speech dereverberation and separation performance (SDR=12.5 dB) in the reverberant multi-speaker condition while trained only with the ASR criterion.


title: Enhanced Modality Transition for Image Captioning

abstract: Image captioning model is a cross-modality knowledge discovery task, which targets at automatically describing an image with an informative and coherent sentence. To generate the captions, the previous encoder-decoder frameworks directly forward the visual vectors to the recurrent language model, forcing the recurrent units to generate a sentence based on the visual features. Although these sentences are generally readable, they still suffer from the lack of details and highlights, due to the fact that the substantial gap between the image and text modalities is not sufficiently addressed. In this work, we explicitly build a Modality Transition Module (MTM) to transfer visual features into semantic representations before forwarding them to the language model. During the training phase, the modality transition network is optimised by the proposed modality loss, which compares the generated preliminary textual encodings with the target sentence vectors from a pre-trained text auto-encoder. In this way, the visual vectors are transited into the textual subspace for more contextual and precise language generation. The novel MTM can be incorporated into most of the existing methods. Extensive experiments have been conducted on the MS-COCO dataset demonstrating the effectiveness of the proposed framework, improving the performance by 3.4% comparing to the state-of-the-arts.


title: Data Quality Certification using ISO/IEC 25012: Industrial Experiences

abstract: The most successful organizations in the world are data-driven businesses. Data is at the core of the business of many organizations as one of the most important assets, since the decisions they make cannot be better than the data on which they are based. Due to this reason, organizations need to be able to trust their data. One important activity that helps to achieve data reliability is the evaluation and certification of the quality level of organizational data repositories. This paper describes the results of the application of a data quality evaluation and certification process to the repositories of three European organizations belonging to different sectors. We present findings from the point of view of both the data quality evaluation team and the organizations that underwent the evaluation process. In this respect, several benefits have been explicitly recognised by the involved organizations after achieving the data quality certification for their repositories (e.g., long-term organizational sustainability, better internal knowledge of data, and a more efficient management of data quality). As a result of this experience, we have also identified a set of best practices aimed to enhance the data quality evaluation process.


title: CBP: Coordinated management of cache partitioning, bandwidth partitioning and prefetch throttling

abstract: Reducing the average memory access time is crucial for improving the performance of applications running on multi-core architectures. With workload consolidation this becomes increasingly challenging due to shared resource contention. Techniques for partitioning of shared resources - cache and bandwidth - and prefetching throttling have been proposed to mitigate contention and reduce the average memory access time. However, existing proposals only employ a single or a subset of these techniques and are therefore not able to exploit the full potential of coordinated management of cache, bandwidth and prefetching. Our characterization results show that application performance, in several cases, is sensitive to prefetching, cache and bandwidth allocation. Furthermore, the results show that managing these together provides higher performance potential during workload consolidation as it enables more resource trade-offs. In this paper, we propose CBP a coordination mechanism for dynamically managing prefetching throttling, cache and bandwidth partitioning, in order to reduce average memory access time and improve performance. CBP works by employing individual resource managers to determine the appropriate setting for each resource and a coordinating mechanism in order to enable inter-resource trade-offs. Our evaluation on a 16-core CMP shows that CBP, on average, improves performance by 11% compared to the state-of-the-art technique that manages cache partitioning and prefetching and by 50% compared to the baseline without cache partitioning, bandwidth partitioning and prefetch throttling.


title: Differentiable Logic Machines

abstract: The integration of reasoning, learning, and decision-making is key to build more general artificial intelligence systems. As a step in this direction, we propose a novel neural-logic architecture, called differentiable logic machine (DLM), that can solve both inductive logic programming (ILP) and reinforcement learning (RL) problems, where the solution can be interpreted as a first-order logic program. Our proposition includes several innovations. Firstly, our architecture defines a restricted but expressive continuous relaxation of the space of first-order logic programs by assigning weights to predicates instead of rules, in contrast to most previous neural-logic approaches. Secondly, with this differentiable architecture, we propose several (supervised and RL) training procedures, based on gradient descent, which can recover a fully-interpretable solution (i.e., logic formula). Thirdly, to accelerate RL training, we also design a novel critic architecture that enables actor-critic algorithms. Fourthly, to solve hard problems, we propose an incremental training procedure that can learn a logic program progressively. Compared to state-of-the-art (SOTA) differentiable ILP methods, DLM successfully solves all the considered ILP problems with a higher percentage of successful seeds (up to 3.5$\times$). On RL problems, without requiring an interpretable solution, DLM outperforms other non-interpretable neural-logic RL approaches in terms of rewards (up to 3.9%). When enforcing interpretability, DLM can solve harder RL problems (e.g., Sorting, Path) Moreover, we show that deep logic programs can be learned via incremental supervised training. In addition to this excellent performance, DLM can scale well in terms of memory and computational time, especially during the testing phase where it can deal with much more constants ($>$2$\times$) than SOTA.


title: Domain-invariant NBV Planner for Active Cross-domain Self-localization

abstract: Pole-like landmark has received increasing attention as a domain-invariant visual cue for visual robot self-localization across domains (e.g., seasons, times of day, weathers). However, self-localization using pole-like landmarks can be ill-posed for a passive observer, as many viewpoints may not provide any pole-like landmark view. To alleviate this problem, we consider an active observer and explore a novel "domain-invariant" next-best-view (NBV) planner that attains consistent performance over different domains (i.e., maintenance-free), without requiring the expensive task of training data collection and retraining. In our approach, a novel multi-encoder deep convolutional neural network enables to detect domain invariant pole-like landmarks, which are then used as the sole input to a model-free deep reinforcement learning -based domain-invariant NBV planner. Further, we develop a practical system for active self-localization using sparse invariant landmarks and dense discriminative landmarks. In experiments, we demonstrate that the proposed method is effective both in efficient landmark detection and in discriminative self-localization.


title: Memory-efficient Speech Recognition on Smart Devices

abstract: Recurrent transducer models have emerged as a promising solution for speech recognition on the current and next generation smart devices. The transducer models provide competitive accuracy within a reasonable memory footprint alleviating the memory capacity constraints in these devices. However, these models access parameters from off-chip memory for every input time step which adversely effects device battery life and limits their usability on low-power devices. We address transducer model's memory access concerns by optimizing their model architecture and designing novel recurrent cell designs. We demonstrate that i) model's energy cost is dominated by accessing model weights from off-chip memory, ii) transducer model architecture is pivotal in determining the number of accesses to off-chip memory and just model size is not a good proxy, iii) our transducer model optimizations and novel recurrent cell reduces off-chip memory accesses by 4.5x and model size by 2x with minimal accuracy impact.


title: Optimality of increasing stability for an inverse boundary value problem

abstract: In this work we study the optimality of increasing stability of the inverse boundary value problem (IBVP) for Schr\"{o}dinger equation. The rigorous justification of increasing stability for the IBVP for Schr\"{o}dinger equation were established by Isakov \cite{Isa11} and by Isakov, Nagayasu, Uhlmann, Wang of the paper \cite{INUW14}. In \cite{Isa11}, \cite{INUW14}, the authors showed that the stability of this IBVP increases as the frequency increases in the sense that the stability estimate changes from a logarithmic type to a H\"{o}lder type. In this work, we prove that the instability changes from an exponential type to a H\"older type when the frequency increases. This result verifies that results in \cite{Isa11}, \cite{INUW14} are optimal.


title: Accurate Learning of Graph Representations with Graph Multiset Pooling

abstract: Graph neural networks have been widely used on modeling graph data, achieving impressive results on node classification and link prediction tasks. Yet, obtaining an accurate representation for a graph further requires a pooling function that maps a set of node representations into a compact form. A simple sum or average over all node representations considers all node features equally without consideration of their task relevance, and any structural dependencies among them. Recently proposed hierarchical graph pooling methods, on the other hand, may yield the same representation for two different graphs that are distinguished by the Weisfeiler-Lehman test, as they suboptimally preserve information from the node features. To tackle these limitations of existing graph pooling methods, we first formulate the graph pooling problem as a multiset encoding problem with auxiliary information about the graph structure, and propose a Graph Multiset Transformer (GMT) which is a multi-head attention based global pooling layer that captures the interaction between nodes according to their structural dependencies. We show that GMT satisfies both injectiveness and permutation invariance, such that it is at most as powerful as the Weisfeiler-Lehman graph isomorphism test. Moreover, our methods can be easily extended to the previous node clustering approaches for hierarchical graph pooling. Our experimental results show that GMT significantly outperforms state-of-the-art graph pooling methods on graph classification benchmarks with high memory and time efficiency, and obtains even larger performance gain on graph reconstruction and generation tasks.


title: Statistical analysis of fireballs: Seismic signature survey

abstract: Fireballs are infrequently recorded by seismic sensors on the ground. If recorded, they are usually reported as one-off events. This study is the first seismic bulk analysis of the largest single fireball data set, observed by the Desert Fireball Network (DFN) in Australia in the period 2014-2019. The DFN typically observes fireballs from cm-m scale impactors. We identified 25 fireballs in seismic time series data recorded by the Australian National Seismograph Network (ANSN). This corresponds to 1.8% of surveyed fireballs, at the kinetic energy range of 10$^6$ to 10$^{10}$ J. The peaks observed in the seismic time series data were consistent with calculated arrival times of the direct airwave or ground-coupled Rayleigh wave caused by shock waves by the fireball in the atmosphere (either due to fragmentation or the passage of the Mach cone). Our work suggests that identification of fireball events in the seismic time series data depends both on physical properties of a fireball (such as fireball energy and entry angle in the atmosphere) and the sensitivity of a seismic instrument. This work suggests that fireballs are likely detectable within 200 km direct air distance between a fireball and seismic station, for sensors used in the ANSN. If each DFN observatory had been accompanied by a seismic sensor of similar sensitivity, 50% of surveyed fireballs could have been detected. These statistics justify the future consideration of expanding the DFN camera network into the seismic domain.


title: Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective

abstract: Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy resource consumption and often incurring search bias due to truncated training or approximations. Can we select the best neural architectures without involving any training and eliminate a drastic portion of the search cost? We provide an affirmative answer, by proposing a novel framework called training-free neural architecture search (TE-NAS). TE-NAS ranks architectures by analyzing the spectrum of the neural tangent kernel (NTK) and the number of linear regions in the input space. Both are motivated by recent theory advances in deep networks and can be computed without any training and any label. We show that: (1) these two measurements imply the trainability and expressivity of a neural network; (2) they strongly correlate with the network's test accuracy. Further on, we design a pruning-based NAS mechanism to achieve a more flexible and superior trade-off between the trainability and expressivity during the search. In NAS-Bench-201 and DARTS search spaces, TE-NAS completes high-quality search but only costs 0.5 and 4 GPU hours with one 1080Ti on CIFAR-10 and ImageNet, respectively. We hope our work inspires more attempts in bridging the theoretical findings of deep networks and practical impacts in real NAS applications. Code is available at: https://github.com/VITA-Group/TENAS.


title: Explicit high-order generalized-$\alpha$ methods for isogeometric analysis of structural dynamics

abstract: We propose a new family of high-order explicit generalized-$\alpha$ methods for hyperbolic problems with the feature of dissipation control. Our approach delivers $2k,\, \left(k \in \mathbb{N}\right)$ accuracy order in time by solving $k$ matrix systems explicitly and updating the other $2k$ variables at each time-step. The user can control the numerical dissipation in the discrete spectrum's high-frequency regions by adjusting the method's coefficients. We study the method's spectrum behaviour and show that the CFL condition is independent of the accuracy order. The stability region remains invariant while we increase the accuracy order. Next, we exploit efficient preconditioners for the isogeometric matrix to minimize the computational cost. These preconditioners use a diagonal-scaled Kronecker product of univariate parametric mass matrices; they have a robust performance with respect to the spline degree and the mesh size, and their decomposition structure implies that their application is faster than a matrix-vector product involving the fully-assembled mass matrix. Our high-order schemes require simple modifications of the available implementations of the generalized-$\alpha$ method. Finally, we present numerical examples demonstrating the methodology's performance regarding single- and multi-patch IGA discretizations.


title: Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimization

abstract: Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often supposed to be linked to the quality of the integrator (accuracy, energy preservation, symplecticity). In this work, we propose a novel ordinary differential equation that questions this connection: both the explicit and the semi-implicit (a.k.a symplectic) Euler discretizations on this ODE lead to an accelerated algorithm for convex programming. Although semi-implicit methods are well-known in numerical analysis to enjoy many desirable features for the integration of physical systems, our findings show that these properties do not necessarily relate to acceleration.


title: Mass production and characterization of 3-inch PMTs for the JUNO experiment

abstract: 26,000 3-inch photomultiplier tubes (PMTs) have been produced for Jiangmen Underground Neutrino Observatory (JUNO) by the Hainan Zhanchuang Photonics Technology Co., Ltd (HZC) company in China and passed all acceptance tests with only 15 tubes rejected. The mass production began in 2018 and elapsed for about 2 years at a rate of $\sim$1,000~PMTs per month. The characterization of the PMTs was performed in the factory concurrently with production as a joint effort between HZC and JUNO. Fifteen performance parameters were tracked at different sampling rates, and novel working strategies were implemented to improve quality assurance. This constitutes the largest sample of 3-inch PMTs ever produced and studied in detail to date.


title: Decision Rule Elicitation for Domain Adaptation

abstract: Human-in-the-loop machine learning is widely used in artificial intelligence (AI) to elicit labels for data points from experts or to provide feedback on how close the predicted results are to the target. This simplifies away all the details of the decision-making process of the expert. In this work, we allow the experts to additionally produce decision rules describing their decision-making; the rules are expected to be imperfect but to give additional information. In particular, the rules can extend to new distributions, and hence enable significantly improving performance for cases where the training and testing distributions differ, such as in domain adaptation. We apply the proposed method to lifelong learning and domain adaptation problems and discuss applications in other branches of AI, such as knowledge acquisition problems in expert systems. In simulated and real-user studies, we show that decision rule elicitation improves domain adaptation of the algorithm and helps to propagate expert's knowledge to the AI model.


title: MSR Mining Challenge: The SmartSHARK Repository Mining Data

abstract: The SmartSHARK repository mining data is a collection of rich and detailed information about the evolution of software projects. The data is unique in its diversity and contains detailed information about each change, issue tracking data, continuous integration data, as well as pull request and code review data. Moreover, the data does not contain only raw data scraped from repositories, but also annotations in form of labels determined through a combination of manual analysis and heuristics, as well as links between the different parts of the data set. The SmartSHARK data set provides a rich source of data that enables us to explore research questions that require data from different sources and/or longitudinal data over time.


title: Deep Deformation Detail Synthesis for Thin Shell Models

abstract: In physics-based cloth animation, rich folds and detailed wrinkles are achieved at the cost of expensive computational resources and huge labor tuning. Data-driven techniques make efforts to reduce the computation significantly by a database. One type of methods relies on human poses to synthesize fitted garments which cannot be applied to general cloth. Another type of methods adds details to the coarse meshes without such restrictions. However, existing works usually utilize coordinate-based representations which cannot cope with large-scale deformation, and requires dense vertex correspondences between coarse and fine meshes. Moreover, as such methods only add details, they require coarse meshes to be close to fine meshes, which can be either impossible, or require unrealistic constraints when generating fine meshes. To address these challenges, we develop a temporally and spatially as-consistent-as-possible deformation representation (named TS-ACAP) and a DeformTransformer network to learn the mapping from low-resolution meshes to detailed ones. This TS-ACAP representation is designed to ensure both spatial and temporal consistency for sequential large-scale deformations from cloth animations. With this representation, our DeformTransformer network first utilizes two mesh-based encoders to extract the coarse and fine features, respectively. To transduct the coarse features to the fine ones, we leverage the Transformer network that consists of frame-level attention mechanisms to ensure temporal coherence of the prediction. Experimental results show that our method is able to produce reliable and realistic animations in various datasets at high frame rates: 10 ~ 35 times faster than physics-based simulation, with superior detail synthesis abilities than existing methods.


title: Symmetry change of $d$-wave superconductivity in $\kappa$-type organic superconductors

abstract: Magnetic-field-angle-resolved heat capacity of dimer-Mott organic superconductors $\kappa$-(BEDT-TTF)$_2$$X$ is reported. Temperature and field dependence of heat capacity indicates that the superconductivity has line nodes on the Fermi surface, which is a typical feature of $d$-wave superconductivity. In-plane field-angle dependence exhibits fourfold oscillations as well as twofold oscillations due to anisotropy of superconducting gap functions. From analyses of the fourfold term, the gap symmetry is determined as $d_{x^{2}-y^{2}}$+$s_{\pm}$ for $X$=Cu[N(CN)$_2$]Br and $d_{xy}$ for $X$=Ag(CN)$_2$H$_2$O. We suggest that the symmetry difference comes from the competition of $d_{xy}$ and $d_{x^{2}-y^{2}}$ antiferromagnetic fluctuations depending on lattice geometry.


title: Parameter estimation in nonlinear mixed effect models based on ordinary differential equations: an optimal control approach

abstract: We present a parameter estimation method for nonlinear mixed effect models based on ordinary differential equations (NLME-ODEs). The method presented here aims at regularizing the estimation problem in presence of model misspecifications, practical identifiability issues and unknown initial conditions. For doing so, we define our estimator as the minimizer of a cost function which incorporates a possible gap between the assumed model at the population level and the specific individual dynamic. The cost function computation leads to formulate and solve optimal control problems at the subject level. This control theory approach allows to bypass the need to know or estimate initial conditions for each subject and it regularizes the estimation problem in presence of poorly identifiable parameters. Comparing to maximum likelihood, we show on simulation examples that our method improves estimation accuracy in possibly partially observed systems with unknown initial conditions or poorly identifiable parameters with or without model error. We conclude this work with a real application on antibody concentration data after vaccination against Ebola virus coming from phase 1 trials. We use the estimated model discrepancy at the subject level to analyze the presence of model misspecification.


title: Identifying Physical Law of Hamiltonian Systems via Meta-Learning

abstract: Hamiltonian mechanics is an effective tool to represent many physical processes with concise yet well-generalized mathematical expressions. A well-modeled Hamiltonian makes it easy for researchers to analyze and forecast many related phenomena that are governed by the same physical law. However, in general, identifying a functional or shared expression of the Hamiltonian is very difficult. It requires carefully designed experiments and the researcher's insight that comes from years of experience. We propose that meta-learning algorithms can be potentially powerful data-driven tools for identifying the physical law governing Hamiltonian systems without any mathematical assumptions on the representation, but with observations from a set of systems governed by the same physical law. We show that a well meta-trained learner can identify the shared representation of the Hamiltonian by evaluating our method on several types of physical systems with various experimental settings.


title: Accelerating Recursive Partition-Based Causal Structure Learning

abstract: Causal structure discovery from observational data is fundamental to the causal understanding of autonomous systems such as medical decision support systems, advertising campaigns and self-driving cars. This is essential to solve well-known causal decision making and prediction problems associated with those real-world applications. Recently, recursive causal discovery algorithms have gained particular attention among the research community due to their ability to provide good results by using Conditional Independent (CI) tests in smaller sub-problems. However, each of such algorithms needs a refinement function to remove undesired causal relations of the discovered graphs. Notably, with the increase of the problem size, the computation cost (i.e., the number of CI-tests) of the refinement function makes an algorithm expensive to deploy in practice. This paper proposes a generic causal structure refinement strategy that can locate the undesired relations with a small number of CI-tests, thus speeding up the algorithm for large and complex problems. We theoretically prove the correctness of our algorithm. We then empirically evaluate its performance against the state-of-the-art algorithms in terms of solution quality and completion time in synthetic and real datasets.


title: High-frequency acoustic droplet vaporization is initiated by resonance

abstract: Vaporization of low-boiling point droplets has numerous applications in combustion, process engineering and in recent years, in clinical medicine. However, the physical mechanisms governing the phase conversion are only partly explained. Here, we show that an acoustic resonance can arise from the large speed of sound mismatch between a perfluorocarbon microdroplet and its surroundings. The fundamental resonance mode obeys a unique relationship $kR$~$\sim$ 0.65 between droplet size and driving frequency that leads to a 3-fold pressure amplification inside the droplet. Classical nucleation theory shows that this pressure amplification increases the nucleation rate by several orders of magnitude. These findings are confirmed by high-speed imaging performed at a timescale of ten nanoseconds. The optical recordings demonstrate that droplets exposed to intense acoustic waves generated by inter-digital-transducers nucleate only if they match the theoretical resonance size.


title: Temperature and entropy-area relation of quantum matter near spherically symmetric outer trapping horizons

abstract: We consider spherically symmetric spacetimes with an outer trapping horizon. Such spacetimes are generalizations of spherically symmetric black hole spacetimes where the central mass can vary with time, like in black hole collapse or black hole evaporation. These spacetimes possess in general no timelike Killing vector field, but admit a Kodama vector field which provides a replacement. Spherically symmetric spacelike cross-sections of the outer trapping horizon define in- and outgoing lightlike congruences. We investigate a scaling limit of Hadamard 2-point functions of a quantum field on the spacetime onto the ingoing lightlike congruence. The scaling limit 2-point function has a universal form and a thermal spectrum with respect to the time-parameter of the Kodama flow, where the inverse temperature is related to the surface gravity of the horizon cross-section in the same way as in the Hawking effect for an asymptotically static black hole. Similarly, the tunneling probability in the scaling limit between in- and outgoing Fourier modes with respect to the the Kodama time shows a thermal distribution with the same inverse temperature, determined by the surface gravity. This can be seen as a local counterpart of the Hawking effect for a dynamical horizon in the scaling limit. The scaling limit 2-point function as well as the 2-point functions of coherent states of the scaling-limit-theory have relative entropies behaving proportional to the cross-sectional horizon area. Thereby, we establish a local counterpart, and microscopic interpretation in the setting of quantum field theory on curved spacetimes, of the dynamical laws of outer trapping horizons, derived by Hayward and others in generalizing the laws of black hole dynamics originally shown for stationary black holes by Bardeen, Carter and Hawking. (Extended abstract in the article.)


title: Maximizing Agreements for Ranking, Clustering and Hierarchical Clustering via MAX-CUT

abstract: In this paper, we study a number of well-known combinatorial optimization problems that fit in the following paradigm: the input is a collection of (potentially inconsistent) local relationships between the elements of a ground set (e.g., pairwise comparisons, similar/dissimilar pairs, or ancestry structure of triples of points), and the goal is to aggregate this information into a global structure (e.g., a ranking, a clustering, or a hierarchical clustering) in a way that maximizes agreement with the input. Well-studied problems such as rank aggregation, correlation clustering, and hierarchical clustering with triplet constraints fall in this class of problems. We study these problems on stochastic instances with a hidden embedded ground truth solution. Our main algorithmic contribution is a unified technique that uses the maximum cut problem in graphs to approximately solve these problems. Using this technique, we can often get approximation guarantees in the stochastic setting that are better than the known worst case inapproximability bounds for the corresponding problem. On the negative side, we improve the worst case inapproximability bound on several hierarchical clustering formulations through a reduction to related ranking problems.


title: Strength and slice rank of forms are generically equal

abstract: We prove that strength and slice rank of homogeneous polynomials of degree $d \geq 5$ over an algebraically closed field of characteristic zero coincide generically. To show this, we establish a conjecture of Catalisano, Geramita, Gimigliano, Harbourne, Migliore, Nagel and Shin concerning dimensions of secant varieties of the varieties of reducible homogeneous polynomials. These statements were already known in degrees $2\leq d\leq 7$ and $d=9$.


title: Blowups and longtime developments with near-boundary mass accretions of irregularly-shaped Euler--Poisson dominated molecular clouds in astrophysics

abstract: Motivated by the astrophysical problems of star formations from molecular clouds,we make the first step on the possible long time behaviors of certain irregularly-shaped molecular clouds. We emphasis the main difficulty of the blowups of the irregular-shaped fluids with vacuum (molecular clouds) comes from the initial irregular configurations of its density (multiple centers of gravity). This inevitably causes far more complicated movements during the evolution than the one with spherical symmetry. The spherical symmetric case has been well studied. However, for the non-spherical symmetric case with the gravity, it is very rare in the references due to a very complicate nonlinear interaction between the gravity and the fluids. This article concludes, under the admissible data (i.e., large scale, irregularly-shaped, expanding and rotational molecular clouds), the developments of the solution (molecular clouds) are either global (the first class) with near-boundary mass accretions (leads to star formations), or blowup at finite time. In addition, certain singularities can be removed from the boundary if the data is strongly admissible. This paper partially answers Makino's conjecture [37] in 1992 on the finite time blowup of any tame solution without symmetries for some data and the model of the molecular clouds and the local wellposedness have been established in the companion article [30].


title: Semi-automated BSM model building procedures in MARTY-1.1 through a 2HDM example

abstract: MARTY is a C++ computer algebra system specialized for High Energy Physics that can calculate amplitudes, squared amplitudes and Wilson coefficients in a large variety of beyond the Standard Model scenarios up to the one-loop order. It is fully independent of any other framework and its main development guideline is generality, in order to be adapted easily to any type of model. The calculations are fully automated from the Lagrangian up to the generation of the C++ code evaluating the theoretical results (numerically, depending on the model parameters). Once a phenomenological tool chain has been set up - from a Lagrangian to observable analysis - it can be used in a model independent way leaving only model building, with MARTY, as the task to be performed by physicists. Here we present the main steps to build a general new physics model, namely gauge group, particle content, representations, replacements, rotations and symmetry breaking, using the example of a 2 Higgs Doublet Model. The sample codes that are shown for this example can be easily generalized to any Beyond the Standard Model scenario written with MARTY.


title: Equidistribution and freeness on Grassmannians

abstract: We associate a certain tensor product lattice to any primitive integer lattice and ask about its typical shape. These lattices are related to the tangent bundle of Grassmannians and their study is motivated by Peyre's programme on "freeness" for rational points of bounded height on Fano varieties.


title: The construction and local distinguishability of multiqubit unextendible product bases

abstract: An important problem in quantum information is to construct multiqubit unextendible product bases (UPBs). By using the unextendible orthogonal matrices, we construct a 7-qubit UPB of size 11. It solves an open problem in [Quantum Information Processing 19:185 (2020)]. Next, we graph-theoretically show that the UPB is locally indistinguishable in the bipartite systems of two qubits and five qubits, respectively. It turns out that the UPB corresponds to a complete graph with 11 vertices constructed by three sorts of nonisomorphic graphs. Taking the graphs as product vectors, we show that they are in three different orbits up to local unitary equivalence. Moreover, we also present the number of sorts of nonisomorphic graphs of complete graphs of some known UPBs and their orbits.


title: Consistent equivalence principle tests with fast radio bursts

abstract: Fast radio bursts (FRBs) are astrophysical transients of still debated origin. So far several hundred events have been detected, mostly at extragalactic distances, and this number is expected to grow significantly over the next years. The radio signals from the burst experience dispersion as they travel through the free electrons along the line-of-sight characterised by the dispersion measure (DM) of the radio pulse. In addition, each photon also experiences a gravitational Shapiro time delay while travelling through the potentials generated by the large-scale structure. If the equivalence principle (EP) holds, the Shapiro delay is the same for photons of all frequencies. In case the EP is broken, one would expect an additional dispersion to occur which could be either positive or negative for individual sources. Here we suggest to use angular statistics of the DM fluctuations to put constraints on the EP parametrized by the post-Newtonian parameter $\gamma$. Previous studies suffer from the problem that the gravitational potential responsible for the delay diverges in a cosmological setting, which our approach avoids. We carry out a forecast for a population of FRBs observable within the next years and show that any significant detection of the DM angular power spectrum will place constraints on the EP that are by a few orders of magnitude more stringent than current limits.


title: Two-sided Singular Control of an Inventory with Unknown Demand Trend (Extended Version)

abstract: We study the problem of optimally managing an inventory with unknown demand trend. Our formulation leads to a stochastic control problem under partial observation, in which a Brownian motion with non-observable drift can be singularly controlled in both an upward and downward direction. We first derive the equivalent separated problem under full information, with state-space components given by the Brownian motion and the filtering estimate of its unknown drift, and we then completely solve this latter problem. Our approach uses the transition amongst three different but equivalent problem formulations, links between two-dimensional bounded-variation stochastic control problems and games of optimal stopping, and probabilistic methods in combination with refined viscosity theory arguments. We show substantial regularity of (a transformed version of) the value function, we construct an optimal control rule, and we show that the free boundaries delineating (transformed) action and inaction regions are bounded globally Lipschitz continuous functions. To our knowledge this is the first time that such a problem has been solved in the literature.


title: The State-of-Practice in Requirements Elicitation: An Extended Interview Study at 12 Companies

abstract: Context. Requirements engineering remains a discipline that is faced with a large number of challenges, including the implementation of a requirements elicitation process in industry. Although several proposals have been suggested by researchers and academics, little is known of the practices that are actually followed in industry. Objective. We investigate the SoTA with respect to requirements elicitation, examining practitioners' practices. We focus on the techniques, the roles involved, and the challenges associated to the process. Method. We conducted an interview-based survey study involving 24 practitioners from 12 different Swedish IT companies. Results. We found that group interaction techniques, including meetings and workshops, are the most popular type of elicitation techniques that are employed by the practitioners, except in the case of small projects. We noted that customers are frequently involved in the elicitation process, except in the case of market-driven organizations. Technical staff (for example, developers and architects) are more frequently involved in the elicitation process compared to the involvement of business- or strategic staff. Finally, we identified a number of challenges with respect to stakeholders. These challenges include difficulties in understanding and prioritizing their needs. Further, it was noted that requirements instability (i.e., caused by changing needs or priorities) was a predominant challenge. These observations need to be interpreted in the context of the study. Conclusion. The relevant observations regarding the survey participants' experiences should be of interest to the industry; experiences that should be analyzed in the practitioners' context. Researchers may find evidence for the use of academic results in practice, thereby inspiring future theoretical work, as well as further empirical studies in the same area.


title: Matrix-Pencil Approach-Based Interference Mitigation for FMCW Radar Systems

abstract: A novel matrix pencil-based interference mitigation approach for FMCW radars is proposed in this paper. The interference-contaminated segment of the beat signal is firstly cut out and then the signal samples in the cut-out region are reconstructed by modeling the beat signal as a sum of complex exponentials and using the matrix pencil method to estimate their parameters. The efficiency of the proposed approach for the interference with different parameters (i.e. interference duration, signal-to-noise ratio (SNR), and different target scenarios) is investigated by means of numerical simulations. The proposed interference mitigation approach is intensively verified on experimental data. Comparisons of the proposed approach with the zeroing and other beat-frequency interpolation techniques are presented. The results indicate the broad applicability and superiority of the proposed approach, especially in low SNR and long interference duration situations.


title: EscapeWildFire: Assisting People to Escape Wildfires in Real-Time

abstract: Over the past couple of decades, the number of wildfires and area of land burned around the world has been steadily increasing, partly due to climatic changes and global warming. Therefore, there is a high probability that more people will be exposed to and endangered by forest fires. Hence there is an urgent need to design pervasive systems that effectively assist people and guide them to safety during wildfires. This paper presents EscapeWildFire, a mobile application connected to a backend system which models and predicts wildfire geographical progression, assisting citizens to escape wildfires in real-time. A small pilot indicates the correctness of the system. The code is open-source; fire authorities around the world are encouraged to adopt this approach.


title: Toward Speeding up Mutation Analysis by Memoizing Expensive Methods

abstract: Mutation analysis has many applications, such as assessing the quality of test cases, fault localization, test input generation, security analysis, etc. Such applications involve running test suite against a large number of program mutants leading to poor scalability. Much research has been aimed at speeding up this process, focusing on reducing the number of mutants, the number of executed tests, or the execution time of the mutants. This paper presents a novel approach, named MeMu, for reducing the execution time of the mutants, by memoizing the most expensive methods in the system. Memoization is an optimization technique that allows bypassing the execution of expensive methods, when repeated inputs are detected. MeMu can be used in conjunction with existing acceleration techniques. We implemented MeMu on top of PITest, a well-known JVM bytecode-level mutation analysis system, and obtained, on average, an 18.15% speed-up over PITest, in the execution time of the mutants for 12 real-world programs. These promising results and the fact that MeMu could also be used for other applications that involve repeated execution of tests (e.g., automatic program repair and regression testing), strongly support future research for improving its efficiency.


title: SISE-PC: Semi-supervised Image Subsampling for Explainable Pathology

abstract: Although automated pathology classification using deep learning (DL) has proved to be predictively efficient, DL methods are found to be data and compute cost intensive. In this work, we aim to reduce DL training costs by pre-training a Resnet feature extractor using SimCLR contrastive loss for latent encoding of OCT images. We propose a novel active learning framework that identifies a minimal sub-sampled dataset containing the most uncertain OCT image samples using label propagation on the SimCLR latent encodings. The pre-trained Resnet model is then fine-tuned with the labelled minimal sub-sampled data and the underlying pathological sites are visually explained. Our framework identifies upto 2% of OCT images to be most uncertain that need prioritized specialist attention and that can fine-tune a Resnet model to achieve upto 97% classification accuracy. The proposed method can be extended to other medical images to minimize prediction costs.


title: Multiparameter universality and conformal field theory for anisotropic confined systems: test by Monte Carlo simulations

abstract: Analytic predictions have been derived recently by V. Dohm and S. Wessel, Phys. Rev. Lett. {\bf 126}, 060601 (2021) from anisotropic $\varphi^4$ theory and conformal field theory for the amplitude ${\cal F}_c$ of the critical free energy of finite anisotropic systems in the two-dimensional Ising universality class. These predictions employ the hypothesis of multiparameter universality. We test these predictions by means of high-precision Monte Carlo (MC) simulations for ${\cal F}_c$ of the Ising model on a square lattice with isotropic ferromagnetic couplings between nearest neighbors and with an anisotropic coupling between next-nearest neighbors along one diagonal. We find remarkable agreement between the MC data and the analytical prediction. This agreement supports the validity of multiparameter universality and invalidates two-scale-factor universality as ${\cal F}_c$ is found to exhibit a nonuniversal dependence on the microscopic couplings of the scalar $\varphi^4$ model and the Ising model. Our results are compared with the exact result for ${\cal F}_c$ in the three-dimensional $\varphi^4$ model with a planar anisotropy in the spherical limit. The critical Casimir amplitude is briefly discussed.


title: Modified quantum delayed-choice experiment without quantum control

abstract: Wheeler's delayed-choice experiment delays the decision to observe either the wave or particle behavior of a photon until after it has entered the interferometer, and the quantum delayed-choice experiment provides the possibility of observing the wave and particle behavior simultaneously by introducing quantum control device. We here propose a modified quantum delayed-choice experiment without quantum control or entanglement assistance, in which a photon can be prepared in a wave-particle superposition state and the morphing behavior of wave-to-particle transition can be observed easily. It is demonstrated that the presented scheme can allow us to rule out classical hidden variable models in a device-independent manner via violating dimension witness. We also extend the scheme to the situation of two degrees of freedom, first constructing a hybrid quantum delayed-choice experiment which enables simultaneous observation of a photon's wave and particle behaviors in different degrees of freedom, and then proposing a scheme to prepare the single-photon wave-particle entanglement. This study is not only meaningful to explore the wave and particle properties of photons, but also provides potential for the research of the single-particle nonlocality from the perspective of the wave-particle degree of freedom.


title: Multivariate generalized splines and syzygies on graphs

abstract: Given a graph $G$ whose edges are labeled by ideals of a commutative ring $R$ with identity, a generalized spline is a vertex labeling of $G$ by the elements of $R$ so that the difference of labels on adjacent vertices is an element of the corresponding edge ideal. The set of all generalized splines on a graph $G$ with base ring $R$ has a ring and an $R$-module structure. In this paper, we focus on the freeness of generalized spline modules over certain graphs with the base ring $R = k[x_1 , \ldots , x_d]$ where $k$ is a field. We first show the freeness of generalized spline modules on graphs with no interior edges over $k[x,y]$ such as cycles or a disjoint union of cycles with free edges. Later, we consider graphs that can be decomposed into disjoint cycles without changing the isomorphism class of the syzygy modules. Then we use this decomposition to show that generalized spline modules are free over $k[x , y]$ and later we extend this result to the base ring $R = k[x_1 , \ldots , x_d]$ under some restrictions.


title: Monotone cubic spline interpolation for functions with a strong gradient

abstract: Spline interpolation has been used in several applications due to its favorable properties regarding smoothness and accuracy of the interpolant. However, when there exists a discontinuity or a steep gradient in the data, some artifacts can appear due to the Gibbs phenomenon. Also, preservation of data monotonicity is a requirement in some applications, and that property is not automatically verified by the interpolator. In this paper, we study sufficient conditions to obtain monotone cubic splines based on Hermite cubic interpolators and propose different ways to construct them using non-linear formulas. The order of approximation, in each case, is calculated and several numerical experiments are performed to contrast the theoretical results.


title: Multiscale, multiwavelength extraction of sources and filaments using separation of the structural components: getsf

abstract: High-quality astronomical images delivered by modern ground-based and space observatories demand adequate, reliable software for their analysis and accurate extraction of sources, filaments, and other structures, containing massive amounts of detailed information about the complex physical processes in space. The multiwavelength observations with highly variable angular resolutions across wavebands require extraction tools that preserve and use the invaluable high-resolution information. This paper presents getsf, a new method for extracting sources and filaments in astronomical images using separation of their structural components, designed to handle multiwavelength sets of images and very complex filamentary backgrounds. The method spatially decomposes the original images and separates the structural components of sources and filaments from each other and from their backgrounds, flattening their resulting images. It spatially decomposes the flattened components, combines them over wavelengths, detects the positions of sources and skeletons of filaments, and measures the detected sources and filaments. This paper presents a realistic multiwavelength set of simulated benchmark images that can serve as the standard benchmark problem to evaluate qualities of source- and filament-extraction methods. This paper describes hires, an improved algorithm for the derivation of high-resolution surface densities from the multiwavelength far-infrared Herschel images. The algorithm allows creating the surface densities with angular resolutions that reach 5.6 arcsec, when the 70 micron image is used. The codes getsf and hires are illustrated by their applications to a variety of images, from the X-ray domain to the millimeter wavelengths.


title: Multi-Knowledge Fusion for New Feature Generation in Generalized Zero-Shot Learning

abstract: Suffering from the semantic insufficiency and domain-shift problems, most of existing state-of-the-art methods fail to achieve satisfactory results for Zero-Shot Learning (ZSL). In order to alleviate these problems, we propose a novel generative ZSL method to learn more generalized features from multi-knowledge with continuously generated new semantics in semantic-to-visual embedding. In our approach, the proposed Multi-Knowledge Fusion Network (MKFNet) takes different semantic features from multi-knowledge as input, which enables more relevant semantic features to be trained for semantic-to-visual embedding, and finally generates more generalized visual features by adaptively fusing visual features from different knowledge domain. The proposed New Feature Generator (NFG) with adaptive genetic strategy is used to enrich semantic information on the one hand, and on the other hand it greatly improves the intersection of visual feature generated by MKFNet and unseen visual faetures. Empirically, we show that our approach can achieve significantly better performance compared to existing state-of-the-art methods on a large number of benchmarks for several ZSL tasks, including traditional ZSL, generalized ZSL and zero-shot retrieval.


title: Artificial Intelligence as an Anti-Corruption Tool (AI-ACT) -- Potentials and Pitfalls for Top-down and Bottom-up Approaches

abstract: Corruption continues to be one of the biggest societal challenges of our time. New hope is placed in Artificial Intelligence (AI) to serve as an unbiased anti-corruption agent. Ever more available (open) government data paired with unprecedented performance of such algorithms render AI the next frontier in anti-corruption. Summarizing existing efforts to use AI-based anti-corruption tools (AI-ACT), we introduce a conceptual framework to advance research and policy. It outlines why AI presents a unique tool for top-down and bottom-up anti-corruption approaches. For both approaches, we outline in detail how AI-ACT present different potentials and pitfalls for (a) input data, (b) algorithmic design, and (c) institutional implementation. Finally, we venture a look into the future and flesh out key questions that need to be addressed to develop AI-ACT while considering citizens' views, hence putting "society in the loop".


title: Sharp moment estimates for martingales with uniformly bounded square functions

abstract: We provide sharp bounds for the exponential moments and $p$-moments, $1\leqslant p \leqslant 2$, of the terminate distribution of a martingale whose square function is uniformly bounded by one. We introduce a Bellman function for the corresponding extremal problem and reduce it to the already known Bellman function on $\mathrm{BMO}([0,1])$. In the case of tail estimates, a similar reduction does not work exactly, so we come up with a fine supersolution that leads to sharp tail estimates.


title: The Challenges Ahead for Multimessenger Analyses of Gravitational Waves and Kilonova: a Case Study on GW190425

abstract: In recent years, there have been significant advances in multi-messenger astronomy due to the discovery of the first, and so far only confirmed, gravitational wave event with a simultaneous electromagnetic (EM) counterpart, as well as improvements in numerical simulations, gravitational wave (GW) detectors, and transient astronomy. This has led to the exciting possibility of performing joint analyses of the GW and EM data, providing additional constraints on fundamental properties of the binary progenitor and merger remnant. Here, we present a new Bayesian framework that allows inference of these properties, while taking into account the systematic modeling uncertainties that arise when mapping from GW binary progenitor properties to photometric light curves. We extend the relative binning method presented in Zackay et al. (2018) to include extrinsic GW parameters for fast analysis of the GW signal. The focus of our EM framework is on light curves arising from r-process nucleosynthesis in the ejected material during and after merger, the so called kilonova, and particularly on black hole - neutron star systems. As a case study, we examine the recent detection of GW190425, where the primary object is consistent with being either a black hole (BH) or a neutron star (NS). We show quantitatively how improved mapping between binary progenitor and outflow properties, and/or an increase in EM data quantity and quality are required in order to break degeneracies in the fundamental source parameters.


title: Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models

abstract: Anomalies or failures in large computer systems, such as the cloud, have an impact on a large number of users that communicate, compute, and store information. Therefore, timely and accurate anomaly detection is necessary for reliability, security, safe operation, and mitigation of losses in these increasingly important systems. Recently, the evolution of the software industry opens up several problems that need to be tackled including (1) addressing the software evolution due software upgrades, and (2) solving the cold-start problem, where data from the system of interest is not available. In this paper, we propose a framework for anomaly detection in log data, as a major troubleshooting source of system information. To that end, we utilize pre-trained general-purpose language models to preserve the semantics of log messages and map them into log vector embeddings. The key idea is that these representations for the logs are robust and less invariant to changes in the logs, and therefore, result in a better generalization of the anomaly detection models. We perform several experiments on a cloud dataset evaluating different language models for obtaining numerical log representations such as BERT, GPT-2, and XL. The robustness is evaluated by gradually altering log messages, to simulate a change in semantics. Our results show that the proposed approach achieves high performance and robustness, which opens up possibilities for future research in this direction.


title: Upgraded Metallurgical Grade Silicon for solar electricity production: a comparative Life Cycle Assessment

abstract: Solar grade silicon (SoG-Si) is a key material for the development of crystalline silicon photovoltaics (PV), which is expected to reach the tera-watt level in the next years and around 50TW in 2050. Upgraded metallurgical grade silicon (UMG-Si) has already demonstrated to be a viable alternative to standard polysilicon in terms of cost and quality. This study presents the life cycle assessment (LCA) of UMG obtained by the FerroSolar process. Moreover, it shows the environmental impacts of PV modules and electricity generation based on this material. For this, an exhaustive review of the life cycle inventory (LCI) of PV value chain, from metallurgical grade silicon (MG-Si) down to electricity generation, has been carried out updating inputs for all processes. The Balance of System (BoS) has also been updated with real state of the art data for a fixed open ground large PV site (100 MW). Two different electricity mixes, with low and high carbon intensities, have been considered. The results reveal that for PV electricity generation using UMG instead of polysilicon leads to an overall reduction of Climate change (CC) emissions of over 20%, along with an improvement of the Energy Payback Time (EPBT) of 25%, achieving significantly low values, 12 gCO2eq / kWhe and 0.52 years, respectively. Moreover, it is shown that UMG silicon feedstock is not the main contributor to the carbon and energy footprint of the produced electricity, leaving the first place to PV module manufacturing.


title: Event-Based Automatic Differentiation of OpenMP with OpDiLib

abstract: We present the new software OpDiLib, a universal add-on for classical operator overloading AD tools that enables the automatic differentiation (AD) of OpenMP parallelized code. With it, we establish support for OpenMP features in a reverse mode operator overloading AD tool to an extent that was previously only reported on in source transformation tools. We achieve this with an event-based implementation ansatz that is unprecedented in AD. Combined with modern OpenMP features around OMPT, we demonstrate how it can be used to achieve differentiation without any additional modifications of the source code; neither do we impose a priori restrictions on the data access patterns, which makes OpDiLib highly applicable. For further performance optimizations, restrictions like atomic updates on adjoint variables can be lifted in a fine-grained manner. OpDiLib can also be applied in a semi-automatic fashion via a macro interface, which supports compilers that do not implement OMPT. We demonstrate the applicability of OpDiLib for a pure operator overloading approach in a hybrid parallel environment. We quantify the cost of atomic updates on adjoint variables and showcase the speedup and scaling that can be achieved with the different configurations of OpDiLib in both the forward and the reverse pass.