title: On the non-existence of singular Borcherds products

abstract: Let $l\geq 3$ and $F$ be a modular form of weight $l/2-1$ on $\mathrm{O}(l,2)$ which vanishes only on rational quadratic divisors. We prove that $F$ has only simple zeros and that $F$ is anti-invariant under every reflection fixing a quadratic divisor in the zeros of $F$. In particular, $F$ is a reflective modular form. As a corollary, the existence of $F$ leads to $l\leq 20$ or $l=26$, in which case $F$ equals the Borcherds form on $\mathrm{II}_{26,2}$. This answers a question posed by Borcherds in 1995.


title: Misspecification-robust Sequential Neural Likelihood for Simulation-based Inference

abstract: Simulation-based inference techniques are indispensable for parameter estimation of mechanistic and simulable models with intractable likelihoods. While traditional statistical approaches like approximate Bayesian computation and Bayesian synthetic likelihood have been studied under well-specified and misspecified settings, they often suffer from inefficiencies due to wasted model simulations. Neural approaches, such as sequential neural likelihood (SNL) avoid this wastage by utilising all model simulations to train a neural surrogate for the likelihood function. However, the performance of SNL under model misspecification is unreliable and can result in overconfident posteriors centred around an inaccurate parameter estimate. In this paper, we propose a novel SNL method, which through the incorporation of additional adjustment parameters, is robust to model misspecification and capable of identifying features of the data that the model is not able to recover. We demonstrate the efficacy of our approach through several illustrative examples, where our method gives more accurate point estimates and uncertainty quantification than SNL.


title: Free boundary problem with a nonlocal kernel

abstract: In this paper, we propose a new nonlocal model for two-phase Stefan problem, where the nonlocal version of the one-phase Stefan problem arises naturally as a special case. Among other things, we obtain the optimal condition for the pointwise convergence between local and nonlocal one-phase Stefan problem and an equivalent characterization of this optimal condition. Moreover, we provide some sufficient criteria for the continuous expansion of free boundaries, and when the sufficient conditions are violated, we construct examples to demonstrate that the jumping phenomena could happen on the free boundaries. The jumping phenomena is essentially induced by the nonlocal diffusion and thus it does not appear in the classical Stefan problem.


title: On the Correctness of Automatic Differentiation for Neural Networks with Machine-Representable Parameters

abstract: Recent work has shown that forward- and reverse- mode automatic differentiation (AD) over the reals is almost always correct in a mathematically precise sense. However, actual programs work with machine-representable numbers (e.g., floating-point numbers), not reals. In this paper, we study the correctness of AD when the parameter space of a neural network consists solely of machine-representable numbers. In particular, we analyze two sets of parameters on which AD can be incorrect: the incorrect set on which the network is differentiable but AD does not compute its derivative, and the non-differentiable set on which the network is non-differentiable. For a neural network with bias parameters, we first prove that the incorrect set is always empty. We then prove a tight bound on the size of the non-differentiable set, which is linear in the number of non-differentiabilities in activation functions, and give a simple necessary and sufficient condition for a parameter to be in this set. We further prove that AD always computes a Clarke subderivative even on the non-differentiable set. We also extend these results to neural networks possibly without bias parameters.


title: Demystifying Disagreement-on-the-Line in High Dimensions

abstract: Evaluating the performance of machine learning models under distribution shift is challenging, especially when we only have unlabeled data from the shifted (target) domain, along with labeled data from the original (source) domain. Recent work suggests that the notion of disagreement, the degree to which two models trained with different randomness differ on the same input, is a key to tackle this problem. Experimentally, disagreement and prediction error have been shown to be strongly connected, which has been used to estimate model performance. Experiments have led to the discovery of the disagreement-on-the-line phenomenon, whereby the classification error under the target domain is often a linear function of the classification error under the source domain; and whenever this property holds, disagreement under the source and target domain follow the same linear relation. In this work, we develop a theoretical foundation for analyzing disagreement in high-dimensional random features regression; and study under what conditions the disagreement-on-the-line phenomenon occurs in our setting. Experiments on CIFAR-10-C, Tiny ImageNet-C, and Camelyon17 are consistent with our theory and support the universality of the theoretical findings.


title: Improving Open-Domain Dialogue Evaluation with a Causal Inference Model

abstract: Effective evaluation methods remain a significant challenge for research on open-domain conversational dialogue systems. Explicit satisfaction ratings can be elicited from users, but users often do not provide ratings when asked, and those they give can be highly subjective. Post-hoc ratings by experts are an alternative, but these can be both expensive and complex to collect. Here, we explore the creation of automated methods for predicting both expert and user ratings of open-domain dialogues. We compare four different approaches. First, we train a baseline model using an end-to-end transformer to predict ratings directly from the raw dialogue text. The other three methods are variants of a two-stage approach in which we first extract interpretable features at the turn level that capture, among other aspects, user dialogue behaviors indicating contradiction, repetition, disinterest, compliments, or criticism. We project these features to the dialogue level and train a dialogue-level MLP regression model, a dialogue-level LSTM, and a novel causal inference model called counterfactual-LSTM (CF-LSTM) to predict ratings. The proposed CF-LSTM is a sequential model over turn-level features which predicts ratings using multiple regressors depending on hypotheses derived from the turn-level features. As a causal inference model, CF-LSTM aims to learn the underlying causes of a specific event, such as a low rating. We also bin the user ratings and perform classification experiments with all four models. In evaluation experiments on conversational data from the Alexa Prize SocialBot, we show that the CF-LSTM achieves the best performance for predicting dialogue ratings and classification.


title: Force moment partitioning and scaling analysis of vortices shed by a 2D pitching wing in quiescent fluid

abstract: We experimentally study the dynamics and strength of vortices shed from a NACA 0012 wing undergoing sinusoidal pitching in quiescent water. We characterize the temporal evolution of the vortex trajectory and circulation over a range of pitching frequencies, amplitudes and pivot locations. By employing a physics-based force and moment partitioning method (FMPM), we estimate the vortex-induced aerodynamic moment from the velocity fields measured using particle image velocimetry. The vortex circulation, formation time and vorticity-induced moment are shown to follow scaling laws based on the feeding shear-layer velocity. The vortex dynamics, together with the spatial distribution of the vorticity-induced moment, provide quantitative explanations for the nonlinear behaviors observed in the fluid damping (Zhu et al., J. Fluid Mech., vol. 923, 2021, R2). The FMPM-estimated moment and damping are shown to match well in trend with direct force measurements, despite a discrepancy in magnitude. Our results demonstrate the powerful capability of the FMPM in dissecting experimental flow field data and providing valuable insights into the underlying flow physics.


title: Enabling surrogate-assisted evolutionary reinforcement learning via policy embedding

abstract: Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement learning methods. However, the evaluation of the iteratively generated population usually requires a large amount of computational time and can be prohibitively expensive, which may potentially restrict the applicability of ERL. Surrogate is often used to reduce the computational burden of evaluation in EAs. Unfortunately, in ERL, each individual of policy usually represents millions of weights parameters of DNN. This high-dimensional representation of policy has introduced a great challenge to the application of surrogates into ERL to speed up training. This paper proposes a PE-SAERL Framework to at the first time enable surrogate-assisted evolutionary reinforcement learning via policy embedding (PE). Empirical results on 5 Atari games show that the proposed method can perform more efficiently than the four state-of-the-art algorithms. The training process is accelerated up to 7x on tested games, comparing to its counterpart without the surrogate and PE.


title: Optimal Transport Perturbations for Safe Reinforcement Learning with Robustness Guarantees

abstract: Robustness and safety are critical for the trustworthy deployment of deep reinforcement learning. Real-world decision making applications require algorithms that can guarantee robust performance and safety in the presence of general environment disturbances, while making limited assumptions on the data collection process during training. In order to accomplish this goal, we introduce a safe reinforcement learning framework that incorporates robustness through the use of an optimal transport cost uncertainty set. We provide an efficient implementation based on applying Optimal Transport Perturbations to construct worst-case virtual state transitions, which does not impact data collection during training and does not require detailed simulator access. In experiments on continuous control tasks with safety constraints, our approach demonstrates robust performance while significantly improving safety at deployment time compared to standard safe reinforcement learning.


title: Quantized Neural Networks for Low-Precision Accumulation with Guaranteed Overflow Avoidance

abstract: We introduce a quantization-aware training algorithm that guarantees avoiding numerical overflow when reducing the precision of accumulators during inference. We leverage weight normalization as a means of constraining parameters during training using accumulator bit width bounds that we derive. We evaluate our algorithm across multiple quantized models that we train for different tasks, showing that our approach can reduce the precision of accumulators while maintaining model accuracy with respect to a floating-point baseline. We then show that this reduction translates to increased design efficiency for custom FPGA-based accelerators. Finally, we show that our algorithm not only constrains weights to fit into an accumulator of user-defined bit width, but also increases the sparsity and compressibility of the resulting weights. Across all of our benchmark models trained with 8-bit weights and activations, we observe that constraining the hidden layers of quantized neural networks to fit into 16-bit accumulators yields an average 98.2% sparsity with an estimated compression rate of 46.5x all while maintaining 99.2% of the floating-point performance.


title: Symmetric group fixed quotients of polynomial rings

abstract: Given a representation of a finite group $G$ over some commutative base ring $\mathbf{k}$, the cofixed space is the largest quotient of the representation on which the group acts trivially. If $G$ acts by $\mathbf{k}$-algebra automorphisms, then the cofixed space is a module over the ring of $G$-invariants. When the order of $G$ is not invertible in the base ring, little is known about this module structure. We study the cofixed space in the case that $G$ is the symmetric group on $n$ letters acting on a polynomial ring by permuting its variables. When $\mathbf{k}$ has characteristic 0, the cofixed space is isomorphic to an ideal of the ring of symmetric polynomials. Localizing $\mathbf{k}$ at a prime integer $p$ while letting $n$ vary reveals striking behavior in these ideals. As $n$ grows, the ideals stay stable in a sense, then jump in complexity each time $n$ reaches a multiple of $p$.


title: Entropy and alternative entropy functionals of fractional Gaussian noise as the functions of Hurst index

abstract: This paper is devoted to the study of the properties of entropy as a function of the Hurst index, which corresponds to the fractional Gaussian noise. Since the entropy of the Gaussian vector depends on the determinant of the covariance matrix, and the behavior of this determinant as a function of the Hurst index is rather difficult to study analytically at high dimensions, we also consider simple alternative entropy functionals, whose behavior, on the one hand, mimics the behavior of entropy and, on the other hand, is not difficult to study. Asymptotic behavior of the normalized entropy (so called entropy rate) is also studied for the entropy and for the alternative functionals.


title: Faithful Chain-of-Thought Reasoning

abstract: While Chain-of-Thought (CoT) prompting boosts Language Models' (LM) performance on a gamut of complex reasoning tasks, the generated reasoning chain does not necessarily reflect how the model arrives at the answer (aka. faithfulness). We propose Faithful CoT, a reasoning framework involving two stages: Translation (Natural Language query $\rightarrow$ symbolic reasoning chain) and Problem Solving (reasoning chain $\rightarrow$ answer), using an LM and a deterministic solver respectively. This guarantees that the reasoning chain provides a faithful explanation of the final answer. Aside from interpretability, Faithful CoT also improves empirical performance: it outperforms standard CoT on 9 of 10 benchmarks from 4 diverse domains, with a relative accuracy gain of 6.3% on Math Word Problems (MWP), 3.4% on Planning, 5.5% on Multi-hop Question Answering (QA), and 21.4% on Relational Inference. Furthermore, with GPT-4 and Codex, it sets the new state-of-the-art few-shot performance on 7 datasets (with 95.0+ accuracy on 6 of them), showing a strong synergy between faithfulness and accuracy.


title: Automated Time-frequency Domain Audio Crossfades using Graph Cuts

abstract: The problem of transitioning smoothly from one audio clip to another arises in many music consumption scenarios, especially as music consumption has moved from professionally curated and live-streamed radios to personal playback devices and services. we present the first steps toward a new method of automatically transitioning from one audio clip to another by discretizing the frequency spectrum into bins and then finding transition times for each bin. We phrase the problem as one of graph flow optimization; specifically min-cut/max-flow.


title: When Source-Free Domain Adaptation Meets Learning with Noisy Labels

abstract: Recent state-of-the-art source-free domain adaptation (SFDA) methods have focused on learning meaningful cluster structures in the feature space, which have succeeded in adapting the knowledge from source domain to unlabeled target domain without accessing the private source data. However, existing methods rely on the pseudo-labels generated by source models that can be noisy due to domain shift. In this paper, we study SFDA from the perspective of learning with label noise (LLN). Unlike the label noise in the conventional LLN scenario, we prove that the label noise in SFDA follows a different distribution assumption. We also prove that such a difference makes existing LLN methods that rely on their distribution assumptions unable to address the label noise in SFDA. Empirical evidence suggests that only marginal improvements are achieved when applying the existing LLN methods to solve the SFDA problem. On the other hand, although there exists a fundamental difference between the label noise in the two scenarios, we demonstrate theoretically that the early-time training phenomenon (ETP), which has been previously observed in conventional label noise settings, can also be observed in the SFDA problem. Extensive experiments demonstrate significant improvements to existing SFDA algorithms by leveraging ETP to address the label noise in SFDA.


title: Numeracy from Literacy: Data Science as an Emergent Skill from Large Language Models

abstract: Large language models (LLM) such as OpenAI's ChatGPT and GPT-3 offer unique testbeds for exploring the translation challenges of turning literacy into numeracy. Previous publicly-available transformer models from eighteen months prior and 1000 times smaller failed to provide basic arithmetic. The statistical analysis of four complex datasets described here combines arithmetic manipulations that cannot be memorized or encoded by simple rules. The work examines whether next-token prediction succeeds from sentence completion into the realm of actual numerical understanding. For example, the work highlights cases for descriptive statistics on in-memory datasets that the LLM initially loads from memory or generates randomly using python libraries. The resulting exploratory data analysis showcases the model's capabilities to group by or pivot categorical sums, infer feature importance, derive correlations, and predict unseen test cases using linear regression. To extend the model's testable range, the research deletes and appends random rows such that recall alone cannot explain emergent numeracy.


title: An Comparative Analysis of Different Pitch and Metrical Grid Encoding Methods in the Task of Sequential Music Generation

abstract: Pitch and meter are two fundamental music features for symbolic music generation tasks, where researchers usually choose different encoding methods depending on specific goals. However, the advantages and drawbacks of different encoding methods have not been frequently discussed. This paper presents a integrated analysis of the influence of two low-level feature, pitch and meter, on the performance of a token-based sequential music generation model. First, the commonly used MIDI number encoding and a less used class-octave encoding are compared. Second, an dense intra-bar metric grid is imposed to the encoded sequence as auxiliary features. Different complexity and resolutions of the metric grid are compared. For complexity, the single token approach and the multiple token approach are compared; for grid resolution, 0 (ablation), 1 (bar-level), 4 (downbeat-level) 12, (8th-triplet-level) up to 64 (64th-note-grid-level) are compared; for duration resolution, 4, 8, 12 and 16 subdivisions per beat are compared. All different encodings are tested on separately trained Transformer-XL models for a melody generation task. Regarding distribution similarity of several objective evaluation metrics to the test dataset, results suggest that the class-octave encoding significantly outperforms the taken-for-granted MIDI encoding on pitch-related metrics; finer grids and multiple-token grids improve the rhythmic quality, but also suffer from over-fitting at early training stage. Results display a general phenomenon of over-fitting from two aspects, the pitch embedding space and the test loss of the single-token grid encoding. From a practical perspective, we both demonstrate the feasibility and raise the concern of easy over-fitting problem of using smaller networks and lower embedding dimensions on the generation task. The findings can also contribute to futural models in terms of feature engineering.


title: GaitSADA: Self-Aligned Domain Adaptation for mmWave Gait Recognition

abstract: mmWave radar-based gait recognition is a novel user identification method that captures human gait biometrics from mmWave radar return signals. This technology offers privacy protection and is resilient to weather and lighting conditions. However, its generalization performance is yet unknown and limits its practical deployment. To address this problem, in this paper, a non-synthetic dataset is collected and analyzed to reveal the presence of spatial and temporal domain shifts in mmWave gait biometric data, which significantly impacts identification accuracy. To mitigate this issue, a novel self-aligned domain adaptation method called GaitSADA is proposed. GaitSADA improves system generalization performance by using a two-stage semi-supervised model training approach. The first stage employs semi-supervised contrastive learning to learn a compact gait representation from both source and target domain data, aligning source-target domain distributions implicitly. The second stage uses semi-supervised consistency training with centroid alignment to further close source-target domain gap by pseudo-labelling the target-domain samples, clustering together the samples belonging to the same class but from different domains, and pushing the class centroid close to the weight vector of each class. Experiments show that GaitSADA outperforms representative domain adaptation methods with an improvement ranging from 15.41\% to 26.32\% on average accuracy in low data regimes. Code and dataset will be available at https://exitudio.github.io/GaitSADA


title: Fisheye traffic data set of point center markers

abstract: This study presents an open data-market platform and a dataset containing 160,000 markers and 18,000 images. We hope that this dataset will bring more new data value and applications In this paper, we introduce the format and usage of the dataset, and we show a demonstration of deep learning vehicle detection trained by this dataset.


title: Emergence of extreme events in a quasi-periodic oscillator

abstract: Extreme events are unusual and rare large-amplitude fluctuations that occur can unexpectedly in nonlinear dynamical systems. Events above the extreme event threshold of the probability distribution of a nonlinear process characterize extreme events. Different mechanisms for the generation of extreme events and their prediction measures have been reported in the literature. Based on the properties of extreme events, such as rare in frequency of occurrence and extreme in amplitude, various studies have shown that extreme events are both linear and nonlinear in nature. Interestingly, in this work, we report on a special class of extreme events which are nonchaotic and nonperiodic. These nonchaotic extreme events appear in between the quasi-periodic and chaotic dynamics of the system. We report the existence of such extreme events with various statistical measures and characterization techniques.


title: Deep Learning for Reference-Free Geolocation for Poplar Trees

abstract: A core task in precision agriculture is the identification of climatic and ecological conditions that are advantageous for a given crop. The most succinct approach is geolocation, which is concerned with locating the native region of a given sample based on its genetic makeup. Here, we investigate genomic geolocation of Populus trichocarpa, or poplar, which has been identified by the US Department of Energy as a fast-rotation biofuel crop to be harvested nationwide. In particular, we approach geolocation from a reference-free perspective, circumventing the need for compute-intensive processes such as variant calling and alignment. Our model, MashNet, predicts latitude and longitude for poplar trees from randomly-sampled, unaligned sequence fragments. We show that our model performs comparably to Locator, a state-of-the-art method based on aligned whole-genome sequence data. MashNet achieves an error of 34.0 km^2 compared to Locator's 22.1 km^2. MashNet allows growers to quickly and efficiently identify natural varieties that will be most productive in their growth environment based on genotype. This paper explores geolocation for precision agriculture while providing a framework and data source for further development by the machine learning community.


title: Large Music Recommendation Studies for Small Teams

abstract: Running live music recommendation studies without direct industry partnerships can be a prohibitively daunting task, especially for small teams. In order to help future researchers interested in such evaluations, we present a number of struggles we faced in the process of generating our own such evaluation system alongside potential solutions. These problems span the topics of users, data, computation, and application architecture.


title: Differentially Private Kernel Inducing Points using features from ScatterNets (DP-KIP-ScatterNet) for Privacy Preserving Data Distillation

abstract: Data distillation aims to generate a small data set that closely mimics the performance of a given learning algorithm on the original data set. The distilled dataset is hence useful to simplify the training process thanks to its small data size. However, distilled data samples are not necessarily privacy-preserving, even if they are generally humanly indiscernible. To address this limitation, we introduce differentially private kernel inducing points (DP-KIP) for privacy-preserving data distillation. Unlike our original intention to simply apply DP-SGD to the framework of KIP, we find that KIP using infinitely-wide convolutional neural tangent kernels (conv-NTKs) performs better compared to KIP using fully-connected NTKs. However, KIP with conv-NTKs, due to its convolutional and pooling operations, introduces an unbearable computational complexity, requiring hundreds of V100 GPUs in parallel to train, which is impractical and more importantly, such computational resources are inaccessible to many. To overcome this issue, we propose an alternative that does not require pre-training (to avoid a privacy loss) and can well capture complex information on images, as those features from conv-NKTs do, while the computational cost is manageable by a single V100 GPU. To this end, we propose DP-KIP-ScatterNet, which uses the wavelet features from Scattering networks (ScatterNet) instead of those from conv-NTKs, to perform DP-KIP at a reasonable computational cost. We implement DP-KIP-ScatterNet in -- computationally efficient -- JAX and test on several popular image datasets to show its efficacy and its superior performance compared to state-of-the art methods in image data distillation with differential privacy guarantees.


title: Massive MIMO in 5G: How Beamforming, Codebooks, and Feedback Enable Larger Arrays

abstract: Massive multiple-input multiple-output (MIMO) is an important technology in fifth generation (5G) cellular networks and beyond. To help design the beamforming at the base station, 5G has introduced new support in the form of flexible feedback and configurable antenna array geometries. In this article, we present an overview of MIMO throughout the mobile standards, highlight the new beam-based feedback system in 5G NR, and describe how this feedback system enables massive MIMO through beam management. Finally, we conclude with challenges related to massive MIMO in 5G.


title: Peculiar band geometry induced giant shift current in ferroelectric SnTe monolayer

abstract: The bulk photovoltaic effect (BPVE) refers to the phenomenon of generating photocurrent or photovoltage in homogeneous noncentrosymmetric materials under illumination, and the intrinsic contribution to the BPVE is known as the shift current effect. We calculate the shift current conductivities of the ferroelectric SnTe monolayer using first-principles methods. We find that the monolayer SnTe has giant shift-current conductivity near the valley points. More remarkably, the linear optical absorption coefficient at this energy is very small, and therefore leads to an enormous Glass coefficient that is four orders of magnitude larger than that of BaTiO$_3$. The unusual shift-current effects are further investigated using a three-band model. We find that the giant shift current conductivities and Glass coefficient are induced by the nontrivial energy band geometries near the valley points, where the shift-vector diverges. This is a prominent example that the band geometry can play essential roles in the fundamental properties of solids.


title: Combinatorial Causal Bandits without Graph Skeleton

abstract: In combinatorial causal bandits (CCB), the learning agent chooses a subset of variables in each round to intervene and collects feedback from the observed variables to minimize expected regret or sample complexity. Previous works study this problem in both general causal models and binary generalized linear models (BGLMs). However, all of them require prior knowledge of causal graph structure. This paper studies the CCB problem without the graph structure on binary general causal models and BGLMs. We first provide an exponential lower bound of cumulative regrets for the CCB problem on general causal models. To overcome the exponentially large space of parameters, we then consider the CCB problem on BGLMs. We design a regret minimization algorithm for BGLMs even without the graph skeleton and show that it still achieves $O(\sqrt{T}\ln T)$ expected regret. This asymptotic regret is the same as the state-of-art algorithms relying on the graph structure. Moreover, we sacrifice the regret to $O(T^{\frac{2}{3}}\ln T)$ to remove the weight gap covered by the asymptotic notation. At last, we give some discussions and algorithms for pure exploration of the CCB problem without the graph structure.


title: Probably Anytime-Safe Stochastic Combinatorial Semi-Bandits

abstract: Motivated by concerns about making online decisions that incur undue amount of risk at each time step, in this paper, we formulate the probably anytime-safe stochastic combinatorial semi-bandits problem. In this problem, the agent is given the option to select a subset of size at most $K$ from a set of $L$ ground items. Each item is associated to a certain mean reward as well as a variance that represents its risk. To mitigate the risk that the agent incurs, we require that with probability at least $1-\delta$, over the entire horizon of time $T$, each of the choices that the agent makes should contain items whose sum of variances does not exceed a certain variance budget. We call this probably anytime-safe constraint. Under this constraint, we design and analyze an algorithm {\sc PASCombUCB} that minimizes the regret over the horizon of time $T$. By developing accompanying information-theoretic lower bounds, we show that under both the problem-dependent and problem-independent paradigms, {\sc PASCombUCB} is almost asymptotically optimal. Experiments are conducted to corroborate our theoretical findings. Our problem setup, the proposed {\sc PASCombUCB} algorithm, and novel analyses are applicable to domains such as recommendation systems and transportation in which an agent is allowed to choose multiple items at a single time step and wishes to control the risk over the whole time horizon.


title: Spectro-polarimetric view of bright atoll source GX 9+9 using IXPE and AstroSat

abstract: We have carried out the first spectro-polarimetric study of the bright NS-LMXB GX 9+9 using IXPE and AstroSat observations. We report a significant detection of polarization of $1.7\pm 0.4\%$ over the $2-8$ keV energy band, with a polarization angle of $63^{\circ}\pm 7^{\circ}$. The polarization is found to be energy-dependent, with a $3\sigma$ polarization degree consistent with null polarization in $2-4$ keV, and $3.2\%$ in $4-8$ keV. Typical of the spectra seen in NS-LMXBs, we find that a combination of soft thermal emission from the accretion disc and Comptonized component from the optically thick corona produces a good fit to the spectra. We also attempt to infer the individual polarization of these components, and obtain a $3\sigma$ upper limit of $\sim 11\%$ on the polarization degree of the thermal component, and constrain that of the Comptonized component to $\sim 3\%$. We comment on the possible corona geometry of the system based on our results.


title: Learning to Solve Integer Linear Programs with Davis-Yin Splitting

abstract: In many applications, a combinatorial problem must be repeatedly solved with similar, but distinct parameters. Yet, the parameters $w$ are not directly observed; only contextual data $d$ that correlates with $w$ is available. It is tempting to use a neural network to predict $w$ given $d$. However, training such a model requires reconciling the discrete nature of combinatorial optimization with the gradient-based frameworks used to train neural networks. When the problem in question is an Integer Linear Program (ILP), one approach to overcome this training issue is to consider a continuous relaxation of the combinatorial problem. While existing methods utilizing this approach have shown to be highly effective on small problems, they do not always scale well to large problems. In this work, we draw on ideas from modern convex optimization to design a network and training scheme which scales effortlessly to problems with thousands of variables. Our experiments verify the computational advantage our proposed method enjoys on two representative problems, namely the shortest path problem and the knapsack problem.


title: Study of Optical Networks, 5G, Artificial Intelligence and Their Applications

abstract: This paper discusses the application of artificial intelligence (AI) technology in optical communication networks and 5G. It primarily introduces representative applications of AI technology and potential risks of AI technology failure caused by the openness of optical communication networks, and proposes some coping strategies, mainly including modeling AI systems through modularization and miniaturization, combining with traditional classical network modeling and planning methods, and improving the effectiveness and interpretability of AI technology. At the same time, it proposes response strategies based on network protection for the possible failure and attack of AI technology.


title: Sequential Strategic Screening

abstract: We initiate the study of strategic behavior in screening processes with multiple classifiers. We focus on two contrasting settings: a conjunctive setting in which an individual must satisfy all classifiers simultaneously, and a sequential setting in which an individual to succeed must satisfy classifiers one at a time. In other words, we introduce the combination of strategic classification with screening processes. We show that sequential screening pipelines exhibit new and surprising behavior where individuals can exploit the sequential ordering of the tests to zig-zag between classifiers without having to simultaneously satisfy all of them. We demonstrate an individual can obtain a positive outcome using a limited manipulation budget even when far from the intersection of the positive regions of every classifier. Finally, we consider a learner whose goal is to design a sequential screening process that is robust to such manipulations, and provide a construction for the learner that optimizes a natural objective.


title: BDG inequality for G-martingale

abstract: In this work we establish an BDG inequality type for certain nonlinear martingale arizing from BSDE.


title: The design and test results of A Giga-Bit Cable Receiver (GBCR) for the ATLAS Inner Tracker Pixel Detector

abstract: This paper presents the design and test results of a Gigabit Cable Receiver ASIC called GBCR for the HL-LHC upgrade of the ATLAS Inner Tracker (ITk) pixel detector. Three prototypes (GBCR1, GBCR2, and GBCR3) have been designed in the CERN-identified 65 nm CMOS technology. GBCR receives seven (GBCR2) or six (GBCR3) channels (RX) each at 1.28 Gbps from the front-end readout chip RD53B via flex cables up to 1 meter and Twinax cables up to 5 meters and sends the equalized and retimed signals to lpGBT. Both GBCR2 and GBCR3 ASICs have two transmitting channels (TX) that pre-emphasize the signals from lpGBT before sending them to RD53B through the same cables. No Single-Event Upset (SEU) is observed in any tested channels of GBCR2 in a 400 MeV proton beam. The extrapolated bit error rate for the future HL-LHC application is below 8*10^(-16), significantly below the specified BER criterion. GBCR3 is designed to improve the immunity to single-event-upset by applying the Triple Modular Redundancy (TMR) technology to all RX channels. The retimed signals from GBCR3 have less total jitter than those from GBCR2 (35 ps versus 79 ps). Each receiver channel of GBCR3 consumes 75% more power than that of GBCR2.


title: The emergence of soft-glassy mechanics in simulated foams

abstract: Several seemingly different soft materials, including foams, cells, and many complex fluids, exhibit remarkably similar rheological properties and microscopic dynamics, termed soft glassy mechanics. Here, we show that such behavior emerges from a simple model of a damped ripening foam, for sufficiently weak damping. In particular, we observe intermittent avalanchey dynamics, bubble super-diffusion, and power-law rheology that vary as the damping factor is changed. In the limit of weak damping, the dynamics are determined by the tortuous low-lying portions of the energy landscape, as described in a recent study. For strong damping the viscous stresses cause the system configuration to evolve along higher energy paths, washing out small-scale tortuosity and producing motion with an increasingly ballistic character. Using a microrheological approach, the linear viscoelastic response of the model can be efficiently calculated. This resembles the power-law rheology expected for soft glassy mechanics, but unexpectedly, is only weakly sensitive to the damping parameter. Lastly, we study the reported memory effect in foams after large perturbations and find that the timescale of the memory goes to zero as the damping parameter vanishes, suggesting that the effect is due to viscous stress relaxation rather than slow structural changes stabilized by the energy landscape.


title: Classified as unknown: A novel Bayesian neural network

abstract: We establish estimations for the parameters of the output distribution for the softmax activation function using the probit function. As an application, we develop a new efficient Bayesian learning algorithm for fully connected neural networks, where training and predictions are performed within the Bayesian inference framework in closed-form. This approach allows sequential learning and requires no computationally expensive gradient calculation and Monte Carlo sampling. Our work generalizes the Bayesian algorithm for a single perceptron for binary classification in \cite{H} to multi-layer perceptrons for multi-class classification.


title: ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing

abstract: The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into its latent space encounters an inherent trade-off between inversion quality and editability. Existing encoder-based or optimization-based StyleGAN inversion methods attempt to mitigate the trade-off but see limited performance. To fundamentally resolve this problem, we propose a novel two-phase framework by designating two separate networks to tackle editing and reconstruction respectively, instead of balancing the two. Specifically, in Phase I, a W-space-oriented StyleGAN inversion network is trained and used to perform image inversion and editing, which assures the editability but sacrifices reconstruction quality. In Phase II, a carefully designed rectifying network is utilized to rectify the inversion errors and perform ideal reconstruction. Experimental results show that our approach yields near-perfect reconstructions without sacrificing the editability, thus allowing accurate manipulation of real images. Further, we evaluate the performance of our rectifying network, and see great generalizability towards unseen manipulation types and out-of-domain images.


title: A Modular Multi-stage Lightweight Graph Transformer Network for Human Pose and Shape Estimation from 2D Human Pose

abstract: In this research, we address the challenge faced by existing deep learning-based human mesh reconstruction methods in balancing accuracy and computational efficiency. These methods typically prioritize accuracy, resulting in large network sizes and excessive computational complexity, which may hinder their practical application in real-world scenarios, such as virtual reality systems. To address this issue, we introduce a modular multi-stage lightweight graph-based transformer network for human pose and shape estimation from 2D human pose, a pose-based human mesh reconstruction approach that prioritizes computational efficiency without sacrificing reconstruction accuracy. Our method consists of a 2D-to-3D lifter module that utilizes graph transformers to analyze structured and implicit joint correlations in 2D human poses, and a mesh regression module that combines the extracted pose features with a mesh template to produce the final human mesh parameters.


title: Opaque Contracts

abstract: Firms have access to abundant data on market participants. They use these data to target contracts to agents with specific characteristics, and describe these contracts in opaque terms. In response to such practices, recent proposed regulations aim to increase transparency, especially in digital markets. In order to understand when opacity arises in contracting and the potential effects of proposed regulations, we study a moral hazard model in which a risk-neutral principal faces a continuum of weakly risk-averse agents. The agents differ in an observable characteristic that affects the payoff of the principal. In a described contract, the principal sorts the agents into groups, and to each group communicates a distribution of output-contingent payments. Within each group, the realized distribution of payments must be consistent with the communicated contract. A described contract is transparent if the principal communicates the realized contract to the agent ex-ante, and otherwise it is opaque. We provide a geometric characterization of the principal's optimal described contract as well as conditions under which the optimal described mechanism is transparent and opaque. We apply our results to the design and description of driver payment schemes on ride-hailing platforms.


title: Novel loop-diagrammatic approach to QCD $\theta$ parameter and application to the left-right model

abstract: When the QCD axion is absent in full theory, the strong $CP$ problem has to be explained by an additional mechanism, e.g., the left-right symmetry. Even though tree-level QCD $\bar\theta$ parameter is restricted by the mechanism, radiative corrections to $\bar\theta$ are mostly generated, which leads to a dangerous neutron electric dipole moment (EDM). The ordinary method for calculating the radiative $\bar\theta$ utilizes an equation $\bar \theta= - \text{arg}\, \text{det}\, m_q^{\rm loop}$ based on the chiral rotations of complex quark masses. In this paper, we point out that when full theory includes extra heavy quarks, the ordinary method is unsettled for the extra quark contributions and does not contain its full radiative corrections. We formulate a novel method to calculate the radiative corrections to $\bar\theta$ through a direct loop-diagrammatic approach, which should be more robust than the ordinary one. As an application, we investigate the radiative $\bar\theta$ in the minimal left-right symmetric model. We first confirm a seminal result that two-loop level radiative $\bar\theta$ completely vanishes (corresponding to one-loop corrections to the quark mass matrices). Furthermore, we estimate the size of a non-vanishing radiative $\bar\theta$ at three-loop level. It is found that the resultant induced neutron EDM is comparable to the current experimental bound, and the expected size is restricted by the perturbative unitarity bound in the minimal left-right model.


title: New perspectives on semi-primal varieties

abstract: We study varieties generated by semi-primal lattice-expansions by means of category theory. We provide a new proof of the Keimel-Werner topological duality for such varieties and, using similar methods, establish its discrete version. We describe multiple adjunctions between the variety of Boolean algebras and the variety generated by a semi-primal lattice-expansion, both on the topological side and explicitly algebraic. In particular, we show that the Boolean skeleton functor has two adjoints, both defined by taking certain Boolean powers, and we identify properties of these adjunctions which fully characterize semi-primality of an algebra. Lastly, we give a new characterization of canonical extensions of algebras in semi-primal varieties in terms of their Boolean skeletons.


title: A compact and highly collimated atomic/molecular beam source

abstract: We describe the design, characterization and application of a simple, highly collimated and compact atomic/molecular beam source. This source is based on a segmented capillary design, constructed using a syringe needle. Angular width measurements and free molecular flow simulations show that the segmented structure effectively suppresses atoms travelling in off-axis directions, resulting in a narrow beam of Helium atoms having a width of 7 mrad (full width half maximum). We demonstrate an application of this source by using it for monitoring real-time changes in surface coverage on a clean Cu(110) surface exposed to oxygen, by measuring specular reflectivity of the Helium beam generated using this source.

categories: physics.chem-ph physics.app-ph physics.atom-ph physics.ins-det


title: Identifiability and inference for copula-based semiparametric models for random vectors with arbitrary marginal distributions

abstract: In this paper, we study the identifiability and the estimation of the parameters of a copula-based multivariate model when the margins are unknown and are arbitrary, meaning that they can be continuous, discrete, or mixtures of continuous and discrete. When at least one margin is not continuous, the range of values determining the copula is not the entire unit square and this situation could lead to identifiability issues that are discussed here. Next, we propose estimation methods when the margins are unknown and arbitrary, using pseudo log-likelihood adapted to the case of discontinuities. In view of applications to large data sets, we also propose a pairwise composite pseudo log-likelihood. These methodologies can also be easily modified to cover the case of parametric margins. One of the main theoretical result is an extension to arbitrary distributions of known convergence results of rank-based statistics when the margins are continuous. As a by-product, under smoothness assumptions, we obtain that the asymptotic distribution of the estimation errors of our estimators are Gaussian. Finally, numerical experiments are presented to assess the finite sample performance of the estimators, and the usefulness of the proposed methodologies is illustrated with a copula-based regression model for hydrological data. The proposed estimation is implemented in the R package CopulaInference, together with a function for checking identifiability.


title: On solvability of a time-fractional doubly critical semilinear equation, and its quantitative approach to the non-existence result on the classical counterpart

abstract: We study a time-fractional semilinear heat equation $$\partial^{\alpha}_t u -\Delta u = u^{p},\ \ \mbox{in}\ (0,T)\times\mathbb{R}^N,\ \ u(0)=u_0\ge0$$ with $u_0\in L^{1}(\mathbb{R}^N)$ and $p=1+2/N$. Here $\partial_t^{\alpha}$ denotes the Caputo derivative of order $\alpha \in (0,1)$. Since the space $L^1(\mathbb{R}^N)$ is scale critical with $p=1+2/N$, this type of equation is known as a doubly critical problem. It is known that the usual doubly critical equation $\partial_t u-\Delta u=u^p$ does not have nonnegative global-in-time solutions, while the time-fractional problem does. Moreover, there exists a singular initial data which admits no local-in-time solution, while the time-fractional equation is solvable for any $L^{1}(\mathbb{R}^N)$ initial data. In this paper, we deduce a necessary condition imposed on $u_0$ for the existence of a nonnegative solution. Furthermore, we obtain corollaries that describe the collapse of the local and global solvability for the time-fractional equation as $\alpha \rightarrow 1$.


title: Multi-Channel Auction Design in the Autobidding World

abstract: Over the past few years, more and more Internet advertisers have started using automated bidding for optimizing their advertising campaigns. Such advertisers have an optimization goal (e.g. to maximize conversions), and some constraints (e.g. a budget or an upper bound on average cost per conversion), and the automated bidding system optimizes their auction bids on their behalf. Often, these advertisers participate on multiple advertising channels and try to optimize across these channels. A central question that remains unexplored is how automated bidding affects optimal auction design in the multi-channel setting. In this paper, we study the problem of setting auction reserve prices in the multi-channel setting. In particular, we shed light on the revenue implications of whether each channel optimizes its reserve price locally, or whether the channels optimize them globally to maximize total revenue. Motivated by practice, we consider two models: one in which the channels have full freedom to set reserve prices, and another in which the channels have to respect floor prices set by the publisher. We show that in the first model, welfare and revenue loss from local optimization is bounded by a function of the advertisers' inputs, but is independent of the number of channels and bidders. In stark contrast, we show that the revenue from local optimization could be arbitrarily smaller than those from global optimization in the second model.


title: Few-Shot Object Detection via Variational Feature Aggregation

abstract: As few-shot object detectors are often trained with abundant base samples and fine-tuned on few-shot novel examples,the learned models are usually biased to base classes and sensitive to the variance of novel examples. To address this issue, we propose a meta-learning framework with two novel feature aggregation schemes. More precisely, we first present a Class-Agnostic Aggregation (CAA) method, where the query and support features can be aggregated regardless of their categories. The interactions between different classes encourage class-agnostic representations and reduce confusion between base and novel classes. Based on the CAA, we then propose a Variational Feature Aggregation (VFA) method, which encodes support examples into class-level support features for robust feature aggregation. We use a variational autoencoder to estimate class distributions and sample variational features from distributions that are more robust to the variance of support examples. Besides, we decouple classification and regression tasks so that VFA is performed on the classification branch without affecting object localization. Extensive experiments on PASCAL VOC and COCO demonstrate that our method significantly outperforms a strong baseline (up to 16\%) and previous state-of-the-art methods (4\% in average). Code will be available at: \url{https://github.com/csuhan/VFA}


title: Development of a Hardware-in-the-loop Testbed for Laboratory Performance Verification of Flexible Building Equipment in Typical Commercial Buildings

abstract: The goals of reducing energy costs, shifting electricity peaks, increasing the use of renewable energy, and enhancing the stability of the electric grid can be met in part by fully exploiting the energy flexibility potential of buildings and building equipment. The development of strategies that exploit these flexibilities could be facilitated by publicly available high-resolution datasets illustrating how control of HVAC systems in commercial buildings can be used in different climate zones to shape the energy use profile of a building for grid needs. This article presents the development and integration of a Hardware-In-the-Loop Flexible load Testbed (HILFT) that integrates physical HVAC systems with a simulated building model and simulated occupants with the goal of generating datasets to verify load flexibility of typical commercial buildings. Compared to simulation-only experiments, the hardware-in-the-loop approach captures the dynamics of the physical systems while also allowing efficient testing of various boundary conditions. The HILFT integration in this article is achieved through the co-simulation among various software environments including LabVIEW, MATLAB, and EnergyPlus. Although theoretically viable, such integration has encountered many real-world challenges, such as: 1) how to design the overall data infrastructure to ensure effective, robust, and efficient integration; 2) how to avoid closed-loop hunting between simulated and emulated variables; 3) how to quantify system response times and minimize system delays; and 4) how to assess the overall integration quality. Lessons-learned using the examples of an AHU-VAV system, an air-source heat pump system, and a water-source heat pump system are presented.


title: Fine Robotic Manipulation without Force/Torque Sensor

abstract: Force Sensing and Force Control are essential to many industrial applications. Typically, a 6-axis Force/Torque (F/T) sensor is mounted between the robot's wrist and the end-effector in order to measure the forces and torques exerted by the environment onto the robot (the external wrench). Although a typical 6-axis F/T sensor can provide highly accurate measurements, it is expensive and vulnerable to drift and external impacts. Existing methods aiming at estimating the external wrench using only the robot's internal signals are limited in scope: for example, wrench estimation accuracy was mostly validated in free-space motions and simple contacts as opposed to tasks like assembly that require high-precision force control. Here we present a Neural Network based method and argue that by devoting particular attention to the training data structure, it is possible to accurately estimate the external wrench in a wide range of scenarios based solely on internal signals. As an illustration, we demonstrate a pin insertion experiment with 100-micron clearance and a hand-guiding experiment, both performed without external F/T sensors or joint torque sensors. Our result opens the possibility of equipping the existing 2.7 million industrial robots with Force Sensing and Force Control capabilities without any additional hardware.


title: Incentive Compatibility in the Auto-bidding World

abstract: Auto-bidding has recently become a popular feature in ad auctions. This feature enables advertisers to simply provide high-level constraints and goals to an automated agent, which optimizes their auction bids on their behalf. In this paper, we examine the effect of different auctions on the incentives of advertisers to report their constraints to the auto-bidder intermediaries. More precisely, we study whether canonical auctions such as first price auction (FPA) and second price auction (SPA) are auto-bidding incentive compatible (AIC): whether an advertiser can gain by misreporting their constraints to the autobidder. We consider value-maximizing advertisers in two important settings: when they have a budget constraint and when they have a target cost-per-acquisition constraint. The main result of our work is that for both settings, FPA and SPA are not AIC. This contrasts with FPA being AIC when auto-bidders are constrained to bid using a (sub-optimal) uniform bidding policy. We further extend our main result and show that any (possibly randomized) auction that is truthful (in the classic profit-maximizing sense), scalar invariant and symmetric is not AIC. Finally, to complement our findings, we provide sufficient market conditions for FPA and SPA to become AIC for two advertisers. These conditions require advertisers' valuations to be well-aligned. This suggests that when the competition is intense for all queries, advertisers have less incentive to misreport their constraints. From a methodological standpoint, we develop a novel continuous model of queries. This model provides tractability to study equilibrium with auto-bidders, which contrasts with the standard discrete query model, which is known to be hard. Through the analysis of this model, we uncover a surprising result: in auto-bidding with two advertisers, FPA and SPA are auction equivalent.


title: LogAI: A Library for Log Analytics and Intelligence

abstract: Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor system health and resolve issues. However, the volume of logs generated can be humongous (of the order of petabytes per day) especially for complex distributed systems, such as cloud, search engine, social media, etc. This has propelled a lot of research on developing AI-based log based analytics and intelligence solutions that can process huge volume of raw logs and generate insights. In order to enable users to perform multiple types of AI-based log analysis tasks in a uniform manner, we introduce LogAI (https://github.com/salesforce/logai), a one-stop open source library for log analytics and intelligence. LogAI supports tasks such as log summarization, log clustering and log anomaly detection. It adopts the OpenTelemetry data model, to enable compatibility with different log management platforms. LogAI provides a unified model interface and provides popular time-series, statistical learning and deep learning models. Alongside this, LogAI also provides an out-of-the-box GUI for users to conduct interactive analysis. With LogAI, we can also easily benchmark popular deep learning algorithms for log anomaly detection without putting in redundant effort to process the logs. We have opensourced LogAI to cater to a wide range of applications benefiting both academic research and industrial prototyping.


title: Structure Flow-Guided Network for Real Depth Super-Resolution

abstract: Real depth super-resolution (DSR), unlike synthetic settings, is a challenging task due to the structural distortion and the edge noise caused by the natural degradation in real-world low-resolution (LR) depth maps. These defeats result in significant structure inconsistency between the depth map and the RGB guidance, which potentially confuses the RGB-structure guidance and thereby degrades the DSR quality. In this paper, we propose a novel structure flow-guided DSR framework, where a cross-modality flow map is learned to guide the RGB-structure information transferring for precise depth upsampling. Specifically, our framework consists of a cross-modality flow-guided upsampling network (CFUNet) and a flow-enhanced pyramid edge attention network (PEANet). CFUNet contains a trilateral self-attention module combining both the geometric and semantic correlations for reliable cross-modality flow learning. Then, the learned flow maps are combined with the grid-sampling mechanism for coarse high-resolution (HR) depth prediction. PEANet targets at integrating the learned flow map as the edge attention into a pyramid network to hierarchically learn the edge-focused guidance feature for depth edge refinement. Extensive experiments on real and synthetic DSR datasets verify that our approach achieves excellent performance compared to state-of-the-art methods.


title: Ten Compatible Poisson Brackets on $\mathbb P^5$

abstract: We give explicit formulas for ten compatible Poisson brackets on $\mathbb P^5$ found in arXiv:2007.12351.


title: BRAIxDet: Learning to Detect Malignant Breast Lesion with Incomplete Annotations

abstract: Methods to detect malignant lesions from screening mammograms are usually trained with fully annotated datasets, where images are labelled with the localisation and classification of cancerous lesions. However, real-world screening mammogram datasets commonly have a subset that is fully annotated and another subset that is weakly annotated with just the global classification (i.e., without lesion localisation). Given the large size of such datasets, researchers usually face a dilemma with the weakly annotated subset: to not use it or to fully annotate it. The first option will reduce detection accuracy because it does not use the whole dataset, and the second option is too expensive given that the annotation needs to be done by expert radiologists. In this paper, we propose a middle-ground solution for the dilemma, which is to formulate the training as a weakly- and semi-supervised learning problem that we refer to as malignant breast lesion detection with incomplete annotations. To address this problem, our new method comprises two stages, namely: 1) pre-training a multi-view mammogram classifier with weak supervision from the whole dataset, and 2) extending the trained classifier to become a multi-view detector that is trained with semi-supervised student-teacher learning, where the training set contains fully and weakly-annotated mammograms. We provide extensive detection results on two real-world screening mammogram datasets containing incomplete annotations, and show that our proposed approach achieves state-of-the-art results in the detection of malignant breast lesions with incomplete annotations.


title: Recurrent Structure Attention Guidance for Depth Super-Resolution

abstract: Image guidance is an effective strategy for depth super-resolution. Generally, most existing methods employ hand-crafted operators to decompose the high-frequency (HF) and low-frequency (LF) ingredients from low-resolution depth maps and guide the HF ingredients by directly concatenating them with image features. However, the hand-designed operators usually cause inferior HF maps (e.g., distorted or structurally missing) due to the diverse appearance of complex depth maps. Moreover, the direct concatenation often results in weak guidance because not all image features have a positive effect on the HF maps. In this paper, we develop a recurrent structure attention guided (RSAG) framework, consisting of two important parts. First, we introduce a deep contrastive network with multi-scale filters for adaptive frequency-domain separation, which adopts contrastive networks from large filters to small ones to calculate the pixel contrasts for adaptive high-quality HF predictions. Second, instead of the coarse concatenation guidance, we propose a recurrent structure attention block, which iteratively utilizes the latest depth estimation and the image features to jointly select clear patterns and boundaries, aiming at providing refined guidance for accurate depth recovery. In addition, we fuse the features of HF maps to enhance the edge structures in the decomposed LF maps. Extensive experiments show that our approach obtains superior performance compared with state-of-the-art depth super-resolution methods.


title: Superhuman Fairness

abstract: The fairness of machine learning-based decisions has become an increasingly important focus in the design of supervised machine learning methods. Most fairness approaches optimize a specified trade-off between performance measure(s) (e.g., accuracy, log loss, or AUC) and fairness metric(s) (e.g., demographic parity, equalized odds). This begs the question: are the right performance-fairness trade-offs being specified? We instead re-cast fair machine learning as an imitation learning task by introducing superhuman fairness, which seeks to simultaneously outperform human decisions on multiple predictive performance and fairness measures. We demonstrate the benefits of this approach given suboptimal decisions.


title: MOAT: Towards Safe BPF Kernel Extension

abstract: The Linux kernel extensively uses the Berkeley Packet Filter (BPF) to allow user-written BPF applications to execute in the kernel space. The BPF employs a verifier to check the security of user-supplied BPF code statically. Recent attacks show that BPF programs can evade security checks and gain unauthorized access to kernel memory, indicating that the verification process is not flawless. In this paper, we present MOAT, a system that isolates potentially malicious BPF programs using Intel Memory Protection Keys (MPK). Enforcing BPF program isolation with MPK is not straightforward; MOAT is designed to alleviate technical obstacles, such as limited hardware keys and the need to protect a wide variety of BPF helper functions. We implement MOAT on Linux (ver. 6.1.38), and our evaluation shows that MOAT delivers low-cost isolation of BPF programs under mainstream use cases, such as isolating a BPF packet filter with only 3% throughput loss.


title: Anomaly Segmentation for High-Resolution Remote Sensing Images Based on Pixel Descriptors

abstract: Anomaly segmentation in high spatial resolution (HSR) remote sensing imagery is aimed at segmenting anomaly patterns of the earth deviating from normal patterns, which plays an important role in various Earth vision applications. However, it is a challenging task due to the complex distribution and the irregular shapes of objects, and the lack of abnormal samples. To tackle these problems, an anomaly segmentation model based on pixel descriptors (ASD) is proposed for anomaly segmentation in HSR imagery. Specifically, deep one-class classification is introduced for anomaly segmentation in the feature space with discriminative pixel descriptors. The ASD model incorporates the data argument for generating virtual ab-normal samples, which can force the pixel descriptors to be compact for normal data and meanwhile to be diverse to avoid the model collapse problems when only positive samples participated in the training. In addition, the ASD introduced a multi-level and multi-scale feature extraction strategy for learning the low-level and semantic information to make the pixel descriptors feature-rich. The proposed ASD model was validated using four HSR datasets and compared with the recent state-of-the-art models, showing its potential value in Earth vision applications.


title: Analysis for idempotent states on quantum permutation groups

abstract: Woronowicz proved the existence of the Haar state for compact quantum groups under a separability assumption later removed by Van Daele in a new existence proof. A minor adaptation of Van Daele's proof yields an idempotent state in any non-empty weak*-compact convolution-closed convex subset of the state space. Such subsets, and their associated idempotent states, are studied in the case of quantum permutation groups.


title: Inradius of random lemniscates

abstract: A classically studied geometric property associated to a complex polynomial $p$ is the inradius (the radius of the largest inscribed disk) of its (filled) lemniscate $\Lambda := \{z \in \mathbb{C}:|p(z)| < 1\}$. In this paper, we study the lemniscate inradius when the defining polynomial $p$ is random, namely, with the zeros of $p$ sampled independently from a compactly supported probability measure $\mu$. If the negative set of the logarithmic potential $U_{\mu}$ generated by $\mu$ is non-empty, then the inradius is bounded from below by a positive constant with overwhelming probability. Moreover, the inradius has a determinstic limit if the negative set of $U_{\mu}$ additionally contains the support of $\mu$. On the other hand, when the zeros are sampled independently and uniformly from the unit circle, then the inradius converges in distribution to a random variable taking values in $(0,1/2)$. We also consider the characteristic polynomial of a Ginibre random matrix whose lemniscate we show is close to the unit disk with overwhelming probability.


title: Towards Mechatronics Approach of System Design, Verification and Validation for Autonomous Vehicles

abstract: Modern-day autonomous vehicles are increasingly becoming complex multidisciplinary systems composed of mechanical, electrical, electronic, computing and information sub-systems. Furthermore, the individual constituent technologies employed for developing autonomous vehicles have started maturing up to a point, where it seems beneficial to start looking at the synergistic integration of these components into sub-systems, systems, and potentially, system-of-systems. Hence, this work applies the principles of mechatronics approach of system design, verification and validation for the development of autonomous vehicles. Particularly, we discuss leveraging multidisciplinary co-design practices along with virtual, hybrid and physical prototyping and testing within a concurrent engineering framework to develop and validate a scaled autonomous vehicle using the AutoDRIVE ecosystem. We also describe a case-study of autonomous parking application using a modular probabilistic framework to illustrate the benefits of the proposed approach.


title: Discrete Search in Heterogeneous Integer Spaces for Automated Choice of Parameters using Correct-by-Construction Methods

abstract: Discrete Search of integer spaces for tool parameter values provides a powerful methodology for modeling and finding a heuristically optimal parameter list for a given system. Current tools and implementations that exist focus primarily on homogeneous tool parameters, and the implementations for heterogeneous tool parameters is lacking. In this paper we introduce a correct-by-construction method of heterogeneous parameter reachability and validity search, and further outline the implementation as well as a demonstration using examples of heterogeneous systems that this tool can be used for.


title: Disciplined Saddle Programming

abstract: We consider convex-concave saddle point problems, and more generally convex optimization problems we refer to as $\textit{saddle problems}$, which include the partial supremum or infimum of convex-concave saddle functions. Saddle problems arise in a wide range of applications, including game theory, machine learning, and finance. It is well known that a saddle problem can be reduced to a single convex optimization problem by dualizing either the convex (min) or concave (max) objectives, reducing a min-max problem into a min-min (or max-max) problem. Carrying out this conversion by hand can be tedious and error prone. In this paper we introduce $\textit{disciplined saddle programming}$ (DSP), a domain specific language (DSL) for specifying saddle problems, for which the dualizing trick can be automated. The language and methods are based on recent work by Juditsky and Nemirovski arXiv:2102.01002 [math.OC], who developed the idea of conic-representable saddle point programs, and showed how to carry out the required dualization automatically using conic duality. Juditsky and Nemirovski's conic representation of saddle problems extends Nesterov and Nemirovski's earlier development of conic representable convex problems; DSP can be thought of as extending disciplined convex programming (DCP) to saddle problems. Just as DCP makes it easy for users to formulate and solve complex convex problems, DSP allows users to easily formulate and solve saddle problems. Our method is implemented in an open-source package, also called DSP.


title: Contrast and Clustering: Learning Neighborhood Pair Representation for Source-free Domain Adaptation

abstract: Unsupervised domain adaptation uses source data from different distributions to solve the problem of classifying data from unlabeled target domains. However, conventional methods require access to source data, which often raise concerns about data privacy. In this paper, we consider a more practical but challenging setting where the source domain data is unavailable and the target domain data is unlabeled. Specifically, we address the domain discrepancy problem from the perspective of contrastive learning. The key idea of our work is to learn a domain-invariant feature by 1) performing clustering directly in the original feature space with nearest neighbors; 2) constructing truly hard negative pairs by extended neighbors without introducing additional computational complexity; and 3) combining noise-contrastive estimation theory to gain computational advantage. We conduct careful ablation studies and extensive experiments on three common benchmarks: VisDA, Office-Home, and Office-31. The results demonstrate the superiority of our methods compared with other state-of-the-art works.


title: On Strichartz estimate for many body Schr\"odinger equation in the waveguide setting

abstract: In this short paper, we prove Strichartz estimates for N-body Schr\"odinger equations in the waveguide manifold setting (i.e. on semiperiodic spaces $\mathbb{R}^m\times \mathbb{T}^n$ where $m\geq 3$), provided that interaction potentials are small enough (depending on the number of the particles and the universal constants, not on the initial data). The proof combines both the ideas of Tzvetkov-Visciglia \cite{TV1} and Hong \cite{hong2017strichartz}. As an immediate application, the scattering asymptotics for this model is also obtained. This result extends Hong \cite{hong2017strichartz} to the waveguide case.


title: GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis

abstract: Generating photo-realistic video portrait with arbitrary speech audio is a crucial problem in film-making and virtual reality. Recently, several works explore the usage of neural radiance field in this task to improve 3D realness and image fidelity. However, the generalizability of previous NeRF-based methods to out-of-domain audio is limited by the small scale of training data. In this work, we propose GeneFace, a generalized and high-fidelity NeRF-based talking face generation method, which can generate natural results corresponding to various out-of-domain audio. Specifically, we learn a variaitional motion generator on a large lip-reading corpus, and introduce a domain adaptative post-net to calibrate the result. Moreover, we learn a NeRF-based renderer conditioned on the predicted facial motion. A head-aware torso-NeRF is proposed to eliminate the head-torso separation problem. Extensive experiments show that our method achieves more generalized and high-fidelity talking face generation compared to previous methods.


title: Breaking Out of the Ivory Tower: A Large-scale Analysis of Patent Citations to HCI Research

abstract: What is the impact of human-computer interaction research on industry? While it is impossible to track all research impact pathways, the growing literature on translational research impact measurement offers patent citations as one measure of how industry recognizes and draws on research in its inventions. In this paper, we perform a large-scale measurement study primarily of 70,000 patent citations to premier HCI research venues, tracing how HCI research are cited in United States patents over the last 30 years. We observe that 20.1% of papers from these venues, including 60--80% of papers at UIST and 13% of papers in a broader dataset of SIGCHI-sponsored venues overall, are cited by patents -- far greater than premier venues in science overall (9.7%) and NLP (11%). However, the time lag between a patent and its paper citations is long (10.5 years) and getting longer, suggesting that HCI research and practice may not be efficiently connected.


title: Manipulation of polarization topology using a Fabry-P\'erot fiber cavity with a higher-order mode optical nanofiber

abstract: Optical nanofiber cavity research has mainly focused on the fundamental mode. Here, a Fabry-P\'erot fiber cavity with an optical nanofiber supporting the higher-order modes, TE01, TM01, HE21o, and HE21e, is demonstrated. Using cavity spectroscopy, with mode imaging and analysis, we observe cavity resonances that exhibit complex, inhomogeneous states of polarization with topological features containing Stokes singularities such as C-points, Poincar\'e vortices, and L-lines. In situ tuning of the intracavity birefringence enables the desired profile and polarization of the cavity mode to be obtained. These findings open new research possibilities for cold atom manipulation and multimode cavity quantum electrodynamics using the evanescent fields of higher-order mode optical nanofibers.


title: On well-posedness results for the cubic-quintic NLS on $\mathbb{T}^3$

abstract: We consider the periodic cubic-quintic nonlinear Schr\"odinger equation \begin{align}\label{cqnls_abstract} (i\partial_t +\Delta )u=\mu_1 |u|^2 u+\mu_2 |u|^4 u\tag{CQNLS} \end{align} on the three-dimensional torus $\mathbb{T}^3$ with $\mu_1,\mu_2\in \mathbb{R} \setminus\{0\}$. As a first result, we establish the small data well-posedness of \eqref{cqnls_abstract} for arbitrarily given $\mu_1$ and $\mu_2$. By adapting the crucial perturbation arguments in \cite{zhang2006cauchy} to the periodic setting, we also prove that \eqref{cqnls_abstract} is always globally well-posed in $H^1(\mathbb{T}^3)$ in the case $\mu_2>0$.


title: DESI and DECaLS (D&D): galaxy-galaxy lensing measurements with 1% survey and its forecast

abstract: The shear measurement from DECaLS (Dark Energy Camera Legacy Survey) provides an excellent opportunity for galaxy-galaxy lensing study with DESI (Dark Energy Spectroscopic Instrument) galaxies, given the large ($\sim 9000$ deg$^2$) sky overlap. We explore this potential by combining the DESI 1\% survey and DECaLS DR8. With $\sim 106$ deg$^2$ sky overlap, we achieve significant detection of galaxy-galaxy lensing for BGS and LRG as lenses. Scaled to the full BGS sample, we expect the statistical errors to improve from $18(12)\%$ to a promising level of $2(1.3)\%$ at $\theta>8^{'}(<8^{'})$. This brings stronger requirements for future systematics control. To fully realize such potential, we need to control the residual multiplicative shear bias $|m|<0.01$ and the bias in the mean redshift $|\Delta z|<0.015$. We also expect significant detection of galaxy-galaxy lensing with DESI LRG/ELG full samples as lenses, and cosmic magnification of ELG through cross-correlation with low-redshift DECaLS shear. {If such systematical error control can be achieved,} we find the advantages of DECaLS, comparing with KiDS (Kilo Degree Survey) and HSC (Hyper-Suprime Cam), are at low redshift, large-scale, and in measuring the shear-ratio (to $\sigma_R\sim 0.04$) and cosmic magnification.


title: Exciton diffusion in amorphous organic semiconductors: reducing simulation overheads with machine learning

abstract: Simulations of exciton and charge hopping in amorphous organic materials involve numerous physical parameters. Each of these parameters must be computed from costly ab initio calculations before the simulation can commence, resulting in a significant computational overhead for studying exciton diffusion, especially in large and complex material datasets. While the idea of using machine learning to quickly predict these parameters has been explored previously, typical machine learning models require long training times which ultimately contribute to simulation overheads. In this paper, we present a new machine learning architecture for building predictive models for intermolecular exciton coupling parameters. Our architecture is designed in such a way that the total training time is reduced compared to ordinary Gaussian process regression or kernel ridge regression models. Based on this architecture, we build a predictive model and use it to estimate the coupling parameters which enter into an exciton hopping simulation in amorphous pentacene. We show that this hopping simulation is able to achieve excellent predictions for exciton diffusion tensor elements and other properties as compared to a simulation using coupling parameters computed entirely from density functional theory. This result, along with the short training times afforded by our architecture, therefore shows how machine learning can be used to reduce the high computational overheads associated with exciton and charge diffusion simulations in amorphous organic materials.


title: Closed Form Expressions for Certain Improper Integrals of Mathematical Physics

abstract: We present new closed-form expressions for certain improper integrals of Mathematical Physics such as certain Ising, Box, and Associated integrals. The techniques we employ here include (a) the Method of Brackets and its modifications and suitable extensions to obtain the Mellin-Barnes representation. (b) The evaluation of the resulting Mellin-Barnes representations via the recently discovered Conic Hull method via the automated package $\textit{MBConichulls.wl}$. Finally, the analytic continuations of these series solutions are then produced using the automated package \texttt{Olsson.wl}, based on the method of Olsson. Thus, combining all these recent advances allows for closed-form evaluation of the hitherto unknown $B_3(s)$, $B_4(s)$, and related integrals in terms of multivariable hypergeometric functions. Along the way, we also discuss certain complications while using the Original Method of Brackets for these evaluations and how to rectify them. The interesting cases of $C_{5,k}$ are also studied. It is not yet fully resolved for the reasons we discuss in this paper.


title: KiDS-1000: cross-correlation with Planck cosmic microwave background lensing and intrinsic alignment removal with self-calibration

abstract: Galaxy shear - cosmic microwave background (CMB) lensing convergence cross-correlations contain additional information on cosmology to auto-correlations. While being immune to certain systematic effects, they are affected by the galaxy intrinsic alignments (IA). This may be responsible for the reported low lensing amplitude of the galaxy shear $\times$ CMB convergence cross-correlations, compared to the standard Planck $\Lambda$CDM (cosmological constant and cold dark matter) cosmology prediction. In this work, we investigate how IA affects the Kilo-Degree Survey (KiDS) galaxy lensing shear - Planck CMB lensing convergence cross-correlation and compare it to previous treatments with or without IA taken into consideration. More specifically, we compare marginalization over IA parameters and the IA self-calibration (SC) method (with additional observables defined only from the source galaxies) and prove that SC can efficiently break the degeneracy between the CMB lensing amplitude $A_{\rm lens}$ and the IA amplitude $A_{\rm IA}$. We further investigate how different systematics affect the resulting $A_{\rm IA}$ and $A_{\rm lens}$, and validate our results with the MICE2 simulation. We find that by including the SC method to constrain IA, the information loss due to the degeneracy between CMB lensing and IA is strongly reduced. The best-fit values are $A_{\rm lens}=0.84^{+0.22}_{-0.22}$ and $A_{\rm IA}=0.60^{+1.03}_{-1.03}$, while different angular scale cuts can affect $A_{\rm lens}$ by $\sim10\%$. We show that appropriate treatment of the boost factor, cosmic magnification, and photometric redshift modeling is important for obtaining the correct IA and cosmological results.


title: Hopf-Rinow Theorem of sub-Finslerian geometry

abstract: The sub-Finslerian geometry means that the metric $F$ is defined only on a given subbundle of the tangent bundle, called a horizontal bundle. In the paper, a version of the Hopf-Rinow theorem is proved in the case of sub-Finslerian manifolds, which relates the properties of completeness, geodesically completeness, and compactness. The sub-Finsler bundle, the exponential map and the Legendre transformation are deeply involved in this investigation.


title: Rare $W$-boson decays into a vector meson and lepton pair

abstract: We have presented a theoretical study of exclusive rare $W$-boson decays, $W\to V\ell\bar{\nu}_\ell$ with $V$ denoting a neutral vector meson and $\ell=e$ or $\mu$, in the standard model. The leading-order contributions to these processes are given by $W\to \gamma^*\ell\bar{\nu}_\ell$ with the subsequent $\gamma^*\to V$ transition. Branching fractions of these decay modes, for $V=\rho$, $\omega$, $\phi$, and $J/\Psi$, respectively, have been calculated and predicted around $10^{-6}\sim 10^{-7}$, which are surprisingly larger than those of two-body hadronic radiative decays $W^\pm\to M^\pm \gamma$ with $M$ denoting a pseudoscalar or vector meson. Thus it is expected that rare $W$ decays into a neutral vector meson plus lepton pair may be the promising channels in future experimental facilities with a large number of $W$-boson events produced.


title: Real characters in nilpotent blocks

abstract: We prove that the number of irreducible real characters in a nilpotent block of a finite group is locally determined. We further conjecture that the Frobenius-Schur indicators of those characters can be computed for p=2 in terms of the extended defect group. We derive this from a more general conjecture on the Frobenius-Schur indicator of projective indecomposable characters of 2-blocks with one simple module. This extends results of Murray on 2-blocks with cyclic and dihedral defect groups.


title: CMLCompiler: A Unified Compiler for Classical Machine Learning

abstract: Classical machine learning (CML) occupies nearly half of machine learning pipelines in production applications. Unfortunately, it fails to utilize the state-of-the-practice devices fully and performs poorly. Without a unified framework, the hybrid deployments of deep learning (DL) and CML also suffer from severe performance and portability issues. This paper presents the design of a unified compiler, called CMLCompiler, for CML inference. We propose two unified abstractions: operator representations and extended computational graphs. The CMLCompiler framework performs the conversion and graph optimization based on two unified abstractions, then outputs an optimized computational graph to DL compilers or frameworks. We implement CMLCompiler on TVM. The evaluation shows CMLCompiler's portability and superior performance. It achieves up to 4.38$\times$ speedup on CPU, 3.31$\times$ speedup on GPU, and 5.09$\times$ speedup on IoT devices, compared to the state-of-the-art solutions -- scikit-learn, intel sklearn, and hummingbird. Our performance of CML and DL mixed pipelines achieves up to 3.04x speedup compared with cross-framework implementations. The project documents and source code are available at https://www.computercouncil.org/cmlcompiler.


title: Scaling laws for single-agent reinforcement learning

abstract: Recent work has shown that, in generative modeling, cross-entropy loss improves smoothly with model size and training compute, following a power law plus constant scaling law. One challenge in extending these results to reinforcement learning is that the main performance objective of interest, mean episode return, need not vary smoothly. To overcome this, we introduce *intrinsic performance*, a monotonic function of the return defined as the minimum compute required to achieve the given return across a family of models of different sizes. We find that, across a range of environments, intrinsic performance scales as a power law in model size and environment interactions. Consequently, as in generative modeling, the optimal model size scales as a power law in the training compute budget. Furthermore, we study how this relationship varies with the environment and with other properties of the training setup. In particular, using a toy MNIST-based environment, we show that varying the "horizon length" of the task mostly changes the coefficient but not the exponent of this relationship.


title: Retiring $\Delta$DP: New Distribution-Level Metrics for Demographic Parity

abstract: Demographic parity is the most widely recognized measure of group fairness in machine learning, which ensures equal treatment of different demographic groups. Numerous works aim to achieve demographic parity by pursuing the commonly used metric $\Delta DP$. Unfortunately, in this paper, we reveal that the fairness metric $\Delta DP$ can not precisely measure the violation of demographic parity, because it inherently has the following drawbacks: i) zero-value $\Delta DP$ does not guarantee zero violation of demographic parity, ii) $\Delta DP$ values can vary with different classification thresholds. To this end, we propose two new fairness metrics, Area Between Probability density function Curves (ABPC) and Area Between Cumulative density function Curves (ABCC), to precisely measure the violation of demographic parity at the distribution level. The new fairness metrics directly measure the difference between the distributions of the prediction probability for different demographic groups. Thus our proposed new metrics enjoy: i) zero-value ABCC/ABPC guarantees zero violation of demographic parity; ii) ABCC/ABPC guarantees demographic parity while the classification thresholds are adjusted. We further re-evaluate the existing fair models with our proposed fairness metrics and observe different fairness behaviors of those models under the new metrics. The code is available at https://github.com/ahxt/new_metric_for_demographic_parity


title: Rethinking Soft Label in Label Distribution Learning Perspective

abstract: The primary goal of training in early convolutional neural networks (CNN) is the higher generalization performance of the model. However, as the expected calibration error (ECE), which quantifies the explanatory power of model inference, was recently introduced, research on training models that can be explained is in progress. We hypothesized that a gap in supervision criteria during training and inference leads to overconfidence, and investigated that performing label distribution learning (LDL) would enhance the model calibration in CNN training. To verify this assumption, we used a simple LDL setting with recent data augmentation techniques. Based on a series of experiments, the following results are obtained: 1) State-of-the-art KD methods significantly impede model calibration. 2) Training using LDL with recent data augmentation can have excellent effects on model calibration and even in generalization performance. 3) Online LDL brings additional improvements in model calibration and accuracy with long training, especially in large-size models. Using the proposed approach, we simultaneously achieved a lower ECE and higher generalization performance for the image classification datasets CIFAR10, 100, STL10, and ImageNet. We performed several visualizations and analyses and witnessed several interesting behaviors in CNN training with the LDL.


title: A Survey of Explainable AI in Deep Visual Modeling: Methods and Metrics

abstract: Deep visual models have widespread applications in high-stake domains. Hence, their black-box nature is currently attracting a large interest of the research community. We present the first survey in Explainable AI that focuses on the methods and metrics for interpreting deep visual models. Covering the landmark contributions along the state-of-the-art, we not only provide a taxonomic organization of the existing techniques, but also excavate a range of evaluation metrics and collate them as measures of different properties of model explanations. Along the insightful discussion on the current trends, we also discuss the challenges and future avenues for this research direction.


title: Sharp Variance-Dependent Bounds in Reinforcement Learning: Best of Both Worlds in Stochastic and Deterministic Environments

abstract: We study variance-dependent regret bounds for Markov decision processes (MDPs). Algorithms with variance-dependent regret guarantees can automatically exploit environments with low variance (e.g., enjoying constant regret on deterministic MDPs). The existing algorithms are either variance-independent or suboptimal. We first propose two new environment norms to characterize the fine-grained variance properties of the environment. For model-based methods, we design a variant of the MVP algorithm (Zhang et al., 2021a). We apply new analysis techniques to demonstrate that this algorithm enjoys variance-dependent bounds with respect to the norms we propose. In particular, this bound is simultaneously minimax optimal for both stochastic and deterministic MDPs, the first result of its kind. We further initiate the study on model-free algorithms with variance-dependent regret bounds by designing a reference-function-based algorithm with a novel capped-doubling reference update schedule. Lastly, we also provide lower bounds to complement our upper bounds.


title: Benchmarking Model Predictive Control Algorithms in Building Optimization Testing Framework (BOPTEST)

abstract: We present a data-driven modeling and control framework for physics-based building emulators. Our approach consists of: (a) Offline training of differentiable surrogate models that accelerate model evaluations, provide cost-effective gradients, and maintain good predictive accuracy for the receding horizon in Model Predictive Control (MPC), and (b) Formulating and solving nonlinear building HVAC MPC problems. We extensively evaluate the modeling and control performance using multiple surrogate models and optimization frameworks across various test cases available in the Building Optimization Testing Framework (BOPTEST). Our framework is compatible with other modeling techniques and can be customized with different control formulations, making it adaptable and future-proof for test cases currently under development for BOPTEST. This modularity provides a path towards prototyping predictive controllers in large buildings, ensuring scalability and robustness in real-world applications.


title: Delay, resonance and the Lambert W function

abstract: We discuss a new type of delay differential equation that exhibits resonating transient oscillations. The power spectrum peak of the dynamical trajectory reaches its maximum height when the delay is suitably tuned. Furthermore, our analysis of the resonant conditions for this equation has revealed a new connection between the solutions of the transcendental trigonometric equation and the Lambert W function. These results offer fresh insights into the nonlinear dynamics induced by delayed feedback.


title: Certification Design for a Competitive Market

abstract: Motivated by applications such as voluntary carbon markets and educational testing, we consider a market for goods with varying but hidden levels of quality in the presence of a third-party certifier. The certifier can provide informative signals about the quality of products, and can charge for this service. Sellers choose both the quality of the product they produce and a certification. Prices are then determined in a competitive market. Under a single-crossing condition, we show that the levels of certification chosen by producers are uniquely determined at equilibrium. We then show how to reduce a revenue-maximizing certifier's problem to a monopolistic pricing problem with non-linear valuations, and design an FPTAS for computing the optimal slate of certificates and their prices. In general, both the welfare-optimal and revenue-optimal slate of certificates can be arbitrarily large.


title: Learning Vision-based Robotic Manipulation Tasks Sequentially in Offline Reinforcement Learning Settings

abstract: With the rise of deep reinforcement learning (RL) methods, many complex robotic manipulation tasks are being solved. However, harnessing the full power of deep learning requires large datasets. Online-RL does not suit itself readily into this paradigm due to costly and time-taking agent environment interaction. Therefore recently, many offline-RL algorithms have been proposed to learn robotic tasks. But mainly, all such methods focus on a single task or multi-task learning, which requires retraining every time we need to learn a new task. Continuously learning tasks without forgetting previous knowledge combined with the power of offline deep-RL would allow us to scale the number of tasks by keep adding them one-after-another. In this paper, we investigate the effectiveness of regularisation-based methods like synaptic intelligence for sequentially learning image-based robotic manipulation tasks in an offline-RL setup. We evaluate the performance of this combined framework against common challenges of sequential learning: catastrophic forgetting and forward knowledge transfer. We performed experiments with different task combinations to analyze the effect of task ordering. We also investigated the effect of the number of object configurations and density of robot trajectories. We found that learning tasks sequentially helps in the propagation of knowledge from previous tasks, thereby reducing the time required to learn a new task. Regularisation based approaches for continuous learning like the synaptic intelligence method although helps in mitigating catastrophic forgetting but has shown only limited transfer of knowledge from previous tasks.


title: Supernova connection of unidentified ultra high energy gamma-ray source LHAASO J2108+5157

abstract: We present a simple phenomenological model of hadronic interaction between protons accelerated in an old supernova remnant (SNR) and cold protons situated within the associated molecular clouds (MCs). The accelerated protons from the old SNR escaped the SNR shock front, and got injected into the MCs at an earlier time, producing ultra high energy gamma-rays and neutrinos through inelastic proton-proton interaction. We also take into account the acceleration and subsequent escape of electrons from the SNR shock front. The escaped electrons produce gamma-rays through various radiative cooling mechanisms, after getting injected into the MCs. We use the model discussed in this letter to explain the multiwavelength (MWL) spectral energy distribution (SED) of unidentified Galactic ultra high energy gamma-ray source LHAASO J2108+5157. We also discuss the feasibility of applying this model in other cases as well. Future observations can test the viability of the model discussed in this letter, which will in turn confirm that the SNRs can, in fact, accelerate particles up to PeV energies.