title: Complete Positivity Violation in Higher-order Quantum Adiabatic Elimination

abstract: When a composite Lindblad system consists of weakly coupled sub-systems with fast and slow timescales, the description of slow dynamics can be simplified by discarding fast degrees of freedom. This model reduction technique is called adiabatic elimination. While second-order perturbative expansion with respect to the timescale separation has revealed that the evolution of a reduced state is completely positive, this paper presents an example exhibiting complete positivity violation in the fourth-order expansion. Despite the non-uniqueness of slow dynamics parametrization, we prove that complete positivity cannot be ensured in any parametrization. The violation stems from correlation in the initial state.


title: Optimal resizable arrays

abstract: A \emph{resizable array} is an array that can \emph{grow} and \emph{shrink} by the addition or removal of items from its end, or both its ends, while still supporting constant-time \emph{access} to each item stored in the array given its \emph{index}. Since the size of an array, i.e., the number of items in it, varies over time, space-efficient maintenance of a resizable array requires dynamic memory management. A standard doubling technique allows the maintenance of an array of size~$N$ using only $O(N)$ space, with $O(1)$ amortized time, or even $O(1)$ worst-case time, per operation. Sitarski and Brodnik et al.\ describe much better solutions that maintain a resizable array of size~$N$ using only $N+O(\sqrt{N})$ space, still with $O(1)$ time per operation. Brodnik et al.\ give a simple proof that this is best possible. We distinguish between the space needed for \emph{storing} a resizable array, and accessing its items, and the \emph{temporary} space that may be needed while growing or shrinking the array. For every integer $r\ge 2$, we show that $N+O(N^{1/r})$ space is sufficient for storing and accessing an array of size~$N$, if $N+O(N^{1-1/r})$ space can be used briefly during grow and shrink operations. Accessing an item by index takes $O(1)$ worst-case time while grow and shrink operations take $O(r)$ amortized time. Using an exact analysis of a \emph{growth game}, we show that for any data structure from a wide class of data structures that uses only $N+O(N^{1/r})$ space to store the array, the amortized cost of grow is $\Omega(r)$, even if only grow and access operations are allowed. The time for grow and shrink operations cannot be made worst-case, unless $r=2$.


title: Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metric

abstract: Combining the Color and Event cameras (also called Dynamic Vision Sensors, DVS) for robust object tracking is a newly emerging research topic in recent years. Existing color-event tracking framework usually contains multiple scattered modules which may lead to low efficiency and high computational complexity, including feature extraction, fusion, matching, interactive learning, etc. In this paper, we propose a single-stage backbone network for Color-Event Unified Tracking (CEUTrack), which achieves the above functions simultaneously. Given the event points and RGB frames, we first transform the points into voxels and crop the template and search regions for both modalities, respectively. Then, these regions are projected into tokens and parallelly fed into the unified Transformer backbone network. The output features will be fed into a tracking head for target object localization. Our proposed CEUTrack is simple, effective, and efficient, which achieves over 75 FPS and new SOTA performance. To better validate the effectiveness of our model and address the data deficiency of this task, we also propose a generic and large-scale benchmark dataset for color-event tracking, termed COESOT, which contains 90 categories and 1354 video sequences. Additionally, a new evaluation metric named BOC is proposed in our evaluation toolkit to evaluate the prominence with respect to the baseline methods. We hope the newly proposed method, dataset, and evaluation metric provide a better platform for color-event-based tracking. The dataset, toolkit, and source code will be released on: \url{https://github.com/Event-AHU/COESOT}.


title: On the fragility of gate-error metrics in simulation models of flux-tunable transmon quantum computers

abstract: Constructing a quantum computer requires immensely precise control over a quantum system. A lack of precision is often quantified by gate-error metrics, such as the average infidelity or the diamond distance. However, usually such gate-error metrics are only considered for individual gates, and not the errors that accumulate over consecutive gates. Furthermore, it is not well known how susceptible the metrics are to the assumptions which make up the model. Here, we investigate these issues using realistic simulation models of quantum computers with flux-tunable transmons and coupling resonators. Our main findings reveal that (1) gate-error metrics are indeed affected by the many assumptions of the model, (2) consecutive gate errors do not accumulate linearly, and (3) gate-error metrics are poor predictors for the performance of consecutive gates. Additionally, we discuss a potential limitation in the scalability of the studied device architecture.


title: Explicit upper bounds for the number of primes simultaneously representable by any set of irreducible polynomials

abstract: Using an explicit version of Selberg's upper sieve, we obtain explicit upper bounds for the number of $n\leq x$ such that a non-empty set of irreducible polynomials $F_i(n)$ with integer coefficients are simultaneously prime; this set can contain as many polynomials as desired. To demonstrate, we present computations for some irreducible polynomials and obtain an explicit upper bound for the number of Sophie Germain primes up to $x$, which have practical applications in cryptography.


title: Machine Learning Methods for Anomaly Detection in Nuclear Power Plant Power Transformers

abstract: Power transformers are an important component of a nuclear power plant (NPP). Currently, the NPP operates a lot of power transformers with extended service life, which exceeds the designated 25 years. Due to the extension of the service life, the task of monitoring the technical condition of power transformers becomes urgent. An important method for monitoring power transformers is Chromatographic Analysis of Dissolved Gas. It is based on the principle of controlling the concentration of gases dissolved in transformer oil. The appearance of almost any type of defect in equipment is accompanied by the formation of gases that dissolve in oil, and specific types of defects generate their gases in different quantities. At present, at NPPs, the monitoring systems for transformer equipment use predefined control limits for the concentration of dissolved gases in the oil. This study describes the stages of developing an algorithm to detect defects and faults in transformers automatically using machine learning and data analysis methods. Among machine learning models, we trained Logistic Regression, Decision Trees, Random Forest, Gradient Boosting, Neural Networks. The best of them were then combined into an ensemble (StackingClassifier) showing F1-score of 0.974 on a test sample. To develop mathematical models, we used data on the state of transformers, containing time series with values of gas concentrations (H2, CO, C2H4, C2H2). The datasets were labeled and contained four operating modes: normal mode, partial discharge, low energy discharge, low-temperature overheating.


title: Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders

abstract: Knowledge distillation (KD) has been a ubiquitous method for model compression to strengthen the capability of a lightweight model with the transferred knowledge from the teacher. In particular, KD has been employed in quantization-aware training (QAT) of Transformer encoders like BERT to improve the accuracy of the student model with the reduced-precision weight parameters. However, little is understood about which of the various KD approaches best fits the QAT of Transformers. In this work, we provide an in-depth analysis of the mechanism of KD on attention recovery of quantized large Transformers. In particular, we reveal that the previously adopted MSE loss on the attention score is insufficient for recovering the self-attention information. Therefore, we propose two KD methods; attention-map and attention-output losses. Furthermore, we explore the unification of both losses to address task-dependent preference between attention-map and output losses. The experimental results on various Transformer encoder models demonstrate that the proposed KD methods achieve state-of-the-art accuracy for QAT with sub-2-bit weight quantization.


title: Prompt and non-prompt charm baryons with ALICE

abstract: Recent measurements of prompt charm-baryon production at midrapidity in pp and p--Pb collisions show baryon-to-meson yield ratios significantly higher than those in $\rm e^+e^-$ collisions, suggesting that the charm fragmentation is not universal across different collision systems. Thus, more precise and broader measurements of prompt charm-baryon production are crucial to study the charm quark hadronization in a partonic-rich environment like the one produced in pp collisions at the LHC energies. Prompt charm baryon-to-meson yield ratios in proton--nucleus collisions provide important information about possible additional modification of hadronization mechanisms, on cold nuclear matter effects, and on the possible presence of collective effects that could modify the production of heavy-flavor hadrons. The non-prompt charm-hadron production can provide information about the beauty sector and can be used to study flavor dependence of heavy-quark hadronization. In this contribution, the most recent results on prompt and non-prompt charm-hadron yield ratios in pp and p--Pb collisions and on charm fragmentation fractions and charm production cross section at midrapidity per unit of rapidity measured by ALICE are discussed.


title: The activated scaling behavior of quantum Griffiths singularity in two-dimensional superconductors

abstract: Quantum Griffiths singularity is characterized by the divergence of the dynamical critical exponent with the activated scaling law and has been widely observed in various two-dimensional superconductors. Recently, the direct activated scaling analysis with the irrelevant correction has been proposed and successfully used to analyze the experimental data of crystalline PdTe2 and polycrystalline \b{eta}-W films, which provides new evidence of quantum Griffiths singularity. Here we show that the direct activated scaling analysis is applicable to the experimental data in different superconducting films, including tri-layer Ga films and LaAlO3/SrTiO3 interface superconductor. When taking the irrelevant correction into account, we calculate the corrected sheet resistance at ultralow temperatures. The scaling behavior of the corrected resistance in a comparably large temperature regime and the theoretical fitting of the phase boundary give unambiguous evidence of quantum Griffiths singularity. Compared to the previous method based on the finite size scaling, the direct activated scaling analysis represents a more direct and precise way to analyze the experimental data of quantum Griffiths singularity in diverse two-dimensional superconductors.


title: Weyl entropy behaviour and Naked Singularities

abstract: In order to show that there exists a relation between the validity of the Weyl entropy and the cosmic censorship hypothesis, we discuss the relation between naked singularities and the gravitational entropy estimator using the Weyl invariant. We look at the examples of Vaidya and Tolman-Bondi spacetimes in asymptotically flat and de Sitter spacetime and look at Weyl entropy as a possible indicator of the prohibition of naked singularities.


title: MagicVideo: Efficient Video Generation With Latent Diffusion Models

abstract: We present an efficient text-to-video generation framework based on latent diffusion models, termed MagicVideo. MagicVideo can generate smooth video clips that are concordant with the given text descriptions. Due to a novel and efficient 3D U-Net design and modeling video distributions in a low-dimensional space, MagicVideo can synthesize video clips with 256x256 spatial resolution on a single GPU card, which takes around 64x fewer computations than the Video Diffusion Models (VDM) in terms of FLOPs. In specific, unlike existing works that directly train video models in the RGB space, we use a pre-trained VAE to map video clips into a low-dimensional latent space and learn the distribution of videos' latent codes via a diffusion model. Besides, we introduce two new designs to adapt the U-Net denoiser trained on image tasks to video data: a frame-wise lightweight adaptor for the image-to-video distribution adjustment and a directed temporal attention module to capture temporal dependencies across frames. Thus, we can exploit the informative weights of convolution operators from a text-to-image model for accelerating video training. To ameliorate the pixel dithering in the generated videos, we also propose a novel VideoVAE auto-encoder for better RGB reconstruction. We conduct extensive experiments and demonstrate that MagicVideo can generate high-quality video clips with either realistic or imaginary content. Refer to \url{https://magicvideo.github.io/#} for more examples.


title: Quadratic theory of gravity with a scalar field and type I Shapovalov wave spacetimes

abstract: For the quadratic theory of gravity with a scalar field, exact solutions are found for gravitational-wave models in Shapovalov~I~type spacetimes, which do not arise in models of the general theory of relativity. The theory of gravity under consideration can effectively describe the early stages of the dynamics of the universe. Type I Shapovalov spaces are the most general form of gravitational-wave Shapovalov spacetimes, whose metric in privileged coordinate systems depends on three variables, including the wave variable. For Einstein vacuum spacetimes, these wave models degenerate into simpler types. The obtained exact models of gravitational waves in the quadratic theory of gravity can be used to test the realism of such theories of gravity.


title: Vop\v{e}nka's Alternative Set Theory in the Mathematical Canon of the 20th Century: Author's Translation from Czech

abstract: Vop\v{e}nka's Alternative Set Theory can be viewed both as an evolution and as a revolution: it is based on his previous experience with nonstandard universes, inspired by Skolem's construction of a nonstandard model of arithmetic, and its inception has been explicitly mentioned as an attempt to axiomatize Robinson's Nonstandard Analysis. Vop\v{e}nka preferred working in an axiomatic theory to investigating its individual models; he also viewed other areas of nonclassical mathematics through this prism. This article is a contribution to the mapping of the mathematical neighbourhood of the Alternative Set Theory, and at the same time, it submits a challenge to analyze in more detail the genesis and structure of the philosophical links that eventually influenced the Alternative Set Theory.


title: Unidentified infrared bands do not correlate with C/O ratio in planetary nebulae

abstract: The concrete evidence adduced to support the widely held idea that unidentified infrared bands (UIBs) are enhanced in carbon-rich planetary nebulae (PNe) is a remarkable UIB 7.7 {\mu}m versus C/O ratio correlation plot for six PNe, obtained from air-born observations and published in 1986 by M. Cohen and coworkers. However, the space-born data presented by Cohen & Barlow in 2005 undercut this correlation, and I show that the larger dataset they provide disproves a specific link between UIBs and carbon abundance in PNe. It also follows from these data that interstellar UIB carriers cannot originate from the atmosphere of carbon-rich PNe.


title: Dusty plasma in active galactic nuclei

abstract: Since many years we know that dust in the form of the dusty-molecular torus is responsible for the obscuration in active galactic nuclei (AGN) at large viewing angles and thus for the classification of AGN. Recently, we gained some observational and theoretical insight into geometry of the region and the role of the dust in the dynamics of the outflow and failed winds. We will briefly touch on all these aspects, including our dust-based model (FRADO - Failed Radiatively Accelerated Dusty Outflow) of the formation of the Balmer lines in AGN.


title: Friable permutations and polynomials revisited

abstract: We prove various optimal estimates for the counts of friable (i.e. smooth) permutations and friable polynomials over finite fields. In particular, for both permutations and polynomials we prove a result with an error term that, for the first time, matches the error term found in the integer setting by de Bruijn more than 70 years ago. The main term is the usual Dickman $\rho$ function, but with its argument shifted. Additionally, for permutations, we determine the order of magnitude of $\log(p_{n,m}/\rho(n/m))$ throughout the range $1\le n \le m$ where $p_{n,m}$ is the probability that a permutation on $n$ elements, chosen uniformly at random, is $m$-friable. We also uncover a phase transition in the polynomial setting. We show that the probability that a polynomial of degree $n$ in $\mathbb{F}_q$ is $m$-friable shifts its behavior at $m\approx (3/2)\log_q n$. Previously, phase transitions were only known to occur at $m\approx 2\log_qn$ and $m\approx \log_q n$.


title: Deterministic Identification For MC ISI-Poisson Channel

abstract: Several applications of molecular communications (MC) feature an alarm-prompt behavior for which the prevalent Shannon capacity may not be the appropriate performance metric. The identification capacity as an alternative measure for such systems has been motivated and established in the literature. In this paper, we study deterministic identification (DI) for the discrete-time \emph{Poisson} channel (DTPC) with inter-symbol interference (ISI) where the transmitter is restricted to an average and a peak molecule release rate constraint. Such a channel serves as a model for diffusive MC systems featuring long channel impulse responses and employing molecule counting receivers. We derive lower and upper bounds on the DI capacity of the DTPC with ISI when the number of ISI channel taps $K$ may grow with the codeword length $n$ (e.g., due to increasing symbol rate). As a key finding, we establish that for deterministic encoding, the codebook size scales as $2^{(n\log n)R}$ assuming that the number of ISI channel taps scales as $K = 2^{\kappa \log n}$, where $R$ is the coding rate and $\kappa$ is the ISI rate. Moreover, we show that optimizing $\kappa$ leads to an effective identification rate [bits/s] that scales linearly with $n$, which is in contrast to the typical transmission rate [bits/s] that is independent of $n$.


title: Self-supervised iRegNet for the Registration of Longitudinal Brain MRI of Diffuse Glioma Patients

abstract: Reliable and accurate registration of patient-specific brain magnetic resonance imaging (MRI) scans containing pathologies is challenging due to tissue appearance changes. This paper describes our contribution to the Registration of the longitudinal brain MRI task of the Brain Tumor Sequence Registration Challenge 2022 (BraTS-Reg 2022). We developed an enhanced unsupervised learning-based method that extends the iRegNet. In particular, incorporating an unsupervised learning-based paradigm as well as several minor modifications to the network pipeline, allows the enhanced iRegNet method to achieve respectable results. Experimental findings show that the enhanced self-supervised model is able to improve the initial mean median registration absolute error (MAE) from 8.20 (7.62) mm to the lowest value of 3.51 (3.50) for the training set while achieving an MAE of 2.93 (1.63) mm for the validation set. Additional qualitative validation of this study was conducted through overlaying pre-post MRI pairs before and after the de-formable registration. The proposed method scored 5th place during the testing phase of the MICCAI BraTS-Reg 2022 challenge. The docker image to reproduce our BraTS-Reg submission results will be publicly available.


title: Linear resolutions of $t$-spread lexsegment ideals via Betti splittings

abstract: Let $S=K[x_1,\dots,x_n]$ be a polynomial ring in $n$ variables with coefficients over a field $K$. A $t$-spread lexsegment ideal $I$ of $S$ is a monomial ideal generated by a $t$-spread lexsegment set. We determine all $t$-spread lexsegment ideals with linear resolution by means of Betti splittings. As applications we provide formulas for the Betti numbers of such a class of ideals and furthermore we characterize all incompletely $t$-spread lexsegment ideals with linear quotients.


title: Safe Reinforcement Learning using Data-Driven Predictive Control

abstract: Reinforcement learning (RL) algorithms can achieve state-of-the-art performance in decision-making and continuous control tasks. However, applying RL algorithms on safety-critical systems still needs to be well justified due to the exploration nature of many RL algorithms, especially when the model of the robot and the environment are unknown. To address this challenge, we propose a data-driven safety layer that acts as a filter for unsafe actions. The safety layer uses a data-driven predictive controller to enforce safety guarantees for RL policies during training and after deployment. The RL agent proposes an action that is verified by computing the data-driven reachability analysis. If there is an intersection between the reachable set of the robot using the proposed action, we call the data-driven predictive controller to find the closest safe action to the proposed unsafe action. The safety layer penalizes the RL agent if the proposed action is unsafe and replaces it with the closest safe one. In the simulation, we show that our method outperforms state-of-the-art safe RL methods on the robotics navigation problem for a Turtlebot 3 in Gazebo and a quadrotor in Unreal Engine 4 (UE4).


title: Algorithmic Decision-Making Safeguarded by Human Knowledge

abstract: Commercial AI solutions provide analysts and managers with data-driven business intelligence for a wide range of decisions, such as demand forecasting and pricing. However, human analysts may have their own insights and experiences about the decision-making that is at odds with the algorithmic recommendation. In view of such a conflict, we provide a general analytical framework to study the augmentation of algorithmic decisions with human knowledge: the analyst uses the knowledge to set a guardrail by which the algorithmic decision is clipped if the algorithmic output is out of bound, and seems unreasonable. We study the conditions under which the augmentation is beneficial relative to the raw algorithmic decision. We show that when the algorithmic decision is asymptotically optimal with large data, the non-data-driven human guardrail usually provides no benefit. However, we point out three common pitfalls of the algorithmic decision: (1) lack of domain knowledge, such as the market competition, (2) model misspecification, and (3) data contamination. In these cases, even with sufficient data, the augmentation from human knowledge can still improve the performance of the algorithmic decision.


title: Harmonic oscillator coherent states from the orbit theory standpoint

abstract: We study the known coherent states of a quantum harmonic oscillator from the standpoint of the original developed noncommutative integration method for linear partial differential equations. The application of the method is based on the symmetry properties of the Schr\"odinger equation and on the orbit geometry of the coadjoint representation of Lie groups. We have shown that analogs of coherent states constructed by the noncommutative integration can be expressed in terms of the solution of a system of differential equations on the Lie group of the oscillatory Lie algebra. The solutions constructed are directly related to irreducible representation of the Lie algebra on the Hilbert space functions on the Lagrangian submanifold to the orbit of the coadjoint representation.


title: Adversarial Cheap Talk

abstract: Adversarial attacks in reinforcement learning (RL) often assume highly-privileged access to the victim's parameters, environment, or data. Instead, this paper proposes a novel adversarial setting called a Cheap Talk MDP in which an Adversary can merely append deterministic messages to the Victim's observation, resulting in a minimal range of influence. The Adversary cannot occlude ground truth, influence underlying environment dynamics or reward signals, introduce non-stationarity, add stochasticity, see the Victim's actions, or access their parameters. Additionally, we present a simple meta-learning algorithm called Adversarial Cheap Talk (ACT) to train Adversaries in this setting. We demonstrate that an Adversary trained with ACT still significantly influences the Victim's training and testing performance, despite the highly constrained setting. Affecting train-time performance reveals a new attack vector and provides insight into the success and failure modes of existing RL algorithms. More specifically, we show that an ACT Adversary is capable of harming performance by interfering with the learner's function approximation, or instead helping the Victim's performance by outputting useful features. Finally, we show that an ACT Adversary can manipulate messages during train-time to directly and arbitrarily control the Victim at test-time. Project video and code are available at https://sites.google.com/view/adversarial-cheap-talk


title: Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors

abstract: Deployed language models decay over time due to shifting inputs, changing user needs, or emergent world-knowledge gaps. When such problems are identified, we want to make targeted edits while avoiding expensive retraining. However, current model editors, which modify such behaviors of pre-trained models, degrade model performance quickly across multiple, sequential edits. We propose GRACE, a lifelong model editing method, which implements spot-fixes on streaming errors of a deployed model, ensuring minimal impact on unrelated inputs. GRACE writes new mappings into a pre-trained model's latent space, creating a discrete, local codebook of edits without altering model weights. This is the first method enabling thousands of sequential edits using only streaming errors. Our experiments on T5, BERT, and GPT models show GRACE's state-of-the-art performance in making and retaining edits, while generalizing to unseen inputs. Our code is available at https://www.github.com/thartvigsen/grace}.


title: Pp OPF -- Pandapower Implementation of Three-phase Optimal Power Flow Model

abstract: Challenges in the planning and operation of distribution networks caused by the integration of distributed energy resources (DERs) create the need for the development of tools that can be easily used by system operators, industry, and the research society but are also easily upgraded with new functionalities. The full implementation of one such open source tool, named pp OPF (pandapower Optimal Power Flow), is presented in this paper. Pp OPF is the tool used for three-phase optimal power flow (OPF) calculations and it is based on already existing functionalities of pandapower, a Python library for power system calculations. The developed tool enables the possibility to use both power-voltage and current-voltage formulation in different OPF problems, such as determining the photovoltaics (PVs) hosting capacity in three-phase distribution networks, the problem on which the functionality of the developed tool is tested. Additionally, the accuracy of pp OPF is verified by comparing the results with ones obtained by pandapower power flow calculation for the same set of input values. The open-source implementation allows further upgrades, the addition of new functionalities, and the creation of new case studies relevant to the planning and operation of distribution networks.


title: On the Complexity of Bayesian Generalization

abstract: We consider concept generalization at a large scale in the diverse and natural visual spectrum. Established computational modes (i.e., rule-based or similarity-based) are primarily studied isolated and focus on confined and abstract problem spaces. In this work, we study these two modes when the problem space scales up, and the $complexity$ of concepts becomes diverse. Specifically, at the $representational \ level$, we seek to answer how the complexity varies when a visual concept is mapped to the representation space. Prior psychology literature has shown that two types of complexities (i.e., subjective complexity and visual complexity) (Griffiths and Tenenbaum, 2003) build an inverted-U relation (Donderi, 2006; Sun and Firestone, 2021). Leveraging Representativeness of Attribute (RoA), we computationally confirm the following observation: Models use attributes with high RoA to describe visual concepts, and the description length falls in an inverted-U relation with the increment in visual complexity. At the $computational \ level$, we aim to answer how the complexity of representation affects the shift between the rule- and similarity-based generalization. We hypothesize that category-conditioned visual modeling estimates the co-occurrence frequency between visual and categorical attributes, thus potentially serving as the prior for the natural visual world. Experimental results show that representations with relatively high subjective complexity outperform those with relatively low subjective complexity in the rule-based generalization, while the trend is the opposite in the similarity-based generalization.


title: The real-time growth rate of stochastic epidemics on random intersection graphs

abstract: This paper is concerned with the growth rate of SIR (Susceptible-Infectious-Recovered) epidemics with general infectious period distribution on random intersection graphs. This type of graph is characterized by the presence of cliques (fully connected subgraphs). We study epidemics on random intersection graphs with a mixed Poisson degree distribution and show that in the limit of large population sizes the number of infected individuals grows exponentially during the early phase of the epidemic, as is generally the case for epidemics on asymptotically unclustered networks. The Malthusian parameter is shown to satisfy a variant of the classical Euler-Lotka equation. To obtain these results we construct a coupling of the epidemic process and a continuous-time multitype branching process, where the type of an individual is (essentially) given by the length of its infectious period. Asymptotic results are then obtained via an embedded single-type Crump-Mode-Jagers branching process.


title: Heterogenous Ensemble of Models for Molecular Property Prediction

abstract: Previous works have demonstrated the importance of considering different modalities on molecules, each of which provide a varied granularity of information for downstream property prediction tasks. Our method combines variants of the recent TransformerM architecture with Transformer, GNN, and ResNet backbone architectures. Models are trained on the 2D data, 3D data, and image modalities of molecular graphs. We ensemble these models with a HuberRegressor. The models are trained on 4 different train/validation splits of the original train + valid datasets. This yields a winning solution to the 2\textsuperscript{nd} edition of the OGB Large-Scale Challenge (2022) on the PCQM4Mv2 molecular property prediction dataset. Our proposed method achieves a test-challenge MAE of $0.0723$ and a validation MAE of $0.07145$. Total inference time for our solution is less than 2 hours. We open-source our code at https://github.com/jfpuget/NVIDIA-PCQM4Mv2.


title: Anosov flows and Liouville pairs in dimension three

abstract: Building upon the work of Mitsumatsu and Hozoori, we establish a complete homotopy correspondence between three-dimensional Anosov flows and certain pairs of contact forms that we call Anosov Liouville pairs. We show a similar correspondence between projectively Anosov flows and bi-contact structures, extending the work of Mitsumatsu and Eliashberg-Thurston. As a consequence, every Anosov flow on a closed oriented three-manifold $M$ gives rise to a Liouville structure on $\mathbb{R} \times M$ which is well-defined up to homotopy, and which only depends on the homotopy class of the Anosov flow. Our results also provide a new perspective on the classification problem of Anosov flows in dimension three.


title: Enumerative geometry of surfaces and topological strings

abstract: This survey covers recent developments on the geometry and physics of Looijenga pairs, namely pairs $(X,D)$ with $X$ a complex algebraic surface and $D$ a singular anticanonical divisor in it. I will describe a surprising web of correspondences linking together several a priori distant classes of enumerative invariants associated to $(X,D)$, including the log Gromov--Witten invariants of the pair, the Gromov--Witten invariants of an associated higher dimensional Calabi--Yau variety, the open Gromov--Witten invariants of certain special Lagrangians in toric Calabi--Yau threefolds, the Donaldson--Thomas theory of a class of symmetric quivers, and certain open and closed BPS-type invariants. I will also discuss how these correspondences can be effectively used to provide a complete closed-form solution to the calculation of all these invariants.


title: Mission-Aware Value of Information Censoring for Distributed Filtering

abstract: In this paper, we study the problem of distributed estimation with an emphasis on communication-efficiency. The proposed algorithm is based on a windowed maximum a posteriori (MAP) estimation problem, wherein each agent in the network locally computes a Kalman-like filter estimate that approximates the centralized MAP solution. Information sharing among agents is restricted to their neighbors only, with guarantees on overall estimate consistency provided via logarithmic opinion pooling. The problem is efficiently distributed using the alternating direction method of multipliers (ADMM), whose overall communication usage is further reduced by a value of information (VoI) censoring mechanism, wherein agents only transmit their primal-dual iterates when deemed valuable to do so. The proposed censoring mechanism is mission-aware, enabling a globally efficient use of communication resources while guaranteeing possibly different local estimation requirements. To illustrate the validity of the approach we perform simulations in a target tracking scenario.


title: Deep Composite Face Image Attacks: Generation, Vulnerability and Detection

abstract: Face manipulation attacks have drawn the attention of biometric researchers because of their vulnerability to Face Recognition Systems (FRS). This paper proposes a novel scheme to generate Composite Face Image Attacks (CFIA) based on facial attributes using Generative Adversarial Networks (GANs). Given the face images corresponding to two unique data subjects, the proposed CFIA method will independently generate the segmented facial attributes, then blend them using transparent masks to generate the CFIA samples. We generate $526$ unique CFIA combinations of facial attributes for each pair of contributory data subjects. Extensive experiments are carried out on our newly generated CFIA dataset consisting of 1000 unique identities with 2000 bona fide samples and 526000 CFIA samples, thus resulting in an overall 528000 face image samples. {{We present a sequence of experiments to benchmark the attack potential of CFIA samples using four different automatic FRS}}. We introduced a new metric named Generalized Morphing Attack Potential (G-MAP) to benchmark the vulnerability of generated attacks on FRS effectively. Additional experiments are performed on the representative subset of the CFIA dataset to benchmark both perceptual quality and human observer response. Finally, the CFIA detection performance is benchmarked using three different single image based face Morphing Attack Detection (MAD) algorithms. The source code of the proposed method together with CFIA dataset will be made publicly available: \url{https://github.com/jagmohaniiit/LatentCompositionCode}


title: PointResNet: Residual Network for 3D Point Cloud Segmentation and Classification

abstract: Point cloud segmentation and classification are some of the primary tasks in 3D computer vision with applications ranging from augmented reality to robotics. However, processing point clouds using deep learning-based algorithms is quite challenging due to the irregular point formats. Voxelization or 3D grid-based representation are different ways of applying deep neural networks to this problem. In this paper, we propose PointResNet, a residual block-based approach. Our model directly processes the 3D points, using a deep neural network for the segmentation and classification tasks. The main components of the architecture are: 1) residual blocks and 2) multi-layered perceptron (MLP). We show that it preserves profound features and structural information, which are useful for segmentation and classification tasks. The experimental evaluations demonstrate that the proposed model produces the best results for segmentation and comparable results for classification in comparison to the conventional baselines.


title: Pragmatic Constraint on Distributional Semantics

abstract: This paper studies the limits of language models' statistical learning in the context of Zipf's law. First, we demonstrate that Zipf-law token distribution emerges irrespective of the chosen tokenization. Second, we show that Zipf distribution is characterized by two distinct groups of tokens that differ both in terms of their frequency and their semantics. Namely, the tokens that have a one-to-one correspondence with one semantic concept have different statistical properties than those with semantic ambiguity. Finally, we demonstrate how these properties interfere with statistical learning procedures motivated by distributional semantics.


title: Report: Statistics of approximations to zeroes of $\zeta$-function via truncated symmetrized Euler products

abstract: We look at approximations $ \zeta_X $ of the $\zeta$-function introduced in Gonek's paper (arXiv:0704.3448). We look at how close the approximate zeroes are to the actual zeroes when (i) X is fixed (Section 1)(ii) X varies like $ t/2\pi $ (Section 3.1). We establish a heuristic for estimating these differences, involving values of $ F_X^\star(t) $ and its near-constant slopes near zeta-zero ordinates $ \gamma $. In Section 3.2 we see the slope around the zeroes behaves logarithmically and we calculate a numerical formula for it. In Section 3.3 and 3.4 we scale the differences with the slopes and compare them with models involving 1 or 2 pairs of neighbouring zeta-zeroes. In Section 3.5, we also look at how often these models capture these scaled differences accurately. In Section 4, we look at our methods from a theoretical standpoint. In Section 5, we look at how close the approximate zeroes are to the actual zeroes when (i) X is fixed (ii) X varies like $ t/2\pi $. The errors seem to behave like powers of log which should be investigated further from a theoretical standpoint.


title: Revealing Robust Oil and Gas Company Macro-Strategies using Deep Multi-Agent Reinforcement Learning

abstract: The energy transition potentially poses an existential risk for major international oil companies (IOCs) if they fail to adapt to low-carbon business models. Projections of energy futures, however, are met with diverging assumptions on its scale and pace, causing disagreement among IOC decision-makers and their stakeholders over what the business model of an incumbent fossil fuel company should be. In this work, we used deep multi-agent reinforcement learning to solve an energy systems wargame wherein players simulate IOC decision-making, including hydrocarbon and low-carbon investments decisions, dividend policies, and capital structure measures, through an uncertain energy transition to explore critical and non-linear governance questions, from leveraged transitions to reserve replacements. Adversarial play facilitated by state-of-the-art algorithms revealed decision-making strategies robust to energy transition uncertainty and against multiple IOCs. In all games, robust strategies emerged in the form of low-carbon business models as a result of early transition-oriented movement. IOCs adopting such strategies outperformed business-as-usual and delayed transition strategies regardless of hydrocarbon demand projections. In addition to maximizing value, these strategies benefit greater society by contributing substantial amounts of capital necessary to accelerate the global low-carbon energy transition. Our findings point towards the need for lenders and investors to effectively mobilize transition-oriented finance and engage with IOCs to ensure responsible reallocation of capital towards low-carbon business models that would enable the emergence of fossil fuel incumbents as future low-carbon leaders.


title: On a class of Algebras Satisfying polynomial identity of degree six

abstract: In this paper we study the structure of a class of algebras satisfying a polynomial identity of degree 6. We show, assuming the existence of a non-zero idempotent, that if an algebra satisfies such an identity, it admits a Peirce decomposition related to this idempotent. We studied the algebraic structure and highlighted the connections of the algebras of this class with Bernstein algebras, train algebras, Jordan algebras and power associative algebras. Keywords: Peirce decomposition, Bernstein algebra, Jordan algebra, Power associative algebra, train algebra,polynomial identity, idempotent.


title: Probing new physics at the LUXE experiment

abstract: The proposed LUXE experiment (Laser und XFEL Experiment) at DESY Hamburg, using the electron beam from the European XFEL, aims to probe QED in the non-perturbative regime created in collisions between high-intensity laser pulses and high-energy electron or photon beams. This setup also provides a unique opportunity to probe physics beyond the standard model. In this proceedings, we show that by leveraging the large photon flux generated at LUXE, one can probe axion-like-particles (ALPs) up to a mass of 350 MeV and with a photon coupling of $3\times{10}^{-6}\ \mathrm{GeV}^{-1}$. This reach is comparable to the background-free projection from NA62. In addition, we will discuss other probes of new physics such as ALPs-electron coupling.


title: Minimal decoherence from inflation

abstract: We compute the rate with which super-Hubble cosmological fluctuations are decohered during inflation, by their gravitational interactions with unobserved shorter-wavelength scalar and tensor modes. We do so using Open Effective Field Theory methods, that remain under control at the late times of observational interest, contrary to perturbative calculations. Our result is minimal in the sense that it only incorporates the self-interactions predicted by General Relativity in single-clock models (additional interaction channels should only speed up decoherence). We find that decoherence is both suppressed by the first slow-roll parameter and by the energy density during inflation in Planckian units, but that it is enhanced by the volume comprised within the scale of interest, in Hubble units. This implies that, for the scales probed in the Cosmic Microwave Background, decoherence is effective as soon as inflation proceeds above $\sim 5\times 10^{9}$ GeV. Alternatively, if inflation proceeds at GUT scale decoherence is incomplete only for the scales crossing out the Hubble radius in the last ~ 13 e-folds, of inflation. We also compute how short-wavelength scalar modes decohere primordial tensor perturbations, finding a faster rate unsuppressed by slow-roll parameters. Identifying the parametric dependence of decoherence, and the rate at which it proceeds, helps suggest ways to look for quantum effects.


title: IWDM: The fate of an interacting non-cold dark matter $-$ vacuum scenario

abstract: In most cosmological models, the equation of state of the dark matter is assumed to be zero, which means that the dark matter is pressure-less or cold. While this hypothesis is based on the abundance of cold dark matter in the universe, however, there is no compelling reason to assume that the equation of state of dark matter is exactly zero. A more general approach would be to allow for a range of values for the dark matter equation of state and use the observational data to determine which values are most likely. With the increasing accuracy of experimental data, we have chosen to explore the possibility of interacting non-cold dark matter $-$ vacuum scenario, where the equation of state of the dark matter is constant but can take different values within a specific range. Using the Cosmic Microwave Background (CMB) anisotropies and the CMB lensing reconstruction from the Planck legacy release, plus other non-CMB measurements, namely, the baryon acoustic oscillations distance measurements, and the Pantheon catalogue from Type Ia Supernovae, we have analyzed this scenario and found that a non-zero value for the dark matter equation of state is preferred with a confidence level of over 68\%. While this is not significant by itself, however, it does suggest that investigating the possibility of non-cold dark matter in the universe is worth exploring further to gain a better understanding of the nature of dark matter.


title: Discretisations and Preconditioners for Magnetohydrodynamics Models

abstract: The magnetohydrodynamics (MHD) equations are generally known to be difficult to solve numerically, due to their highly nonlinear structure and the strong coupling between the electromagnetic and hydrodynamic variables, especially for high Reynolds and coupling numbers. In the first part of this work, we present a scalable augmented Lagrangian preconditioner for a finite element discretisation of the $\mathbf{B}$-$\mathbf{E}$ formulation of the incompressible viscoresistive MHD equations. For stationary problems, our solver achieves robust performance with respect to the Reynolds and coupling numbers in two dimensions and good results in three dimensions. Our approach relies on specialised parameter-robust multigrid methods for the hydrodynamic and electromagnetic blocks. The scheme ensures exactly divergence-free approximations of both the velocity and the magnetic field up to solver tolerances. In the second part, we focus on incompressible, resistive Hall MHD models and derive structure-preserving finite element methods for these equations. We present a variational formulation of Hall MHD that enforces the magnetic Gauss's law precisely (up to solver tolerances) and prove the well-posedness of a Picard linearisation. For the transient problem, we present time discretisations that preserve the energy and magnetic and hybrid helicity precisely in the ideal limit for two types of boundary conditions. In the third part, we investigate anisothermal MHD models. We start by performing a bifurcation analysis for a magnetic Rayleigh--B\'enard problem at a high coupling number $S=1{,}000$ by choosing the Rayleigh number in the range between 0 and $100{,}000$ as the bifurcation parameter. We study the effect of the coupling number on the bifurcation diagram and outline how we create initial guesses to obtain complex solution patterns and disconnected branches for high coupling numbers.


title: Explaining (Sarcastic) Utterances to Enhance Affect Understanding in Multimodal Dialogues

abstract: Conversations emerge as the primary media for exchanging ideas and conceptions. From the listener's perspective, identifying various affective qualities, such as sarcasm, humour, and emotions, is paramount for comprehending the true connotation of the emitted utterance. However, one of the major hurdles faced in learning these affect dimensions is the presence of figurative language, viz. irony, metaphor, or sarcasm. We hypothesize that any detection system constituting the exhaustive and explicit presentation of the emitted utterance would improve the overall comprehension of the dialogue. To this end, we explore the task of Sarcasm Explanation in Dialogues, which aims to unfold the hidden irony behind sarcastic utterances. We propose MOSES, a deep neural network, which takes a multimodal (sarcastic) dialogue instance as an input and generates a natural language sentence as its explanation. Subsequently, we leverage the generated explanation for various natural language understanding tasks in a conversational dialogue setup, such as sarcasm detection, humour identification, and emotion recognition. Our evaluation shows that MOSES outperforms the state-of-the-art system for SED by an average of ~2% on different evaluation metrics, such as ROUGE, BLEU, and METEOR. Further, we observe that leveraging the generated explanation advances three downstream tasks for affect classification - an average improvement of ~14% F1-score in the sarcasm detection task and ~2% in the humour identification and emotion recognition task. We also perform extensive analyses to assess the quality of the results.


title: Fitting latent non-Gaussian models using variational Bayes and Laplace approximations

abstract: Latent Gaussian models (LGMs) are perhaps the most commonly used class of models in statistical applications. Nevertheless, in areas ranging from longitudinal studies in biostatistics to geostatistics, it is easy to find datasets that contain inherently non-Gaussian features, such as sudden jumps or spikes, that adversely affect the inferences and predictions made from an LGM. These datasets require more general latent non-Gaussian models (LnGMs) that can handle these non-Gaussian features automatically. However, fast implementation and easy-to-use software are lacking, which prevent LnGMs from becoming widely applicable. In this paper, we derive variational Bayes algorithms for fast and scalable inference of LnGMs. The approximation leads to an LGM that downweights extreme events in the latent process, reducing their impact and leading to more robust inferences. It can be applied to a wide range of models, such as autoregressive processes for time series, simultaneous autoregressive models for areal data, and spatial Mat\'ern models. To facilitate Bayesian inference, we introduce the ngvb package, where LGMs implemented in R-INLA can be easily extended to LnGMs by adding a single line of code.


title: A free discontinuity model for smectic thin films

abstract: We attempt to describe surface defects in smectic A thin films by formulating a free discontinuity problem - that is, a variational problem in which the order parameter is allowed to have jump discontinuities on some (unknown) set. The free energy functional contains an interfacial energy which penalizes dislocations of the smectic layers at the jump. We discuss mathematical issues related to the existence of minimizers and provide examples of minimizers in some simplified settings.


title: Convexifying Transformers: Improving optimization and understanding of transformer networks

abstract: Understanding the fundamental mechanism behind the success of transformer networks is still an open problem in the deep learning literature. Although their remarkable performance has been mostly attributed to the self-attention mechanism, the literature still lacks a solid analysis of these networks and interpretation of the functions learned by them. To this end, we study the training problem of attention/transformer networks and introduce a novel convex analytic approach to improve the understanding and optimization of these networks. Particularly, we first introduce a convex alternative to the self-attention mechanism and reformulate the regularized training problem of transformer networks with our alternative convex attention. Then, we cast the reformulation as a convex optimization problem that is interpretable and easier to optimize. Moreover, as a byproduct of our convex analysis, we reveal an implicit regularization mechanism, which promotes sparsity across tokens. Therefore, we not only improve the optimization of attention/transformer networks but also provide a solid theoretical understanding of the functions learned by them. We also demonstrate the effectiveness of our theory through several numerical experiments.


title: Continuous Time-Delay Estimation From Sampled Measurements

abstract: An algorithm for continuous time-delay estimation from sampled output data and known input of finite energy is presented. The continuous time-delay modeling allows for the estimation of subsample delays. The proposed estimation algorithm consists of two steps. First, the continuous Laguerre spectrum of the output signal is estimated from discrete-time (sampled) noisy measurements. Second, an estimate of the delay value is obtained in Laguerre domain given a continuous-time description of the input. The second step of the algorithm is shown to be intrinsically biased, the bias sources are established, and the bias itself is modeled. The proposed delay estimation approach is compared in a Monte-Carlo simulation with state-of-the-art methods implemented in time, frequency, and Laguerre domain demonstrating comparable or higher accuracy for the considered case.


title: Solar energetic electron events measured by MESSENGER and Solar Orbiter. Peak intensity and energy spectrum radial dependences: statistical analysis

abstract: Context/Aims: We present a list of 61 solar energetic electron (SEE) events measured by the MESSENGER mission and the radial dependences of the electron peak intensity and the peak-intensity energy spectrum. The analysis comprises the period from 2010 to 2015, when MESSENGER heliocentric distance varied between 0.31 and 0.47 au. We also show the radial dependencies for a shorter list of 12 SEE events measured in February and March 2022 by spacecraft near 1 au and by Solar Orbiter around its first close perihelion at 0.32 au. Results: Due to the elevated background intensity level of the particle instrument on board MESSENGER, the SEE events measured by this mission are necessarily large and intense; most of them accompanied by a CME-driven shock, being widespread in heliolongitude, and displaying relativistic ($\sim$1 MeV) electron intensity enhancements. The two main conclusions derived from the analysis of the large SEE events measured by MESSENGER, which are generally supported by Solar Orbiter's data results, are: (1) There is a wide variability in the radial dependence of the electron peak intensity between $\sim$0.3 au and $\sim$1 au, but the peak intensities of the energetic electrons decrease with radial distance from the Sun in 27 out of 28 events. On average and within the uncertainties, we find a radial dependence consistent with $R^{-3}$. (2) The electron spectral index found in the energy range around 200 keV ($\delta$200) of the backward-scattered population near 0.3 au measured by MESSENGER is harder in 19 out of 20 (15 out of 18) events by a median factor of $\sim$20% ($\sim$10%) when comparing to the anti-sunward propagating beam (backward-scattered population) near 1 au.


title: Data-based determination of the isospin-limit light-quark-connected contribution to the anomalous magnetic moment of the muon

abstract: We describe how recent determinations of exclusive-mode contributions to $a_\mu^{\rm LO,HVP}$, the leading-order hadronic vacuum polarization contribution to the anomalous magnetic moment of the muon, can be used to provide, up to small electromagnetic (EM) corrections accessible from the lattice, a data-based dispersive determination of $a_\mu^{\rm lqc;\, IL}$, the isospin-limit, light-quark-connected contribution to $a_\mu^{\rm LO,HVP}$. Such a determination is of interest in view of the existence of a number of lattice results for this quantity, emerging evidence for a tension between lattice and dispersive determinations of $a_\mu^{\rm LO,HVP}$, and the desire to clarify the source of this tension. Taking as input for the small EM correction that must be applied to the purely data-driven dispersive determination the result $-0.93(58)\times 10^{-10}$ obtained in a recent BMW lattice study, we find $a_\mu^{\rm lqc;\, IL}$ to be $635.0(2.7)\times 10^{-10}$ if the results of Keshavarzi, Nomura and Teubner are used for the exclusive-mode contributions and $638.4(4.1)\times 10^{-10}$ if instead those of Davier, H\"ocker, Malaescu and Zhang are used.


title: Safe Control Under Input Limits with Neural Control Barrier Functions

abstract: We propose new methods to synthesize control barrier function (CBF)-based safe controllers that avoid input saturation, which can cause safety violations. In particular, our method is created for high-dimensional, general nonlinear systems, for which such tools are scarce. We leverage techniques from machine learning, like neural networks and deep learning, to simplify this challenging problem in nonlinear control design. The method consists of a learner-critic architecture, in which the critic gives counterexamples of input saturation and the learner optimizes a neural CBF to eliminate those counterexamples. We provide empirical results on a 10D state, 4D input quadcopter-pendulum system. Our learned CBF avoids input saturation and maintains safety over nearly 100% of trials.


title: Semantic Similarity-Based Clustering of Findings From Security Testing Tools

abstract: Over the last years, software development in domains with high security demands transitioned from traditional methodologies to uniting modern approaches from software development and operations (DevOps). Key principles of DevOps gained more importance and are now applied to security aspects of software development, resulting in the automation of security-enhancing activities. In particular, it is common practice to use automated security testing tools that generate reports after inspecting a software artifact from multiple perspectives. However, this raises the challenge of generating duplicate security findings. To identify these duplicate findings manually, a security expert has to invest resources like time, effort, and knowledge. A partial automation of this process could reduce the analysis effort, encourage DevOps principles, and diminish the chance of human error. In this study, we investigated the potential of applying Natural Language Processing for clustering semantically similar security findings to support the identification of problem-specific duplicate findings. Towards this goal, we developed a web application for annotating and assessing security testing tool reports and published a human-annotated corpus of clustered security findings. In addition, we performed a comparison of different semantic similarity techniques for automatically grouping security findings. Finally, we assess the resulting clusters using both quantitative and qualitative evaluation methods.


title: Convolutional Filtering on Sampled Manifolds

abstract: The increasing availability of geometric data has motivated the need for information processing over non-Euclidean domains modeled as manifolds. The building block for information processing architectures with desirable theoretical properties such as invariance and stability is convolutional filtering. Manifold convolutional filters are defined from the manifold diffusion sequence, constructed by successive applications of the Laplace-Beltrami operator to manifold signals. However, the continuous manifold model can only be accessed by sampling discrete points and building an approximate graph model from the sampled manifold. Effective linear information processing on the manifold requires quantifying the error incurred when approximating manifold convolutions with graph convolutions. In this paper, we derive a non-asymptotic error bound for this approximation, showing that convolutional filtering on the sampled manifold converges to continuous manifold filtering. Our findings are further demonstrated empirically on a problem of navigation control.


title: Coarse-to-fine Task-driven Inpainting for Geoscience Images

abstract: The processing and recognition of geoscience images have wide applications. Most of existing researches focus on understanding the high-quality geoscience images by assuming that all the images are clear. However, in many real-world cases, the geoscience images might contain occlusions during the image acquisition. This problem actually implies the image inpainting problem in computer vision and multimedia. To the best of our knowledge, all the existing image inpainting algorithms learn to repair the occluded regions for a better visualization quality, they are excellent for natural images but not good enough for geoscience images by ignoring the geoscience related tasks. This paper aims to repair the occluded regions for a better geoscience task performance with the advanced visualization quality simultaneously, without changing the current deployed deep learning based geoscience models. Because of the complex context of geoscience images, we propose a coarse-to-fine encoder-decoder network with coarse-to-fine adversarial context discriminators to reconstruct the occluded image regions. Due to the limited data of geoscience images, we use a MaskMix based data augmentation method to exploit more information from limited geoscience image data. The experimental results on three public geoscience datasets for remote sensing scene recognition, cross-view geolocation and semantic segmentation tasks respectively show the effectiveness and accuracy of the proposed method.


title: Simultaneously Learning Robust Audio Embeddings and balanced Hash codes for Query-by-Example

abstract: Audio fingerprinting systems must efficiently and robustly identify query snippets in an extensive database. To this end, state-of-the-art systems use deep learning to generate compact audio fingerprints. These systems deploy indexing methods, which quantize fingerprints to hash codes in an unsupervised manner to expedite the search. However, these methods generate imbalanced hash codes, leading to their suboptimal performance. Therefore, we propose a self-supervised learning framework to compute fingerprints and balanced hash codes in an end-to-end manner to achieve both fast and accurate retrieval performance. We model hash codes as a balanced clustering process, which we regard as an instance of the optimal transport problem. Experimental results indicate that the proposed approach improves retrieval efficiency while preserving high accuracy, particularly at high distortion levels, compared to the competing methods. Moreover, our system is efficient and scalable in computational load and memory storage.


title: Deep learning delay coordinate dynamics for chaotic attractors from partial observable data

abstract: A common problem in time series analysis is to predict dynamics with only scalar or partial observations of the underlying dynamical system. For data on a smooth compact manifold, Takens theorem proves a time delayed embedding of the partial state is diffeomorphic to the attractor, although for chaotic and highly nonlinear systems learning these delay coordinate mappings is challenging. We utilize deep artificial neural networks (ANNs) to learn discrete discrete time maps and continuous time flows of the partial state. Given training data for the full state, we also learn a reconstruction map. Thus, predictions of a time series can be made from the current state and several previous observations with embedding parameters determined from time series analysis. The state space for time evolution is of comparable dimension to reduced order manifold models. These are advantages over recurrent neural network models, which require a high dimensional internal state or additional memory terms and hyperparameters. We demonstrate the capacity of deep ANNs to predict chaotic behavior from a scalar observation on a manifold of dimension three via the Lorenz system. We also consider multivariate observations on the Kuramoto-Sivashinsky equation, where the observation dimension required for accurately reproducing dynamics increases with the manifold dimension via the spatial extent of the system.


title: Patch-level Gaze Distribution Prediction for Gaze Following

abstract: Gaze following aims to predict where a person is looking in a scene, by predicting the target location, or indicating that the target is located outside the image. Recent works detect the gaze target by training a heatmap regression task with a pixel-wise mean-square error (MSE) loss, while formulating the in/out prediction task as a binary classification task. This training formulation puts a strict, pixel-level constraint in higher resolution on the single annotation available in training, and does not consider annotation variance and the correlation between the two subtasks. To address these issues, we introduce the patch distribution prediction (PDP) method. We replace the in/out prediction branch in previous models with the PDP branch, by predicting a patch-level gaze distribution that also considers the outside cases. Experiments show that our model regularizes the MSE loss by predicting better heatmap distributions on images with larger annotation variances, meanwhile bridging the gap between the target prediction and in/out prediction subtasks, showing a significant improvement in performance on both subtasks on public gaze following datasets.


title: Probabilistic bounds on the $k-$Traveling Salesman Problem and the Traveling Repairman Problem

abstract: The $k-$traveling salesman problem ($k$-TSP) seeks a tour of minimal length that visits a subset of $k\leq n$ points. The traveling repairman problem (TRP) seeks a complete tour with minimal latency. This paper provides constant-factor probabilistic approximations of both problems. We first show that the optimal length of the $k$-TSP path grows at a rate of $\Theta\left(k/n^{\frac{1}{2}\left(1+\frac{1}{k-1}\right)}\right)$. The proof provides a constant-factor approximation scheme, which solves a TSP in a high-concentration zone -- leveraging large deviations of local concentrations. Then, we show that the optimal TRP latency grows at a rate of $\Theta(n\sqrt n)$. This result extends the classical Beardwood-Halton-Hammersley theorem to the TRP. Again, the proof provides a constant-factor approximation scheme, which visits zones by decreasing order of probability density. We discuss practical implications of this result in the design of transportation and logistics systems. Finally, we propose dedicated notions of fairness -- randomized population-based fairness for the $k$-TSP and geographical fairness for the TRP -- and give algorithms to balance efficiency and fairness.


title: Impact of Lattice Strangeness Asymmetry Data in the CTEQ-TEA Global Analysis

abstract: We study the impact of lattice data on the determination of the strangeness asymmetry distribution $s_-(x) \equiv s(x) - {\bar s}(x)$ in the general CTEQ-TEA global analysis of parton distribution functions (PDFs) of the proton. Firstly, we find that allowing a nonvanishing $s_-(x)$, at the initial $Q_0=1.3$~GeV scale, in a global PDF analysis leads to a CT18As fit with similar quality to CT18A. Secondly, including the lattice data in the CT18As\_Lat fit greatly reduces the $s_-$-PDF error band size in the large-$x$ region. To further reduce its error would require more precise lattice data, extended to smaller $x$ values. We take ATLAS 7 TeV $W$ and $Z$ production data, SIDIS di-muon production data, $F_3$ structure function data, E866 NuSea data, and E906 SeaQuest data as examples to illustrate the implication of CT18As and CT18As\_Lat fits. The parametrization dependence for PDF ratio $(s+\bar{s})/(\bar{u}+\bar{d})(x)$ is analyzed with CT18As2 and CT18As2\_Lat fits as results.


title: Additional Results and Extensions for the paper "Probabilistic bounds on the $k-$Traveling Salesman Problem and the Traveling Repairman Problem''

abstract: This technical report provides additional results for the main paper ``Probabilistic bounds on the $k-$Traveling Salesman Problem ($k-$TSP) and the Traveling Repairman Problem (TRP)''. For the $k-$TSP, we extend the probabilistic bounds derived in the main paper to the case of distributions with general densities. For the TRP, we propose a utility-based notion of fairness and derive constant-factor probabilistic bounds for this objective, thus extending the TRP bounds from the main paper to non-linear utilities.


title: Hybrid Transformer Based Feature Fusion for Self-Supervised Monocular Depth Estimation

abstract: With an unprecedented increase in the number of agents and systems that aim to navigate the real world using visual cues and the rising impetus for 3D Vision Models, the importance of depth estimation is hard to understate. While supervised methods remain the gold standard in the domain, the copious amount of paired stereo data required to train such models makes them impractical. Most State of the Art (SOTA) works in the self-supervised and unsupervised domain employ a ResNet-based encoder architecture to predict disparity maps from a given input image which are eventually used alongside a camera pose estimator to predict depth without direct supervision. The fully convolutional nature of ResNets makes them susceptible to capturing per-pixel local information only, which is suboptimal for depth prediction. Our key insight for doing away with this bottleneck is to use Vision Transformers, which employ self-attention to capture the global contextual information present in an input image. Our model fuses per-pixel local information learned using two fully convolutional depth encoders with global contextual information learned by a transformer encoder at different scales. It does so using a mask-guided multi-stream convolution in the feature space to achieve state-of-the-art performance on most standard benchmarks.


title: Off-shell generalized parton distributions and form factors of the pion

abstract: Off-shell effects in generalized parton distributions (GPDs) of the pion, appearing, e.g., in the Sullivan process, are considered. Due to the lack of crossing symmetry, the moments of GPDs involve also odd powers of the skewness (longitudinal momentum transfer) parameter, which results in emergence of new off-shell form factors. With current-algebra techniques, we derive exact relations between the four off-shell gravitational form factors of the pion, in analogy to the electromagnetic case. Our results place stringent constraints on the off-shell GPDs of the pion. We provide an explicit realization in terms of a chiral quark model, where we show that the off-shell effects in GPDs are potentially significant in modeling physical processes and should not be neglected.


title: Realizing a Robust, Reconfigurable Active Quenching Design for Multiple Types of Single-Photon Avalanche Detectors

abstract: Most active quench circuits used for single-photon avalanche photodetectors (APDs) are designed either with discrete components which lack the flexibility of dynamically changing the control parameters, or with custom ASICs which require a long development time and high cost. As an alternative, we present a reconfigurable and robust hybrid design implemented using a System-on-Chip (SoC), which integrates both an FPGA and a microcontroller. We take advantage of the FPGA's speed and reconfiguration capabilities to vary the quench and reset parameters dynamically over a large range, thus allowing our system to operate a variety of APDs without changing the design. The microcontroller enables the remote adjustment of control parameters and calibration of APDs in the field. The ruggedized design uses components with space heritage, thus making it suitable for space-based applications in the fields of telecommunications and quantum key distribution (QKD). We demonstrate our circuit by operating a commercial APD cooled to -20{\deg}C with a deadtime of 35ns while maintaining the after-pulsing probability at close to 3%. We also showcase its versatility by operating custom-fabricated chip-scale APDs, which paves the way for automated wafer-scale characterization.


title: Learning Nonlinear Couplings in Network of Agents from a Single Sample Trajectory

abstract: We consider a class of stochastic dynamical networks whose governing dynamics can be modeled using a coupling function. It is shown that the dynamics of such networks can generate geometrically ergodic trajectories under some reasonable assumptions. We show that a general class of coupling functions can be learned using only one sample trajectory from the network. This is practically plausible as in numerous applications it is desired to run an experiment only once but for a longer period of time, rather than repeating the same experiment multiple times from different initial conditions. Building upon ideas from the concentration inequalities for geometrically ergodic Markov chains, we formulate several results about the convergence of the empirical estimator to the true coupling function. Our theoretical findings are supported by extensive simulation results.

categories: eess.SY cs.LG cs.SY math.DS math.ST stat.TH


title: Who Tracks Who? A Surveillance Capitalist Examination of Commercial Bluetooth Tracking Networks

abstract: Object and person tracking networks powered by Bluetooth and mobile devices have become increasingly popular for purposes of public safety and individual concerns. This essay examines popular commercial tracking networks and their campaigns from Apple, Samsung and Tile with reference to surveillance capitalism and digital privacy, discovering the hidden assets commodified through said networks, and their potential of turning users into unregulated digital labour while leaving individual privacy at risk.


title: Equation of state for strange quark matter: Linking the Nambu--Jona-Lasinio model to perturbative QCD

abstract: Neutron star constraints and {\it ab initio} pQCD evaluations require the EoS representing cold quark matter to be stiff at intermediate baryonic densities and soft at high-$n_B$. Here, I suggest that the three flavor NJL model with a density dependent repulsive coupling, $G_V(\mu)$, can generate an EoS which interpolates between these two regimes. Such an interpolation requires repulsion to start decreasing with the chemical potential just after chiral transition takes place. The conjecture behind this mechanism is that repulsion should be necessary only as long as the quark condensates, which dress the effective masses, have non-vanishing values. This assumption guarantees that an initially hard EoS suffers a conspicuous change of slope at ${\cal E} \simeq 0.7 \,{\rm GeV fm^{-3}}$ converging to the pQCD results at higher energy densities. Then, the speed of sound naturally reaches a non-conformal maximum at $n_B = 3.23 \, n_0 = 0.52 \, {\rm fm}^{-3}$ while the trace anomaly remains positive for all densities, in agreement with recent investigations. These non-trivial results {\it cannot} be simultaneously obtained when $G_V$ vanishes or has a fixed value. Therefore, the simple model proposed here is able to link the (non-perturbative) region of intermediate densities to the region where pQCD becomes reliable.


title: Nodes and Spin Windings for Topological Transitions in Light-Matter Interactions: \\ Anisotropic Quantum Rabi Model as a Born Abstract Artist

abstract: By extracting different levels of topological information a new light is shed on the energy spectrum of the anisotropic quantum Rabi model (QRM) which is the fundamental model of light-matter interactions with indispensable counter-rotating terms in ultra-strong couplings. Besides conventional topological transitions (TTs) at gap closing, abundant unconventional TTs including a particular one universal for different energy levels are unveiled underlying level anticrossings without gap closing by tracking the wave-function nodes. On the other hand, it is found that the nodes have a correspondence to spin windings, which not only endows the nodes a more explicit topological character in supporting single-qubit TTs but also turns the topological information physically detectable. Furthermore, hidden small-spin-knot transitions are exposed for the ground state, while more kinds of spin-knot transitions emerge in excited states including unmatched node numbers and spin winding numbers. As a surprise, frequently the spin windings produce portraits in high spiritual similarity with abstract artistic works, which demonstrates that the anisotropic QRM may be the Picasso of physical models. This signifies that art is joining the dialogue between mathematics and physics which was triggered by the milestone work of revealing integrability of the QRM.


title: Line Defects in Fermionic CFTs

abstract: We study line defects in the fermionic CFTs in the Gross-Neveu-Yukawa universality class in dimensions $2<d<4$. These CFTs may be described as the IR fixed points of the Gross-Neveu-Yukawa (GNY) model in $d=4-\epsilon$, or as the UV fixed points of the Gross-Neveu (GN) model, which can be studied using the large $N$ expansion in $2<d<4$. These models admit natural line defects obtained by integrating over a line either the scalar field in the GNY description, or the fermion bilinear operator in the GN description. We compute the beta function for the defect RG flow using both the epsilon expansion and the large $N$ approach, and find IR stable fixed points for the defect coupling, thus providing evidence for a non-trivial IR DCFT. We also compute some of the DCFT observables at the fixed point, and check that the $g$-function associated with the circular defect is consistent with the $g$-theorem for the defect RG flow.


title: Frozen Overparameterization: A Double Descent Perspective on Transfer Learning of Deep Neural Networks

abstract: We study the generalization behavior of transfer learning of deep neural networks (DNNs). We adopt the overparameterization perspective -- featuring interpolation of the training data (i.e., approximately zero train error) and the double descent phenomenon -- to explain the delicate effect of the transfer learning setting on generalization performance. We study how the generalization behavior of transfer learning is affected by the dataset size in the source and target tasks, the number of transferred layers that are kept frozen in the target DNN training, and the similarity between the source and target tasks. We show that the test error evolution during the target DNN training has a more significant double descent effect when the target training dataset is sufficiently large. In addition, a larger source training dataset can yield a slower target DNN training. Moreover, we demonstrate that the number of frozen layers can determine whether the transfer learning is effectively underparameterized or overparameterized and, in turn, this may induce a freezing-wise double descent phenomenon that determines the relative success or failure of learning. Also, we show that the double descent phenomenon may make a transfer from a less related source task better than a transfer from a more related source task. We establish our results using image classification experiments with the ResNet, DenseNet and the vision transformer (ViT) architectures.


title: Modeling the Co-evolution of Climate Impact and Population Behavior: A Mean-Field Analysis

abstract: Motivated by the climate crisis that is currently ravaging the planet, we propose and analyze a novel framework for the evolution of anthropogenic climate impact in which the evolution of human environmental behavior and environmental impact is coupled. Our framework includes a human decision-making process that captures social influence, government policy interventions, and the cost of environmentally-friendly behavior, modeled within a game-theoretic paradigm. By taking a mean-field approach in the limit of large populations, we derive the equilibria and their local stability characteristics. Subsequently, we study global convergence, whereby we show that the system converges to a periodic solution for almost all initial conditions. Numerical simulations confirm our findings and suggest that, before the system reaches such a periodic solution, the level of environmental impact might become dangerously high, calling for the design of optimal control strategies to influence the system trajectory.


title: Vibration Free Flexible Object Handling with a Robot Manipulator Using Learning Control

abstract: Many industries extensively use flexible materials. Effective approaches for handling flexible objects with a robot manipulator must address residual vibrations. Existing solutions rely on complex models, use additional instrumentation for sensing the vibrations, or do not exploit the repetitive nature of most industrial tasks. This paper develops an iterative learning control approach that jointly learns model parameters and residual dynamics using only the interoceptive sensors of the robot. The learned model is subsequently utilized to design optimal (PTP) trajectories that accounts for residual vibration, nonlinear kinematics of the manipulator and joint limits. We experimentally show that the proposed approach reduces the residual vibrations by an order of magnitude compared with optimal vibration suppression using the analytical model and threefold compared with the available state-of-the-art method. These results demonstrate that effective handling of a flexible object does not require neither complex models nor additional instrumentation.


title: Unifying Tracking and Image-Video Object Detection

abstract: Objection detection (OD) has been one of the most fundamental tasks in computer vision. Recent developments in deep learning have pushed the performance of image OD to new heights by learning-based, data-driven approaches. On the other hand, video OD remains less explored, mostly due to much more expensive data annotation needs. At the same time, multi-object tracking (MOT) which requires reasoning about track identities and spatio-temporal trajectories, shares similar spirits with video OD. However, most MOT datasets are class-specific (e.g., person-annotated only), which constrains a model's flexibility to perform tracking on other objects. We propose TrIVD (Tracking and Image-Video Detection), the first framework that unifies image OD, video OD, and MOT within one end-to-end model. To handle the discrepancies and semantic overlaps of category labels across datasets, TrIVD formulates detection/tracking as grounding and reasons about object categories via visual-text alignments. The unified formulation enables cross-dataset, multi-task training, and thus equips TrIVD with the ability to leverage frame-level features, video-level spatio-temporal relations, as well as track identity associations. With such joint training, we can now extend the knowledge from OD data, that comes with much richer object category annotations, to MOT and achieve zero-shot tracking capability. Experiments demonstrate that multi-task co-trained TrIVD outperforms single-task baselines across all image/video OD and MOT tasks. We further set the first baseline on the new task of zero-shot tracking.


title: Symmetry-breaking-induced loss of ergodicity in maps of the simplex with inversion symmetry

abstract: Motivated by proving the loss of ergodicity in expanding systems of piecewise affine coupled maps with arbitrary number of units, all-to-all coupling and inversion symmetry, we provide ad-hoc substitutes - namely inversion-symmetric maps of the simplex with arbitrary number of vertices - that exhibit several asymmetric absolutely continuous invariant measures when their expanding rate is sufficiently small. In a preliminary study, we consider arbitrary maps of the multi-dimensional torus with permutation symmetries. Using these symmetries, we show that the existence of multiple invariant sets of such maps can be obtained from their analogues in some reduced maps of a smaller phase space. For the coupled maps, this reduction yields inversion-symmetric maps of the simplex. The subsequent analysis of these reduced maps show that their systematic dynamics is intractable because some essential features vary with the number of units; hence the substitutes which nonetheless capture the coupled maps common characteristics. The construction itself is based on a simple mechanism for the generation of asymmetric invariant union of polytopes, whose basic principles should extend to a broad range of maps with permutation and inversion symmetries.


title: Entanglement masquerading in the CMB

abstract: The simplest single-field inflation models capture all the relevant contributions to the patterns in the Cosmic Microwave Background (CMB) observed today. A key assumption in these models is that the quantum inflationary fluctuations that source such patterns are generated by a particular quantum state -- the Bunch-Davies (BD) state. While this is a well-motivated choice from a theoretical perspective, the question arises of whether current data can rule out other, also well motivated, choices of states. In particular, as we previously demonstrated in arXiv:2104.13410 [hep-th], entanglement is naturally and inevitably dynamically generated during inflation given the presence of a "rolling" spectator scalar field -- and the resulting entangled state will yield a primordial power spectrum with potentially measurable deviations compared to the canonical BD result. For this work we developed a perturbative framework to allow a systematic exploration of constraints on (or detection of) entangled states with Planck CMB data using Monte Carlo techniques. We have found that most entangled states accessible with our framework are consistent with the data. One would have to expand the framework to allow a greater variety of entangled states in order to saturate the Planck constraints and more systematically explore any preferences the data may have among the different possibilities.


title: The LOFAR Tied-Array All-Sky Survey: Timing of 35 radio pulsars and an overview of the properties of the LOFAR pulsar discoveries

abstract: The LOFAR Tied-Array All-Sky Survey (LOTAAS) is the most sensitive untargeted radio pulsar survey performed at low radio frequencies (119--151\,MHz) to date and has discovered 76 new radio pulsars, among which the 23.5-s pulsar J0250+5854, up until recently the slowest-spinning radio pulsar known. Here, we report on the timing solutions of 35 pulsars discovered by LOTAAS, which include a nulling pulsar and a mildly recycled pulsar, and thereby complete the full timing analysis of the LOTAAS pulsar discoveries. We give an overview of the findings from the full LOTAAS sample of 76 pulsars, discussing their pulse profiles, radio spectra and timing parameters. We found that the pulse profiles of some of the pulsars show profile variations in time or frequency and while some pulsars show signs of scattering, a large majority display no pulse broadening. The LOTAAS discoveries have on average steeper radio spectra and have longer spin periods ($1.4\times$) as well as lower spin-down rates ($3.1\times$) compared to the known pulsar population. We discuss the cause of these differences, and attribute them to a combination of selection effects of the LOTAAS survey as well as previous pulsar surveys, though can not rule out that older pulsars tend to have steeper radio spectra.


title: A Theory of Unsupervised Translation Motivated by Understanding Animal Communication

abstract: Neural networks are capable of translating between languages -- in some cases even between two languages where there is little or no access to parallel translations, in what is known as Unsupervised Machine Translation (UMT). Given this progress, it is intriguing to ask whether machine learning tools can ultimately enable understanding animal communication, particularly that of highly intelligent animals. We propose a theoretical framework for analyzing UMT when no parallel translations are available and when it cannot be assumed that the source and target corpora address related subject domains or posses similar linguistic structure. We exemplify this theory with two stylized models of language, for which our framework provides bounds on necessary sample complexity; the bounds are formally proven and experimentally verified on synthetic data. These bounds show that the error rates are inversely related to the language complexity and amount of common ground. This suggests that unsupervised translation of animal communication may be feasible if the communication system is sufficiently complex.


title: DynIBaR: Neural Dynamic Image-Based Rendering

abstract: We address the problem of synthesizing novel views from a monocular video depicting a complex dynamic scene. State-of-the-art methods based on temporally varying Neural Radiance Fields (aka dynamic NeRFs) have shown impressive results on this task. However, for long videos with complex object motions and uncontrolled camera trajectories, these methods can produce blurry or inaccurate renderings, hampering their use in real-world applications. Instead of encoding the entire dynamic scene within the weights of MLPs, we present a new approach that addresses these limitations by adopting a volumetric image-based rendering framework that synthesizes new viewpoints by aggregating features from nearby views in a scene-motion-aware manner. Our system retains the advantages of prior methods in its ability to model complex scenes and view-dependent effects, but also enables synthesizing photo-realistic novel views from long videos featuring complex scene dynamics with unconstrained camera trajectories. We demonstrate significant improvements over state-of-the-art methods on dynamic scene datasets, and also apply our approach to in-the-wild videos with challenging camera and object motion, where prior methods fail to produce high-quality renderings. Our project webpage is at dynibar.github.io.


title: Inverse magnetic catalysis and size-dependent effects on the chiral symmetry restoration

abstract: We investigate the combined finite-size and thermo-magnetic effects on the properties of the quark matter, in the context of the two-flavored Nambu--Jona-Lasinio model. In particular, by using the mean-field approximation and the Schwinger proper time method in a toroidal topology with periodic or antiperiodic conditions, we evaluate the chiral phase transition, the constituent quark mass and the thermal and spatial susceptibilities under the change of the size, temperature and strength of external magnetic field. To take into account the inverse magnetic catalysis phenomenon, we make use of a recently proposed magnetized coupling constant. The findings suggest that the observables are strongly affected by the variation of the variables and also by the periodicity of the boundary conditions, with the final outcomes depending on the balance of these competing phenomena.


title: The Future of US Particle Physics -- The Snowmass 2021 Energy Frontier Report

abstract: This report, as part of the 2021 Snowmass Process, summarizes the current status of collider physics at the Energy Frontier, the broad and exciting future prospects identified for the Energy Frontier, the challenges and needs of future experiments, and indicates high priority research areas.


title: R2-MLP: Round-Roll MLP for Multi-View 3D Object Recognition

abstract: Recently, vision architectures based exclusively on multi-layer perceptrons (MLPs) have gained much attention in the computer vision community. MLP-like models achieve competitive performance on a single 2D image classification with less inductive bias without hand-crafted convolution layers. In this work, we explore the effectiveness of MLP-based architecture for the view-based 3D object recognition task. We present an MLP-based architecture termed as Round-Roll MLP (R$^2$-MLP). It extends the spatial-shift MLP backbone by considering the communications between patches from different views. R$^2$-MLP rolls part of the channels along the view dimension and promotes information exchange between neighboring views. We benchmark MLP results on ModelNet10 and ModelNet40 datasets with ablations in various aspects. The experimental results show that, with a conceptually simple structure, our R$^2$-MLP achieves competitive performance compared with existing state-of-the-art methods.


title: An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learning

abstract: Semi-supervised learning (SSL) has shown great promise in leveraging unlabeled data to improve model performance. While standard SSL assumes uniform data distribution, we consider a more realistic and challenging setting called imbalanced SSL, where imbalanced class distributions occur in both labeled and unlabeled data. Although there are existing endeavors to tackle this challenge, their performance degenerates when facing severe imbalance since they can not reduce the class imbalance sufficiently and effectively. In this paper, we study a simple yet overlooked baseline -- SimiS -- which tackles data imbalance by simply supplementing labeled data with pseudo-labels, according to the difference in class distribution from the most frequent class. Such a simple baseline turns out to be highly effective in reducing class imbalance. It outperforms existing methods by a significant margin, e.g., 12.8%, 13.6%, and 16.7% over previous SOTA on CIFAR100-LT, FOOD101-LT, and ImageNet127 respectively. The reduced imbalance results in faster convergence and better pseudo-label accuracy of SimiS. The simplicity of our method also makes it possible to be combined with other re-balancing techniques to improve the performance further. Moreover, our method shows great robustness to a wide range of data distributions, which holds enormous potential in practice. Code will be publicly available.


title: Conceptor-Aided Debiasing of Large Language Models

abstract: Pre-trained large language models (LLMs) reflect the inherent social biases of their training corpus. Many methods have been proposed to mitigate this issue, but they often fail to debias or they sacrifice model accuracy. We use conceptors--a soft projection method--to identify and remove the bias subspace in LLMs such as BERT and GPT. We propose two methods of applying conceptors (1) bias subspace projection by post-processing by the conceptor NOT operation; and (2) a new architecture, conceptor-intervened BERT (CI-BERT), which explicitly incorporates the conceptor projection into all layers during training. We find that conceptor post-processing achieves state-of-the-art (SoTA) debiasing results while maintaining LLMs' performance on the GLUE benchmark. Further, it is robust in various scenarios and can mitigate intersectional bias efficiently by its AND operation on the existing bias subspaces. Although CI-BERT's training takes all layers' bias into account and can beat its post-processing counterpart in bias mitigation, CI-BERT reduces the language model accuracy. We also show the importance of carefully constructing the bias subspace. The best results are obtained by removing outliers from the list of biased words, combining them (via the OR operation), and computing their embeddings using the sentences from a cleaner corpus.


title: Co-optimizing Consumption and EV Charging under Net Energy Metering

abstract: We consider the co-optimization of flexible household consumption, electric vehicle charging, and behind-the-meter distributed energy resources under the net energy metering tariff. Using a stochastic dynamic programming formulation, we show that the solution to the dynamic programming co-optimization is a procrastination threshold policy that delays and minimizes electricity purchasing for EV charging in each time interval. The policy thresholds can be computed off-line, simplifying the continuous action space dynamic optimization to decoupled closed-form charging and consumption decisions. Empirical studies using renewable, consumption, and EV data demonstrate the benefits of co-optimization.


title: Multi-Arm Bin-Picking in Real-Time: A Combined Task and Motion Planning Approach

abstract: Automated bin-picking is a prerequisite for fully automated manufacturing and warehouses. To successfully pick an item from an unstructured bin the robot needs to first detect possible grasps for the objects, decide on the object to remove and consequently plan and execute a feasible trajectory to retrieve the chosen object. Over the last years significant progress has been made towards solving these problems. However, when multiple robot arms are cooperating the decision and planning problems become exponentially harder. We propose an integrated multi-arm bin-picking pipeline (IMAPIP), and demonstrate that it is able to reliably pick objects from a bin in real-time using multiple robot arms. IMAPIP solves the multi-arm bin-picking task first at high-level using a geometry-aware policy integrated in a combined task and motion planning framework. We then plan motions consistent with this policy using the BIT* algorithm on the motion planning level. We show that this integrated solution enables robot arm cooperation. In our experiments, we show the proposed geometry-aware policy outperforms a baseline by increasing bin-picking time by 28\% using two robot arms. The policy is robust to changes in the position of the bin and number of objects. We also show that IMAPIP to successfully scale up to four robot arms working in close proximity.