title: Revisiting primordial black holes formation from preheating instabilities: the case of Starobinsky inflation

abstract: In recent years, the formation of primordial black holes (PBH) in the early universe inflationary cosmology has garnered significant attention. One plausible scenario for primordial black hole (PBH) formation arises during the preheating stage following inflation. Notably, this scenario does not necessitate any ad-hoc fine-tuning of the scalar field potential. This paper focuses on the growth of primordial density perturbation and the consequent possibility of PBH formation in the preheating stage of the Starobinsky model for inflation. The typical mechanism for PBH formation during preheating is based on the collapse of primordial fluctuations that become super-horizon during inflation (type I) and re-enter the particle horizon in the different phases of cosmic expansion. In this work, we show that there exists a certain range of modes that remain in the sub-horizon (not exited) during inflation (type II modes) but evolve identically to type I modes if they fall into the instability band, leading to large density perturbation above the threshold and can potentially also contribute to the PBH formation. We detail the conditions determining the possible collapse of type I and/or type II modes whose wavelengths are larger than the Jeans length we derive from the effective sound speed of scalar field fluctuations. Since the preheating stage is an 'inflaton' (approximately) matter-dominated phase, we follow the framework of the critical collapse of fluctuations and compute the mass fraction using the well-known Press-Schechter and the Khlopov-Polnarev formalisms, and compare the two. Finally, we comment on the implications of our study for the investigations concerned with primordial accretion and consequent PBH contribution to the dark matter.


title: Solvability of a sixth-order boundary value problem with multi-point and multi-term integral boundary conditions

abstract: This paper aims to investigate the existence and uniqueness of solutions for a sixth order differential equation involving nonlocal and integral boundary conditions. Firstly, we obtain the properties of the relevant Green's functions. The existence result of at least one nontrivial solution is obtained by applying the Krasnoselskii-Zabreiko fixed point theorem. Moreover, we also establish the existence of unique solution to the considered problem via H\"{o}lder and Minkowski inequalities and Rus's theorem. Finally, two examples are included to show the applicability of our main results.


title: Run-to-Run Adaptive Nonlinear Feedforward Control of Electromechanical Switching Devices

abstract: Feedforward control can greatly improve the response time and control accuracy of any mechatronic system. However, in order to compensate for the effects of modeling errors or disturbances, it is imperative that this type of control works in conjunction with some form of feedback. In this paper, we present a new adaptive feedforward control scheme for electromechanical systems in which real-time measurements or estimates of the position and its derivatives are not technically or economically feasible. This is the case, for example, of commercial electromechanical switching devices such as solenoid actuators. Our proposal consists of two blocks: on the one hand, a feedforward controller based on differential flatness theory; on the other, an iterative adaptation law that exploits the repetitive operation of these devices to modify the controller parameters cycle by cycle. As shown, this law can be fed with any available measurement of the system, with the only requirement that it can be processed and converted into an indicator of the performance of any given operation. Simulated and experimental results show that our proposal is effective in dealing with a long-standing control problem in electromechanics: the soft-landing control of electromechanical switching devices.


title: ELEGANT: Certified Defense on the Fairness of Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have emerged as a prominent graph learning model in various graph-based tasks over the years. Nevertheless, due to the vulnerabilities of GNNs, it has been empirically proved that malicious attackers could easily corrupt the fairness level of their predictions by adding perturbations to the input graph data. In this paper, we take crucial steps to study a novel problem of certifiable defense on the fairness level of GNNs. Specifically, we propose a principled framework named ELEGANT and present a detailed theoretical certification analysis for the fairness of GNNs. ELEGANT takes any GNNs as its backbone, and the fairness level of such a backbone is theoretically impossible to be corrupted under certain perturbation budgets for attackers. Notably, ELEGANT does not have any assumption over the GNN structure or parameters, and does not require re-training the GNNs to realize certification. Hence it can serve as a plug-and-play framework for any optimized GNNs ready to be deployed. We verify the satisfactory effectiveness of ELEGANT in practice through extensive experiments on real-world datasets across different backbones of GNNs, where ELEGANT is also demonstrated to be beneficial for GNN debiasing. Open-source code can be found at https://github.com/yushundong/ELEGANT.


title: M4BRAM: Mixed-Precision Matrix-Matrix Multiplication in FPGA Block RAMs

abstract: Mixed-precision quantization is a popular approach for compressing deep neural networks (DNNs). However, it is challenging to scale the performance efficiently with mixed-precision DNNs given the current FPGA architecture and conventional accelerator dataflows. In this work, we enhance the FPGA's capability for accelerating mixed-precision DNNs by proposing M4BRAM, a novel compute-in-block RAM (BRAM) architecture that can compute mixed-precision matrix-matrix multiplication. On the precision side, M4BRAM supports a wide range of mixed-precision DNN configurations -- the weight precision can be 2/4/8 bits while the activation precision can vary from 2 to 8 bits. On the dataflow side, M4BRAM leverages a novel in-BRAM data duplication scheme to achieve high hardware utilization. Moreover, during M4BRAM computation, other FPGA resources can seamlessly access its data without the need for a separate buffer. Hence, unlike prior compute-in-BRAM proposals, M4BRAM can simultaneously perform mixed-precision computation and maintain full functionality as a memory unit to \textit{truly} complement the existing compute resources on FPGAs. Experiments show that adding M4BRAM to a tiled DNN accelerator can achieve an average speedup of 2.16$\times$ across various DNNs on the ImageNet classification task while incurring a negligible accuracy loss of $<$ 0.5%. Compared to the same tiled accelerator that employs a prior compute-in-BRAM architecture, M4BRAM delivers 1.43$\times$ higher performance on average across various DNNs.


title: Mal'cev Complexes

abstract: It is well known that an equivalence relation is invariant under the basic operations of an algebra if and only if it is invariant under the unary polynomials of the algebra. We show that a higher arity version of this property holds for a higher dimensional analogue of an equivalence relation. It follows that the hypercommutator of arity $n$ for an algebra is determined by its $n$-ary polynomials. We construct examples to show that this fails for every arity of the term condition higher commutator.


title: Causal Question Answering with Reinforcement Learning

abstract: Causal questions inquire about causal relationships between different events or phenomena. They are important for a variety of use cases, including virtual assistants and search engines. However, many current approaches to causal question answering cannot provide explanations or evidence for their answers. Hence, in this paper, we aim to answer causal questions with a causality graph, a large-scale dataset of causal relations between noun phrases along with the relations' provenance data. Inspired by recent, successful applications of reinforcement learning to knowledge graph tasks, such as link prediction and fact-checking, we explore the application of reinforcement learning on a causality graph for causal question answering. We introduce an Actor-Critic-based agent which learns to search through the graph to answer causal questions. We bootstrap the agent with a supervised learning procedure to deal with large action spaces and sparse rewards. Our evaluation shows that the agent successfully prunes the search space to answer binary causal questions by visiting less than 30 nodes per question compared to over 3,000 nodes by a naive breadth-first search. Our ablation study indicates that our supervised learning strategy provides a strong foundation upon which our reinforcement learning agent improves. The paths returned by our agent explain the mechanisms by which a cause produces an effect. Moreover, for each edge on a path, our causality graph provides its original source allowing for easy verification of paths.


title: One-Shot Strategic Classification Under Unknown Costs

abstract: The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation. Earlier works assume that these responses are known; while some recent works handle unknown responses, they exclusively study online settings with repeated model deployments. But there are many domains$\unicode{x2014}$particularly in public policy, a common motivating use case$\unicode{x2014}$where multiple deployments are infeasible, or where even one bad round is unacceptable. To address this gap, we initiate the formal study of one-shot strategic classification under unknown responses, which requires committing to a single classifier once. Focusing on uncertainty in the users' cost function, we begin by proving that for a broad class of costs, even a small mis-estimation of the true cost can entail trivial accuracy in the worst case. In light of this, we frame the task as a minimax problem, aiming to minimize worst-case risk over an uncertainty set of costs. We design efficient algorithms for both the full-batch and stochastic settings, which we prove converge (offline) to the minimax solution at the rate of $\tilde{\mathcal{O}}(T^{-\frac{1}{2}})$. Our analysis reveals important structure stemming from strategic responses, particularly the value of dual norm regularization with respect to the cost function.


title: Fast Sparse 3D Convolution Network with VDB

abstract: We proposed a new Convolution Neural Network implementation optimized for sparse 3D data inference. This implementation uses NanoVDB as the data structure to store the sparse tensor. It leaves a relatively small memory footprint while maintaining high performance. We demonstrate that this architecture is around 20 times faster than the state-of-the-art dense CNN model on a high-resolution 3D object classification network.


title: Log-Concavity of Multinomial Likelihood Functions Under Interval Censoring Constraints on Frequencies or Their Partial Sums

abstract: We show that the likelihood function for a multinomial vector observed under arbitrary interval censoring constraints on the frequencies or their partial sums is completely log-concave by proving that the constrained sample spaces comprise M-convex subsets of the discrete simplex.


title: Strong laws of large numbers for lightly trimmed sums of generalized Oppenheim expansions

abstract: In the framework of generalized Oppenheim expansions we prove strong law of large numbers for lightly trimmed sums. In the first part of this work we identify a particular class of expansions for which we provide a convergence result assuming that only the largest summand is deleted from the sum; this result generalizes a strong law recently proven for the Luroth case. In the second part we drop any assumptions concerning the structure of the Oppenheim expansions and we prove a result concerning trimmed sums when at least two summands are trimmed; then we derive a corollary for the case in which only the largest summand is deleted from the sum.


title: Rule Learning as Machine Translation using the Atomic Knowledge Bank

abstract: Machine learning models, and in particular language models, are being applied to various tasks that require reasoning. While such models are good at capturing patterns their ability to reason in a trustable and controlled manner is frequently questioned. On the other hand, logic-based rule systems allow for controlled inspection and already established verification methods. However it is well-known that creating such systems manually is time-consuming and prone to errors. We explore the capability of transformers to translate sentences expressing rules in natural language into logical rules. We see reasoners as the most reliable tools for performing logical reasoning and focus on translating language into the format expected by such tools. We perform experiments using the DKET dataset from the literature and create a dataset for language to logic translation based on the Atomic knowledge bank.


title: Riemannian Laplace Approximation with the Fisher Metric

abstract: Laplace's method approximates a target density with a Gaussian distribution at its mode. It is computationally efficient and asymptotically exact for Bayesian inference due to the Bernstein-von Mises theorem, but for complex targets and finite-data posteriors it is often too crude an approximation. A recent generalization of the Laplace Approximation transforms the Gaussian approximation according to a chosen Riemannian geometry providing a richer approximation family, while still retaining computational efficiency. However, as shown here, its properties depend heavily on the chosen metric, indeed the metric adopted in previous work results in approximations that are overly narrow as well as being biased even at the limit of infinite data. We correct this shortcoming by developing the approximation family further, deriving two alternative variants that are exact at the limit of infinite data, extending the theoretical analysis of the method, and demonstrating practical improvements in a range of experiments.


title: Understanding Structured Knowledge Production: A Case Study of Wikidata's Representation Injustice

abstract: Wikidata is a multi-language knowledge base that is being edited and maintained by editors from different language communities. Due to the structured nature of its content, the contributions are in various forms, including manual edit, tool-assisted edits, automated edits, etc, with the majority of edits being the import from wiki-internal or external datasets. Due to the outstanding power of bots and tools reflecting from their large volume of edits, knowledge contributions within Wikidata can easily cause epistemic injustice due to internal and external reasons. In this case study, we compared the coverage and edit history of human pages in two countries. By shedding light on these disparities and offering actionable solutions, our study aims to enhance the fairness and inclusivity of knowledge representation within Wikidata, ultimately contributing to a more equitable and comprehensive global knowledge base.


title: Finiteness criteria for Gorenstein homological dimension and some invariants of groups

abstract: In this paper, we study finiteness criteria for the Gorenstein homological dimension of groups over a commutative ring of finite weak Gorenstein global dimension and provide good estimations for the Gorenstein weak global dimension of group rings. As a result, we obtain Gorenstein analogues of well known properties in classical homological algebra over some large families of infinite groups. Moreover, we prove that over a commutative ring of finite weak Gorenstein global dimension, the Gorenstein cohomological dimension of a group $G$ bounds the Gorenstein homological dimension of $G$. Finally, we compare the generalized cohomological dimension and the generalized homological dimension of a group, defined by Ikenaga.


title: COGNAC: Circuit Optimization via Gradients and Noise-Aware Compilation

abstract: We present COGNAC, a novel strategy for compiling quantum circuits based on numerical optimization algorithms from scientific computing. Using a simple noise model informed by the duration of entangling gates, our gradient-based method can quickly converge to a local optimum that closely approximates the target unitary. By iteratively and continuously decreasing a gate's duration to zero, we reduce a circuit's gate count without the need for a large number of explicit elimination rewrite rules. We have implemented this technique as a general-purpose Qiskit compiler plugin and compared performance with state-of-the-art optimizers on a variety of standard 4-qubit benchmarks. COGNAC typically outperforms existing optimizers in reducing 2-qubit gate count, sometimes significantly. Running on a low-end laptop, our plugin takes seconds to optimize a small circuit, making it effective and accessible for a typical quantum programmer.


title: Mass independent shapes for relative equilibria in the two dimensional constant positive curved three body problem

abstract: In the planar three-body problem under Newtonian potential, it is well known that any masses, located at the vertices of an equilateral triangle generates a relative equilibrium, known as the Lagrange relative equilibrium. In fact, the equilateral triangle is the unique mass independent shape for a relative equilibrium in this problem. The two dimensional positive curved three-body problem, is a natural extension of the Newtonian three-body problem to the sphere $\mathbb{S}^2$, where the masses are moving under the influence of the cotangent potential. S.~Zhu showed that in this problem, equilateral triangle on a rotating meridian can form a relative equilibria for any masses. This was the first report of mass independent shape on $\mathbb{S}^2$ which can form a relative equilibrium. % In this paper, we show that, in addition to the equilateral triangle, there exists one isosceles triangle on a rotating meridian, with two equal angles seen from the centre of $\mathbb{S}^2$ given by $2^{-1}\arccos((\sqrt{2}-1)/2)$, which always form a relative equilibrium for any choice of the masses. Additionally we prove that, the equilateral and the above isosceles relative equilibrium are unique with this characteristic. We also prove that each relative equilibrium generated by a mass independent shape is not isolated from the other relative equilibria.


title: Optimal Two-Dimensional Reed--Solomon Codes Correcting Insertions and Deletions

abstract: Constructing Reed--Solomon (RS) codes that can correct insertions and deletions (insdel errors) has been considered in numerous recent works. For the special case of two-dimensional RS-codes, it is known [CST23] that an $[n,2]_q$ RS-code that can correct from $n-3$ insdel errors satisfies that $q=\Omega(n^3)$. On the other hand, there are several known constructions of $[n,2]_q$ RS-codes that can correct from $n-3$ insdel errors, where the smallest field size is $q=O(n^4)$. In this short paper, we construct $[n,2]_q$ Reed--Solomon codes that can correct $n-3$ insdel errors with $q=O(n^3)$, thereby resolving the minimum field size needed for such codes.


title: Attention or Convolution: Transformer Encoders in Audio Language Models for Inference Efficiency

abstract: In this paper, we show that a simple self-supervised pre-trained audio model can achieve comparable inference efficiency to more complicated pre-trained models with speech transformer encoders. These speech transformers rely on mixing convolutional modules with self-attention modules. They achieve state-of-the-art performance on ASR with top efficiency. We first show that employing these speech transformers as an encoder significantly improves the efficiency of pre-trained audio models as well. However, our study shows that we can achieve comparable efficiency with advanced self-attention solely. We demonstrate that this simpler approach is particularly beneficial with a low-bit weight quantization technique of a neural network to improve efficiency. We hypothesize that it prevents propagating the errors between different quantized modules compared to recent speech transformers mixing quantized convolution and the quantized self-attention modules.


title: Actions on the quiver -- Discrete quotients on the Coulomb branch

abstract: This paper introduces two operations in quiver gauge theories. The first operation takes a quiver with a permutation symmetry $S_n$ and gives a quiver with adjoint loops. The corresponding 3d $\mathcal{N}=4$ Coulomb branches are related by an orbifold of $S_n$. The second operation takes a quiver with $n$ nodes connected by edges of multiplicity $k$ and replaces them by $n$ nodes of multiplicity $qk$. The corresponding Coulomb branch moduli spaces are related by an orbifold of type $\mathbb{Z}_q^{n-1}$. The first operation generalises known cases that appeared in the literature. These two operations can be combined to generate new relations between moduli spaces that are constructed using the magnetic construction.


title: A stronger connection between the asymptotic rank conjecture and the set cover conjecture

abstract: We give a short proof that Strassen's asymptotic rank conjecture implies that for every $\varepsilon > 0$ there exists a $(3/2^{2/3} + \varepsilon)^n$-time algorithm for set cover on a universe of size $n$ with sets of bounded size. This strengthens and simplifies a recent result of Bj\"orklund and Kaski that Strassen's asymptotic rank conjecture implies that the set cover conjecture is false. From another perspective, we show that the set cover conjecture implies that a particular family of tensors $T_n \in \mathbb{C}^N \otimes \mathbb{C}^N \otimes \mathbb{C}^N$ has asymptotic rank greater than $N^{1.08}$. Furthermore, if one could improve a known upper bound of $\frac{1}{2}8^n$ on the tensor rank of $T_n$ to $\frac{2}{9 \cdot n}8^n$ for any $n$, then the set cover conjecture is false.


title: AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMs

abstract: Responding to the thousands of student questions on online QA platforms each semester has a considerable human cost, particularly in computing courses with rapidly growing enrollments. To address the challenges of scalable and intelligent question-answering (QA), we introduce an innovative solution that leverages open-source Large Language Models (LLMs) from the LLaMA-2 family to ensure data privacy. Our approach combines augmentation techniques such as retrieval augmented generation (RAG), supervised fine-tuning (SFT), and learning from human preferences data using Direct Preference Optimization (DPO). Through extensive experimentation on a Piazza dataset from an introductory CS course, comprising 10,000 QA pairs and 1,500 pairs of preference data, we demonstrate a significant 30% improvement in the quality of answers, with RAG being a particularly impactful addition. Our contributions include the development of a novel architecture for educational QA, extensive evaluations of LLM performance utilizing both human assessments and LLM-based metrics, and insights into the challenges and future directions of educational data processing. This work paves the way for the development of AI-TA, an intelligent QA assistant customizable for courses with an online QA platform


title: GOES GLM, Biased Bolides, and Debiased Distributions

abstract: The large combined field of view of the Geostationary Lightning Mapper (GLM) instruments onboard the GOES weather satellites makes them useful for studying the population of other atmospheric phenomena, such as bolides. Being a lightning mapper, GLM has many detection biases when applied to non-lightning and these systematics must be studied and properly accounted for before precise measurements of bolide flux can be ascertained. We developed a Bayesian Poisson regression model which simultaneously estimates instrumental biases and our statistic of principal interest: the latitudinal variation of bolide flux. We find that the estimated bias due to the angle of incident light upon the instrument corresponds roughly with the known sensitivity of the GLM instruments. We compare our latitudinal flux variation estimates to existing theoretical models and find our estimates consistent with GLM being strongly biased towards high-velocity bolides.


title: Robust Generalization Strategies for Morpheme Glossing in an Endangered Language Documentation Context

abstract: Generalization is of particular importance in resource-constrained settings, where the available training data may represent only a small fraction of the distribution of possible texts. We investigate the ability of morpheme labeling models to generalize by evaluating their performance on unseen genres of text, and we experiment with strategies for closing the gap between performance on in-distribution and out-of-distribution data. Specifically, we use weight decay optimization, output denoising, and iterative pseudo-labeling, and achieve a 2% improvement on a test set containing texts from unseen genres. All experiments are performed using texts written in the Mayan language Uspanteko.


title: MuSHRoom: Multi-Sensor Hybrid Room Dataset for Joint 3D Reconstruction and Novel View Synthesis

abstract: Metaverse technologies demand accurate, real-time, and immersive modeling on consumer-grade hardware for both non-human perception (e.g., drone/robot/autonomous car navigation) and immersive technologies like AR/VR, requiring both structural accuracy and photorealism. However, there exists a knowledge gap in how to apply geometric reconstruction and photorealism modeling (novel view synthesis) in a unified framework. To address this gap and promote the development of robust and immersive modeling and rendering with consumer-grade devices, we propose a real-world Multi-Sensor Hybrid Room Dataset (MuSHRoom). Our dataset presents exciting challenges and requires state-of-the-art methods to be cost-effective, robust to noisy data and devices, and can jointly learn 3D reconstruction and novel view synthesis instead of treating them as separate tasks, making them ideal for real-world applications. We benchmark several famous pipelines on our dataset for joint 3D mesh reconstruction and novel view synthesis. Our dataset and benchmark show great potential in promoting the improvements for fusing 3D reconstruction and high-quality rendering in a robust and computationally efficient end-to-end fashion. The dataset and code are available at the project website: https://xuqianren.github.io/publications/MuSHRoom/.


title: Measuring the CMB primordial B-modes with Bolometric Interferometry

abstract: The Q&U Bolometric Interferometer for Cosmology (QUBIC) is the first bolometric interferometer designed to measure the primordial B-mode polarization of the Cosmic Microwave Background (CMB). Bolometric interferometry is a novel technique that combines the sensitivity of bolometric detectors with the control of systematic effects that is typical of interferometry, both key features in the quest for the faint signal of the primordial B-modes. A unique feature is the so-called "spectral imaging", i.e., the ability to recover the sky signal in several sub-bands within the physical band during data analysis. This feature provides an in-band spectral resolution of \Delta{\nu}/{\nu} \sim 0.04 that is unattainable by a traditional imager. This is a key tool for controlling the Galactic foregrounds contamination. In this paper, we describe the principles of bolometric interferometry, the current status of the QUBIC experiment and future prospects.


title: Revivals in time-evolution quasi-periodic problems

abstract: We examine the influence of quasi-periodic boundary conditions on the phenomenon of revivals in linear dispersive PDEs. We show that, in general, quasi-periodic problems do not support the revival effect at rational times. Our method is based on a correspondence between quasi-periodic and periodic problems. We prove that the solution to a quasi-periodic problem is expressed via the solution to a corresponding periodic problem, and vice-versa. Then, our main results follow by deriving a representation of the periodic problem solution in terms of a composition of solutions for a particular class of periodic problems, where the latter supports the classical revival and fractalisation dichotomy at rational and irrational times.


title: Architecting Intermediate Layers for Efficient Composition of Data Management and Machine Learning Systems

abstract: Modern data analytics workloads combine relational data processing with machine learning (ML). Most DBMS handle these workloads by offloading these ML operations to external specialized ML systems. While both DBMS and ML systems go to great lengths to optimize performance for their specific workloads, significant performance is lost when used in combination, due to data movement across system boundaries, conversions between incompatible internal data formats, and the lack of cross system optimizations. A key idea to remove these bottlenecks is to integrate existing data manipulation systems with ML systems by building a common intermediate layer (IR). Although this idea has been explored before (Weld, Delite), previous such attempts require significant re-engineering of prior systems and still fall short in achieving best-of-breed performance for individual tasks (e.g., SQL, Deep Learning). Specifically, they rely on re-implementing existing systems using a generic set of operators and fail to match best-of-breed individual performance due to the inability to recover high-level optimizations from this generic IR through compiler analysis. We present Flern, the first intermediate-layer integration between DB and ML systems that are best-of-breed individually, competitive with the best compiled query engines such as HyPer on comprehensive relational benchmarks (TPC-H) and competitive with TensorFlow and PyTorch in state-of-the-art ML models (e.g., DeepSpeech, SqueezeNet, Transformers) and also represents a new state-of-the-art for integration. A key realization is to architect intermediate layers based on generative programming capabilities, which preserves high-level contextual information for cross optimizations and enables the construction of a variety of complex structures and cross system optimizations with minimal effort.


title: Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Lead

abstract: Anomaly detection is a crucial task across different domains and data types. However, existing anomaly detection models are often designed for specific domains and modalities. This study explores the use of GPT-4V(ision), a powerful visual-linguistic model, to address anomaly detection tasks in a generic manner. We investigate the application of GPT-4V in multi-modality, multi-domain anomaly detection tasks, including image, video, point cloud, and time series data, across multiple application areas, such as industrial, medical, logical, video, 3D anomaly detection, and localization tasks. To enhance GPT-4V's performance, we incorporate different kinds of additional cues such as class information, human expertise, and reference images as prompts.Based on our experiments, GPT-4V proves to be highly effective in detecting and explaining global and fine-grained semantic patterns in zero/one-shot anomaly detection. This enables accurate differentiation between normal and abnormal instances. Although we conducted extensive evaluations in this study, there is still room for future evaluation to further exploit GPT-4V's generic anomaly detection capacity from different aspects. These include exploring quantitative metrics, expanding evaluation benchmarks, incorporating multi-round interactions, and incorporating human feedback loops. Nevertheless, GPT-4V exhibits promising performance in generic anomaly detection and understanding, thus opening up a new avenue for anomaly detection.


title: Multiple integral formulas for weighted zeta moments: the case of the sixth moment

abstract: We prove exact formulas for weighted $2k$th moments of the Riemann zeta function for all integer $k\geq 1$ in terms of the analytic continuation of an auto-correlation function. This latter enjoys several functional equations. One of them, following from a fundamental lemma of Bettin and Conrey (2013), yields to new formulas for the moments: our second main result is the case $k=3$, but there is no obstruction to obtain higher moments. This generalizes results by Titchmarsh (1928) for $k=1$ and $k=2$. A basic and powerful tool is a special Fourier transform unveiled by Ramanujan (1915). In a nutshell, the new idea is to consider the associated structures to $\Gamma^k\zeta^k$, which enjoy remarkable properties that are not satisfied by the more classically studied structure $\Gamma\zeta^k$.


title: An algorithm to recognize echelon subgroups of a free group

abstract: We provide an algorithm that, given a finite set of generators for a subgroup $H$ of a finitely generated free group $F$, determines whether $H$ is echelon or not and, in case of affirmative answer, also computes a basis with respect to which $H$ is in echelon form. This answers to a question of A. Rosenmann. We also prove, by means of a counterexample, that intersection of two echelon subgroups needs not to be echelon, answering to another question of A. Rosenmann.


title: Complex Fermiology and Electronic Structure of Antiferromagnet EuSnP

abstract: We studied the electronic structure of a layered antiferromagnetic metal, EuSnP, in the paramagnetic and in the antiferromagnetic phase using angle resolved photoemission spectroscopy (ARPES) alongside density functional theory (DFT) based first principles calculations. The temperature dependence of the magnetic susceptibility measurements exhibits an antiferromagnetic transition at a Neel temperature of 21 K. Employing high resolution ARPES, the valence band structure was measured at several temperatures above and below the Neel temperature, which produced identical spectra independent of temperature. Through analysis of the ARPES results presented here, we attribute the temperature independent spectra to the weak coupling of the Sn, and P conduction electrons with Eu 4f states.


title: Mobility as a Resource (MaaR) for resilient human-centric automation: a vision paper

abstract: With technological advances, mobility has been moving from a product (i.e., traditional modes and vehicles), to a service (i.e., Mobility as a Service, MaaS). However, as observed in other fields (e.g. cloud computing resource management) we argue that mobility will evolve from a service to a resource (i.e., Mobility as a Resource, MaaR). Further, due to increasing scarcity of shared mobility spaces across traditional and emerging modes, the transition must be viewed within the critical need for ethical and equitable solutions for the traveling public (i.e., research is needed to avoid hyper-market driven outcomes for society). The evolution of mobility into a resource requires novel conceptual frameworks, technologies, processes and perspectives of analysis. A key component of the future MaaR system is the technological capacity to observe, allocate and manage (in real-time) the smallest envisionable units of mobility (i.e., atomic units of mobility capacity) while providing prioritized attention to human movement and ethical metrics related to access, consumption and impact. To facilitate research into the envisioned future system, this paper proposes initial frameworks which synthesize and advance methodologies relating to highly dynamic capacity reservation systems. Future research requires synthesis across transport network management, demand behavior, mixed-mode usage, and equitable mobility.


title: Make a Donut: Hierarchical EMD-Space Planning for Zero-Shot Deformable Manipulation with Tools

abstract: Deformable object manipulation stands as one of the most captivating yet formidable challenges in robotics. While previous techniques have predominantly relied on learning latent dynamics through demonstrations, typically represented as either particles or images, there exists a pertinent limitation: acquiring suitable demonstrations, especially for long-horizon tasks, can be elusive. Moreover, basing learning entirely on demonstrations can hamper the model's ability to generalize beyond the demonstrated tasks. In this work, we introduce a demonstration-free hierarchical planning approach capable of tackling intricate long-horizon tasks without necessitating any training. We employ large language models (LLMs) to articulate a high-level, stage-by-stage plan corresponding to a specified task. For every individual stage, the LLM provides both the tool's name and the Python code to craft intermediate subgoal point clouds. With the tool and subgoal for a particular stage at our disposal, we present a granular closed-loop model predictive control strategy. This leverages Differentiable Physics with Point-to-Point correspondence (DiffPhysics-P2P) loss in the earth mover distance (EMD) space, applied iteratively. Experimental findings affirm that our technique surpasses multiple benchmarks in dough manipulation, spanning both short and long horizons. Remarkably, our model demonstrates robust generalization capabilities to novel and previously unencountered complex tasks without any preliminary demonstrations. We further substantiate our approach with experimental trials on real-world robotic platforms. Our project page: https://qq456cvb.github.io/projects/donut.


title: Machine learning regression analyses of intensity modulation two-photon spectroscopy (Mlim) in perovskite microcrystals

abstract: Perovskite thin films hold great promise for optoelectronic applications, such as solar cells and light emitting diodes. A challenge is that defects are unavoidably formed in the material. Thorough understanding of the defect formation and their dynamics has proven challenging based on traditional spectroscopy. Here we integrated the functional intensity modulation two-photon spectroscopy with artificial intelligence - enhance data analyses to obtain a deep understanding of defect-related trap states within perovskite microcrystals. We introduce a novel charge carrier recombination dynamics model that comprehensively includes exciton and electron-hole pair photoluminescence (PL) emissions, as well as the trapping and detrapping equilibrium dynamics. By varying parameters in the dynamic model, a large pool of the temperature dependent intensity modulation PL spectra can be simulated by solving the ordinary differential equations in the charge carrier dynamics model. Then, tree-based supervised machine learning methods and ensemble technique -- regression chain have been used to optimize the Machine learning intensity modulation spectroscopy (Mlim), which helps to determine the parameters of the charge carrier dynamics model based on the temperature dependent intensity modulated PL spectra in perovskite. And the reliability of the Mlim predicted trap property parameters is confirmed by directly comparing the Mlim-retrieved intensity modulation spectra with experimental data. Besides, our approach unravels valuable insights into PL emissions, including those from excitons and free electron-hole pairs, but also provides details of trapping, detrapping, and nonradiative depopulation processes, offering a comprehensive understanding of perovskite material photophysics. This study suggests that Mlim applications hold promise for studying various photoactive devices.


title: Estimation and Inference for a Class of Generalized Hierarchical Models

abstract: In this paper, we consider estimation and inference for the unknown parameters and function involved in a class of generalized hierarchical models. Such models are of great interest in the literature of neural networks (such as Bauer and Kohler, 2019). We propose a rectified linear unit (ReLU) based deep neural network (DNN) approach, and contribute to the design of DNN by i) providing more transparency for practical implementation, ii) defining different types of sparsity, iii) showing the differentiability, iv) pointing out the set of effective parameters, and v) offering a new variant of rectified linear activation function (ReLU), etc. Asymptotic properties are established accordingly, and a feasible procedure for the purpose of inference is also proposed. We conduct extensive numerical studies to examine the finite-sample performance of the estimation methods, and we also evaluate the empirical relevance and applicability of the proposed models and estimation methods to real data.


title: CausalCite: A Causal Formulation of Paper Citations

abstract: Citation count of a paper is a commonly used proxy for evaluating the significance of a paper in the scientific community. Yet citation measures are widely criticized for failing to accurately reflect the true impact of a paper. Thus, we propose CausalCite, a new way to measure the significance of a paper by assessing the causal impact of the paper on its follow-up papers. CausalCite is based on a novel causal inference method, TextMatch, which adapts the traditional matching framework to high-dimensional text embeddings. TextMatch encodes each paper using text embeddings from large language models (LLMs), extracts similar samples by cosine similarity, and synthesizes a counterfactual sample as the weighted average of similar papers according to their similarity values. We demonstrate the effectiveness of CausalCite on various criteria, such as high correlation with paper impact as reported by scientific experts on a previous dataset of 1K papers, (test-of-time) awards for past papers, and its stability across various subfields of AI. We also provide a set of findings that can serve as suggested ways for future researchers to use our metric for a better understanding of the quality of a paper. Our code is available at https://github.com/causalNLP/causal-cite.


title: MirrorCalib: Utilizing Human Pose Information for Mirror-based Virtual Camera Calibration

abstract: In this paper, we present the novel task of estimating the extrinsic parameters of a virtual camera relative to a real camera in exercise videos with a mirror. This task poses a significant challenge in scenarios where the views from the real and mirrored cameras have no overlap or share salient features. To address this issue, prior knowledge of a human body and 2D joint locations are utilized to estimate the camera extrinsic parameters when a person is in front of a mirror. We devise a modified eight-point algorithm to obtain an initial estimation from 2D joint locations. The 2D joint locations are then refined subject to human body constraints. Finally, a RANSAC algorithm is employed to remove outliers by comparing their epipolar distances to a predetermined threshold. MirrorCalib achieves a rotation error of 1.82{\deg} and a translation error of 69.51 mm on a collected real-world dataset, which outperforms the state-of-art method.


title: Signed graphs and inverses of their incidence matrices

abstract: The Laplacian matrix $L$ of a signed graph $G$ may or may not be invertible. We present a combinatorial formula of the Moore-Penrose inverse of $L$. This is achieved by finding a combinatorial formula for the Moore-Penrose inverse of an incidence matrix of $G$. This work generalizes related known results on incidence and Laplacian matrices of an unsigned graph. Several examples are provided to show the usefulness of these combinatorial formulas.


title: Improving Photovoltaic Hosting Capacity of Distribution Networks with Coordinated Inverter Control -- A Case Study of the EPRI J1 Feeder

abstract: Adding photovoltaic (PV) systems in distribution networks, while desirable for reducing the carbon footprint, can lead to voltage violations under high solar-low load conditions. The inability of traditional volt-VAr control in eliminating all the violations is also well-known. This paper presents a novel coordinated inverter control methodology that leverages system-wide situational awareness to significantly improve hosting capacity (HC). The methodology employs a real-time voltage-reactive power (VQ) sensitivity matrix in an iterative linear optimizer to calculate the minimum reactive power intervention from PV inverters needed for mitigating over-voltage without resorting to active power curtailing or requiring step voltage regulator setting changes. The algorithm is validated using the EPRI J1 feeder under an extensive set of realistic use cases and is shown to provide 3x improvement in HC under all scenarios.


title: Modelling Cellular Perturbations with the Sparse Additive Mechanism Shift Variational Autoencoder

abstract: Generative models of observations under interventions have been a vibrant topic of interest across machine learning and the sciences in recent years. For example, in drug discovery, there is a need to model the effects of diverse interventions on cells in order to characterize unknown biological mechanisms of action. We propose the Sparse Additive Mechanism Shift Variational Autoencoder, SAMS-VAE, to combine compositionality, disentanglement, and interpretability for perturbation models. SAMS-VAE models the latent state of a perturbed sample as the sum of a local latent variable capturing sample-specific variation and sparse global variables of latent intervention effects. Crucially, SAMS-VAE sparsifies these global latent variables for individual perturbations to identify disentangled, perturbation-specific latent subspaces that are flexibly composable. We evaluate SAMS-VAE both quantitatively and qualitatively on a range of tasks using two popular single cell sequencing datasets. In order to measure perturbation-specific model-properties, we also introduce a framework for evaluation of perturbation models based on average treatment effects with links to posterior predictive checks. SAMS-VAE outperforms comparable models in terms of generalization across in-distribution and out-of-distribution tasks, including a combinatorial reasoning task under resource paucity, and yields interpretable latent structures which correlate strongly to known biological mechanisms. Our results suggest SAMS-VAE is an interesting addition to the modeling toolkit for machine learning-driven scientific discovery.


title: PermutEx: Feature-Extraction-Based Permutation -- A New Diffusion Scheme for Image Encryption Algorithms

abstract: Traditional permutation schemes mostly focus on random scrambling of pixels, often neglecting the intrinsic image information that could enhance diffusion in image encryption algorithms. This paper introduces PermutEx, a feature-extraction-based permutation method that utilizes inherent image features to scramble pixels effectively. Unlike random permutation schemes, PermutEx extracts the spatial frequency and local contrast features of the image and ranks each pixel based on this information, identifying which pixels are more important or information-rich based on texture and edge information. In addition, a unique permutation key is generated using the Logistic-Sine Map based on chaotic behavior. The ranked pixels are permuted in conjunction with this unique key, effectively permuting the original image into a scrambled version. Experimental results indicate that the proposed method effectively disrupts the correlation in information-rich areas within the image resulting in a correlation value of 0.000062. The effective scrambling of pixels, resulting in nearly zero correlation, makes this method suitable to be used as diffusion in image encryption algorithms.


title: High-throughput speckle spectrometers based on multifractal scattering media

abstract: We present compact integrated speckle spectrometers based on monofractal and multifractal scattering media in a silicon-on-insulator platform. Through both numerical and experimental studies we demonstrate enhanced optical throughput, and hence signal-to-noise ratio, for a number of random structures with tailored multifractal geometries without affecting the spectral decay of the speckle correlation functions. Moreover, we show that the developed multifractal media outperform traditional scattering spectrometers based on uniform random distributions of scattering centers. Our findings establish the potential of low-density random media with multifractal correlations for integrated on-chip applications beyond what is possible with uncorrelated random disorder.


title: Optimal Construction of N-bit-delay Almost Instantaneous Fixed-to-Variable-Length Codes

abstract: This paper presents an optimal construction of $N$-bit-delay almost instantaneous fixed-to-variable-length (AIFV) codes, the general form of binary codes we can make when finite bits of decoding delay are allowed. The presented method enables us to optimize lossless codes among a broader class of codes compared to the conventional FV and AIFV codes. The paper first discusses the problem of code construction, which contains some essential partial problems, and defines three classes of optimality to clarify how far we can solve the problems. The properties of the optimal codes are analyzed theoretically, showing the sufficient conditions for achieving the optimum. Then, we propose an algorithm for constructing $N$-bit-delay AIFV codes for given stationary memory-less sources. The optimality of the constructed codes is discussed both theoretically and empirically. They showed shorter expected code lengths when $N\ge 3$ than the conventional AIFV-$m$ and extended Huffman codes. Moreover, in the random numbers simulation, they performed higher compression efficiency than the 32-bit-precision range codes under reasonable conditions.


title: From molecules to scaffolds to functional groups: building context-dependent molecular representation via multi-channel learning

abstract: Reliable molecular property prediction is essential for various scientific endeavors and industrial applications, such as drug discovery. However, the scarcity of data, combined with the highly non-linear causal relationships between physicochemical and biological properties and conventional molecular featurization schemes, complicates the development of robust molecular machine learning models. Self-supervised learning (SSL) has emerged as a popular solution, utilizing large-scale, unannotated molecular data to learn a foundational representation of chemical space that might be advantageous for downstream tasks. Yet, existing molecular SSL methods largely overlook domain-specific knowledge, such as molecular similarity and scaffold importance, as well as the context of the target application when operating over the large chemical space. This paper introduces a novel learning framework that leverages the knowledge of structural hierarchies within molecular structures, embeds them through separate pre-training tasks over distinct channels, and employs a task-specific channel selection to compose a context-dependent representation. Our approach demonstrates competitive performance across various molecular property benchmarks and establishes some state-of-the-art results. It further offers unprecedented advantages in particularly challenging yet ubiquitous scenarios like activity cliffs with enhanced robustness and generalizability compared to other baselines.


title: A Unified Dynamic Model for the Decomposition of Skin Conductance and the Inference of Sudomotor Nerve Activities

abstract: In behavioral health informatics, inferring an individual's psychological state from physiological and behavioral data is fundamental. A key physiological signal in this endeavor is electrodermal activity (EDA), often quantified as skin conductance (SC), known for its sensitivity to a variety of psychological stimuli. Traditional methods to analyze skin conductance, such as the trough-to-peak method, often result in imprecise estimations due to overlapping skin conductance responses. While various mathematical models have been proposed to improve the analysis, many of them do not incorporate the tonic level in the dynamic system. This paper introduces a novel fourth order dynamic system to model the temporal dynamics of skin conductance, unifying both the tonic level and phasic response. Applied to a large dataset with over 200 participants, majority of the models achieved an $R^2$ value above 0.99. Furthermore, this work offers a unique three-component decomposition of skin conductance, shedding light on its temporal dynamics. Comparative evaluations highlight the model's capability to differentiate arousal levels and maintain an appropriate sparsity level for the estimated sudomotor nerve activities signal. The code of the proposed model and algorithm are available for open access.


title: Kivi: Verification for Cluster Management

abstract: Modern cloud infrastructure is powered by cluster management systems such as Kubernetes and Docker Swarm. While these systems seek to minimize users' operational burden, the complex, dynamic, and non-deterministic nature of these systems makes them hard to reason about, potentially leading to failures ranging from performance degradation to outages. We present Kivi, the first system for verifying controllers and their configurations in cluster management systems. Kivi focuses on the popular system Kubernetes, and models its controllers and events into processes whereby their interleavings are exhaustively checked via model checking. Central to handling autoscaling and large-scale deployments is our design that seeks to find violations in a smaller and reduced topology. We also develop several model optimizations in Kivi to scale to large clusters. We show that Kivi is effective and accurate in finding issues in realistic and complex scenarios and showcase two new issues in Kubernetes controller source code.


title: On the Intersection of Self-Correction and Trust in Language Models

abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex cognitive tasks. However, their complexity and lack of transparency have raised several trustworthiness concerns, including the propagation of misinformation and toxicity. Recent research has explored the self-correction capabilities of LLMs to enhance their performance. In this work, we investigate whether these self-correction capabilities can be harnessed to improve the trustworthiness of LLMs. We conduct experiments focusing on two key aspects of trustworthiness: truthfulness and toxicity. Our findings reveal that self-correction can lead to improvements in toxicity and truthfulness, but the extent of these improvements varies depending on the specific aspect of trustworthiness and the nature of the task. Interestingly, our study also uncovers instances of "self-doubt" in LLMs during the self-correction process, introducing a new set of challenges that need to be addressed.


title: Incorporating Worker Perspectives into MTurk Annotation Practices for NLP

abstract: Current practices regarding data collection for natural language processing on Amazon Mechanical Turk (MTurk) often rely on a combination of studies on data quality and heuristics shared among NLP researchers. However, without considering the perspectives of MTurk workers, these approaches are susceptible to issues regarding workers' rights and poor response quality. We conducted a critical literature review and a survey of MTurk workers aimed at addressing open questions regarding best practices for fair payment, worker privacy, data quality, and considering worker incentives. We found that worker preferences are often at odds with received wisdom among NLP researchers. Surveyed workers preferred reliable, reasonable payments over uncertain, very high payments; reported frequently lying on demographic questions; and expressed frustration at having work rejected with no explanation. We also found that workers view some quality control methods, such as requiring minimum response times or Master's qualifications, as biased and largely ineffective. Based on the survey results, we provide recommendations on how future NLP studies may better account for MTurk workers' experiences in order to respect workers' rights and improve data quality.


title: Fast and Interpretable Face Identification for Out-Of-Distribution Data Using Vision Transformers

abstract: Most face identification approaches employ a Siamese neural network to compare two images at the image embedding level. Yet, this technique can be subject to occlusion (e.g. faces with masks or sunglasses) and out-of-distribution data. DeepFace-EMD (Phan et al. 2022) reaches state-of-the-art accuracy on out-of-distribution data by first comparing two images at the image level, and then at the patch level. Yet, its later patch-wise re-ranking stage admits a large $O(n^3 \log n)$ time complexity (for $n$ patches in an image) due to the optimal transport optimization. In this paper, we propose a novel, 2-image Vision Transformers (ViTs) that compares two images at the patch level using cross-attention. After training on 2M pairs of images on CASIA Webface (Yi et al. 2014), our model performs at a comparable accuracy as DeepFace-EMD on out-of-distribution data, yet at an inference speed more than twice as fast as DeepFace-EMD (Phan et al. 2022). In addition, via a human study, our model shows promising explainability through the visualization of cross-attention. We believe our work can inspire more explorations in using ViTs for face identification.


title: Last fall degree of semi-local polynomial systems

abstract: We study the last fall degrees of {\em semi-local} polynomial systems, and the computational complexity of solving such systems for closed-point and rational-point solutions, where the systems are defined over a finite field. A semi-local polynomial system specifies an algebraic set which is the image of a global linear transformation of a direct product of local affine algebraic sets. As a special but interesting case, polynomial systems that arise from Weil restriction of algebraic sets in an affine space of low dimension are semi-local. Such systems have received considerable attention due to their application in cryptography. Our main results bound the last fall degree of a semi-local polynomial system in terms of the number of closed point solutions, and yield an efficient algorithm for finding all rational-point solutions when the prime characteristic of the finite field and the number of rational solutions are small. Our results on solving semi-local systems imply an improvement on a previously known polynomial-time attack on the HFE (Hidden Field Equations) cryptosystems. The attacks implied in our results extend to public key encryption functions which are based on semi-local systems where either the number of closed point solutions is small, or the characteristic of the field is small. It remains plausible to construct public key cryptosystems based on semi-local systems over a finite field of large prime characteristic with exponential number of closed point solutions. Such a method is presented in the paper, followed by further cryptanalysis involving the isomorphism of polynomials (IP) problem, as well as a concrete public key encryption scheme which is secure against all the attacks discussed in this paper.


title: Tailoring Self-Rationalizers with Multi-Reward Distillation

abstract: Large language models (LMs) are capable of generating free-text rationales to aid question answering. However, prior work 1) suggests that useful self-rationalization is emergent only at significant scales (e.g., 175B parameter GPT-3); and 2) focuses largely on downstream performance, ignoring the semantics of the rationales themselves, e.g., are they faithful, true, and helpful for humans? In this work, we enable small-scale LMs (approx. 200x smaller than GPT-3) to generate rationales that not only improve downstream task performance, but are also more plausible, consistent, and diverse, assessed both by automatic and human evaluation. Our method, MaRio (Multi-rewArd RatIOnalization), is a multi-reward conditioned self-rationalization algorithm that optimizes multiple distinct properties like plausibility, diversity and consistency. Results on five difficult question-answering datasets StrategyQA, QuaRel, OpenBookQA, NumerSense and QASC show that not only does MaRio improve task accuracy, but it also improves the self-rationalization quality of small LMs across the aforementioned axes better than a supervised fine-tuning (SFT) baseline. Extensive human evaluations confirm that MaRio rationales are preferred vs. SFT rationales, as well as qualitative improvements in plausibility and consistency.


title: Cavity Induced Topology in Graphene

abstract: Strongly coupling materials to cavity fields can affect their electronic properties altering the phases of matter. We study the monolayer graphene whose electrons are coupled to both left and right circularly polarized photons, and time-reversal symmetry is broken due to a phase shift between the two polarizations. We develop a many-body perturbative theory, and derive cavity mediated electronic interactions. This theory leads to a gap equation which predicts a sizable topological band gap at Dirac nodes in vacuum and when the cavity is prepared in an excited Fock state. Remarkably, band gaps also open in light-matter hybridization points away from the Dirac nodes giving rise to topological photo-electron bands with high Chern numbers. We reveal that the physical mechanism behind this phenomenon lies on the exchange of chiral photons with electronic matter at the hybridization points, and the number and polarization of exchanged photons determine the Chern number. This is a generic microscopic mechanism for the photo-electron band topology. Our theory shows that graphene-based materials, with no need of Floquet engineering and hence protected from the heating effects, host high Chern insulator phases when coupled to chiral cavity fields.


title: QualEval: Qualitative Evaluation for Model Improvement

abstract: Quantitative evaluation metrics have traditionally been pivotal in gauging the advancements of artificial intelligence systems, including large language models (LLMs). However, these metrics have inherent limitations. Given the intricate nature of real-world tasks, a single scalar to quantify and compare is insufficient to capture the fine-grained nuances of model behavior. Metrics serve only as a way to compare and benchmark models, and do not yield actionable diagnostics, thus making the model improvement process challenging. Model developers find themselves amid extensive manual efforts involving sifting through vast datasets and attempting hit-or-miss adjustments to training data or setups. In this work, we address the shortcomings of quantitative metrics by proposing QualEval, which augments quantitative scalar metrics with automated qualitative evaluation as a vehicle for model improvement. QualEval uses a powerful LLM reasoner and our novel flexible linear programming solver to generate human-readable insights that when applied, accelerate model improvement. The insights are backed by a comprehensive dashboard with fine-grained visualizations and human-interpretable analyses. We corroborate the faithfulness of QualEval by demonstrating that leveraging its insights, for example, improves the absolute performance of the Llama 2 model by up to 15% points relative on a challenging dialogue task (DialogSum) when compared to baselines. QualEval successfully increases the pace of model development, thus in essence serving as a data-scientist-in-a-box. Given the focus on critiquing and improving current evaluation metrics, our method serves as a refreshingly new technique for both model evaluation and improvement.


title: Nonparametric Estimation of Conditional Copula using Smoothed Checkerboard Bernstein Sieves

abstract: Conditional copulas are useful tools for modeling the dependence between multiple response variables that may vary with a given set of predictor variables. Conditional dependence measures such as conditional Kendall's tau and Spearman's rho that can be expressed as functionals of the conditional copula are often used to evaluate the strength of dependence conditioning on the covariates. In general, semiparametric estimation methods of conditional copulas rely on an assumed parametric copula family where the copula parameter is assumed to be a function of the covariates. The functional relationship can be estimated nonparametrically using different techniques but it is required to choose an appropriate copula model from various candidate families. In this paper, by employing the empirical checkerboard Bernstein copula (ECBC) estimator we propose a fully nonparametric approach for estimating conditional copulas, which doesn't require any selection of parametric copula models. Closed-form estimates of the conditional dependence measures are derived directly from the proposed ECBC-based conditional copula estimator. We provide the large-sample consistency of the proposed estimator as well as the estimates of conditional dependence measures. The finite-sample performance of the proposed estimator and comparison with semiparametric methods are investigated through simulation studies. An application to real case studies is also provided.


title: Proactive Robot Control for Collaborative Manipulation Using Human Intent

abstract: Collaborative manipulation task often requires negotiation using explicit or implicit communication. An important example is determining where to move when the goal destination is not uniquely specified, and who should lead the motion. This work is motivated by the ability of humans to communicate the desired destination of motion through back-and-forth force exchanges. Inherent to these exchanges is also the ability to dynamically assign a role to each participant, either taking the initiative or deferring to the partner's lead. In this paper, we propose a hierarchical robot control framework that emulates human behavior in communicating a motion destination to a human collaborator and in responding to their actions. At the top level, the controller consists of a set of finite-state machines corresponding to different levels of commitment of the robot to its desired goal configuration. The control architecture is loosely based on the human strategy observed in the human-human experiments, and the key component is a real-time intent recognizer that helps the robot respond to human actions. We describe the details of the control framework, and feature engineering and training process of the intent recognition. The proposed controller was implemented on a UR10e robot (Universal Robots) and evaluated through human studies. The experiments show that the robot correctly recognizes and responds to human input, communicates its intent clearly, and resolves conflict. We report success rates and draw comparisons with human-human experiments to demonstrate the effectiveness of the approach.


title: Bending short DNAs as transversely isotropic rings in series

abstract: Despite the significance of the high flexibility exhibited by short DNAs, there remains an incomplete understanding of their anomalous persistence length. In this study, we propose a novel approach wherein each fundamental characteristic of gene sequences within short DNAs is modeled as a transversely isotropic ring. Our comprehensive model analysis not only successfully replicates the observed high flexibility of short DNAs but also sheds light on the impact of sequence dependence, aligning with experimental findings. Furthermore, our analysis suggests that the bending behavior of short DNAs can be effectively described by the Timoshenko beam theory, accounting for shear considerations.


title: Contour Algorithm for Connectivity

abstract: Finding connected components in a graph is a fundamental problem in graph analysis. In this work, we present a novel minimum-mapping based Contour algorithm to efficiently solve the connectivity problem. We prove that the Contour algorithm with two or higher order operators can identify all connected components of an undirected graph within $\mathcal{O}(\log d_{max})$ iterations, with each iteration involving $\mathcal{O}(m)$ work, where $d_{max}$ represents the largest diameter among all components in the given graph, and $m$ is the total number of edges in the graph. Importantly, each iteration is highly parallelizable, making use of the efficient minimum-mapping operator applied to all edges. To further enhance its practical performance, we optimize the Contour algorithm through asynchronous updates, early convergence checking, eliminating atomic operations, and choosing more efficient mapping operators. Our implementation of the Contour algorithm has been integrated into the open-source framework Arachne. Arachne extends Arkouda for large-scale interactive graph analytics, providing a Python API powered by the high-productivity parallel language Chapel. Experimental results on both real-world and synthetic graphs demonstrate the superior performance of our proposed Contour algorithm compared to state-of-the-art large-scale parallel algorithm FastSV and the fastest shared memory algorithm ConnectIt. On average, Contour achieves a speedup of 7.3x and 1.4x compared to FastSV and ConnectIt, respectively. All code for the Contour algorithm and the Arachne framework is publicly available on GitHub ( https://github.com/Bears-R-Us/arkouda-njit ), ensuring transparency and reproducibility of our work.


title: Endoscopic liftings of epipelagic representations for classical groups

abstract: Let $G$ be a p-adic classical group (orthogonal, symplectic, unitary) and $\pi$ be an epipelagic representation of $G$ defined by Reeder-Yu. Using M{\oe}glin's theory of extended cuspidal supports and Bushnell-Kutzko's theory of covering types, we determine the endoscopic lift of $\pi$ into the general linear group whose dual expresses the dual group of $G$ as a complex matrix group, explicitly in terms of the inducing type of $\pi$ that is extended from the character of the first Moy-Prasad filtration subgroup defined by a stable functional. We interpret the inducing type of $\pi$ via Stevens' construction of supercuspidal representations by skew semi-simple strata, and introduce the so-called epipelagic strata, which only require the residual characteristic p to be odd. As an application, we reprove the results of M. Oi on the endoscopic lifts of Gross-Reeder's simple supercuspidal representations of quasi-split classical groups.


title: Institutional Screening and the Sustainability of Conditional Cooperation

abstract: This paper studies a preference evolution model in which a population of agents are matched to play a sequential prisoner's dilemma in an incomplete information environment. An institution can design an incentive-compatible screening scheme, such as a special zone that requires an entry fee, or a costly label for purchase, to segregate the conditional cooperators from the non-cooperators. We show that institutional intervention of this sort can help the conditional cooperators to prevail when the psychological benefit of cooperating for them is sufficiently strong and the membership of the special zone or the label is inheritable with a sufficiently high probability.


title: A Novel Catalyst Scheme for Stochastic Minimax Optimization

abstract: This paper presents a proximal-point-based catalyst scheme for simple first-order methods applied to convex minimization and convex-concave minimax problems. In particular, for smooth and (strongly)-convex minimization problems, the proposed catalyst scheme, instantiated with a simple variant of stochastic gradient method, attains the optimal rate of convergence in terms of both deterministic and stochastic errors. For smooth and strongly-convex-strongly-concave minimax problems, the catalyst scheme attains the optimal rate of convergence for deterministic and stochastic errors up to a logarithmic factor. To the best of our knowledge, this reported convergence seems to be attained for the first time by stochastic first-order methods in the literature. We obtain this result by designing and catalyzing a novel variant of stochastic extragradient method for solving smooth and strongly-monotone variational inequality, which may be of independent interest.


title: Efficient, Self-Supervised Human Pose Estimation with Inductive Prior Tuning

abstract: The goal of 2D human pose estimation (HPE) is to localize anatomical landmarks, given an image of a person in a pose. SOTA techniques make use of thousands of labeled figures (finetuning transformers or training deep CNNs), acquired using labor-intensive crowdsourcing. On the other hand, self-supervised methods re-frame the HPE task as a reconstruction problem, enabling them to leverage the vast amount of unlabeled visual data, though at the present cost of accuracy. In this work, we explore ways to improve self-supervised HPE. We (1) analyze the relationship between reconstruction quality and pose estimation accuracy, (2) develop a model pipeline that outperforms the baseline which inspired our work, using less than one-third the amount of training data, and (3) offer a new metric suitable for self-supervised settings that measures the consistency of predicted body part length proportions. We show that a combination of well-engineered reconstruction losses and inductive priors can help coordinate pose learning alongside reconstruction in a self-supervised paradigm.


title: APGL4SR: A Generic Framework with Adaptive and Personalized Global Collaborative Information in Sequential Recommendation

abstract: The sequential recommendation system has been widely studied for its promising effectiveness in capturing dynamic preferences buried in users' sequential behaviors. Despite the considerable achievements, existing methods usually focus on intra-sequence modeling while overlooking exploiting global collaborative information by inter-sequence modeling, resulting in inferior recommendation performance. Therefore, previous works attempt to tackle this problem with a global collaborative item graph constructed by pre-defined rules. However, these methods neglect two crucial properties when capturing global collaborative information, i.e., adaptiveness and personalization, yielding sub-optimal user representations. To this end, we propose a graph-driven framework, named Adaptive and Personalized Graph Learning for Sequential Recommendation (APGL4SR), that incorporates adaptive and personalized global collaborative information into sequential recommendation systems. Specifically, we first learn an adaptive global graph among all items and capture global collaborative information with it in a self-supervised fashion, whose computational burden can be further alleviated by the proposed SVD-based accelerator. Furthermore, based on the graph, we propose to extract and utilize personalized item correlations in the form of relative positional encoding, which is a highly compatible manner of personalizing the utilization of global collaborative information. Finally, the entire framework is optimized in a multi-task learning paradigm, thus each part of APGL4SR can be mutually reinforced. As a generic framework, APGL4SR can outperform other baselines with significant margins. The code is available at https://github.com/Graph-Team/APGL4SR.


title: Safe-VLN: Collision Avoidance for Vision-and-Language Navigation of Autonomous Robots Operating in Continuous Environments

abstract: The task of vision-and-language navigation in continuous environments (VLN-CE) aims at training an autonomous agent to perform low-level actions to navigate through 3D continuous surroundings using visual observations and language instructions. The significant potential of VLN-CE for mobile robots has been demonstrated across a large number of studies. However, most existing works in VLN-CE focus primarily on transferring the standard discrete vision-and-language navigation (VLN) methods to continuous environments, overlooking the problem of collisions. Such oversight often results in the agent deviating from the planned path or, in severe instances, the agent being trapped in obstacle areas and failing the navigational task. To address the above-mentioned issues, this paper investigates various collision scenarios within VLN-CE and proposes a classification method to predicate the underlying causes of collisions. Furthermore, a new VLN-CE algorithm, named Safe-VLN, is proposed to bolster collision avoidance capabilities including two key components, i.e., a waypoint predictor and a navigator. In particular, the waypoint predictor leverages a simulated 2D LiDAR occupancy mask to prevent the predicted waypoints from being situated in obstacle-ridden areas. The navigator, on the other hand, employs the strategy of `re-selection after collision' to prevent the robot agent from becoming ensnared in a cycle of perpetual collisions. The proposed Safe-VLN is evaluated on the R2R-CE, the results of which demonstrate an enhanced navigational performance and a statistically significant reduction in collision incidences.


title: Signal Processing Meets SGD: From Momentum to Filter

abstract: In deep learning, stochastic gradient descent (SGD) and its momentum-based variants are widely used for optimization, but they typically suffer from slow convergence. Conversely, existing adaptive learning rate optimizers speed up convergence but often compromise generalization. To resolve this issue, we propose a novel optimization method designed to accelerate SGD's convergence without sacrificing generalization. Our approach reduces the variance of the historical gradient, improves first-order moment estimation of SGD by applying Wiener filter theory, and introduces a time-varying adaptive gain. Empirical results demonstrate that SGDF (SGD with Filter) effectively balances convergence and generalization compared to state-of-the-art optimizers.


title: An Exploration of Multimodality and Data Augmentation for Dementia Classification

abstract: Dementia is a progressive neurological disorder that profoundly affects the daily lives of older adults, impairing abilities such as verbal communication and cognitive function. Early diagnosis is essential for enhancing both lifespan and quality of life for affected individuals. Despite its importance, diagnosing dementia is complex and often necessitates a multimodal approach incorporating diverse clinical data types. In this study, we fine-tune Wav2vec and Word2vec baseline models using two distinct data types: audio recordings and text transcripts. We experiment with four conditions: original datasets versus datasets purged of short sentences, each with and without data augmentation. Our results indicate that synonym-based text data augmentation generally enhances model performance, underscoring the importance of data volume for achieving generalizable performance. Additionally, models trained on text data frequently excel and can further improve the performance of other modalities when combined. Audio and timestamp data sometimes offer marginal improvements. We provide a qualitative error analysis of the sentence archetypes that tend to be misclassified under each condition, providing insights into the effects of altering data modality and augmentation decisions.


title: Mesh Neural Cellular Automata

abstract: Texture modeling and synthesis are essential for enhancing the realism of virtual environments. Methods that directly synthesize textures in 3D offer distinct advantages to the UV-mapping-based methods as they can create seamless textures and align more closely with the ways textures form in nature. We propose Mesh Neural Cellular Automata (MeshNCA), a method that directly synthesizes dynamic textures on 3D meshes without requiring any UV maps. MeshNCA is a generalized type of cellular automata that can operate on a set of cells arranged on non-grid structures such as the vertices of a 3D mesh. MeshNCA accommodates multi-modal supervision and can be trained using different targets such as images, text prompts, and motion vector fields. Only trained on an Icosphere mesh, MeshNCA shows remarkable test-time generalization and can synthesize textures on unseen meshes in real time. We conduct qualitative and quantitative comparisons to demonstrate that MeshNCA outperforms other 3D texture synthesis methods in terms of generalization and producing high-quality textures. Moreover, we introduce a way of grafting trained MeshNCA instances, enabling interpolation between textures. MeshNCA allows several user interactions including texture density/orientation controls, grafting/regenerate brushes, and motion speed/direction controls. Finally, we implement the forward pass of our MeshNCA model using the WebGL shading language and showcase our trained models in an online interactive demo, which is accessible on personal computers and smartphones and is available at https://meshnca.github.io.


title: On-chip transfer of ultrashort graphene plasmon wavepackets using terahertz electronics

abstract: Steering transport of ultrashort polariton wavepackets is essential for achieving on-chip integrated nanocircuits with tightly confined electromagnetic fields towards ultrafast information processing. However, conventional optical techniques have struggled to integrate the necessary components for transferring polariton signals. Here, we address this challenge by electrically generating, manipulating, and reading out terahertz graphene plasmon-polariton wavepackets on-chip. By injecting an electrical pulse into graphene via an ohmic contact, we achieve coherent conversion of the pulse into a plasmon wavepacket exhibiting a pulse duration of 1.2 ps and extreme three-dimensional spatial confinement within a volume of $2.1 \times 10^{-18} m^3$. We reveal the transport properties of plasmons along graphene ribbons in different dielectric environments, providing a basis for designing graphene plasmonic circuits. Furthermore, we find that the conversion efficiency between the electrical pulses and plasmon wavepackets reaches ~30% thanks to the absence of a momentum mismatch. With unprecedented controllability, our platform represents a significant advance in on-chip handling of plasmonic signals in various van der Waals heterostructures.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph physics.optics


title: Robust estimation of heteroscedastic regression models: a brief overview and new proposals

abstract: We collect robust proposals given in the field of regression models with heteroscedastic errors. Our motivation stems from the fact that the practitioner frequently faces the confluence of two phenomena in the context of data analysis: non--linearity and heteroscedasticity. The impact of heteroscedasticity on the precision of the estimators is well--known, however the conjunction of these two phenomena makes handling outliers more difficult. An iterative procedure to estimate the parameters of a heteroscedastic non--linear model is considered. The studied estimators combine weighted $MM-$regression estimators, to control the impact of high leverage points, and a robust method to estimate the parameters of the variance function.


title: Three-dimensional checkerboard spin structure on a breathing pyrochlore lattice

abstract: The standard approach to realize a spin liquid state is through magnetically frustrated states, relying on ingredients such as the lattice geometry, dimensionality, and magnetic interaction type of the spins. While Heisenberg spins on a pyrochlore lattice with only antiferromagnetic nearest neighbors interactions are theoretically proven disordered, spins in real systems generally include longer-range interactions. The spatial correlations at longer distances typically stabilize a long-range order rather than enhancing a spin liquid state. Both states can, however, be destroyed by short-range static correlations introduced by chemical disorder. Here, using disorder-free specimens with a clear long-range antiferromagnetic order, we refine the spin structure of the Heisenberg spinel ZnFe2O4 through neutron magnetic diffraction. The unique wave vector (1, 0, 1/2) leads to a spin structure that can be viewed as alternatively stacked ferromagnetic and antiferromagnetic tetrahedra in a three-dimensional checkerboard form. Stable coexistence of these opposing types of clusters is enabled by the bipartite breathing-pyrochlore crystal structure, leading to a second order phase transition at 10 K. The diffraction intensity of ZnFe2O4 is an exact complement to the inelastic scattering intensity of several chromate spinel systems which are regarded as model classical spin liquids. Our results challenge this attribution, and suggest instead of the six-spin ring-mode, spin excitations in chromate spinels are closely related to the (1, 0, 1/2) type of spin order and the four-spin ferromagnetic cluster locally at one tetrahedron.


title: Strain induced flat-band superconductivity and symmetry breaking

abstract: Superconductivity in single-layer graphene has attracted considerable interest. Here, using the determinant quantum Monte Carlo method, we study transitions of superconductivity and magnetism in a graphene monolayer with a special periodic strain. Consistent with experiments, the deformation accumulates a series of flat bands, whose robustness under interaction is verified through electron localization in real space. During the reconstruction of the band structure, the superconductivity appears in flat band range with next-nearest neighbor d+id pairing symmetry dominating other modes and is accompanied by ferromagnetism caused by symmetry breaking. We also demonstrate that the strain-induced symmetry breaking would accumulate an energy-gap antiferromagnetic insulating phase at half filling even under the limitation of not strong enough interaction, which shows its potential as a platform that exhibits strongly correlated phenomena.


title: Entropy-cost type Propagation of Chaos for Mean Field Interacting Particle System

abstract: In this paper, the quantitative entropy-cost type propagation of chaos for mean field interacting particle system is obtained, where the interaction is bounded and the initial distribution of mean field interacting particles converges to that of corresponding McKean-Vlasov SDEs in $L^1$-transportation cost $\W_1^\Psi$ induced by some cost function $\Psi$. In the finite dimension case, the interaction is merely assumed to be bounded measurable and the noise can be multiplicative, while for the semi-linear SPDEs, the interaction is required to be bounded and Dini continuous. In addition, an example is presented for the infinite model.


title: InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image

abstract: With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when handling natural language as editing instructions. Due to the lack of labeled human face 3D datasets and effective architectures, the area of human-instructed 3D-aware editing for open-world portraits in an end-to-end manner remains under-explored. To solve this problem, we propose an end-to-end diffusion-based framework termed InstructPix2NeRF, which enables instructed 3D-aware portrait editing from a single open-world image with human instructions. At its core lies a conditional latent 3D diffusion process that lifts 2D editing to 3D space by learning the correlation between the paired images' difference and the instructions via triplet data. With the help of our proposed token position randomization strategy, we could even achieve multi-semantic editing through one single pass with the portrait identity well-preserved. Besides, we further propose an identity consistency module that directly modulates the extracted identity signals into our diffusion process, which increases the multi-view 3D identity consistency. Extensive experiments verify the effectiveness of our method and show its superiority against strong baselines quantitatively and qualitatively. Source code and pre-trained models can be found on our project page: \url{https://mybabyyh.github.io/InstructPix2NeRF}.


title: On Subagging Boosted Probit Model Trees

abstract: With the insight of variance-bias decomposition, we design a new hybrid bagging-boosting algorithm named SBPMT for classification problems. For the boosting part of SBPMT, we propose a new tree model called Probit Model Tree (PMT) as base classifiers in AdaBoost procedure. For the bagging part, instead of subsampling from the dataset at each step of boosting, we perform boosted PMTs on each subagged dataset and combine them into a powerful "committee", which can be viewed an incomplete U-statistic. Our theoretical analysis shows that (1) SBPMT is consistent under certain assumptions, (2) Increase the subagging times can reduce the generalization error of SBPMT to some extent and (3) Large number of ProbitBoost iterations in PMT can benefit the performance of SBPMT with fewer steps in the AdaBoost part. Those three properties are verified by a famous simulation designed by Mease and Wyner (2008). The last two points also provide a useful guidance in model tuning. A comparison of performance with other state-of-the-art classification methods illustrates that the proposed SBPMT algorithm has competitive prediction power in general and performs significantly better in some cases.


title: Electroweak baryogenesis, dark matter, and dark CP-symmetry

abstract: With the motivation of explaining the dark matter and achieving the electroweak baryogenesis via the spontaneous CP-violation at high temperature, we propose a complex singlet scalar ($S=\frac{\chi+i\eta_s}{\sqrt{2}}$) extension of the two-Higgs-doublet model respecting a discrete dark CP-symmetry: $S\to -S^*$. The dark CP-symmetry guarantees $\chi$ to be a dark matter candidate on one hand and on the other hand allows $\eta_s$ to have mixings with the pseudoscalars of the Higgs doublet fields, which play key roles in generating the CP-violation sources needed by the electroweak baryogenesis at high temperature. The universe undergoes multi-step phase transitions, including a strongly first-order electroweak phase transition during which the baryon number is produced. At the present temperature, the observed vacuum is produced and the CP-symmetry is restored so that the stringent electric dipole moment experimental bounds are satisfied. Considering relevant constraints, we study the simple scenario of $m_{\chi}$ around the Higgs resonance region, and find that the dark matter relic abundance and the baryon asymmetry can be simultaneously explained. Finally, we briefly discuss the gravitational wave signatures at future space-based detectors and the LHC signatures.


title: A non-torus positive 2-bridge knot does not admit chirally cosmetic surgeries

abstract: We prove that a positive two-bridge knot other than the $(2,k)$ torus knot does not admit chirally cosmetic surgeries, a pair of Dehn surgeries along distinct slopes yielding orientation-reversingly homeomorphic 3-manifolds.


title: Nef vector bundles on a quadric surface with first Chern class $(2,2)$

abstract: We classify nef vector bundles on a smooth quadric surface with first Chern class $(2,2)$ over an algebraically closed field of characteristic zero.


title: SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

abstract: Loop closure, as one of the crucial components in SLAM, plays an essential role in correcting the accumulated errors. Traditional appearance-based methods, such as bag-of-words models, are often limited by local 2D features and the volume of training data, making them less versatile and robust in real-world scenarios, leading to missed detections or false positives detections in loop closure. To address these issues, we first propose a object-level data association method based on multi-level verification, which can associate 2D semantic features of current frame with 3D objects landmarks of map. Next, taking advantage of these association relations, we introduce a semantic loop closure method based on quadric-level object map topology, which represents scenes through the topological graph of objects and achieves accurate loop closure at a wide field of view by comparing differences in the topological graphs. Finally, we integrate these two methods into a complete object-aware SLAM system. Qualitative experiments and ablation studies demonstrate the effectiveness and robustness of the proposed object-level data association algorithm. Quantitative experiments show that our semantic loop closure method outperforms existing state-of-the-art methods in terms of precision, recall and localization accuracy metrics.


title: Prioritized Propagation in Graph Neural Networks

abstract: Graph neural networks (GNNs) have recently received significant attention. Learning node-wise message propagation in GNNs aims to set personalized propagation steps for different nodes in the graph. Despite the success, existing methods ignore node priority that can be reflected by node influence and heterophily. In this paper, we propose a versatile framework PPro, which can be integrated with most existing GNN models and aim to learn prioritized node-wise message propagation in GNNs. Specifically, the framework consists of three components: a backbone GNN model, a propagation controller to determine the optimal propagation steps for nodes, and a weight controller to compute the priority scores for nodes. We design a mutually enhanced mechanism to compute node priority, optimal propagation step and label prediction. We also propose an alternative optimization strategy to learn the parameters in the backbone GNN model and two parametric controllers. We conduct extensive experiments to compare our framework with other 11 state-of-the-art competitors on 8 benchmark datasets. Experimental results show that our framework can lead to superior performance in terms of propagation strategies and node representations.


title: CESAR: Control Envelope Synthesis via Angelic Refinements

abstract: This paper presents an approach for synthesizing provably correct control envelopes for hybrid systems. Control envelopes characterize families of safe controllers and are used to monitor untrusted controllers at runtime. Our algorithm fills in the blanks of a hybrid system's sketch specifying the desired shape of the control envelope, the possible control actions, and the system's differential equations. In order to maximize the flexibility of the control envelope, the synthesized conditions saying which control action can be chosen when should be as permissive as possible while establishing a desired safety condition from the available assumptions, which are augmented if needed. An implicit, optimal solution to this synthesis problem is characterized using hybrid systems game theory, from which explicit solutions can be derived via symbolic execution and sound, systematic game refinements. Optimality can be recovered in the face of approximation via a dual game characterization. The resulting algorithm, Control Envelope Synthesis via Angelic Refinements (CESAR), is demonstrated in a range of safe control synthesis examples with different control challenges.


title: CAME: Competitively Learning a Mixture-of-Experts Model for First-stage Retrieval

abstract: The first-stage retrieval aims to retrieve a subset of candidate documents from a huge collection both effectively and efficiently. Since various matching patterns can exist between queries and relevant documents, previous work tries to combine multiple retrieval models to find as many relevant results as possible. The constructed ensembles, whether learned independently or jointly, do not care which component model is more suitable to an instance during training. Thus, they cannot fully exploit the capabilities of different types of retrieval models in identifying diverse relevance patterns. Motivated by this observation, in this paper, we propose a Mixture-of-Experts (MoE) model consisting of representative matching experts and a novel competitive learning mechanism to let the experts develop and enhance their expertise during training. Specifically, our MoE model shares the bottom layers to learn common semantic representations and uses differently structured upper layers to represent various types of retrieval experts. Our competitive learning mechanism has two stages: (1) a standardized learning stage to train the experts equally to develop their capabilities to conduct relevance matching; (2) a specialized learning stage where the experts compete with each other on every training instance and get rewards and updates according to their performance to enhance their expertise on certain types of samples. Experimental results on three retrieval benchmark datasets show that our method significantly outperforms the state-of-the-art baselines.


title: Flexible Multi-Generator Model with Fused Spatiotemporal Graph for Trajectory Prediction

abstract: Trajectory prediction plays a vital role in automotive radar systems, facilitating precise tracking and decision-making in autonomous driving. Generative adversarial networks with the ability to learn a distribution over future trajectories tend to predict out-of-distribution samples, which typically occurs when the distribution of forthcoming paths comprises a blend of various manifolds that may be disconnected. To address this issue, we propose a trajectory prediction framework, which can capture the social interaction variations and model disconnected manifolds of pedestrian trajectories. Our framework is based on a fused spatiotemporal graph to better model the complex interactions of pedestrians in a scene, and a multi-generator architecture that incorporates a flexible generator selector network on generated trajectories to learn a distribution over multiple generators. We show that our framework achieves state-of-the-art performance compared with several baselines on different challenging datasets.


title: Nef vector bundles on a quadric threefold with first Chern class two

abstract: We classify nef vector bundles on a smooth hyperquadric of dimension three with first Chern class two over an algebraically closed field of characteristic zero. In particular, we see that they are globally generated.