title: Coalitional Manipulations and Immunity of the Shapley Value

abstract: We consider manipulations in the context of coalitional games, where a coalition aims to increase the total payoff of its members. An allocation rule is immune to coalitional manipulation if no coalition can benefit from internal reallocation of worth on the level of its subcoalitions (reallocation-proofness), and if no coalition benefits from a lower worth while all else remains the same (weak coalitional monotonicity). Replacing additivity in Shapley's original characterization by these requirements yields a new foundation of the Shapley value, i.e., it is the unique efficient and symmetric allocation rule that awards nothing to a null player and is immune to coalitional manipulations. We further find that for efficient allocation rules, reallocation-proofness is equivalent to constrained marginality, a weaker variant of Young's marginality axiom. Our second characterization improves upon Young's characterization by weakening the independence requirement intrinsic to marginality.


title: Linear-nonlinear duality for circuit design on quantum computing platforms

abstract: The unitary description of beam splitters (BSs) and optical parametric amplifiers (OPAs) in terms of the dynamical Lie groups $SU(2)$ and $SU(1,1)$ has a long history. Recently, an inherent duality has been proposed that relates the unitaries of both optical devices. At the physical level, this duality relates the linear nature of a lossless BS to the nonlinear Parametric Down-Conversion (PDC) process exhibited by an OPA. Here, we argue that the duality between BS and PDC can instead be naturally interpreted by analyzing the geometrical properties of both Lie groups, an approach that explicitly connects the dynamical group description of the optical devices with the aforementioned duality. Furthermore, we show that the BS-PDC duality can be represented through tensor network diagrams, enabling the implementation of a PDC as a circuit on a standard quantum computing platform. Thus, it is feasible to simulate nonlinear processes by using single-qubit unitaries that can be implemented on currently available digital quantum processors.


title: Radio-continuum spectra of ram pressure stripped galaxies in the Coma Cluster

abstract: $Aims:$ We used the nearby Coma Cluster as a laboratory in order to probe the impact of ram pressure on star formation as well as to constrain the characteristic timescales and velocities for the stripping of the non-thermal ISM. $Methods:$ We used high-resolution ($6.5'' \approx 3\,\mathrm{kpc}$), multi-frequency ($144\,\mathrm{MHz} - 1.5\,\mathrm{GHz}$) radio continuum imaging of the Coma Cluster to resolve the low-frequency radio spectrum across the discs and tails of 25 ram pressure stripped galaxies. With resolved spectral index maps across these galaxy discs, we constrained the impact of ram pressure perturbations on galaxy star formation. We measured multi-frequency flux-density profiles along each of the ram pressure stripped tails in our sample. We then fit the resulting radio continuum spectra with a simple synchrotron aging model. $Results:$ We showed that ram pressure stripped tails in Coma have steep ($-2 \lesssim \alpha \lesssim -1$) spectral indices. The discs of galaxies undergoing ram pressure stripping have integrated spectral indices within the expected range for shock acceleration from supernovae ($-0.8 \lesssim \alpha \lesssim -0.5$), though there is a tail towards flatter values. In a resolved sense, there are gradients in spectral index across the discs of ram pressure stripped galaxies in Coma. These gradients are aligned with the direction of the observed radio tails, with the flattest spectral indices being found on the `leading half'. From best-fit break frequencies we estimated the projected plasma velocities along the tail to be on the order of hundreds of kilometers per second, with the precise magnitude depending on the assumed magnetic field strength.


title: Multipartite entanglement sudden death and birth in randomized hypergraph states

abstract: We introduce and analyze the entanglement properties of randomized hypergraph states, as an extended notion of the randomization procedure in the quantum logic gates for the usual graph states, recently proposed in the literature. The probabilities of applying imperfect generalized controlled-$Z$ gates simulate the noisy operations over the qubits. We obtain entanglement measures as negativity, concurrence, and genuine multiparticle negativity, and show that entanglement exhibits a non-monotonic behavior in terms of the randomness parameters, which is a consequence of the non-uniformity of the associated hypergraphs, reinforcing the claim that the entanglement of randomized graph states is monotonic since they are related to $2$-uniform hypergraphs. Moreover, we observed the phenomena of entanglement sudden death and entanglement sudden birth in RH states. This work revels a connection between the non-uniformity of hypergraphs and loss of entanglement.


title: Relative NN-Descent: A Fast Index Construction for Graph-Based Approximate Nearest Neighbor Search

abstract: Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets. However, graph-based methods have the disadvantage of long index construction time. Recently, many researchers have improved the tradeoff between accuracy and speed during a search. However, there is little research on accelerating index construction. We propose a fast graph construction algorithm, Relative NN-Descent (RNN-Descent). RNN-Descent combines NN-Descent, an algorithm for constructing approximate K-nearest neighbor graphs (K-NN graphs), and RNG Strategy, an algorithm for selecting edges effective for search. This algorithm allows the direct construction of graph-based indexes without ANNS. Experimental results demonstrated that the proposed method had the fastest index construction speed, while its search performance is comparable to existing state-of-the-art methods such as NSG. For example, in experiments on the GIST1M dataset, the construction of the proposed method is 2x faster than NSG. Additionally, it was even faster than the construction speed of NN-Descent.


title: Kashiwara-Vergne solutions degree by degree

abstract: We show that solutions to the Kashiwara-Vergne problem can be extended degree by degree. This can be used to simplify the computation of a class of Drinfel'd associators, which under the Alekseev-Torossian conjecture, may comprise all associators. We also give a proof that the associated graded Lie algebra of the Kashiwara-Vergne group is isomorphic to the graded Kashiwara-Vergne Lie algebra.


title: Two-stage solution for ancilla-assisted quantum process tomography: error analysis and optimal design

abstract: Quantum process tomography (QPT) is a fundamental task to characterize the dynamics of quantum systems. In contrast to standard QPT, ancilla-assisted process tomography (AAPT) framework introduces an extra ancilla system such that a single input state is needed. In this paper, we extend the two-stage solution, a method originally designed for standard QPT, to perform AAPT. Our algorithm has $O(Md_A^2d_B^2)$ computational complexity where $ M $ is the type number of the measurement operators, $ d_A $ is the dimension of the quantum system of interest, and $d_B$ is the dimension of the ancilla system. Then we establish an error upper bound and further discuss the optimal design on the input state in AAPT. A numerical example on a phase damping process demonstrates the effectiveness of the optimal design and illustrates the theoretical error analysis.


title: Microwave Spin-Pumping from an Antiferromagnet FeBO3

abstract: Recently, canted antiferromagnets offer great potential for fundamental research and applications due to their unique properties. The presence of the Dzyaloshinskii-Moriya interaction leads to the existence of a weak ferromagnetic moment at room temperature. We study both theoretically and experimentally microwave spin pumping by the quasi-ferromagnetic mode from a canted easy plane antiferromagnet with weak ferromagnetism FeBO3. The conversion of a microwave signal into the constant voltage is realized using the inverse spin Hall effect in an iron borate/heavy metal heterostructure. We use an additional bias magnetic field to selectively tune the resonance frequency of such a microwave detector over a wide range up to 43.5 GHz with potential sensitivity near 2.5 microV/W. We confirm the pure spin current nature by changing polarity of the detected via inverse spin Hall effect voltage by switching the direction of the bias magnetic field. We believe that our results will be useful for the development of highly tunable, portable and sensitive microwave antiferromagnet-based functional devices.


title: Limits of chordal graphs with bounded tree-width

abstract: We study random $k$-connected chordal graphs with bounded tree-width. Our main results are scaling limits and quenched local limits.


title: DDC-PIM: Efficient Algorithm/Architecture Co-design for Doubling Data Capacity of SRAM-based Processing-In-Memory

abstract: Processing-in-memory (PIM), as a novel computing paradigm, provides significant performance benefits from the aspect of effective data movement reduction. SRAM-based PIM has been demonstrated as one of the most promising candidates due to its endurance and compatibility. However, the integration density of SRAM-based PIM is much lower than other non-volatile memory-based ones, due to its inherent 6T structure for storing a single bit. Within comparable area constraints, SRAM-based PIM exhibits notably lower capacity. Thus, aiming to unleash its capacity potential, we propose DDC-PIM, an efficient algorithm/architecture co-design methodology that effectively doubles the equivalent data capacity. At the algorithmic level, we propose a filter-wise complementary correlation (FCC) algorithm to obtain a bitwise complementary pair. At the architecture level, we exploit the intrinsic cross-coupled structure of 6T SRAM to store the bitwise complementary pair in their complementary states ($Q/\overline{Q}$), thereby maximizing the data capacity of each SRAM cell. The dual-broadcast input structure and reconfigurable unit support both depthwise and pointwise convolution, adhering to the requirements of various neural networks. Evaluation results show that DDC-PIM yields about $2.84\times$ speedup on MobileNetV2 and $2.69\times$ on EfficientNet-B0 with negligible accuracy loss compared with PIM baseline implementation. Compared with state-of-the-art SRAM-based PIM macros, DDC-PIM achieves up to $8.41\times$ and $2.75\times$ improvement in weight density and area efficiency, respectively.


title: Discussing the Spectrum of Physics-Enhanced Machine Learning; a Survey on Structural Mechanics Applications

abstract: The intersection of physics and machine learning has given rise to the physics-enhanced machine learning (PEML) paradigm, aiming to improve the capabilities and reduce the individual shortcomings of data- or physics-only methods. In this paper, the spectrum of physics-enhanced machine learning methods, expressed across the defining axes of physics and data, is discussed by engaging in a comprehensive exploration of its characteristics, usage, and motivations. In doing so, we present a survey of recent applications and developments of PEML techniques, revealing the potency of PEML in addressing complex challenges. We further demonstrate application of select such schemes on the simple working example of a single degree-of-freedom Duffing oscillator, which allows to highlight the individual characteristics and motivations of different `genres' of PEML approaches. To promote collaboration and transparency, and to provide practical examples for the reader, the code generating these working examples is provided alongside this paper. As a foundational contribution, this paper underscores the significance of PEML in pushing the boundaries of scientific and engineering research, underpinned by the synergy of physical insights and machine learning capabilities.


title: Dealing with Structure Constraints in Evolutionary Pareto Set Learning

abstract: In the past few decades, many multiobjective evolutionary optimization algorithms (MOEAs) have been proposed to find a finite set of approximate Pareto solutions for a given problem in a single run, each with its own structure. However, in many real-world applications, it could be desirable to have structure constraints on the entire optimal solution set, which define the patterns shared among all solutions. The current population-based MOEAs cannot properly handle such requirements. In this work, we make the first attempt to incorporate the structure constraints into the whole solution set by a single Pareto set model, which can be efficiently learned by a simple evolutionary stochastic optimization method. With our proposed method, the decision-makers can flexibly trade off the Pareto optimality with preferred structures among all solutions, which is not supported by previous MOEAs. A set of experiments on benchmark test suites and real-world application problems fully demonstrates the efficiency of our proposed method.


title: Assessing and Enhancing Robustness of Deep Learning Models with Corruption Emulation in Digital Pathology

abstract: Deep learning in digital pathology brings intelligence and automation as substantial enhancements to pathological analysis, the gold standard of clinical diagnosis. However, multiple steps from tissue preparation to slide imaging introduce various image corruptions, making it difficult for deep neural network (DNN) models to achieve stable diagnostic results for clinical use. In order to assess and further enhance the robustness of the models, we analyze the physical causes of the full-stack corruptions throughout the pathological life-cycle and propose an Omni-Corruption Emulation (OmniCE) method to reproduce 21 types of corruptions quantified with 5-level severity. We then construct three OmniCE-corrupted benchmark datasets at both patch level and slide level and assess the robustness of popular DNNs in classification and segmentation tasks. Further, we explore to use the OmniCE-corrupted datasets as augmentation data for training and experiments to verify that the generalization ability of the models has been significantly enhanced.


title: In the recovery of sparse vectors from quadratic measurements, the presence of linear terms breaks the square root bottleneck

abstract: Motivated by recent results in the statistical physics of spin glasses, we study the recovery of a sparse vector $\mathbf{x}_0\in \mathbb{S}^{n-1}$, $\|\mathbf{x}_0\|_{\ell_0} = k<n$, from $m$ quadratic measurements of the form $ (1-\lambda)\langle \mathbf{A}_i, \mathbf{x}_0\mathbf{x}_0^T \rangle + \lambda \langle\mathbf{c}_i,\mathbf{x}_0 \rangle $ where $\mathbf{A}_{i}, \mathbf{c}_{i}$ have i.i.d Gaussian entries. This can be related to a constrained version of the 2-spin Hamiltonian with external field for which it was recently shown (in the absence of any structural constraint and in the asymptotic regime) that the geometry of the energy landscape becomes trivial above a certain threshold $\lambda > \lambda_c\in (0,1)$. Building on this idea we study the evolution of the so-called square root bottleneck for $\lambda\in [0,1]$ in the setting of the sparse rank one matrix recovery/sensing problem. We show that recovery of the vector $\mathbf{x}_0$ can be guaranteed as soon as $m\gtrsim k^2 (1-\lambda)^2/\lambda^2$, $\lambda \gtrsim k^{-1/2}$ provided that this vector satisfies a sufficiently strong incoherence condition, thus retrieving the linear regime for an external field $(1-\lambda)/\lambda \lesssim k^{-1/2}$. Our proof relies on an interpolation between the linear and quadratic settings, as well as on standard convex geometry arguments.


title: Revisiting $K_1(1270)- K_1(1400)$ mixing in QCD sum rules

abstract: We investigate the $K_1(1270)-K_1(1400)$ mixing caused by the flavor $SU(3)$ symmetry breaking. The mixing angle is expressed by a $K_{1A}\to K_{1B}$ matrix element induced by the operators that breaks flavor $SU(3)$ symmetry. The QCD contribution to this matrix element is assumed to be dominated and calculated by QCD sum rules. A three-point correlation function is defined and handled both at the hadron and quark-gluon levels. The quark-gluon level calculation is based on operator product expansion up to dimension-5 condensates. A detailed numerical analysis is performed to determine the Borel parameters, and the obtained mixing angle is $\theta_{K_1}=22^{\circ}\pm 7^{\circ}$ or $\theta_{K_1}=68^{\circ}\pm 7^{\circ}$.


title: Borrowable Fractional Ownership Types for Verification

abstract: Automated verification of functional correctness of imperative programs with references (a.k.a. pointers) is challenging because of reference aliasing. Ownership types have recently been applied to address this issue, but the existing approaches were limited in that they are effective only for a class of programs whose reference usage follows a certain style. To relax the limitation, we combine the approaches of ConSORT (based on fractional ownership) and RustHorn (based on borrowable ownership), two recent approaches to automated program verification based on ownership types, and propose the notion of borrowable fractional ownership types. We formalize a new type system based on the borrowable fractional ownership types and show how we can use it to automatically reduce the program verification problem for imperative programs with references to that for functional programs without references. We also show the soundness of our type system and the translation, and conduct experiments to confirm the effectiveness of our approach.


title: Raising the ClaSS of Streaming Time Series Segmentation

abstract: Ubiquitous sensors today emit high frequency streams of numerical measurements that reflect properties of human, animal, industrial, commercial, and natural processes. Shifts in such processes, e.g. caused by external events or internal state changes, manifest as changes in the recorded signals. The task of streaming time series segmentation (STSS) is to partition the stream into consecutive variable-sized segments that correspond to states of the observed processes or entities. The partition operation itself must in performance be able to cope with the input frequency of the signals. We introduce ClaSS, a novel, efficient, and highly accurate algorithm for STSS. ClaSS assesses the homogeneity of potential partitions using self-supervised time series classification and applies statistical tests to detect significant change points (CPs). In our experimental evaluation using two large benchmarks and six real-world data archives, we found ClaSS to be significantly more precise than eight state-of-the-art competitors. Its space and time complexity is independent of segment sizes and linear only in the sliding window size. We also provide ClaSS as a window operator with an average throughput of 1k data points per second for the Apache Flink streaming engine.


title: Demonstration of a parity-time symmetry breaking phase transition using superconducting and trapped-ion qutrits

abstract: Scalable quantum computers hold the promise to solve hard computational problems, such as prime factorization, combinatorial optimization, simulation of many-body physics, and quantum chemistry. While being key to understanding many real-world phenomena, simulation of non-conservative quantum dynamics presents a challenge for unitary quantum computation. In this work, we focus on simulating non-unitary parity-time symmetric systems, which exhibit a distinctive symmetry-breaking phase transition as well as other unique features that have no counterpart in closed systems. We show that a qutrit, a three-level quantum system, is capable of realizing this non-equilibrium phase transition. By using two physical platforms -- an array of trapped ions and a superconducting transmon -- and by controlling their three energy levels in a digital manner, we experimentally simulate the parity-time symmetry-breaking phase transition. Our results indicate the potential advantage of multi-level (qudit) processors in simulating physical effects, where additional accessible levels can play the role of a controlled environment.


title: Simple and tight complexity lower bounds for solving Rabin games

abstract: We give a simple proof that assuming the Exponential Time Hypothesis (ETH), determining the winner of a Rabin game cannot be done in time $2^{o(k \log k)} \cdot n^{O(1)}$, where $k$ is the number of pairs of vertex subsets involved in the winning condition and $n$ is the vertex count of the game graph. While this result follows from the lower bounds provided by Calude et al [SIAM J. Comp. 2022], our reduction is simpler and arguably provides more insight into the complexity of the problem. In fact, the analogous lower bounds discussed by Calude et al, for solving Muller games and multidimensional parity games, follow as simple corollaries of our approach. Our reduction also highlights the usefulness of a certain pivot problem -- Permutation SAT -- which may be of independent interest.


title: Rapid cryogenic characterisation of 1024 integrated silicon quantum dots

abstract: Quantum computers are nearing the thousand qubit mark, with the current focus on scaling to improve computational performance. As quantum processors grow in complexity, new challenges arise such as the management of device variability and the interface with supporting electronics. Spin qubits in silicon quantum dots are poised to address these challenges with their proven control fidelities and potential for compatibility with large-scale integration. Here, we demonstrate the integration of 1024 silicon quantum dots with on-chip digital and analogue electronics, all operating below 1 K. A high-frequency analogue multiplexer provides fast access to all devices with minimal electrical connections, enabling characteristic data across the quantum dot array to be acquired in just 5 minutes. We achieve this by leveraging radio-frequency reflectometry with state-of-the-art signal integrity, reaching a minimum integration time of 160 ps. Key quantum dot parameters are extracted by fast automated machine learning routines to assess quantum dot yield and understand the impact of device design. We find correlations between quantum dot parameters and room temperature transistor behaviour that may be used as a proxy for in-line process monitoring. Our results show how rapid large-scale studies of silicon quantum devices can be performed at lower temperatures and measurement rates orders of magnitude faster than current probing techniques, and form a platform for the future on-chip addressing of large scale qubit arrays.


title: Assessing the Sustainability and Trustworthiness of Federated Learning Models

abstract: Artificial intelligence (AI) plays a pivotal role in various sectors, influencing critical decision-making processes in our daily lives. Within the AI landscape, novel AI paradigms, such as Federated Learning (FL), focus on preserving data privacy while collaboratively training AI models. In such a context, a group of experts from the European Commission (AI-HLEG) has identified sustainable AI as one of the key elements that must be considered to provide trustworthy AI. While existing literature offers several taxonomies and solutions for assessing the trustworthiness of FL models, a significant gap exists in considering sustainability and the carbon footprint associated with FL. Thus, this work introduces the sustainability pillar to the most recent and comprehensive trustworthy FL taxonomy, making this work the first to address all AI-HLEG requirements. The sustainability pillar assesses the FL system environmental impact, incorporating notions and metrics for hardware efficiency, federation complexity, and energy grid carbon intensity. Then, this work designs and implements an algorithm for evaluating the trustworthiness of FL models by incorporating the sustainability pillar. Extensive evaluations with the FederatedScope framework and various scenarios varying federation participants, complexities, hardware, and energy grids demonstrate the usefulness of the proposed solution.


title: SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark

abstract: We present SignAvatars, the first large-scale, multi-prompt 3D sign language (SL) motion dataset designed to bridge the communication gap for Deaf and hard-of-hearing individuals. While there has been an exponentially growing number of research regarding digital communication, the majority of existing communication technologies primarily cater to spoken or written languages, instead of SL, the essential communication method for Deaf and hard-of-hearing communities. Existing SL datasets, dictionaries, and sign language production (SLP) methods are typically limited to 2D as annotating 3D models and avatars for SL is usually an entirely manual and labor-intensive process conducted by SL experts, often resulting in unnatural avatars. In response to these challenges, we compile and curate the SignAvatars dataset, which comprises 70,000 videos from 153 signers, totaling 8.34 million frames, covering both isolated signs and continuous, co-articulated signs, with multiple prompts including HamNoSys, spoken language, and words. To yield 3D holistic annotations, including meshes and biomechanically-valid poses of body, hands, and face, as well as 2D and 3D keypoints, we introduce an automated annotation pipeline operating on our large corpus of SL videos. SignAvatars facilitates various tasks such as 3D sign language recognition (SLR) and the novel 3D SL production (SLP) from diverse inputs like text scripts, individual words, and HamNoSys notation. Hence, to evaluate the potential of SignAvatars, we further propose a unified benchmark of 3D SL holistic motion production. We believe that this work is a significant step forward towards bringing the digital world to the Deaf and hard-of-hearing communities as well as people interacting with them.


title: A forecast of the sensitivity of the DALI Experiment to Galactic axion dark matter

abstract: The axion is a long-postulated boson that can simultaneously solve two fundamental problems of modern physics: the charge-parity symmetry problem in the strong interaction and the enigma of dark matter. In this work we estimate, by means of Monte Carlo simulations, the sensitivity of the Dark-photons$\&$Axion-Like particles Interferometer (DALI), a new-generation Fabry-P\'erot haloscope proposed to probe axion dark matter in the 25-250 $\mu$eV band.


title: The Phase Transition Phenomenon of Shuffled Regression

abstract: We study the phase transition phenomenon inherent in the shuffled (permuted) regression problem, which has found numerous applications in databases, privacy, data analysis, etc. In this study, we aim to precisely identify the locations of the phase transition points by leveraging techniques from message passing (MP). In our analysis, we first transform the permutation recovery problem into a probabilistic graphical model. We then leverage the analytical tools rooted in the message passing (MP) algorithm and derive an equation to track the convergence of the MP algorithm. By linking this equation to the branching random walk process, we are able to characterize the impact of the signal-to-noise-ratio ($\snr$) on the permutation recovery. Depending on whether the signal is given or not, we separately investigate the oracle case and the non-oracle case. The bottleneck in identifying the phase transition regimes lies in deriving closed-form formulas for the corresponding critical points, but only in rare scenarios can one obtain such precise expressions. To tackle this technical challenge, this study proposes the Gaussian approximation method, which allows us to obtain the closed-form formulas in almost all scenarios. In the oracle case, our method can fairly accurately predict the phase transition $\snr$. In the non-oracle case, our algorithm can predict the maximum allowed number of permuted rows and uncover its dependency on the sample number.


title: The inviscid inflow-outflow problem via analyticity

abstract: We consider the incompressible Euler equation on an analytic domain $\Omega $ with nonhomogeneous boundary condition $u\cdot \mathsf{n} = \overline{u} \cdot \mathsf{n}$ on $\partial \Omega$, where $\overline{u}$ is a given divergence-free analytic vector field. We establish local well-posedness for $u$ in analytic spaces without any compatibility conditions in all space dimensions. We also prove global well-posedness in the 2D case if $\overline{u}$ decays in time sufficiently fast.


title: The SourceData-NLP dataset: integrating curation into scientific publishing for training large language models

abstract: Introduction: The scientific publishing landscape is expanding rapidly, creating challenges for researchers to stay up-to-date with the evolution of the literature. Natural Language Processing (NLP) has emerged as a potent approach to automating knowledge extraction from this vast amount of publications and preprints. Tasks such as Named-Entity Recognition (NER) and Named-Entity Linking (NEL), in conjunction with context-dependent semantic interpretation, offer promising and complementary approaches to extracting structured information and revealing key concepts. Results: We present the SourceData-NLP dataset produced through the routine curation of papers during the publication process. A unique feature of this dataset is its emphasis on the annotation of bioentities in figure legends. We annotate eight classes of biomedical entities (small molecules, gene products, subcellular components, cell lines, cell types, tissues, organisms, and diseases), their role in the experimental design, and the nature of the experimental method as an additional class. SourceData-NLP contains more than 620,000 annotated biomedical entities, curated from 18,689 figures in 3,223 papers in molecular and cell biology. We illustrate the dataset's usefulness by assessing BioLinkBERT and PubmedBERT, two transformers-based models, fine-tuned on the SourceData-NLP dataset for NER. We also introduce a novel context-dependent semantic task that infers whether an entity is the target of a controlled intervention or the object of measurement. Conclusions: SourceData-NLP's scale highlights the value of integrating curation into publishing. Models trained with SourceData-NLP will furthermore enable the development of tools able to extract causal hypotheses from the literature and assemble them into knowledge graphs.


title: Unlocking ultrastrong high-temperature ceramics: Beyond Equimolar Compositions in High Entropy Nitrides

abstract: Traditionally, increasing compositional complexity and chemical diversity of high entropy alloy ceramics whilst maintaining a stable single-phase solid solution has been a primary design strategy for the development of new ceramics. However, only a handful have shown properties that justify the increased alloying content. Here, we unveil a groundbreaking strategy based on deviation from conventional equimolar composition towards non-equimolar composition space, enabling tuning the metastability level of the supersaturated single-phase solid solution. By employing high-temperature micromechanical testing of refractory metal-based high entropy nitrides, we found that the activation of an additional strengthening mechanism upon metastable phase decomposition propels the yield strength of a non-equimolar nitride at 1000 C to a staggering 6.9 GPa, that is 40 % higher than the most robust equimolar nitride. We show that the inherent instability triggers the decomposition of the solid solution with non-equimolar composition at high temperatures, inducing strengthening due to the coherency stress of a spinodally modulated structure, combined with the lattice resistance of the product solid solution phase. In stark contrast, the strength of equimolar systems, boasting diverse chemical compositions, declines as a function of temperature due to the weakening of the lattice resistance and the absence of other strengthening mechanisms.


title: Characteristics of gamma-ray burst afterglows in the context of non-axisymmetric structured jets

abstract: As the most energetic explosions in the Universe, gamma-ray bursts (GRBs) are commonly believed to be generated by relativistic jets. Recent observational evidence suggests that the jets producing GRBs are likely to have a structured nature. Some studies have suggested that non-axisymmetric structured jets may be formed through internal non-uniform magnetic dissipation processes or the precession of the central engine. In this study, we analyze the potential characteristics of GRB afterglows within the framework of non-axisymmetric structured jets. We simplify the profile of the asymmetric jet as a step function of the azimuth angle, dividing the entire jet into individual elements. By considering specific cases, we demonstrate that the velocity, energy, and line-of-sight direction of each jet element can greatly affect the behaviour of the overall light curve. The radiative contributions from multiple elements may lead to the appearance of multiple distinct peaks or plateaus in the light curve. Furthermore, fluctuations in the rising and declining segments of each peak can be observed. These findings establish a theoretical foundation for future investigations into the structural characteristics of GRBs by leveraging GRB afterglow data.


title: Ontologies for Models and Algorithms in Applied Mathematics and Related Disciplines

abstract: In applied mathematics and related disciplines, the modeling-simulation-optimization workflow is a prominent scheme, with mathematical models and numerical algorithms playing a crucial role. For these types of mathematical research data, the Mathematical Research Data Initiative has developed, merged and implemented ontologies and knowledge graphs. This contributes to making mathematical research data FAIR by introducing semantic technology and documenting the mathematical foundations accordingly. Using the concrete example of microfracture analysis of porous media, it is shown how the knowledge of the underlying mathematical model and the corresponding numerical algorithms for its solution can be represented by the ontologies.


title: Analyzing the Impact of Companies on AI Research Based on Publications

abstract: Artificial Intelligence (AI) is one of the most momentous technologies of our time. Thus, it is of major importance to know which stakeholders influence AI research. Besides researchers at universities and colleges, researchers in companies have hardly been considered in this context. In this article, we consider how the influence of companies on AI research can be made measurable on the basis of scientific publishing activities. We compare academic- and company-authored AI publications published in the last decade and use scientometric data from multiple scholarly databases to look for differences across these groups and to disclose the top contributing organizations. While the vast majority of publications is still produced by academia, we find that the citation count an individual publication receives is significantly higher when it is (co-)authored by a company. Furthermore, using a variety of altmetric indicators, we notice that publications with company participation receive considerably more attention online. Finally, we place our analysis results in a broader context and present targeted recommendations to safeguard a harmonious balance between academia and industry in the realm of AI research.


title: Harnessing collective radiative phenomena on a photonic kagome lattice

abstract: Photonic lattices enable experimental exploration of transport and localization phenomena, two of the mayor goals in physics and technology. In particular, the optical excitation of some lattice sites which evanescently couple to a lattice array emulates radiation processes into structured reservoirs, a fundamental subject in quantum optics. Moreover, the simultaneous excitation of two sites simulates collective phenomena, leading to phase-controlled enhanced or suppressed radiation, namely super and subradiance. This work presents an experimental study of collective radiative processes on a photonic kagome lattice. A single or simultaneous -- in or out-of-phase -- excitation of the outlying sites controls the radiation dynamics. Specifically, we demonstrate a controlable transition between a fully localized profile at the two outlying sites and a completely dispersed state into the quasi-continuum. Our result presents photonic lattices as a platform to emulate and experimentally explore quantum optical phenomena in two-dimensional structured reservoirs, while harnessing such phenomena for controlling transport dynamics and implementing all-optical switching devices.


title: LAVSS: Location-Guided Audio-Visual Spatial Audio Separation

abstract: Existing machine learning research has achieved promising results in monaural audio-visual separation (MAVS). However, most MAVS methods purely consider what the sound source is, not where it is located. This can be a problem in VR/AR scenarios, where listeners need to be able to distinguish between similar audio sources located in different directions. To address this limitation, we have generalized MAVS to spatial audio separation and proposed LAVSS: a location-guided audio-visual spatial audio separator. LAVSS is inspired by the correlation between spatial audio and visual location. We introduce the phase difference carried by binaural audio as spatial cues, and we utilize positional representations of sounding objects as additional modality guidance. We also leverage multi-level cross-modal attention to perform visual-positional collaboration with audio features. In addition, we adopt a pre-trained monaural separator to transfer knowledge from rich mono sounds to boost spatial audio separation. This exploits the correlation between monaural and binaural channels. Experiments on the FAIR-Play dataset demonstrate the superiority of the proposed LAVSS over existing benchmarks of audio-visual separation. Our project page: https://yyx666660.github.io/LAVSS/.


title: Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks

abstract: Learning curve extrapolation aims to predict model performance in later epochs of training, based on the performance in earlier epochs. In this work, we argue that, while the inherent uncertainty in the extrapolation of learning curves warrants a Bayesian approach, existing methods are (i) overly restrictive, and/or (ii) computationally expensive. We describe the first application of prior-data fitted neural networks (PFNs) in this context. A PFN is a transformer, pre-trained on data generated from a prior, to perform approximate Bayesian inference in a single forward pass. We propose LC-PFN, a PFN trained to extrapolate 10 million artificial right-censored learning curves generated from a parametric prior proposed in prior art using MCMC. We demonstrate that LC-PFN can approximate the posterior predictive distribution more accurately than MCMC, while being over 10 000 times faster. We also show that the same LC-PFN achieves competitive performance extrapolating a total of 20 000 real learning curves from four learning curve benchmarks (LCBench, NAS-Bench-201, Taskset, and PD1) that stem from training a wide range of model architectures (MLPs, CNNs, RNNs, and Transformers) on 53 different datasets with varying input modalities (tabular, image, text, and protein data). Finally, we investigate its potential in the context of model selection and find that a simple LC-PFN based predictive early stopping criterion obtains 2 - 6x speed-ups on 45 of these datasets, at virtually no overhead.


title: A Survey on Federated Unlearning: Challenges, Methods, and Future Directions

abstract: In recent years, the notion of ``the right to be forgotten" (RTBF) has become a crucial aspect of data privacy, requiring the provision of mechanisms that support the removal of personal data of individuals upon their requests. Consequently, given the extensive adoption of data-intensive machine learning (ML) algorithms and increasing concerns for personal data privacy protection, the concept of machine unlearning (MU) has gained considerable attention. MU empowers an ML model to selectively eliminate identifiable information. Evolving from the foundational principles of MU, federated unlearning (FU) has emerged to confront the challenge of data erasure within federated learning (FL) settings. This empowers the FL model to unlearn an FL client or identifiable information pertaining to the client. Nevertheless, unlike traditional MU, the distinctive attributes of federated learning introduce specific challenges for FU techniques. These challenges necessitate a tailored design when developing FU algorithms. While various concepts and numerous federated unlearning schemes exist in this field, the unified workflow and tailored design of FU are not yet well understood. Therefore, this comprehensive survey delves into the techniques, methodologies, and recent advancements in federated unlearning. It provides an overview of fundamental concepts and principles, evaluates existing federated unlearning algorithms, and reviews optimizations tailored to federated learning. Additionally, it discusses practical applications and assesses their limitations. Finally, it outlines promising directions for future research.


title: Long strings of consecutive composite values of polynomials

abstract: We show that for any polynomial $f$ from the integers to the integers, with positive leading coefficient and irreducible over the rationals, if $x$ is large enough then there is a string of $(\log x)(\log\log x)^{1/835}$ consecutive integers $n \in [1,x]$ for which $f(n)$ is composite. This improves a result of the first author, Konyagin, Maynard, Pomerance and Tao, which states that there are such strings of length $(\log x)(\log\log x)^{c_f}$, where $c_f$ depends on $f$ and $c_f$ is exponentially small in the degree of $f$ for some polynomials.


title: Safe Testing for Large-Scale Experimentation Platforms

abstract: In the past two decades, AB testing has proliferated to optimise products in digital domains. Traditional AB tests use fixed-horizon testing, determining the sample size of the experiment and continuing until the experiment has concluded. However, due to the feedback provided by modern data infrastructure, experimenters may take incorrect decisions based on preliminary results of the test. For this reason, anytime-valid inference (AVI) is seeing increased adoption as the modern experimenters method for rapid decision making in the world of data streaming. This work focuses on Safe Testing, a novel framework for experimentation that enables continuous analysis without elevating the risk of incorrect conclusions. There exist safe testing equivalents of many common statistical tests, including the z-test, the t-test, and the proportion test. We compare the efficacy of safe tests against classical tests and another method for AVI, the mixture sequential probability ratio test (mSPRT). Comparisons are conducted first on simulation and then by real-world data from a large technology company, Vinted, a large European online marketplace for second-hand clothing. Our findings indicate that safe tests require fewer samples to detect significant effects, encouraging its potential for broader adoption.


title: Liouvillian integrability of three dimensional vector fields

abstract: We consider a three dimensional complex polynomial, or rational, vector field (equivalently, a two-form in three variables) which admits a Liouvillian first integral. We prove that there exists a first integral whose differential is the product of a rational 1-form with a Darboux function, or there exists a Darboux Jacobi multiplier. Moreover, we prove that Liouvillian integrability always implies the existence of a first integral that is obtained by two successive integrations from a one-forms with coefficients in a finite algebraic extension of the rational function field.


title: AsGrad: A Sharp Unified Analysis of Asynchronous-SGD Algorithms

abstract: We analyze asynchronous-type algorithms for distributed SGD in the heterogeneous setting, where each worker has its own computation and communication speeds, as well as data distribution. In these algorithms, workers compute possibly stale and stochastic gradients associated with their local data at some iteration back in history and then return those gradients to the server without synchronizing with other workers. We present a unified convergence theory for non-convex smooth functions in the heterogeneous regime. The proposed analysis provides convergence for pure asynchronous SGD and its various modifications. Moreover, our theory explains what affects the convergence rate and what can be done to improve the performance of asynchronous algorithms. In particular, we introduce a novel asynchronous method based on worker shuffling. As a by-product of our analysis, we also demonstrate convergence guarantees for gradient-type algorithms such as SGD with random reshuffling and shuffle-once mini-batch SGD. The derived rates match the best-known results for those algorithms, highlighting the tightness of our approach. Finally, our numerical evaluations support theoretical findings and show the good practical performance of our method.


title: Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion

abstract: Sequential recommendation aims to recommend the next item that matches a user's interest, based on the sequence of items he/she interacted with before. Scrutinizing previous studies, we can summarize a common learning-to-classify paradigm -- given a positive item, a recommender model performs negative sampling to add negative items and learns to classify whether the user prefers them or not, based on his/her historical interaction sequence. Although effective, we reveal two inherent limitations:(1) it may differ from human behavior in that a user could imagine an oracle item in mind and select potential items matching the oracle; and (2) the classification is limited in the candidate pool with noisy or easy supervision from negative samples, which dilutes the preference signals towards the oracle item. Yet, generating the oracle item from the historical interaction sequence is mostly unexplored. To bridge the gap, we reshape sequential recommendation as a learning-to-generate paradigm, which is achieved via a guided diffusion model, termed DreamRec.Specifically, for a sequence of historical items, it applies a Transformer encoder to create guidance representations. Noising target items explores the underlying distribution of item space; then, with the guidance of historical interactions, the denoising process generates an oracle item to recover the positive item, so as to cast off negative sampling and depict the true preference of the user directly. We evaluate the effectiveness of DreamRec through extensive experiments and comparisons with existing methods. Codes and data are open-sourced at https://github.com/YangZhengyi98/DreamRec.


title: Supernovae Origin for the Low-Latitude-Intermediate-Velocity Arch and the North-Celestial-Pole Loop

abstract: Supernova explosions attributed to the unseen companion in several binary systems identified by the Third Gaia Data Release (Gaia DR3) may be responsible for a number of well-known and well-studied features in the radio sky, including the Low-Latitude-Intermediate-Velocity Arch and the North-Celestial-Pole Loop. Slices from the Longitude-Latitude-Velocity data cube of the $\lambda$-21-cm galactic neutral hydrogen HI4PI survey (HI4PI Collaboration et al. 2016) show multiple signatures of an expanding shell. The source of this expansion, which includes the Low-Latitude-Intermediate-Velocity Arch on the approaching side, may be the neutron star candidate in the Gaia DR3 1093757200530267520 binary. If we make the simplifying assumptions that the expansion of the cavity is uniform and spherically symmetric, then the explosion took place about 700,000 years ago. The momentum is in reasonable agreement with recent model estimates for a supernova this old. The HI on the receding side of this cavity is interacting with the gas approaching us on the near side of a second cavity. The North-Celestial-Pole Loop appears to be located at the intersection of these two expanding features. The neutron star candidate in the Gaia DR3 1144019690966028928 binary may be (in part) responsible for this cavity. Explosions from other candidates may account for the observed elongation along the line of sight of this second cavity. We can use the primary star in these binaries to anchor the distances to the Low-Latitude-Intermediate-Velocity Arch and North-Celestial-Pole Loop, which are about 167 and about 220 pc, respectively.


title: Simple cuspidal representations of symplectic groups: Langlands parameter

abstract: Let $F$ be a non-archimedean local field of odd residual characteristic. We compute the Jordan set of a simple cuspidal representation of a symplectic group over $F$, using explicit computations of generators of the Hecke algebras of covers reflecting the parabolic induction under study. When $F$ is a $p$-adic field we obtain the Langlands parameter of the representation.


title: Towards a Deep Understanding of Multilingual End-to-End Speech Translation

abstract: In this paper, we employ Singular Value Canonical Correlation Analysis (SVCCA) to analyze representations learnt in a multilingual end-to-end speech translation model trained over 22 languages. SVCCA enables us to estimate representational similarity across languages and layers, enhancing our understanding of the functionality of multilingual speech translation and its potential connection to multilingual neural machine translation. The multilingual speech translation model is trained on the CoVoST 2 dataset in all possible directions, and we utilize LASER to extract parallel bitext data for SVCCA analysis. We derive three major findings from our analysis: (I) Linguistic similarity loses its efficacy in multilingual speech translation when the training data for a specific language is limited. (II) Enhanced encoder representations and well-aligned audio-text data significantly improve translation quality, surpassing the bilingual counterparts when the training data is not compromised. (III) The encoder representations of multilingual speech translation demonstrate superior performance in predicting phonetic features in linguistic typology prediction. With these findings, we propose that releasing the constraint of limited data for low-resource languages and subsequently combining them with linguistically related high-resource languages could offer a more effective approach for multilingual end-to-end speech translation.


title: FlexTrain: A Dynamic Training Framework for Heterogeneous Devices Environments

abstract: As deep learning models become increasingly large, they pose significant challenges in heterogeneous devices environments. The size of deep learning models makes it difficult to deploy them on low-power or resource-constrained devices, leading to long inference times and high energy consumption. To address these challenges, we propose FlexTrain, a framework that accommodates the diverse storage and computational resources available on different devices during the training phase. FlexTrain enables efficient deployment of deep learning models, while respecting device constraints, minimizing communication costs, and ensuring seamless integration with diverse devices. We demonstrate the effectiveness of FlexTrain on the CIFAR-100 dataset, where a single global model trained with FlexTrain can be easily deployed on heterogeneous devices, saving training time and energy consumption. We also extend FlexTrain to the federated learning setting, showing that our approach outperforms standard federated learning benchmarks on both CIFAR-10 and CIFAR-100 datasets.


title: Machine learning detects terminal singularities

abstract: Algebraic varieties are the geometric shapes defined by systems of polynomial equations; they are ubiquitous across mathematics and science. Amongst these algebraic varieties are Q-Fano varieties: positively curved shapes which have Q-factorial terminal singularities. Q-Fano varieties are of fundamental importance in geometry as they are "atomic pieces" of more complex shapes - the process of breaking a shape into simpler pieces in this sense is called the Minimal Model Programme. Despite their importance, the classification of Q-Fano varieties remains unknown. In this paper we demonstrate that machine learning can be used to understand this classification. We focus on 8-dimensional positively-curved algebraic varieties that have toric symmetry and Picard rank 2, and develop a neural network classifier that predicts with 95% accuracy whether or not such an algebraic variety is Q-Fano. We use this to give a first sketch of the landscape of Q-Fanos in dimension 8. How the neural network is able to detect Q-Fano varieties with such accuracy remains mysterious, and hints at some deep mathematical theory waiting to be uncovered. Furthermore, when visualised using the quantum period, an invariant that has played an important role in recent theoretical developments, we observe that the classification as revealed by ML appears to fall within a bounded region, and is stratified by the Fano index. This suggests that it may be possible to state and prove conjectures on completeness in the future. Inspired by the ML analysis, we formulate and prove a new global combinatorial criterion for a positively curved toric variety of Picard rank 2 to have terminal singularities. Together with the first sketch of the landscape of Q-Fanos in higher dimensions, this gives new evidence that machine learning can be an essential tool in developing mathematical conjectures and accelerating theoretical discovery.


title: Soliton equations: admitted solutions and invariances via B\"acklund transformations

abstract: A couple of applications of B\"acklund transformations in the study of nonlinear evolution equations is here given. Specifically, we are concerned about third order nonlinear evolution equations. Our attention is focussed on one side, on proving a new invariance admitted by a third order nonlinear evolution equation and, on the other one, on the construction of solutions. Indeed, via B\"acklund transformations, a {\it B\"acklund chart}, connecting Abelian as well as non Abelian equations can be constructed. The importance of such a net of links is twofold since it indicates invariances as well as allows to construct solutions admitted by the nonlinear evolution equations it relates. The present study refers to third order nonlinear evolution equations of KdV type. On the basis of the Abelian wide B\"acklund chart which connects various different third order nonlinear evolution equations an invariance admitted by the {\it Korteweg-deVries interacting soliton} (int.sol.KdV) equation is obtained and a related new explicit solution is constructed. Then, the corresponding non-Abelian {\it B\"acklund chart}, shows how to construct matrix solutions of the mKdV equations: some recently obtained solutions are reconsidered.


title: Aggregating Dependent Signals with Heavy-Tailed Combination Tests

abstract: Combining dependent p-values to evaluate the global null hypothesis presents a longstanding challenge in statistical inference, particularly when aggregating results from diverse methods to boost signal detection. P-value combination tests using heavy-tailed distribution based transformations, such as the Cauchy combination test and the harmonic mean p-value, have recently garnered significant interest for their potential to efficiently handle arbitrary p-value dependencies. Despite their growing popularity in practical applications, there is a gap in comprehensive theoretical and empirical evaluations of these methods. This paper conducts an extensive investigation, revealing that, theoretically, while these combination tests are asymptotically valid for pairwise quasi-asymptotically independent test statistics, such as bivariate normal variables, they are also asymptotically equivalent to the Bonferroni test under the same conditions. However, extensive simulations unveil their practical utility, especially in scenarios where stringent type-I error control is not necessary and signals are dense. Both the heaviness of the distribution and its support substantially impact the tests' non-asymptotic validity and power, and we recommend using a truncated Cauchy distribution in practice. Moreover, we show that under the violation of quasi-asymptotic independence among test statistics, these tests remain valid and, in fact, can be considerably less conservative than the Bonferroni test. We also present two case studies in genetics and genomics, showcasing the potential of the combination tests to significantly enhance statistical power while effectively controlling type-I errors.


title: Ramsey numbers of bounded degree trees versus general graphs

abstract: For every $k\ge 2$ and $\Delta$, we prove that there exists a constant $C_{\Delta,k}$ such that the following holds. For every graph $H$ with $\chi(H)=k$ and every tree with at least $C_{\Delta,k}|H|$ vertices and maximum degree at most $\Delta$, the Ramsey number $R(T,H)$ is $(k-1)(|T|-1)+\sigma(H)$, where $\sigma(H)$ is the size of a smallest colour class across all proper $k$-colourings of $H$. This is tight up to the value of $C_{\Delta,k}$, and confirms a conjecture of Balla, Pokrovskiy, and Sudakov.


title: Anti-van der Waerden Numbers of Graph Products with Trees

abstract: Given a graph $G$, an exact $r$-coloring of $G$ is a surjective function $c:V(G) \to [1,\dots,r]$. An arithmetic progression in $G$ of length $j$ with common difference $d$ is a set of vertices $\{v_1,\dots, v_j\}$ such that $dist(v_i,v_{i+1}) = d$ for $1\le i < j$. An arithmetic progression is rainbow if all of the vertices are colored distinctly. The fewest number of colors that guarantees a rainbow arithmetic progression of length three is called the anti-van der Waerden number of $G$ and is denoted $aw(G,3)$. It is known that $3 \le aw(G\square H,3) \le 4$. Here we determine exact values $aw(T\square T',3)$ for some trees $T$ and $T'$, determine $aw(G\square T,3)$ for some trees $T$, and determine $aw(G\square H,3)$ for some graphs $G$ and $H$.


title: Interpretable Neural PDE Solvers using Symbolic Frameworks

abstract: Partial differential equations (PDEs) are ubiquitous in the world around us, modelling phenomena from heat and sound to quantum systems. Recent advances in deep learning have resulted in the development of powerful neural solvers; however, while these methods have demonstrated state-of-the-art performance in both accuracy and computational efficiency, a significant challenge remains in their interpretability. Most existing methodologies prioritize predictive accuracy over clarity in the underlying mechanisms driving the model's decisions. Interpretability is crucial for trustworthiness and broader applicability, especially in scientific and engineering domains where neural PDE solvers might see the most impact. In this context, a notable gap in current research is the integration of symbolic frameworks (such as symbolic regression) into these solvers. Symbolic frameworks have the potential to distill complex neural operations into human-readable mathematical expressions, bridging the divide between black-box predictions and solutions.


title: Inducing Stratification of Colloidal Mixtures with a Mixed Binary Solvent

abstract: Molecular dynamics simulations are used to demonstrate that a binary solvent can be used to stratify colloidal mixtures when the suspension is rapidly dried. The solvent consists of two components, one more volatile than the other. When evaporated at high rates, the more volatile component becomes depleted near the evaporation front and develops a negative concentration gradient from the bulk of the mixture to the liquid-vapor interface while the less volatile solvent is enriched in the same region and exhibit a positive concentration gradient. Such gradients can be used to drive a binary mixture of colloidal particles to stratify if one is preferentially attracted to the more volatile solvent and the other to the less volatile solvent. During solvent evaporation, the fraction of colloidal particles preferentially attracted to the less volatile solvent is enhanced at the evaporation front, whereas the colloidal particles having stronger attractions with the more volatile solvent are driven away from the interfacial region. As a result, the colloidal particles show a stratified distribution after drying, even if the two colloids have the same size.


title: Intercellular Friction and Motility Drive Orientational Order in Cell Monolayers

abstract: Spatiotemporal patterns in multicellular systems are important to understanding tissue dynamics, for instance, during embryonic development and disease. Here, we use a multiphase field model to study numerically the behavior of a near-confluent monolayer of deformable cells with intercellular friction. Varying friction and cell motility drives a solid-liquid transition, and near the transition boundary, we find the emergence of nematic order of cell deformation driven by shear-aligning cellular flows. Intercellular friction endows the monolayer with a finite viscosity, which significantly increases the spatial correlation in the flow and, concomitantly, the extent of nematic order. We also show that hexatic and nematic order are tightly coupled and propose a mechanical-geometric model for the colocalization of +1/2 nematic defects and 5-7 disclination pairs, which are the structural defects in the hexatic phase. Such topological defects coincide with regions of high cell-cell overlap, suggesting that they may mediate cellular extrusion from the monolayer, as found experimentally. Our results delineate a mechanical basis for the recent observation of nematic and hexatic order in multicellular collectives in experiments and simulations and pinpoint a generic pathway to couple topological and physical effects in these systems.


title: Quantum DNA Sequencing using Gaussian Amplitude Amplification

abstract: In this study, we explore how quantum pathfinding algorithm called Gaussian Amplitude Amplification (GAA) can be used to solve the DNA sequencing problem. To do this, sequencing by hybridization was assumed wherein short fragments of the nucleic acids called oligonucleotides of length l were gathered and were then assembled. The process of reassembling the sequence was then abstracted into a graph problem of finding the Hamiltonian path with the least cost. The constructed directed graph was then converted into sequential bipartite graphs in order to use GAA. The results of our simulation revealed that for the case where l = 2 and spectrum size of |S| = 4, the probability of finding the optimal solution (with the least cost) is approximately 70.92% - a significant improvement compared to 4.17% when the path is chosen randomly. While this study only focused on the ideal scenario where there are no errors in the spectrum, the outcomes presented here demonstrate the plausibility of using GAA as a genome sequencing method.


title: ACL Anthology Helper: A Tool to Retrieve and Manage Literature from ACL Anthology

abstract: The ACL Anthology is an online repository that serves as a comprehensive collection of publications in the field of natural language processing (NLP) and computational linguistics (CL). This paper presents a tool called ``ACL Anthology Helper''. It automates the process of parsing and downloading papers along with their meta-information, which are then stored in a local MySQL database. This allows for efficient management of the local papers using a wide range of operations, including "where," "group," "order," and more. By providing over 20 operations, this tool significantly enhances the retrieval of literature based on specific conditions. Notably, this tool has been successfully utilised in writing a survey paper (Tang et al.,2022a). By introducing the ACL Anthology Helper, we aim to enhance researchers' ability to effectively access and organise literature from the ACL Anthology. This tool offers a convenient solution for researchers seeking to explore the ACL Anthology's vast collection of publications while allowing for more targeted and efficient literature retrieval.


title: An Introduction to Causal Inference Methods for Observational Human-Robot Interaction Research

abstract: Quantitative methods in Human-Robot Interaction (HRI) research have primarily relied upon randomized, controlled experiments in laboratory settings. However, such experiments are not always feasible when external validity, ethical constraints, and ease of data collection are of concern. Furthermore, as consumer robots become increasingly available, increasing amounts of real-world data will be available to HRI researchers, which prompts the need for quantative approaches tailored to the analysis of observational data. In this article, we present an alternate approach towards quantitative research for HRI researchers using methods from causal inference that can enable researchers to identify causal relationships in observational settings where randomized, controlled experiments cannot be run. We highlight different scenarios that HRI research with consumer household robots may involve to contextualize how methods from causal inference can be applied to observational HRI research. We then provide a tutorial summarizing key concepts from causal inference using a graphical model perspective and link to code examples throughout the article, which are available at https://gitlab.com/causal/causal_hri. Our work paves the way for further discussion on new approaches towards observational HRI research while providing a starting point for HRI researchers to add causal inference techniques to their analytical toolbox.


title: Amoeba: Circumventing ML-supported Network Censorship via Adversarial Reinforcement Learning

abstract: Embedding covert streams into a cover channel is a common approach to circumventing Internet censorship, due to censors' inability to examine encrypted information in otherwise permitted protocols (Skype, HTTPS, etc.). However, recent advances in machine learning (ML) enable detecting a range of anti-censorship systems by learning distinct statistical patterns hidden in traffic flows. Therefore, designing obfuscation solutions able to generate traffic that is statistically similar to innocuous network activity, in order to deceive ML-based classifiers at line speed, is difficult. In this paper, we formulate a practical adversarial attack strategy against flow classifiers as a method for circumventing censorship. Specifically, we cast the problem of finding adversarial flows that will be misclassified as a sequence generation task, which we solve with Amoeba, a novel reinforcement learning algorithm that we design. Amoeba works by interacting with censoring classifiers without any knowledge of their model structure, but by crafting packets and observing the classifiers' decisions, in order to guide the sequence generation process. Our experiments using data collected from two popular anti-censorship systems demonstrate that Amoeba can effectively shape adversarial flows that have on average 94% attack success rate against a range of ML algorithms. In addition, we show that these adversarial flows are robust in different network environments and possess transferability across various ML models, meaning that once trained against one, our agent can subvert other censoring classifiers without retraining.


title: Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation

abstract: Multilingualism is widespread around the world and code-switching (CSW) is a common practice among different language pairs/tuples across locations and regions. However, there is still not much progress in building successful CSW systems, despite the recent advances in Massive Multilingual Language Models (MMLMs). We investigate the reasons behind this setback through a critical study about the existing CSW data sets (68) across language pairs in terms of the collection and preparation (e.g. transcription and annotation) stages. This in-depth analysis reveals that \textbf{a)} most CSW data involves English ignoring other language pairs/tuples \textbf{b)} there are flaws in terms of representativeness in data collection and preparation stages due to ignoring the location based, socio-demographic and register variation in CSW. In addition, lack of clarity on the data selection and filtering stages shadow the representativeness of CSW data sets. We conclude by providing a short check-list to improve the representativeness for forthcoming studies involving CSW data collection and preparation.


title: Measure-dependent non-linear diffusions with superlinear drifts: asymptotic behaviour of the first exit-times

abstract: In this paper, we study McKean-Vlasov SDE living in $\mathbb{R}^d$ in the reversible case without assuming any type of convexity assumptions for confinement or interaction potentials. Kramers' type law for the exit-time from a domain of attraction is established. Namely, in the small-noise regime, the limit in probability of the first exit-time behaves exponentially. This result is established using the large deviations principle as well as improved coupling method. Having removed the convexity assumption, this work is a major improvement of the previously known results for the exit-time problem, the review of which is provided in the paper.


title: Direct detection of dark matter: a critical review

abstract: The nature of the dark matter in the Universe is one of the hardest unsolved problems in modern physics. Indeed, on one hand, the overwhelming indirect evidence from astrophysics seems to leave no doubt about its existence; on the other hand, direct search experiments, especially those conducted with low background detectors in underground laboratories all over the world seem to deliver only null results, with a few debated exceptions. Furthermore, the lack of predicted candidates at the LHC energy scale has made this dichotomy even more puzzling. We will recall the most important phases of this novel branch of experimental astro-particle physics, analyzing the interconnections among the main projects involved in this challenging quest, and we will draw conclusions slightly different from how the problem is commonly understood.


title: Improved Roundtrip Spanners, Emulators, and Directed Girth Approximation

abstract: Roundtrip spanners are the analog of spanners in directed graphs, where the roundtrip metric is used as a notion of distance. Recent works have shown existential results of roundtrip spanners nearly matching the undirected case, but the time complexity for constructing roundtrip spanners is still widely open. This paper focuses on developing fast algorithms for roundtrip spanners and related problems. For any $n$-vertex directed graph $G$ with $m$ edges (with non-negative edge weights), our results are as follows: - 3-roundtrip spanner faster than APSP: We give an $\tilde{O}(m\sqrt{n})$-time algorithm that constructs a roundtrip spanner of stretch $3$ and optimal size $O(n^{3/2})$. Previous constructions of roundtrip spanners of the same size either required $\Omega(nm)$ time [Roditty, Thorup, Zwick SODA'02; Cen, Duan, Gu ICALP'20], or had worse stretch $4$ [Chechik and Lifshitz SODA'21]. - Optimal roundtrip emulator in dense graphs: For integer $k\ge 3$, we give an $O(kn^2\log n)$-time algorithm that constructs a roundtrip \emph{emulator} of stretch $(2k-1)$ and size $O(kn^{1+1/k})$, which is optimal for constant $k$ under Erd\H{o}s' girth conjecture. Previous work of [Thorup and Zwick STOC'01] implied a roundtrip emulator of the same size and stretch, but it required $\Omega(nm)$ construction time. Our improved running time is near-optimal for dense graphs. - Faster girth approximation in sparse graphs: We give an $\tilde{O}(mn^{1/3})$-time algorithm that $4$-approximates the girth of a directed graph. This can be compared with the previous $2$-approximation algorithm in $\tilde{O}(n^2, m\sqrt{n})$ time by [Chechik and Lifshitz SODA'21]. In sparse graphs, our algorithm achieves better running time at the cost of a larger approximation ratio.


title: Critical Role of Artificially Intelligent Conversational Chatbot

abstract: Artificially intelligent chatbot, such as ChatGPT, represents a recent and powerful advancement in the AI domain. Users prefer them for obtaining quick and precise answers, avoiding the usual hassle of clicking through multiple links in traditional searches. ChatGPT's conversational approach makes it comfortable and accessible for finding answers quickly and in an organized manner. However, it is important to note that these chatbots have limitations, especially in terms of providing accurate answers as well as ethical concerns. In this study, we explore various scenarios involving ChatGPT's ethical implications within academic contexts, its limitations, and the potential misuse by specific user groups. To address these challenges, we propose architectural solutions aimed at preventing inappropriate use and promoting responsible AI interactions.


title: Linked Papers With Code: The Latest in Machine Learning as an RDF Knowledge Graph

abstract: In this paper, we introduce Linked Papers With Code (LPWC), an RDF knowledge graph that provides comprehensive, current information about almost 400,000 machine learning publications. This includes the tasks addressed, the datasets utilized, the methods implemented, and the evaluations conducted, along with their results. Compared to its non-RDF-based counterpart Papers With Code, LPWC not only translates the latest advancements in machine learning into RDF format, but also enables novel ways for scientific impact quantification and scholarly key content recommendation. LPWC is openly accessible at https://linkedpaperswithcode.com and is licensed under CC-BY-SA 4.0. As a knowledge graph in the Linked Open Data cloud, we offer LPWC in multiple formats, from RDF dump files to a SPARQL endpoint for direct web queries, as well as a data source with resolvable URIs and links to the data sources SemOpenAlex, Wikidata, and DBLP. Additionally, we supply knowledge graph embeddings, enabling LPWC to be readily applied in machine learning applications.


title: Global Transformer Architecture for Indoor Room Temperature Forecasting

abstract: A thorough regulation of building energy systems translates in relevant energy savings and in a better comfort for the occupants. Algorithms to predict the thermal state of a building on a certain time horizon with a good confidence are essential for the implementation of effective control systems. This work presents a global Transformer architecture for indoor temperature forecasting in multi-room buildings, aiming at optimizing energy consumption and reducing greenhouse gas emissions associated with HVAC systems. Recent advancements in deep learning have enabled the development of more sophisticated forecasting models compared to traditional feedback control systems. The proposed global Transformer architecture can be trained on the entire dataset encompassing all rooms, eliminating the need for multiple room-specific models, significantly improving predictive performance, and simplifying deployment and maintenance. Notably, this study is the first to apply a Transformer architecture for indoor temperature forecasting in multi-room buildings. The proposed approach provides a novel solution to enhance the accuracy and efficiency of temperature forecasting, serving as a valuable tool to optimize energy consumption and decrease greenhouse gas emissions in the building sector.


title: Exploring Practitioner Perspectives On Training Data Attribution Explanations

abstract: Explainable AI (XAI) aims to provide insight into opaque model reasoning to humans and as such is an interdisciplinary field by nature. In this paper, we interviewed 10 practitioners to understand the possible usability of training data attribution (TDA) explanations and to explore the design space of such an approach. We confirmed that training data quality is often the most important factor for high model performance in practice and model developers mainly rely on their own experience to curate data. End-users expect explanations to enhance their interaction with the model and do not necessarily prioritise but are open to training data as a means of explanation. Within our participants, we found that TDA explanations are not well-known and therefore not used. We urge the community to focus on the utility of TDA techniques from the human-machine collaboration perspective and broaden the TDA evaluation to reflect common use cases in practice.


title: Unveiling Black-boxes: Explainable Deep Learning Models for Patent Classification

abstract: Recent technological advancements have led to a large number of patents in a diverse range of domains, making it challenging for human experts to analyze and manage. State-of-the-art methods for multi-label patent classification rely on deep neural networks (DNNs), which are complex and often considered black-boxes due to their opaque decision-making processes. In this paper, we propose a novel deep explainable patent classification framework by introducing layer-wise relevance propagation (LRP) to provide human-understandable explanations for predictions. We train several DNN models, including Bi-LSTM, CNN, and CNN-BiLSTM, and propagate the predictions backward from the output layer up to the input layer of the model to identify the relevance of words for individual predictions. Considering the relevance score, we then generate explanations by visualizing relevant words for the predicted patent class. Experimental results on two datasets comprising two-million patent texts demonstrate high performance in terms of various evaluation measures. The explanations generated for each prediction highlight important relevant words that align with the predicted class, making the prediction more understandable. Explainable systems have the potential to facilitate the adoption of complex AI-enabled methods for patent classification in real-world applications.


title: Multi-User MultiWOZ: Task-Oriented Dialogues among Multiple Users

abstract: While most task-oriented dialogues assume conversations between the agent and one user at a time, dialogue systems are increasingly expected to communicate with multiple users simultaneously who make decisions collaboratively. To facilitate development of such systems, we release the Multi-User MultiWOZ dataset: task-oriented dialogues among two users and one agent. To collect this dataset, each user utterance from MultiWOZ 2.2 was replaced with a small chat between two users that is semantically and pragmatically consistent with the original user utterance, thus resulting in the same dialogue state and system response. These dialogues reflect interesting dynamics of collaborative decision-making in task-oriented scenarios, e.g., social chatter and deliberation. Supported by this data, we propose the novel task of multi-user contextual query rewriting: to rewrite a task-oriented chat between two users as a concise task-oriented query that retains only task-relevant information and that is directly consumable by the dialogue system. We demonstrate that in multi-user dialogues, using predicted rewrites substantially improves dialogue state tracking without modifying existing dialogue systems that are trained for single-user dialogues. Further, this method surpasses training a medium-sized model directly on multi-user dialogues and generalizes to unseen domains.


title: Anomaly constraints for heterotic strings and supergravity in six dimensions

abstract: The landscape of six-dimensional supergravities is dramatically constrained by the cancellation of gauge and gravitational anomalies, but the full extent of its implications has not been uncovered. We explore the cancellation of global anomalies of the Dai-Freed type in this setting with abelian and simply laced gauge groups, finding novel constraints. In particular, we exclude arbitrarily large abelian charges in an infinite family of theories for certain types of quadratic refinements, including a specific one defined in the literature. We also show that the Gepner orientifold with no tensor multiplets is anomaly-free for a different choice, as well as a number of heterotic models with and without spacetime supersymmetry in six dimensions. The latter analysis extends previous results in ten dimensions to some lower-dimensional settings in the heterotic landscape.


title: Wolfes model aka $G_2/I_6$-rational integrable model: $g^{(2)}, g^{(3)}$ hidden algebras and quartic polynomial algebra of integrals

abstract: One-dimensional 3-body Wolfes model with 2- and 3-body interactions also known as $G_2/I_6$-rational integrable model of the Hamiltonian reduction is exactly-solvable and superintegrable. Its Hamiltonian $H$ and two integrals ${\cal I}_{1}, {\cal I}_{2}$, which can be written as algebraic differential operators in two variables (with polynomial coefficients) of the 2nd and 6th orders, respectively, are represented as non-linear combinations of $g^{(2)}$ or $g^{(3)}$ (hidden) algebra generators in a minimal manner. By using a specially designed MAPLE-18 code to deal with algebraic operators it is found that $(H, {\cal I}_1, {\cal I}_2, {\cal I}_{12} \equiv [{\cal I}_1, {\cal I}_2])$ are the four generating elements of the {\it quartic} polynomial algebra of integrals. This algebra is embedded into the universal enveloping algebra $g^{(3)}$. In turn, 3-body/$A_2$-rational Calogero model is characterized by cubic polynomial algebra of integrals, it is mentioned briefly.


title: Diameter of K\"ahler currents

abstract: We establish upper bounds on the diameter of compact K\"ahler manifolds endowed with K\"ahler metrics whose volume form satisfies an Orlicz integrability condition. Our results extend previous estimates due to Fu-Guo-Song, Y.Li, and Guo-Phong-Song-Sturm. In particular, they do not involve any constraint on the vanishing of the volume form. Moreover, we show that singular K\"ahler-Einstein currents have finite diameter, provided that their local potentials are H\"older continuous.


title: Measuring multidimensional heterogeneity in emergent social phenomena

abstract: Measuring inequalities in a multidimensional framework is a challenging problem which is common to most field of science and engineering. Nevertheless, despite the enormous amount of researches illustrating the fields of application of inequality indices, and of the Gini index in particular, very few consider the case of a multidimensional variable. In this paper, we consider in some details a new inequality index, based on the Fourier transform, that can be fruitfully applied to measure the degree of inhomogeneity of multivariate probability distributions. This index exhibits a number of interesting properties that make it very promising in quantifying the degree of inequality in data sets of complex and multifaceted social phenomena.


title: On the Long-time Dynamics and Ergodicity of the Stochastic Nernst-Planck-Navier-Stokes System

abstract: We consider an electrodiffusion model that describes the intricate interplay of multiple ionic species with a two-dimensional, incompressible, viscous fluid subjected to stochastic additive noise. This system involves nonlocal nonlinear drift-diffusion Nernst-Planck equations for ionic species and stochastic Navier-Stokes equations for fluid motion under the influence of electric and time-independent forces. Under the selective boundary conditions imposed on the concentrations, we establish the existence and uniqueness of global pathwise solutions to this system on smooth bounded domains. Our study also investigates long-time ionic concentration dynamics and explores Feller properties of the associated Markovian semigroup. In the context of equal diffusive species and under appropriate conditions, we demonstrate the existence of invariant ergodic measures supported on $H^2$. We then enhance the ergodicity results on periodic tori and obtain smooth invariant measures under a constraint on the initial spatial averages of the concentrations. The uniqueness of the invariant measures on periodic boxes and smooth bounded domains is further established when the noise forces sufficient modes, and the diffusivities of the species are large. Finally, in the case of two ionic species with equal diffusivities and valences of $1$ and $-1$, we study the rate of convergence of the Markov transition kernels to the invariant measure and obtain unconditional, unique exponential ergodicity for the model.


title: Al$_3$Sc thin films for advanced interconnect applications

abstract: Al$_x$Sc$_{1-x}$ thin films have been studied with compositions around Al$_3$Sc ($x$ = 0.75) for potential interconnect metallization applications. As-deposited 25 nm thick films were x-ray amorphous but crystallized at 190{\deg}C, followed by recrystallization at 440{\deg}C. After annealing at 500{\deg}C, 24 nm thick stoichiometric Al$_3$Sc showed a resistivity of 12.6 $\mu\Omega$cm, limited by a combination of grain boundary and point defect (disorder) scattering. Together with ab initio calculations that found a mean free path of the charge carriers of 7 nm for stoichiometric Al$_3$Sc, these results indicate that Al$_3$Sc bears promise for future interconnect metallization schemes. Challenges remain in minimizing the formation of secondary phases as well as in the control of the non-stoichiometric surface oxidation and interfacial reactions with underlying dielectrics.


title: Optimal Binary Differential Privacy via Graphs

abstract: We present the notion of \emph{reasonable utility} for binary mechanisms, which applies to all utility functions in the literature. This notion induces a partial ordering on the performance of all binary differentially private (DP) mechanisms. DP mechanisms that are maximal elements of this ordering are optimal DP mechanisms for every reasonable utility. By looking at differential privacy as a randomized graph coloring, we characterize these optimal DP in terms of their behavior on a certain subset of the boundary datasets we call a boundary hitting set. In the process of establishing our results, we also introduce a useful notion that generalizes DP conditions for binary-valued queries, which we coin as suitable pairs. Suitable pairs abstract away the algebraic roles of $\varepsilon,\delta$ in the DP framework, making the derivations and understanding of our proofs simpler. Additionally, the notion of a suitable pair can potentially capture privacy conditions in frameworks other than DP and may be of independent interest.


title: Large Language Model Can Interpret Latent Space of Sequential Recommender

abstract: Sequential recommendation is to predict the next item of interest for a user, based on her/his interaction history with previous items. In conventional sequential recommenders, a common approach is to model item sequences using discrete IDs, learning representations that encode sequential behaviors and reflect user preferences. Inspired by recent success in empowering large language models (LLMs) to understand and reason over diverse modality data (e.g., image, audio, 3D points), a compelling research question arises: ``Can LLMs understand and work with hidden representations from ID-based sequential recommenders?''.To answer this, we propose a simple framework, RecInterpreter, which examines the capacity of open-source LLMs to decipher the representation space of sequential recommenders. Specifically, with the multimodal pairs (\ie representations of interaction sequence and text narrations), RecInterpreter first uses a lightweight adapter to map the representations into the token embedding space of the LLM. Subsequently, it constructs a sequence-recovery prompt that encourages the LLM to generate textual descriptions for items within the interaction sequence. Taking a step further, we propose a sequence-residual prompt instead, which guides the LLM in identifying the residual item by contrasting the representations before and after integrating this residual into the existing sequence. Empirical results showcase that our RecInterpreter enhances the exemplar LLM, LLaMA, to understand hidden representations from ID-based sequential recommenders, especially when guided by our sequence-residual prompts. Furthermore, RecInterpreter enables LLaMA to instantiate the oracle items generated by generative recommenders like DreamRec, concreting the item a user would ideally like to interact with next. Codes are available at https://github.com/YangZhengyi98/RecInterpreter.


title: NaijaCoder: Participatory Design for Early Algorithms Education in the Global South

abstract: The majority of Nigerian high schoolers have little to no exposure to the basics of algorithms and programming. We believe this trajectory should change as programming offers these students, especially those from indigent backgrounds, an opportunity to learn profitable skills and ignite their passions for problem-solving and critical thinking. NaijaCoder is an organization that is dedicated to organizing a free, intensive summer program in Nigeria to teach the basics of algorithms and computer programming to high schoolers. However, the adoption of computer science curriculum has been especially challenging in countries in the global south that face unique challenges -- such as unstable power supply, internet service, and price volatility. We design a curriculum that is more conducive to the local environment while incorporating rigorous thinking and preparation. Using basic survey designs, we elicit feedback, from the students, designed to further improve and iterate on our curriculum.


title: Northward Propagating Versus Non-propagating BSISO over South Asia: Horizontal Advection Driven Moisture Mode Within a Vertically Sheared Background

abstract: The Boreal Summer Intraseasonal Oscillation (BSISO) is a pronounced mode of tropical variability. Here, we identify two types of BSISO events, one which propagates northward over South Asia (SA) from the equatorial Indian Ocean (EIO), and the other which doesn't. Contrasting their behaviour shows that northward propagation occurs in multiple stages after convection is initiated over the EIO. First, convection moves into the southern Arabian Sea (AS) due to moistening of the free troposphere via horizontal BSISO anomalous winds acting on the background moisture distribution, and forms a northwest-southeast (NW-SE) oriented convection band. Subsequently, in the presence of an easterly vertical shear of monsoon winds and meridional gradient of anomalous vertical velocity, a NW-SE oriented tilting term is generated that results in a tilted gyre north of the existing convective anomaly and south-easterly BSISO winds over the South Asian landmass. In the second stage, these winds tap the ambient north-westward moisture gradient and help move convection further north over land. Moreover, background winds advect anomalous moisture to initiate convection over the Bay of Bengal. For non-propagating events, though a Rossby gyre results as a response to nascent EIO convection, it is smaller, thus BSISO advection of moisture is weaker and does not initiate convection over the southern AS. In turn, the meridional gradient of anomalous vertical velocity is weak, and the background vertical shear does not generate sufficient tilting over the northern AS. Thus, the convective wind response stalls, and large-scale convection does not propagate north of 15N. Thus, free-tropospheric moisture advection and vortex tilting due to the background vertical shear work together for robust northward propagation of the BSISO.


title: Long-Tailed Learning as Multi-Objective Optimization

abstract: Real-world data is extremely imbalanced and presents a long-tailed distribution, resulting in models that are biased towards classes with sufficient samples and perform poorly on rare classes. Recent methods propose to rebalance classes but they undertake the seesaw dilemma (what is increasing performance on tail classes may decrease that of head classes, and vice versa). In this paper, we argue that the seesaw dilemma is derived from gradient imbalance of different classes, in which gradients of inappropriate classes are set to important for updating, thus are prone to overcompensation or undercompensation on tail classes. To achieve ideal compensation, we formulate the long-tailed recognition as an multi-objective optimization problem, which fairly respects the contributions of head and tail classes simultaneously. For efficiency, we propose a Gradient-Balancing Grouping (GBG) strategy to gather the classes with similar gradient directions, thus approximately make every update under a Pareto descent direction. Our GBG method drives classes with similar gradient directions to form more representative gradient and provide ideal compensation to the tail classes. Moreover, We conduct extensive experiments on commonly used benchmarks in long-tailed learning and demonstrate the superiority of our method over existing SOTA methods.


title: Collaborative Decision-Making Using Spatiotemporal Graphs in Connected Autonomy

abstract: Collaborative decision-making is an essential capability for multi-robot systems, such as connected vehicles, to collaboratively control autonomous vehicles in accident-prone scenarios. Under limited communication bandwidth, capturing comprehensive situational awareness by integrating connected agents' observation is very challenging. In this paper, we propose a novel collaborative decision-making method that efficiently and effectively integrates collaborators' representations to control the ego vehicle in accident-prone scenarios. Our approach formulates collaborative decision-making as a classification problem. We first represent sequences of raw observations as spatiotemporal graphs, which significantly reduce the package size to share among connected vehicles. Then we design a novel spatiotemporal graph neural network based on heterogeneous graph learning, which analyzes spatial and temporal connections of objects in a unified way for collaborative decision-making. We evaluate our approach using a high-fidelity simulator that considers realistic traffic, communication bandwidth, and vehicle sensing among connected autonomous vehicles. The experimental results show that our representation achieves over 100x reduction in the shared data size that meets the requirements of communication bandwidth for connected autonomous driving. In addition, our approach achieves over 30% improvements in driving safety.


title: Log-based Anomaly Detection of Enterprise Software: An Empirical Study

abstract: Most enterprise applications use logging as a mechanism to diagnose anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical and deep neural network-based machine learning models. In recent years, the research has largely focused in using variations of sequence-based deep neural networks (e.g., Long-Short Term Memory and Transformer-based models) for log-based anomaly detection on open-source data. However, they have not been applied in industrial datasets, as often. In addition, the studied open-source datasets are typically very large in size with logging statements that do not change much over time, which may not be the case with a dataset from an industrial service that is relatively new. In this paper, we evaluate several state-of-the-art anomaly detection models on an industrial dataset from our research partner, which is much smaller and loosely structured than most large scale open-source benchmark datasets. Results show that while all models are capable of detecting anomalies, certain models are better suited for less-structured datasets. We also see that model effectiveness changes when a common data leak associated with a random train-test split in some prior work is removed. A qualitative study of the defects' characteristics identified by the developers on the industrial dataset further shows strengths and weaknesses of the models in detecting different types of anomalies. Finally, we explore the effect of limited training data by gradually increasing the training set size, to evaluate if the model effectiveness does depend on the training set size.


title: Requirement falsification for cyber-physical systems using generative models

abstract: We present the OGAN algorithm for automatic requirement falsification of cyber-physical systems. System inputs and output are represented as piecewise constant signals over time while requirements are expressed in signal temporal logic. OGAN can find inputs that are counterexamples for the safety of a system revealing design, software, or hardware defects before the system is taken into operation. The OGAN algorithm works by training a generative machine learning model to produce such counterexamples. It executes tests atomically and does not require any previous model of the system under test. We evaluate OGAN using the ARCH-COMP benchmark problems, and the experimental results show that generative models are a viable method for requirement falsification. OGAN can be applied to new systems with little effort, has few requirements for the system under test, and exhibits state-of-the-art CPS falsification efficiency and effectiveness.