title: Synthesizing Follow-Up Drive Data for Enhanced Road Safety in Intelligent Driving Function Systems

abstract: This study underscores the vital importance of intelligent driving functions in enhancing road safety and driving comfort. Central to our research is the challenge of obtaining sufficient test data for evaluating these functions, especially in high-risk, safety-critical driving scenarios. Such scenarios often suffer from a dearth of available data, primarily due to their inherent complexity and the risks involved. Addressing this gap, our research introduces a novel methodology designed to create a wide array of diverse and realistic safety-critical driving scenarios. This approach significantly broadens the testing spectrum for driver assistance systems and autonomous vehicle functions. We particularly focus on the follow-up drive scenario due to its high relevance in practical applications. Here, vehicle movements are intricately modeled using kinematic equations, incorporating factors like driver reaction times. We vary parameters to generate a spectrum of plausible driving scenarios. The utilization of the Difference Space Stopping (DSS) metric is a pivotal element in our research. This metric plays a crucial role in the safety evaluation of follow-up drives, facilitating a more thorough and comprehensive validation process. By doing so, our methodology enhances the reliability and safety assessment of driver assistance and autonomous driving systems, specifically tailored for the most challenging and safety-critical scenarios.


title: Modelling and cooling power control of a TES-backed-up vapour-compression refrigeration system

abstract: This work addresses the modelling, power control, and optimization of a thermal energy storage (TES) system combined with a vapour-compression refrigeration facility based on phase change materials (PCM). Given a novel design of a PCM-based TES tank and its interconnection with an existing refrigeration system, the joint dynamic modelling is first studied, exploring the different time scales that coexist at the interconnected system. Diverse operating modes are defined, according to the intended use of the TES tank as a cold-energy buffer to decouple cooling demand and production, whereas the static characteristic and power limits are calculated and show the high coupling between the main cooling powers involved (TES charging/discharging power, and direct power production at the evaporator). In this light, a decoupling control strategy is proposed, where the low-level controllers are simply PI regulators and the refrigerant/secondary mass flows are considered as virtual manipulated variables, applying a feedforward-based cascade strategy. The control performance is evaluated through a thorough simulation that includes all operating modes, where the reference tracking is shown to be fast and reliable enough to address high-level scheduling strategies, where the references on the main cooling powers are intended to be imposed considering economic and efficiency criteria.


title: Evading Deep Learning-Based Malware Detectors via Obfuscation: A Deep Reinforcement Learning Approach

abstract: Adversarial Malware Generation (AMG), the generation of adversarial malware variants to strengthen Deep Learning (DL)-based malware detectors has emerged as a crucial tool in the development of proactive cyberdefense. However, the majority of extant works offer subtle perturbations or additions to executable files and do not explore full-file obfuscation. In this study, we show that an open-source encryption tool coupled with a Reinforcement Learning (RL) framework can successfully obfuscate malware to evade state-of-the-art malware detection engines and outperform techniques that use advanced modification methods. Our results show that the proposed method improves the evasion rate from 27%-49% compared to widely-used state-of-the-art reinforcement learning-based methods.


title: Equivalence transformations and conservation laws for a generalized variable-coefficient Gardner equation

abstract: In this paper we study the generalized variable-coefficient Gardner equations of the form $u_t + A(t)u^n\,u_x+ C(t)\,u^{2n}u_x + B(t)\,u_{xxx} + Q(t)\,u =0$. This class broadens out many other equations previously considered: Johnpillai and Khalique (2010), Molati and Ramollo (2012) and Vaneeva, Kuriksha and Sophocleous (2015). Equivalence group of the class under consideration has been constructed which permit an exhaustive study and a simple and clear formulation of the results. Some conservation laws are derived for the nonlinearly self-adjoint equations, based on differential substitutions, and by using the direct method of the multipliers.


title: Models of High-Level Computation

abstract: Classical models of computation have been successful in capturing the very essence of individual computing devices. Although they are useful to understand computability power and limitations in the small, such models are not suitable to study large-scale complex computations. Accordingly, plenty of formalisms have been proposed in the last half century as an attempt to raise the level of abstraction, with the aim of describing not only a single computing device but interactions among a collection of them. In this paper, we encompass such formalisms into a common framework which we refer to as Models of High-Level Computation. We particularly discuss the semantics, some of the key properties, paradigms and future directions of such models.


title: A Review of Full-Sized Autonomous Racing Vehicle Sensor Architecture

abstract: In the landscape of technological innovation, autonomous racing is a dynamic and challenging domain that not only pushes the limits of technology, but also plays a crucial role in advancing and fostering a greater acceptance of autonomous systems. This paper thoroughly explores challenges and advances in autonomous racing vehicle design and performance, focusing on Roborace and the Indy Autonomous Challenge (IAC). This review provides a detailed analysis of sensor setups, architectural nuances, and test metrics on these cutting-edge platforms. In Roborace, the evolution from Devbot 1.0 to Robocar and Devbot 2.0 is detailed, revealing insights into sensor configurations and performance outcomes. The examination extends to the IAC, which is dedicated to high-speed self-driving vehicles, emphasizing developmental trajectories and sensor adaptations. By reviewing these platforms, the analysis provides valuable insight into autonomous driving racing, contributing to a broader understanding of sensor architectures and the challenges faced. This review supports future advances in full-scale autonomous racing technology.


title: Minute-Cadence Observations of the LAMOST Fields with the TMTS V. Machine Learning Classification of TMTS Catalogues of Periodic Variable Stars

abstract: Periodic variables are always of great scientific interest in astrophysics. Thanks to the rapid advancement of modern large-scale time-domain surveys, the number of reported variable stars has experienced substantial growth for several decades, which significantly deepened our comprehension of stellar structure and binary evolution. The Tsinghua University-Ma Huateng Telescopes for Survey (TMTS) has started to monitor the LAMOST sky areas since 2020, with a cadence of 1 minute. During the period from 2020 to 2022, this survey has resulted in densely sampled light curves for ~ 30,000 variables of the maximum powers in the Lomb-Scargle periodogram above the 5sigma threshold. In this paper, we classified 11,638 variable stars into 6 main types using XGBoost and Random Forest classifiers with accuracies of 98.83% and 98.73%, respectively. Among them, 5301 (45.55%) variables are newly discovered, primarily consisting of Delta Scuti stars, demonstrating the capability of TMTS in searching for short-period variables. We cross-matched the catalogue with Gaia's second Data Release (DR2) and LAMOST's seventh Data Release (DR7) to obtain important physical parameters of the variables. We identified 5504 Delta Scuti stars (including 4876 typical Delta Scuti stars and 628 high-amplitude Delta Scuti stars), 5899 eclipsing binaries (including EA-, EB- and EW-type) and 226 candidates of RS Canum Venaticorum. Leveraging the metal abundance data provided by LAMOST and the Galactic latitude, we discovered 8 candidates of SX Phe stars within the class of "Delta Scuti stars". Moreover, with the help of Gaia color-magnitude diagram, we identified 9 ZZ ceti stars.


title: Skew category algebras, twisted tensor product algebras and induction of precosheaves

abstract: We show that a skew category algebra can be embedded into a twisted tensor product algebra. We investigate the extension of some concepts of Puig and Turull from group algebras to category algebras and their behavior with respect to skew category algebras.


title: Nelson algebras, residuated lattices and rough sets: A survey

abstract: Over the past 50 years, Nelson algebras have been extensively studied by distinguished scholars as the algebraic counterpart of Nelson's constructive logic with strong negation. Despite these studies, a comprehensive survey of the topic is currently lacking, and the theory of Nelson algebras remains largely unknown to most logicians. This paper aims to fill this gap by focussing on the essential developments in the field over the past two decades. Additionally, we explore generalisations of Nelson algebras, such as N4-lattices which correspond to the paraconsistent version of Nelson's logic, as well as their applications to other areas of interest to logicians, such as duality and rough set theory. A general representation theorem states that each Nelson algebra is isomorphic to a subalgebra of a rough set-based Nelson algebra induced by a quasiorder. Furthermore, a formula is a theorem of Nelson logic if and only if it is valid in every finite Nelson algebra induced by a quasiorder.


title: Flexible Non-interactive Short-term Implicit Certificate Generation for VANETs

abstract: A leading industry standard for secure and trusted communication in vehicular ad-hoc networks (VANETs) is the Security Credential Management System (SCMS). It uses anonymous certificates, functioning as pseudonyms, to preserve the privacy of vehicles. With the rapid development of advanced applications in VANETs, such as crowdsensing and federated learning, vehicles need to communicate with each other or infrastructures more frequently, leading to a higher demand for pseudonyms. However, the current approach of certificate provisioning in SCMS is not able to fully support pseudonyms, due to storage limitation, cost of connectivity establishment, and communication overhead of certificate downloading. To tackle this challenge, we propose a non-interactive approach for SCMS, allowing vehicles themselves to generate short-term key pairs and anonymous implicit certificates. Our evaluation and comparison with previous work show that our solution not only effectively reduces the communication cost, but also grants vehicles greater flexibility in certificate generation and use. On the technical side, to the best of our knowledge, this is the first work which (1) applies sanitizable signature for non-interactive anonymous certificate generation, and (2) is specifically designed for SCMS, which opens up possibilities for extensions and applications in industry.


title: Accelerating Inverse Reinforcement Learning with Expert Bootstrapping

abstract: Existing inverse reinforcement learning methods (e.g. MaxEntIRL, $f$-IRL) search over candidate reward functions and solve a reinforcement learning problem in the inner loop. This creates a rather strange inversion where a harder problem, reinforcement learning, is in the inner loop of a presumably easier problem, imitation learning. In this work, we show that better utilization of expert demonstrations can reduce the need for hard exploration in the inner RL loop, hence accelerating learning. Specifically, we propose two simple recipes: (1) placing expert transitions into the replay buffer of the inner RL algorithm (e.g. Soft-Actor Critic) which directly informs the learner about high reward states instead of forcing the learner to discover them through extensive exploration, and (2) using expert actions in Q value bootstrapping in order to improve the target Q value estimates and more accurately describe high value expert states. Our methods show significant gains over a MaxEntIRL baseline on the benchmark MuJoCo suite of tasks, speeding up recovery to 70\% of deterministic expert performance by 2.13x on HalfCheetah-v2, 2.6x on Ant-v2, 18x on Hopper-v2, and 3.36x on Walker2d-v2.


title: Orbital collapse and dual states of the $5g$ electrons in superheavy elements

abstract: The problem of orbital collapse of the $5g$ and $6f$ electrons in atoms of superheavy elements (SHE) is considered. Previously, the presence of the orbital collapse was established for the $4f$ and $5f$ elements of the periodic table. Because of the large centrifugal term for the $f$ and $g$ electrons, the effective radial potential has two wells, one narrow and deep and the other wide but shallow. Depending on the external parameters, the electron can be either localized in the outer well with low binding energy and large average radius or in the inner one with higher energy and smaller radius. In this work, we demonstrate the existence of the orbital collapse for the $5g$ electrons when changing the total angular momentum $J$ of the atom. We also found that for some SHE elements, two different solutions of the same Dirac-Fock equations may coexist, with the $5g$ electron localized either in the inner or outer well. In both cases, the radial wave functions are nodeless. The problem of the dual-state coexistence is studied by the configuration-interaction method in the Dirac-Fock-Sturm orbital basis as well.


title: A 3D joint interpretation of magnetotelluric and seismic tomographic models: the case of the volcanic island of Tenerife

abstract: In this work we have done a 3D joint interpretation of magnetotelluric and seismic tomography models. Previously we have described different techniques to infer the inner structure of the Earth. We have focused on volcanic regions, specifically on Tenerife Island volcano (Canary Islands, Spain). In this area, magnetotelluric and seismic tomography studies have been done separately. The novelty of the present work is the combination of both techniques in Tenerife Island. For this aim we have applied Fuzzy Clusters Method at different depths obtaining several clusters or classes. From the results, a geothermal system has been inferred below Teide volcano, in the center of Tenerife Island. An edifice hydrothermally altered and full of fluids is situated below Teide, ending at 600 m below sea level. From this depth the resistivity and VP values increase downwards. We also observe a clay cap structure, a typical feature in geothermal systems related with low resistivity and low VP values.


title: PuzzleBench: Can LLMs Solve Challenging First-Order Combinatorial Reasoning Problems?

abstract: Recent works show that the largest of the large language models (LLMs) can solve many simple reasoning tasks expressed in natural language, without any/much supervision. But, can they also solve challenging first-order combinatorial reasoning problems, such as graph coloring, knapsack and cryptarithmetic? To answer this question, we present PuzzleBench, a dataset of 31 such challenging problems along with a few solved instances for each problem. These problems are all first order, i.e., they can be instantiated with problem instances of varying sizes, and most of them are NP-hard, requiring several reasoning steps to reach the solution. We first observe that LLMs, even when aided by symbolic solvers, perform rather poorly on our dataset. In response, we propose a new approach, Puzzle-LM, which combines LLMs with both symbolic solvers and program interpreters, along with feedback from solved examples, to achieve huge performance gains. Our extensive experimentation and analyses offer new insights into the reasoning abilities and limitations of present-day LLMs.


title: Fast Explicit-Input Assistance for Teleoperation in Clutter

abstract: The performance of prediction-based assistance for robot teleoperation degrades in unseen or goal-rich environments due to incorrect or quickly-changing intent inferences. Poor predictions can confuse operators or cause them to change their control input to implicitly signal their goal. We present a new assistance interface for robotic manipulation where an operator can explicitly communicate a manipulation goal by pointing the end-effector. The pointing target specifies a region for local pose generation and optimization, providing interactive control over grasp and placement pose candidates. We compare the explicit pointing interface to an implicit inference-based assistance scheme in a within-subjects user study (N=20) where participants teleoperate a simulated robot to complete a multi-step singulation and stacking task in cluttered environments. We find that operators prefer the explicit interface, experience fewer pick failures and report lower cognitive workload. Our code is available at: https://github.com/NVlabs/fast-explicit-teleop


title: Advanced monitoring of rail breakage in double-track railway lines by means of PCA techniques

abstract: This work describes a classifier designed to identify rail breakages in double-track railway lines, completing the electronic equipment carried out by authors. The main objective of this proposal is to guarantee the integrity of tracks before the railway traffic starts working. In addition, it facilitates maintenance tasks providing information about possible breakages. The detection of breakages is based on the analysis of eight currents provided by the electronic equipment, one per rail, at the ends of the section (emitting and receiving nodes). The imbalance that occurs among the value of these currents implies that there is at least a breakage in the track section under analysis. This analysis is conducted according to three phases. The first one identifies whether there is a breakage, and, in that case, the damaged track is identified. The second phase provides information about which rail is broken (internal, external or both of them) in the previously identified track. Finally, if there is only one breakage, the third phase estimates its most likely zone along the track section. This situation is considered as a classification problem, and solved by means of the Principal Component Analysis technique. This means that a significant number of measurements is required for every breakage pattern (types of breakages) to be considered. Due to the difficulty of having real data, the proposal has been validated using an 8km-long double-track hardware simulator specially designed by the authors, with specific localizations for breakages.


title: Lunar ore geology and feasibility of ore mineral detection using a far-IR spectrometer

abstract: Lunar sulfides and oxides are a significant source of noble and base metals and will be vital for future human colonies' self-sustainability. Sulfide detection (pyrite and troilite) applies to many technological fields and use cases, for example, as a raw material source (available in situ on the Lunar surface) for new solar panel production methods. Ilmenite is the primary iron and titanium ore on the Moon and can provide helium-3 for nuclear fusion and oxygen for rocket fuel. The most important ore minerals have prominent absorption peaks in a narrow far-infrared (FIR) wavelength range of 20-40 $\mu$m, much stronger than the spectral features of other common minerals, including significant silicates, sulfates, and carbonates. Our simulations based on the linear mixing of pyrite with the silicates mentioned above indicated that areas containing at least 10-20% pyrite could be detected from the orbit in the FIR range. MIRORES, Multiplanetary far-IR ORE Spectrometer, proposed here, would operate with a resolution down to <5 m, enabling the detection of areas covered by 2-3 m$^2$ of pyrite (or ilmenite) on a surface of ~17 m$^2$ from an altitude of 50 km, creating possibilities for detecting large and local smaller orebodies along with their stockworks. The use of the Cassegrain optical system achieves this capability. MIRORES will measure radiation in eight narrow bands (0.3 $\mu$m in width) that can include up to five bands centered on the ore mineral absorption bands, for example, 24.3, 24.9, 27.6, 34.2, and 38.8 $\mu$m for pyrite, marcasite, chalcopyrite, ilmenite, and troilite, respectively. The instrument size is 32 $\times$ 32 $\times$ 42 cm, and the mass is <10 kg, which fits the standard microsatellite requirements.


title: High-fugacity expansion and crystallization in non-sliding hard-core lattice particle models without a tiling constraint

abstract: In this paper, we prove the existence of a crystallization transition for a family of hard-core particle models on periodic graphs in arbitrary dimensions. We establish a criterion under which crystallization occurs at sufficiently high densities. The criterion is more general than that in [Jauslin, Lebowitz, Comm. Math. Phys. 364:2, 2018], as it allows models in which particles do not tile the space in the close-packing configurations, such as discrete hard-disk models. To prove crystallization, we prove that the pressure is analytic in the inverse of the fugacity for large enough complex fugacities, using Pirogov-Sinai theory. One of the main tools used for this result is the definition of a local density, based on a discrete generalization of Voronoi cells. We illustrate the criterion by proving that it applies to two examples: staircase models and the radius 2.5 hard-disk model on the square lattice.

categories: math-ph cond-mat.stat-mech math.MP math.PR


title: The Virtues of Pessimism in Inverse Reinforcement Learning

abstract: Inverse Reinforcement Learning (IRL) is a powerful framework for learning complex behaviors from expert demonstrations. However, it traditionally requires repeatedly solving a computationally expensive reinforcement learning (RL) problem in its inner loop. It is desirable to reduce the exploration burden by leveraging expert demonstrations in the inner-loop RL. As an example, recent work resets the learner to expert states in order to inform the learner of high-reward expert states. However, such an approach is infeasible in the real world. In this work, we consider an alternative approach to speeding up the RL subroutine in IRL: \emph{pessimism}, i.e., staying close to the expert's data distribution, instantiated via the use of offline RL algorithms. We formalize a connection between offline RL and IRL, enabling us to use an arbitrary offline RL algorithm to improve the sample efficiency of IRL. We validate our theory experimentally by demonstrating a strong correlation between the efficacy of an offline RL algorithm and how well it works as part of an IRL procedure. By using a strong offline RL algorithm as part of an IRL procedure, we are able to find policies that match expert performance significantly more efficiently than the prior art.


title: Layer-Wise Analysis of Self-Supervised Acoustic Word Embeddings: A Study on Speech Emotion Recognition

abstract: The efficacy of self-supervised speech models has been validated, yet the optimal utilization of their representations remains challenging across diverse tasks. In this study, we delve into Acoustic Word Embeddings (AWEs), a fixed-length feature derived from continuous representations, to explore their advantages in specific tasks. AWEs have previously shown utility in capturing acoustic discriminability. In light of this, we propose measuring layer-wise similarity between AWEs and word embeddings, aiming to further investigate the inherent context within AWEs. Moreover, we evaluate the contribution of AWEs, in comparison to other types of speech features, in the context of Speech Emotion Recognition (SER). Through a comparative experiment and a layer-wise accuracy analysis on two distinct corpora, IEMOCAP and ESD, we explore differences between AWEs and raw self-supervised representations, as well as the proper utilization of AWEs alone and in combination with word embeddings. Our findings underscore the acoustic context conveyed by AWEs and showcase the highly competitive SER accuracies by appropriately employing AWEs.


title: Schr\"odinger's Cheshire Cat: A tabletop experiment to measure the Di\'osi-Penrose collapse time and demonstrate Objective Reduction (OR)

abstract: For nearly 100 years, the paradox of Schr\"odinger's Cat has remained unresolved. Why does the world we live in appear classical despite being composed of quantum particles governed by the Schr\"odinger wave equation? Lajos Di\'osi and Roger Penrose propose the wavefunction collapses because it describes two incompatible space-times, demonstrating an inconsistency between quantum mechanics and general relativity. To avoid this paradox, collapse must occur within Heisenberg's time-energy uncertainty limit. Subatomic particles with low mass, and correspondingly low energy, collapse in years, while superposed cats would collapse almost instantaneously. We propose a table-top experiment to put two small mirrors into superposition and observe them collapse in a time consistent with the Di\'osi-Penrose model. We employ two techniques to perform this experiment in ambient laboratory conditions. Most experiments separate a small mass by a large distance. In contrast, we displace a large mass by a small distance where the self-energy follows an inverse square law with correspondingly high collapse times. We further use a symmetrical apparatus, where a break in symmetry indicates collapse independent of decoherence.


title: Increasing Trust in Language Models through the Reuse of Verified Circuits

abstract: Language Models (LMs) are increasingly used for a wide range of prediction tasks, but their training can often neglect rare edge cases, reducing their reliability. Here, we define a stringent standard of trustworthiness whereby the task algorithm and circuit implementation must be verified, accounting for edge cases, with no known failure modes. We show that a model can be trained to meet this standard if built using mathematically and logically specified frameworks. In this paper, we fully verify an auto-regressive transformer model for n-digit integer addition. To exhibit the reusability of verified modules, we insert the trained integer addition model into a larger untrained model and train the combined model to perform both addition and subtraction. We find extensive reuse of the addition circuits for both tasks, easing verification of the more complex subtractor model. We discuss how inserting verified task modules into LMs can leverage model reuse to improve verifiability and trustworthiness of language models built using them. The reuse of verified circuits reduces the effort to verify more complex composite models which we believe to be a significant step towards safety of language models.


title: The Measurement and Modelling of Cosmic Ray Muons at KM3NeT Detectors

abstract: Atmospheric muons are the most frequently observed form of cosmic radiation. Despite this, the existence of the muon flux component produced in decays of short-lived parent particles, called prompt muon flux still awaits experimental confirmation. This contribution to the muon flux is expected to start dominating at high energies, around PeV, since many of the prompt parent particles are heavy hadrons, containing charm and strange quarks. The aim of this thesis was two-fold: to evaluate the possibility of observing the prompt muon flux and to validate the performance of the KM3NeT detectors. [shortened abstract, the full version is contained in the thesis]


title: Perfect Multi-User Distributed Computing

abstract: In this paper, we investigate the problem of multi-user linearly decomposable function computation, where $N$ servers help compute functions for $K$ users, and where each such function can be expressed as a linear combination of $L$ basis subfunctions. The process begins with each server computing some of the subfunctions, then broadcasting a linear combination of its computed outputs to a selected group of users, and finally having each user linearly combine its received data to recover its function. As it has become recently known, this problem can be translated into a matrix decomposition problem $\mathbf{F}=\mathbf{D}\mathbf{E}$, where $\mathbf{F} \in \mathbf{GF}(q)^{K \times L}$ describes the coefficients that define the users' demands, where $\mathbf{E} \in \mathbf{GF}(q)^{N \times L}$ describes which subfunction each server computes and how it combines the computed outputs, and where $\mathbf{D} \in \mathbf{GF}(q)^{K \times N}$ describes which servers each user receives data from and how it combines this data. Our interest here is in reducing the total number of subfunction computations across the servers (cumulative computational cost), as well as the worst-case load which can be a measure of computational delay. Our contribution consists of novel bounds on the two computing costs, where these bounds are linked here to the covering and packing radius of classical codes. One of our findings is that in certain cases, our distributed computing problem -- and by extension our matrix decomposition problem -- is treated optimally when $\mathbf{F}$ is decomposed into a parity check matrix $\mathbf{D}$ of a perfect code, and a matrix $\mathbf{E}$ which has as columns the coset leaders of this same code.


title: DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging

abstract: The transformer architecture by Vaswani et al. (2017) is now ubiquitous across application domains, from natural language processing to speech processing and image understanding. We propose DenseFormer, a simple modification to the standard architecture that improves the perplexity of the model without increasing its size -- adding a few thousand parameters for large-scale models in the 100B parameters range. Our approach relies on an additional averaging step after each transformer block, which computes a weighted average of current and past representations -- we refer to this operation as Depth-Weighted-Average (DWA). The learned DWA weights exhibit coherent patterns of information flow, revealing the strong and structured reuse of activations from distant layers. Experiments demonstrate that DenseFormer is more data efficient, reaching the same perplexity of much deeper transformer models, and that for the same perplexity, these new models outperform transformer baselines in terms of memory efficiency and inference time.


title: Efficient Market Dynamics: Unraveling Informational Efficiency in UK Horse Racing Betting Markets Through Betfair's Time Series Analysis

abstract: Using Betfair's time series data, an analysis of the United Kingdom (UK) horse racing market reveals an interesting paradox: a market with short tails, rapidly decaying autocorrelations, and no long-term memory. There seems to be a remarkably high level of informational efficiency in betting exchange returns, in contrast to financial assets that are characterized by heavy tails and volatility clustering. The generalized Gaussian unconditional distribution with a light tail point to a market where knowledge is quickly assimilated and reflected in prices. This is further supported by the extremely quick fading of autocorrelations and the absence of gain-loss asymmetry. Therefore, in addition to measuring long-range memory, the Hurst exponent also shows mean reversion, a sign that markets respond quickly to fresh information.


title: A Safe Reinforcement Learning driven Weights-varying Model Predictive Control for Autonomous Vehicle Motion Control

abstract: Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by determining a Pareto optimal parameter set for an MPC with static weights. However, a single parameter set may not deliver the most optimal closed-loop control performance when the context of the MPC operating conditions changes during its operation, urging the need to adapt the cost function weights at runtime. Deep Reinforcement Learning (RL) algorithms can automatically learn context-dependent optimal parameter sets and dynamically adapt for a Weightsvarying MPC (WMPC). However, learning cost function weights from scratch in a continuous action space may lead to unsafe operating states. To solve this, we propose a novel approach limiting the RL actions within a safe learning space representing a catalog of pre-optimized BO Pareto-optimal weight sets. We conceive a RL agent not to learn in a continuous space but to proactively anticipate upcoming control tasks and to choose the most optimal discrete actions, each corresponding to a single set of Pareto optimal weights, context-dependent. Hence, even an untrained RL agent guarantees a safe and optimal performance. Experimental results demonstrate that an untrained RL-WMPC shows Pareto-optimal closed-loop behavior and training the RL-WMPC helps exhibit a performance beyond the Pareto-front.


title: Enhancing Transformer RNNs with Multiple Temporal Perspectives

abstract: We introduce the concept of multiple temporal perspectives, a novel approach applicable to Recurrent Neural Network (RNN) architectures for enhancing their understanding of sequential data. This method involves maintaining diverse temporal views of previously encountered text, significantly enriching the language models' capacity to interpret context. To show the efficacy of this approach, we incorporate it into the Receptance Weighted Key Value (RWKV) architecture, addressing its inherent challenge of retaining all historical information within a single hidden state. Notably, this improvement is achieved with a minimal increase in the number of parameters --even as little as $0.04\%$ of the original number of parameters. Further, the additional parameters necessary for the multiple temporal perspectives are fine-tuned with minimal computational overhead, avoiding the need for a full pre-training. The resulting model maintains linear computational complexity during prompt inference, ensuring consistent efficiency across various sequence lengths. The empirical results and ablation studies included in our research validate the effectiveness of our approach, showcasing improved performance across multiple benchmarks. The code, model weights and datasets are open-sourced at: https://github.com/RazvanDu/TemporalRNNs.


title: Position bias in features

abstract: The purpose of modeling document relevance for search engines is to rank better in subsequent searches. Document-specific historical click-through rates can be important features in a dynamic ranking system which updates as we accumulate more sample. This paper describes the properties of several such features, and tests them in controlled experiments. Extending the inverse propensity weighting method to documents creates an unbiased estimate of document relevance. This feature can approximate relevance accurately, leading to near-optimal ranking in ideal circumstances. However, it has high variance that is increasing with respect to the degree of position bias. Furthermore, inaccurate position bias estimation leads to poor performance. Under several scenarios this feature can perform worse than biased click-through rates. This paper underscores the need for accurate position bias estimation, and is unique in suggesting simultaneous use of biased and unbiased position bias features.


title: Stability Analysis of Various Symbolic Rule Extraction Methods from Recurrent Neural Network

abstract: This paper analyzes two competing rule extraction methodologies: quantization and equivalence query. We trained $3600$ RNN models, extracting $18000$ DFA with a quantization approach (k-means and SOM) and $3600$ DFA by equivalence query($L^{*}$) methods across $10$ initialization seeds. We sampled the datasets from $7$ Tomita and $4$ Dyck grammars and trained them on $4$ RNN cells: LSTM, GRU, O2RNN, and MIRNN. The observations from our experiments establish the superior performance of O2RNN and quantization-based rule extraction over others. $L^{*}$, primarily proposed for regular grammars, performs similarly to quantization methods for Tomita languages when neural networks are perfectly trained. However, for partially trained RNNs, $L^{*}$ shows instability in the number of states in DFA, e.g., for Tomita 5 and Tomita 6 languages, $L^{*}$ produced more than $100$ states. In contrast, quantization methods result in rules with number of states very close to ground truth DFA. Among RNN cells, O2RNN produces stable DFA consistently compared to other cells. For Dyck Languages, we observe that although GRU outperforms other RNNs in network performance, the DFA extracted by O2RNN has higher performance and better stability. The stability is computed as the standard deviation of accuracy on test sets on networks trained across $10$ seeds. On Dyck Languages, quantization methods outperformed $L^{*}$ with better stability in accuracy and the number of states. $L^{*}$ often showed instability in accuracy in the order of $16\% - 22\%$ for GRU and MIRNN while deviation for quantization methods varied in $5\% - 15\%$. In many instances with LSTM and GRU, DFA's extracted by $L^{*}$ even failed to beat chance accuracy ($50\%$), while those extracted by quantization method had standard deviation in the $7\%-17\%$ range. For O2RNN, both rule extraction methods had deviation in the $0.5\% - 3\%$ range.


title: Slip-induced odd viscous flow past a cylinder

abstract: Odd viscosity is a transport coefficient that can occur when fluids experience breaking of parity and time-reversal symmetry. Previous knowledge indicates that cylinders in incompressible odd viscous fluids, under no-slip boundary conditions, do not exhibit lift force, a phenomenon that poses challenges for the experimental detection of odd viscosity. This study investigates the impact of slip in Stokes flow, employing the odd generalization of the Lorentz reciprocal theorem. Our findings reveal that, at linear order in slip length, lift does not manifest. Subsequently, we explore the scenario involving a thin sheet with momentum decay as well as that of a finite system size, demonstrating that for Stokes flow lift does occur for the second order slip length contribution. We address cylinder flow beyond the Stokes approximation by solving the Oseen equation to obtain a fluid profile that shows an interplay between odd viscosity and inertia, and acquire an explicit expression for the leading order slip length contribution to Oseen lift at low Reynolds number.


title: PROSAC: Provably Safe Certification for Machine Learning Models under Adversarial Attacks

abstract: It is widely known that state-of-the-art machine learning models, including vision and language models, can be seriously compromised by adversarial perturbations. It is therefore increasingly relevant to develop capabilities to certify their performance in the presence of the most effective adversarial attacks. Our paper offers a new approach to certify the performance of machine learning models in the presence of adversarial attacks with population level risk guarantees. In particular, we introduce the notion of $(\alpha,\zeta)$ machine learning model safety. We propose a hypothesis testing procedure, based on the availability of a calibration set, to derive statistical guarantees providing that the probability of declaring that the adversarial (population) risk of a machine learning model is less than $\alpha$ (i.e. the model is safe), while the model is in fact unsafe (i.e. the model adversarial population risk is higher than $\alpha$), is less than $\zeta$. We also propose Bayesian optimization algorithms to determine efficiently whether a machine learning model is $(\alpha,\zeta)$-safe in the presence of an adversarial attack, along with statistical guarantees. We apply our framework to a range of machine learning models including various sizes of vision Transformer (ViT) and ResNet models impaired by a variety of adversarial attacks, such as AutoAttack, SquareAttack and natural evolution strategy attack, to illustrate the operation of our approach. Importantly, we show that ViT's are generally more robust to adversarial attacks than ResNets, and ViT-large is more robust than smaller models. Our approach goes beyond existing empirical adversarial risk-based certification guarantees. It formulates rigorous (and provable) performance guarantees that can be used to satisfy regulatory requirements mandating the use of state-of-the-art technical tools.


title: Cryptographically Assured Information Flow: Assured Remote Execution

abstract: Assured Remote Execution on a device is the ability of suitably authorized parties to construct secure channels with known processes -- i.e. processes executing known code -- running on it. Assured Remote Execution requires a hardware basis including cryptographic primitives. In this paper, we show that a simple hardware-level mechanism called Cryptographically Assured Information Flow (CAIF) enables Assured Remote Execution. CAIF is akin to some operations in existing Trusted Execution Environments, but securely implements an ideal functionality defined in terms of logging and confidential escrow. We show how to achieve Assured Remote Execution for a wide variety of processes on a CAIF device. Cryptographic protocol analysis demonstrates our security goals are achieved even against a strong adversary that may modify our programs and execute unauthorized programs on the device. Assured Remote Execution enables useful functionality such as trustworthy remote attestation, and provides some of the support needed for secure remote reprogramming.


title: Learning to Understand: Identifying Interactions via the M\"obius Transform

abstract: One of the key challenges in machine learning is to find interpretable representations of learned functions. The M\"obius transform is essential for this purpose, as its coefficients correspond to unique importance scores for sets of input variables. This transform is closely related to widely used game-theoretic notions of importance like the Shapley and Bhanzaf value, but it also captures crucial higher-order interactions. Although computing the obius Transform of a function with $n$ inputs involves $2^n$ coefficients, it becomes tractable when the function is sparse and of low-degree as we show is the case for many real-world functions. Under these conditions, the complexity of the transform computation is significantly reduced. When there are $K$ non-zero coefficients, our algorithm recovers the M\"obius transform in $O(Kn)$ samples and $O(Kn^2)$ time asymptotically under certain assumptions, the first non-adaptive algorithm to do so. We also uncover a surprising connection between group testing and the M\"obius transform. For functions where all interactions involve at most $t$ inputs, we use group testing results to compute the M\"obius transform with $O(Kt\log n)$ sample complexity and $O(K\mathrm{poly}(n))$ time. A robust version of this algorithm withstands noise and maintains this complexity. This marks the first $n$ sub-linear query complexity, noise-tolerant algorithm for the M\"obius transform. In several examples, we observe that representations generated via sparse M\"obius transform are up to twice as faithful to the original function, as compared to Shaply and Banzhaf values, while using the same number of terms.


title: GIRT-Model: Automated Generation of Issue Report Templates

abstract: Platforms such as GitHub and GitLab introduce Issue Report Templates (IRTs) to enable more effective issue management and better alignment with developer expectations. However, these templates are not widely adopted in most repositories, and there is currently no tool available to aid developers in generating them. In this work, we introduce GIRT-Model, an assistant language model that automatically generates IRTs based on the developer's instructions regarding the structure and necessary fields. We create GIRT-Instruct, a dataset comprising pairs of instructions and IRTs, with the IRTs sourced from GitHub repositories. We use GIRT-Instruct to instruction-tune a T5-base model to create the GIRT-Model. In our experiments, GIRT-Model outperforms general language models (T5 and Flan-T5 with different parameter sizes) in IRT generation by achieving significantly higher scores in ROUGE, BLEU, METEOR, and human evaluation. Additionally, we analyze the effectiveness of GIRT-Model in a user study in which participants wrote short IRTs with GIRT-Model. Our results show that the participants find GIRT-Model useful in the automated generation of templates. We hope that through the use of GIRT-Model, we can encourage more developers to adopt IRTs in their repositories. We publicly release our code, dataset, and model at https://github.com/ISE-Research/girt-model.


title: Predicting Machine Translation Performance on Low-Resource Languages: The Role of Domain Similarity

abstract: Fine-tuning and testing a multilingual large language model is expensive and challenging for low-resource languages (LRLs). While previous studies have predicted the performance of natural language processing (NLP) tasks using machine learning methods, they primarily focus on high-resource languages, overlooking LRLs and shifts across domains. Focusing on LRLs, we investigate three factors: the size of the fine-tuning corpus, the domain similarity between fine-tuning and testing corpora, and the language similarity between source and target languages. We employ classical regression models to assess how these factors impact the model's performance. Our results indicate that domain similarity has the most critical impact on predicting the performance of Machine Translation models.


title: Key-Graph Transformer for Image Restoration

abstract: While it is crucial to capture global information for effective image restoration (IR), integrating such cues into transformer-based methods becomes computationally expensive, especially with high input resolution. Furthermore, the self-attention mechanism in transformers is prone to considering unnecessary global cues from unrelated objects or regions, introducing computational inefficiencies. In response to these challenges, we introduce the Key-Graph Transformer (KGT) in this paper. Specifically, KGT views patch features as graph nodes. The proposed Key-Graph Constructor efficiently forms a sparse yet representative Key-Graph by selectively connecting essential nodes instead of all the nodes. Then the proposed Key-Graph Attention is conducted under the guidance of the Key-Graph only among selected nodes with linear computational complexity within each window. Extensive experiments across 6 IR tasks confirm the proposed KGT's state-of-the-art performance, showcasing advancements both quantitatively and qualitatively.


title: Towards Principled Risk Scores for Space Cyber Risk Management

abstract: Space is an emerging domain critical to humankind. Correspondingly, space cybersecurity is an emerging field with much research to be done. To help space cybersecurity practitioners better manage cyber risks, The Aerospace Corporation proposed Notional Risk Scores (NRS) within their Space Attack Research and Tactic Analysis (SPARTA) framework, which can be applied to quantify the cyber risks associated with space infrastructures and systems. While intended for adoption by practitioners, NRS has not been analyzed with real-world scenarios, putting its effectiveness into question. In this paper we analyze NRS via a real-world cyber attack scenario against a satellite, and characterize the strengths, weaknesses, and applicability of NRS. The characterization prompts us to propose a set of desired properties to guide the design of future NRS. As a first step along this direction, we further propose a formalism to serve as a baseline for designing future NRS with those desired properties.


title: Can Large Language Models Learn Independent Causal Mechanisms?

abstract: Despite impressive performance on language modelling and complex reasoning tasks, Large Language Models (LLMs) fall short on the same tasks in uncommon settings or with distribution shifts, exhibiting some lack of generalisation ability. This issue has usually been alleviated by feeding more training data into the LLM. However, this method is brittle, as the scope of tasks may not be readily predictable or may evolve, and updating the model with new data generally requires extensive additional training. By contrast, systems, such as causal models, that learn abstract variables and causal relationships can demonstrate increased robustness against changes in the distribution. One reason for this success is the existence and use of Independent Causal Mechanisms (ICMs) representing high-level concepts that only sparsely interact. In this work, we apply two concepts from causality to learn ICMs within LLMs. We develop a new LLM architecture composed of multiple sparsely interacting language modelling modules. We introduce a routing scheme to induce specialisation of the network into domain-specific modules. We also present a Mutual Information minimisation objective that trains a separate module to learn abstraction and domain-invariant mechanisms. We show that such causal constraints can improve out-of-distribution performance on abstract and causal reasoning tasks.


title: $C^*$-Algebraic Machine Learning: Moving in a New Direction

abstract: Machine learning has a long collaborative tradition with several fields of mathematics, such as statistics, probability and linear algebra. We propose a new direction for machine learning research: $C^*$-algebraic ML $-$ a cross-fertilization between $C^*$-algebra and machine learning. The mathematical concept of $C^*$-algebra is a natural generalization of the space of complex numbers. It enables us to unify existing learning strategies, and construct a new framework for more diverse and information-rich data models. We explain why and how to use $C^*$-algebras in machine learning, and provide technical considerations that go into the design of $C^*$-algebraic learning models in the contexts of kernel methods and neural networks. Furthermore, we discuss open questions and challenges in $C^*$-algebraic ML and give our thoughts for future development and applications.


title: Representations of solutions of time-fractional multi-order systems of differential-operator equations

abstract: This paper is devoted to the general theory of systems of time-fractional differential-operator equations. The representation formulas for solutions of systems of ordinary differential equations with single (commensurate) fractional order is known through the matrix valued Mittag-Leffler function. Multi-order (incommensurate) systems with rational components can be reduced to single order systems, and hence, representation formulas are also known. However, for arbitrary fractional multi-order (not necessarily with rational components) systems of differential equations this question remains open even in the case of ordinary differential equations. In this paper we obtain representation formulas for solutions of arbitrary fractional multi-order systems of differential-operator equations along with proving the existence and uniqueness theorems in appropriate topological-vector spaces. Moreover, we introduce vector-indexed Mittag-Leffler functions and prove some of their properties.


title: "It's how you do things that matters": Attending to Process to Better Serve Indigenous Communities with Language Technologies

abstract: Indigenous languages are historically under-served by Natural Language Processing (NLP) technologies, but this is changing for some languages with the recent scaling of large multilingual models and an increased focus by the NLP community on endangered languages. This position paper explores ethical considerations in building NLP technologies for Indigenous languages, based on the premise that such projects should primarily serve Indigenous communities. We report on interviews with 17 researchers working in or with Aboriginal and/or Torres Strait Islander communities on language technology projects in Australia. Drawing on insights from the interviews, we recommend practices for NLP researchers to increase attention to the process of engagements with Indigenous communities, rather than focusing only on decontextualised artefacts.


title: Determination of the spins and parities for the 0$_{4}^{+}$ and 0$_{5}^{+}$ states in $^{100}$Zr

abstract: Two 0$^{+}$ states at 1294.5 and 1774.0 keV, together with three 2$^{+}$ and one 4$^{+}$ levels, were identified or unambiguously spin-parity assigned for the first time in $^{100}$Zr utilizing $\gamma$-ray spectroscopy and $\gamma$-$\gamma$ angular correlation techniques with the Gammasphere spectrometer, following the $\beta^{-}$ decay of neutron-rich, mass separated $^{100,100m}$Y isotopes. Comparisons with recent Monte Carlo Shell-Model (MCSM) calculations indicate that these two states are candidates for the bandhead of a sequence in a shape-coexisting spherical minimum predicted to be located around $\approx$1500 keV. According to the measured relative B(E2)$_{relative}$ transition probabilities, the 0$_{5}^{+}$ state exhibits decay properties which more closely align with those predicted for a spherical shape, while the 0$_{4}^{+}$ level is suggested to be associated with a weakly-deformed shape similar to one related to the 0$_{2}^{+}$ state.


title: Performance studies of a SiPM-readout system with a pico-second timing chip

abstract: A pico-second timing (PIST) front-end electronic chip has been developed using $55~\mathrm{nm}$ CMOS technology for future electron-positron collider experiments (namely Higgs factories). Extensive tests have been performed to evaluate the timing performance of a dedicated SiPM-readout system equipped with a PIST chip. The results show that the system timing resolution can achieve $45~\mathrm{ps}$ for SiPM signals at the minimum-ionizing particles (MIP) level ($200~\mathrm{p.e.}$) and better than $ 10~\mathrm{ps}$ for signals larger than $1200~\mathrm{p.e.}$, while the PIST intrinsic timing resolution is $4.76 \pm 0.60~\mathrm{ps}$. The PIST dynamic range has been further extended using the time-over-threshold (ToT) technique, which can cover the SiPM response spanning from $\mathrm{\sim 900~p.e.}$ to $~\mathrm{\sim 40000~p.e.}$.


title: Object Graph Programming

abstract: We introduce Object Graph Programming (OGO), which enables reading and modifying an object graph (i.e., the entire state of the object heap) via declarative queries. OGO models the objects and their relations in the heap as an object graph thereby treating the heap as a graph database: each node in the graph is an object (e.g., an instance of a class or an instance of a metadata class) and each edge is a relation between objects (e.g., a field of one object references another object). We leverage Cypher, the most popular query language for graph databases, as OGO's query language. Unlike LINQ, which uses collections (e.g., List) as a source of data, OGO views the entire object graph as a single "collection". OGO is ideal for querying collections (just like LINQ), introspecting the runtime system state (e.g., finding all instances of a given class or accessing fields via reflection), and writing assertions that have access to the entire program state. We prototyped OGO for Java in two ways: (a) by translating an object graph into a Neo4j database on which we run Cypher queries, and (b) by implementing our own in-memory graph query engine that directly queries the object heap. We used OGO to rewrite hundreds of statements in large open-source projects into OGO queries. We report our experience and performance of our prototypes.


title: LLM-Enhanced Data Management

abstract: Machine learning (ML) techniques for optimizing data management problems have been extensively studied and widely deployed in recent five years. However traditional ML methods have limitations on generalizability (adapting to different scenarios) and inference ability (understanding the context). Fortunately, large language models (LLMs) have shown high generalizability and human-competitive abilities in understanding context, which are promising for data management tasks (e.g., database diagnosis, database tuning). However, existing LLMs have several limitations: hallucination, high cost, and low accuracy for complicated tasks. To address these challenges, we design LLMDB, an LLM-enhanced data management paradigm which has generalizability and high inference ability while avoiding hallucination, reducing LLM cost, and achieving high accuracy. LLMDB embeds domain-specific knowledge to avoid hallucination by LLM fine-tuning and prompt engineering. LLMDB reduces the high cost of LLMs by vector databases which provide semantic search and caching abilities. LLMDB improves the task accuracy by LLM agent which provides multiple-round inference and pipeline executions. We showcase three real-world scenarios that LLMDB can well support, including query rewrite, database diagnosis and data analytics. We also summarize the open research challenges of LLMDB.


title: Variational DAG Estimation via State Augmentation With Stochastic Permutations

abstract: Estimating the structure of a Bayesian network, in the form of a directed acyclic graph (DAG), from observational data is a statistically and computationally hard problem with essential applications in areas such as causal discovery. Bayesian approaches are a promising direction for solving this task, as they allow for uncertainty quantification and deal with well-known identifiability issues. From a probabilistic inference perspective, the main challenges are (i) representing distributions over graphs that satisfy the DAG constraint and (ii) estimating a posterior over the underlying combinatorial space. We propose an approach that addresses these challenges by formulating a joint distribution on an augmented space of DAGs and permutations. We carry out posterior estimation via variational inference, where we exploit continuous relaxations of discrete distributions. We show that our approach performs competitively when compared with a wide range of Bayesian and non-Bayesian benchmarks on a range of synthetic and real datasets.


title: Subsidence and current strain patterns on Tenerife Island (Canary Archipelago, Spain) derived from continuous GNSS time series (2008-2015)

abstract: In this paper we present the current crustal deformation model of Tenerife Island derived from daily CGPS time series processing (2008 to 2015). Our results include the position time series, a global velocity estimation and the current crustal deformation on the island in terms of strain tensors. We detect a measurable subsidence of 1.5 to 2 mm/yr. in the proximities of the Ca\~nadas-Teide-Pico Viejo (CTPV) complex. These values are higher in the central part of the complex and could be explained by a lateral spreading of the elastic lithosphere combined with the effect of the drastic descent of the water table in the island experienced during recent decades. The results show that the Anaga massif is stable in both its horizontal and vertical components. The strain tensor analysis shows a 70 nstrain/yr. E-W compression in the central complex, perpendicular to the 2004 sismo-volcanic area, and 50 nstrain/yr. SW-NE extension towards the Northeast ridge. The residual velocity and strain patterns coincide with a decline in volcanic activity since the 2004 unrest.


title: Log concavity of the Grothendieck class of $\overline{\mathcal M}_{0,n}$

abstract: Using a known recursive formula for the Grothendieck classes of the moduli spaces $\overline{\mathcal M}_{0,n}$, we prove that they satisfy an asymptotic form of ultra-log-concavity as polynomials in the Lefschetz class. We also observe that these polynomials are $\gamma$-positive. Both properties, along with numerical evidence, support the conjecture that these polynomials only have real zeros. This conjecture may be viewed as a particular case of a possible extension of a conjecture of Ferroni-Schr\"oter and Huh on Hilbert series of Chow rings of matroids. We prove asymptotic ultra-log-concavity by studying differential equations obtained from the recursion, whose solutions are the generating functions of the individual betti numbers of $\overline{\mathcal M}_{0,n}$. We obtain a rather complete description of these generating functions, determining their asymptotic behavior; their dominant term is controlled by the coefficients of the Lambert W function. The $\gamma$-positivity property follows directly from the recursion, extending the argument of Ferroni et al. proving $\gamma$-positivity for the Hilbert series of the Chow ring of matroids.


title: A multi-objective optimization framework for reducing the impact of ship noise on marine mammals

abstract: The underwater radiated noise (URN) emanating from ships presents a significant threat to marine mammals, given their heavy reliance on hearing for essential life activities. The intensity of URN from ships is directly correlated to the speed, making speed reduction a crucial operational mitigation strategy. This paper presents a new multi-objective optimization framework to optimize the ship speed for effective URN mitigation without compromising fuel consumption. The proposed framework addresses a fixed-path voyage scheduling problem, incorporating two objective functions namely (i) noise intensity levels and (ii) fuel consumption. The optimization is performed using the state-of-the-art non-dominated sorting genetic algorithm under voyage constraints. A 2D ocean acoustic environment, comprising randomly scattered marine mammals of diverse audiogram groups and realistic conditions, including sound speed profiles and bathymetry, is simulated. To estimate the objective functions, we consider empirical relations for fuel consumption and near-field noise modeling together with a ray-tracing approach for far-field noise propagation. The optimization problem is solved using the genetic algorithm to determine the Pareto solutions and subsequently the trade-off solution. The effectiveness of the optimization framework is demonstrated via both simplified tests and practical case studies involving a large container ship. A comparative analysis illustrates the adaptability of the optimization framework across different oceanic environments, affirming its potential as a robust tool for reducing the URN from shipping.


title: Recursive Chain-of-Feedback Prevents Performance Degradation from Redundant Prompting

abstract: Large Language Models (LLMs) frequently struggle with complex reasoning tasks, failing to construct logically sound steps towards the solution. In response to this behavior, users often try prompting the LLMs repeatedly in hopes of reaching a better response. This paper studies such repetitive behavior and its effect by defining a novel setting, Chain-of-Feedback (CoF). The setting takes questions that require multi-step reasoning as an input. Upon response, we repetitively prompt meaningless feedback (e.g. 'make another attempt') requesting additional trials. Surprisingly, our preliminary results show that repeated meaningless feedback gradually decreases the quality of the responses, eventually leading to a larger deviation from the intended outcome. To alleviate these troubles, we propose a novel method, Recursive Chain-of-Feedback (R-CoF). Following the logic of recursion in computer science, R-CoF recursively revises the initially incorrect response by breaking down each incorrect reasoning step into smaller individual problems. Our preliminary results show that majority of questions that LLMs fail to respond correctly can be answered using R-CoF without any sample data outlining the logical process.


title: Densely Decoded Networks with Adaptive Deep Supervision for Medical Image Segmentation

abstract: Medical image segmentation using deep neural networks has been highly successful. However, the effectiveness of these networks is often limited by inadequate dense prediction and inability to extract robust features. To achieve refined dense prediction, we propose densely decoded networks (ddn), by selectively introducing 'crutch' network connections. Such 'crutch' connections in each upsampling stage of the network decoder (1) enhance target localization by incorporating high resolution features from the encoder, and (2) improve segmentation by facilitating multi-stage contextual information flow. Further, we present a training strategy based on adaptive deep supervision (ads), which exploits and adapts specific attributes of input dataset, for robust feature extraction. In particular, ads strategically locates and deploys auxiliary supervision, by matching the average input object size with the layer-wise effective receptive fields (lerf) of a network, resulting in a class of ddns. Such inclusion of 'companion objective' from a specific hidden layer, helps the model pay close attention to some distinct input-dependent features, which the network might otherwise 'ignore' during training. Our new networks and training strategy are validated on 4 diverse datasets of different modalities, demonstrating their effectiveness.


title: Geodetic Research on Deception Island and its Environment (South Shetland Islands, Bransfield Sea and Antarctic Peninsula) During Spanish Antarctic Campaigns (1987-2007)

abstract: Since 1987, Spain has been continuously developing several scientific projects, mainly based on Earth Sciences, in Geodesy, Geochemistry, Geology or Volcanology. The need of a geodetic reference frame when doing hydrographic and topographic mapping meant the organization of the earlier campaigns with the main goals of updating the existing cartography and of making new maps of the area. During this period of time, new techniques arose in Space Geodesy improving the classical methodology and making possible its applications to other different fields such as tectonic or volcanism. Spanish Antarctic Geodetic activities from the 1987/1988 to 2006/2007 campaigns are described as well as a geodetic and a levelling network are presented. The first network, RGAE, was designed and established to define a reference frame in the region formed by the South Shetlands Islands, the Bransfield Sea and the Antarctic Peninsula whereas the second one, REGID, was planned to control the volcanic activity in Deception Island. Finally, the horizontal and vertical deformation models are described too, as well as the strategy which has been followed when computing an experimental geoid.


title: Vision-Language Models Provide Promptable Representations for Reinforcement Learning

abstract: Humans can quickly learn new behaviors by leveraging background world knowledge. In contrast, agents trained with reinforcement learning (RL) typically learn behaviors from scratch. We thus propose a novel approach that uses the vast amounts of general and indexable world knowledge encoded in vision-language models (VLMs) pre-trained on Internet-scale data for embodied RL. We initialize policies with VLMs by using them as promptable representations: embeddings that encode semantic features of visual observations based on the VLM's internal knowledge and reasoning capabilities, as elicited through prompts that provide task context and auxiliary information. We evaluate our approach on visually-complex, long horizon RL tasks in Minecraft and robot navigation in Habitat. We find that our policies trained on embeddings from off-the-shelf, general-purpose VLMs outperform equivalent policies trained on generic, non-promptable image embeddings. We also find our approach outperforms instruction-following methods and performs comparably to domain-specific embeddings. Finally, we show that our approach can use chain-of-thought prompting to produce representations of common-sense semantic reasoning, improving policy performance in novel scenes by 1.5 times.


title: Second-order charge and spin transport in LaO/STO system in the presence of cubic Rashba spin orbit couplings

abstract: Certain non-centrosymmetric materials with broken time-reversal symmetry may exhibit non-reciprocal transport behavior under an applied electric field in which the charge and spin currents contain components that are second order in the electric field. In this study, we investigate the second-order spin accumulation and charge and spin responses in the LaAlO$_3$/SrTiO$_3$ (LaO/STO) system with magnetic dopants under the influence of linear and cubic Rashba spin-orbit coupling (RSOC) terms. We explain the physical origin of the second-order response and perform a symmetry analysis of the first and second-order responses for different dopant magnetization directions relative to the applied electric field. We then numerically solve the Boltzmann transport equation by extending the approach of Schliemann and Loss [Phys. Rev. B 68, 165311] to higher orders in the electric field. We show that the sign of the second-order responses can be switched by varying the magnetization direction of the magnetic dopants or relative strengths of the two cubic RSOC terms and explain these trends by considering the Fermi surfaces of the respective systems. These findings provide insights into the interplay of multiple SOC effects in a LaO/STO system and how the resulting first- and second-order charge and spin responses can be engineered by exploiting the symmetries of the system.


title: Learning with Mixture of Prototypes for Out-of-Distribution Detection

abstract: Out-of-distribution (OOD) detection aims to detect testing samples far away from the in-distribution (ID) training data, which is crucial for the safe deployment of machine learning models in the real world. Distance-based OOD detection methods have emerged with enhanced deep representation learning. They identify unseen OOD samples by measuring their distances from ID class centroids or prototypes. However, existing approaches learn the representation relying on oversimplified data assumptions, e.g, modeling ID data of each class with one centroid class prototype or using loss functions not designed for OOD detection, which overlook the natural diversities within the data. Naively enforcing data samples of each class to be compact around only one prototype leads to inadequate modeling of realistic data and limited performance. To tackle these issues, we propose PrototypicAl Learning with a Mixture of prototypes (PALM) which models each class with multiple prototypes to capture the sample diversities, and learns more faithful and compact samples embeddings to enhance OOD detection. Our method automatically identifies and dynamically updates prototypes, assigning each sample to a subset of prototypes via reciprocal neighbor soft assignment weights. PALM optimizes a maximum likelihood estimation (MLE) loss to encourage the sample embeddings to be compact around the associated prototypes, as well as a contrastive loss on all prototypes to enhance intra-class compactness and inter-class discrimination at the prototype level. Moreover, the automatic estimation of prototypes enables our approach to be extended to the challenging OOD detection task with unlabelled ID data. Extensive experiments demonstrate the superiority of PALM, achieving state-of-the-art average AUROC performance of 93.82 on the challenging CIFAR-100 benchmark. Code is available at https://github.com/jeff024/PALM.


title: Half Quantum Mirror Hall Effect

abstract: We report the discovery of the half-quantized mirror Hall effect, a novel quantum-anomaly induced by mirror symmetry in a strong topological insulator (TI) film. These films are known to host a pair of gapless Dirac cones associated with surface electrons. Our findings reveal that mirror symmetry assigns a unique mirror parity to each Dirac cone, resulting in a half-quantized Hall conductance of $\pm\frac{e^{2}}{2h}$ for each cone. Despite the total electric Hall conductance being null due to time-reversal invariance, the difference in the Hall conductance between the two cones yields a quantized Hall conductance of $\frac{e^{2}}{h}$ for the difference in mirror currents. The effect of helical edge mirror current, a crucial feature of this quantum effect, can be determined by means of electrical measurements. Overall, the half-quantum mirror Hall effect reveals a new type of mirror-symmetry induced quantum anomaly in a time-reversal invariant lattice system, giving rise to a topological metallic state of matter with time-reversal invariance.


title: VlogQA: Task, Dataset, and Baseline Models for Vietnamese Spoken-Based Machine Reading Comprehension

abstract: This paper presents the development process of a Vietnamese spoken language corpus for machine reading comprehension (MRC) tasks and provides insights into the challenges and opportunities associated with using real-world data for machine reading comprehension tasks. The existing MRC corpora in Vietnamese mainly focus on formal written documents such as Wikipedia articles, online newspapers, or textbooks. In contrast, the VlogQA consists of 10,076 question-answer pairs based on 1,230 transcript documents sourced from YouTube -- an extensive source of user-uploaded content, covering the topics of food and travel. By capturing the spoken language of native Vietnamese speakers in natural settings, an obscure corner overlooked in Vietnamese research, the corpus provides a valuable resource for future research in reading comprehension tasks for the Vietnamese language. Regarding performance evaluation, our deep-learning models achieved the highest F1 score of 75.34% on the test set, indicating significant progress in machine reading comprehension for Vietnamese spoken language data. In terms of EM, the highest score we accomplished is 53.97%, which reflects the challenge in processing spoken-based content and highlights the need for further improvement.


title: RACER: An LLM-powered Methodology for Scalable Analysis of Semi-structured Mental Health Interviews

abstract: Semi-structured interviews (SSIs) are a commonly employed data-collection method in healthcare research, offering in-depth qualitative insights into subject experiences. Despite their value, the manual analysis of SSIs is notoriously time-consuming and labor-intensive, in part due to the difficulty of extracting and categorizing emotional responses, and challenges in scaling human evaluation for large populations. In this study, we develop RACER, a Large Language Model (LLM) based expert-guided automated pipeline that efficiently converts raw interview transcripts into insightful domain-relevant themes and sub-themes. We used RACER to analyze SSIs conducted with 93 healthcare professionals and trainees to assess the broad personal and professional mental health impacts of the COVID-19 crisis. RACER achieves moderately high agreement with two human evaluators (72%), which approaches the human inter-rater agreement (77%). Interestingly, LLMs and humans struggle with similar content involving nuanced emotional, ambivalent/dialectical, and psychological statements. Our study highlights the opportunities and challenges in using LLMs to improve research efficiency and opens new avenues for scalable analysis of SSIs in healthcare research.


title: Two-dimensional topological effect in a transmon qubit array with tunable couplings

abstract: We investigate a square-lattice architecture of superconducting transmon qubits with inter-qubit interactions mediated by inductive couplers. Therein, the inductive couling between the qubit and couplers is suggested to be designed into the gradiometer form to intigimate the flux noise orginating from the environment. Via periodically modulating the couplers,the Abelian gauge potential, termed effective magnetic flux, can be synthesized artificially, making the system an excellent platform for simulating two-dimensional topological physics. In the simplest two-dimensional model, the double (or three-leg) ladder, the staggered vortex-Meissner phase transition different from that in the two-leg ladder can be found in the single-particle ground state as the effective magnetic flux varies. Besides, the large coupling ratio between the interleg and intraleg coupling strengths also makes the chiral current resemble squeezed sinusoidal functions. If the row number is further increased, the topological band structure anticipated at massive rows begins to occur even for a relatively small number of rows (ten or so for the considered parameters). This heralds a small circuit scale to observe the topological band. The edge state in the band gap is determined by the topological Chern number and can be calculated through integrating the Berry curvature with respect to the first Brillouin zone. Besides, we present a systematic method on how to measure the topological band structure based on time- and space-domain Frourier transformation of the wave function after properly excited. The result offers an avenue for simulating two-dimensional topological physics on the state-of-the-art superconducting quantum chips.


title: Multi-step Problem Solving Through a Verifier: An Empirical Analysis on Model-induced Process Supervision

abstract: Process supervision, using a trained verifier to evaluate the intermediate steps generated by reasoner, has demonstrated significant improvements in multi-step problem solving. In this paper, to avoid expensive human annotation effort on the verifier training data, we introduce Model-induced Process Supervision (MiPS), a novel method for automating data curation. MiPS annotates an intermediate step by sampling completions of this solution through the reasoning model, and obtaining an accuracy defined as the proportion of correct completions. Errors in the reasoner would cause MiPS to underestimate the accuracy of intermediate steps, therefore, we suggest and empirically show that verification focusing on high predicted scores of the verifier shall be preferred over that of low predicted scores, contrary to prior work. Our approach significantly improves the performance of PaLM 2 on math and coding tasks (accuracy +0.67% on GSM8K, +4.16% on MATH, +0.92% on MBPP compared with an output supervision trained verifier). Additionally, our study demonstrates that the verifier exhibits strong generalization ability across different reasoning models.


title: Observational signatures of the dust size evolution in isolated galaxy simulations

abstract: We aim to provide observational signatures of the dust size evolution in the ISM, in particular exploring indicators of polycyclic aromatic hydrocarbon (PAH) mass fraction ($q_{PAH}$) defined as the mass fraction of PAHs relative to total dust grains. Additionally, we validate our dust evolution model by comparing the observational signatures from our simulations to those from observations. We model the evolution of grain size distribution of Milky Way-like and NGC 628-like galaxies representing star-forming galaxies with a hydrodynamic simulation code, GADGET4-OSAKA, which considers dust production and interstellar processing. Furthermore, we perform post-processing dust radiative transfer with SKIRT based on the simulations to predict the observational properties. We find that the intensity ratio between 8 um and 24 um correlates with $q_{PAH}$ and can be used as an indicator of PAH mass fraction. However, this ratio is influenced by the radiation field. As another indicator, we suggest the 8 um-to-total infrared intensity ratio ($\nu I_\nu(8 \mu m)/I$(TIR)), which tightly correlates with $q_{PAH}$. Furthermore, we explore the spatial evolution of $q_{PAH}$ in the simulated Milky Way-like galaxy using $\nu I_\nu(8 \mu m)/I$(TIR). We find that the spatially resolved $q_{PAH}$ increases with metallicity at lower metallicity (Z<0.2 Zsun) due to the interplay between accretion and shattering while it decreases with metallicity at higher metallicity (Z>0.2 Zsun) due to coagulation. Finally, we compare the above indicators in the NGC 628-like simulation with those observed in NGC 628. Consequently, our simulation underestimates the PAH mass fraction throughout the entire galaxy. This is probably because PAH is too efficiently lost by coagulation in the interstellar medium in our model, which suggests that the inhibition of coagulation of the PAHs is key to enhancing PAH formation.


title: Stirling-Ramanujan constants are exponential periods

abstract: Ramanujan studied a general class of Stirling constants that are the resummation of some natural divergent series. These constants include the classical Euler-Mascheroni, Stirling and Glaisher-Kinkelin constants. We find natural integral representations for all these constants that appear as exponential periods in the field $\mathbb Q (t,e^{-t})$ which reveals their natural transalgebraic nature. We conjecture that all these constants are transcendental numbers. Euler-Mascheroni's and Stirling's integral formula are classical, but the integral formula for Glaisher-Kinkelin appears to be new, as well as the integral formulas for the higher Stirling-Ramanujan constants. The method presented generalizes naturally to prove that many other constants are exponential periods over the field $\mathbb Q(t,e^{-t})$.


title: GraphRT: A graph-based deep learning model for predicting the retention time of peptides

abstract: GraphRT is a graph based deep learning model that predicts the retention time (RT) of peptides in liquid chromatography tandem mass spectrometry (LC MSMS) experiments. Each amino acid is represented as a graph, capturing its atomic and structural properties through a graph neural network. This enables the model to understand not just the chemical composition of each amino acid, but also the intricate relationships between its atoms. The sequential context of the peptide the order and interaction of amino acids in the sequence is then encoded using recurrent neural networks. This dual approach of graph based and sequential modelling allows for a comprehensive understanding of both the individual characteristics of amino acids and their collective behaviour in a peptide sequence. GraphRT outperforms all current state of the art models and can predict retention time for peptides containing unseen modifications.


title: Image-Caption Encoding for Improving Zero-Shot Generalization

abstract: Recent advances in vision-language models have combined contrastive approaches with generative methods to achieve state-of-the-art (SOTA) on downstream inference tasks like zero-shot image classification. However, a persistent issue of these models for image classification is their out-of-distribution (OOD) generalization capabilities. We first show that when an OOD data point is misclassified, the correct class can be typically found in the Top-K predicted classes. In order to steer the model prediction toward the correct class within the top predicted classes, we propose the Image-Caption Encoding (ICE) method, a straightforward approach that directly enforces consistency between the image-conditioned and caption-conditioned predictions at evaluation time only. Intuitively, we take advantage of unique properties of the generated captions to guide our local search for the correct class label within the Top-K predicted classes. We show that our method can be easily combined with other SOTA methods to enhance Top-1 OOD accuracies by 0.5% on average and up to 3% on challenging datasets. Our code: https://github.com/Chris210634/ice


title: Counterfactual Fairness Is Not Demographic Parity, and Other Observations

abstract: Blanket statements of equivalence between causal concepts and purely probabilistic concepts should be approached with care. In this short note, I examine a recent claim that counterfactual fairness is equivalent to demographic parity. The claim fails to hold up upon closer examination. I will take the opportunity to address some broader misunderstandings about counterfactual fairness.


title: Statistical Inference for Generalized Integer Autoregressive Processes

abstract: A popular and flexible time series model for counts is the generalized integer autoregressive process of order $p$, GINAR($p$). These Markov processes are defined using thinning operators evaluated on past values of the process along with a discretely-valued innovation process. This class includes the commonly used INAR($p$) process, defined with binomial thinning and Poisson innovations. GINAR processes can be used in a variety of settings, including modeling time series with low counts, and allow for more general mean-variance relationships, capturing both over- or under-dispersion. While there are many thinning operators and innovation processes given in the literature, less focus has been spent on comparing statistical inference and forecasting procedures over different choices of GINAR process. We provide an extensive study of exact and approximate inference and forecasting methods that can be applied to a wide class of GINAR($p$) processes with general thinning and innovation parameters. We discuss the challenges of exact estimation when $p$ is larger. We summarize and extend asymptotic results for estimators of process parameters, and present simulations to compare small sample performance, highlighting how different methods compare. We illustrate this methodology by fitting GINAR processes to a disease surveillance series.


title: Utility-Based Reinforcement Learning: Unifying Single-objective and Multi-objective Reinforcement Learning

abstract: Research in multi-objective reinforcement learning (MORL) has introduced the utility-based paradigm, which makes use of both environmental rewards and a function that defines the utility derived by the user from those rewards. In this paper we extend this paradigm to the context of single-objective reinforcement learning (RL), and outline multiple potential benefits including the ability to perform multi-policy learning across tasks relating to uncertain objectives, risk-aware RL, discounting, and safe RL. We also examine the algorithmic implications of adopting a utility-based approach.


title: Using child-woman ratios to infer demographic rates in historical populations with limited data

abstract: Data on historical populations often extends no further than numbers of people by broad age-sex group, with nothing on numbers of births or deaths. Demographers studying these populations have experimented with methods that use the data on numbers of people to infer birth and death rates. These methods have, however, received little attention since they were first developed in the 1960s. We revisit the problem of inferring demographic rates from population structure, spelling out the assumptions needed, and specialising the methods to the case where only child-woman ratios are available. We apply the methods to the case of Maori populations in nineteenth-century Aotearoa New Zealand. We find that, in this particular case, the methods reveal as much about the nature of the data as they do about historical demographic conditions.


title: A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations

abstract: This paper aims to analyze errors in the implementation of the Physics-Informed Neural Network (PINN) for solving the Allen--Cahn (AC) and Cahn--Hilliard (CH) partial differential equations (PDEs). The accuracy of PINN is still challenged when dealing with strongly non-linear and higher-order time-varying PDEs. To address this issue, we introduce a stable and bounded self-adaptive weighting scheme known as Residuals-RAE, which ensures fair training and effectively captures the solution. By incorporating this new training loss function, we conduct numerical experiments on 1D and 2D AC and CH systems to validate our theoretical findings. Our theoretical analysis demonstrates that feedforward neural networks with two hidden layers and tanh activation function effectively bound the PINN approximation errors for the solution field, temporal derivative, and nonlinear term of the AC and CH equations by the training loss and number of collocation points.


title: Practical Rateless Set Reconciliation

abstract: Set reconciliation, where two parties hold fixed-length bit strings and run a protocol to learn the strings they are missing from each other, is a fundamental task in many distributed systems. We present Rateless Invertible Bloom Lookup Tables (Rateless IBLT), the first set reconciliation protocol, to the best of our knowledge, that achieves low computation cost and near-optimal communication cost across a wide range of scenarios: set differences of one to millions, bit strings of a few bytes to megabytes, and workloads injected by potential adversaries. Rateless IBLT is based on a novel encoder that incrementally encodes the set difference into an infinite stream of coded symbols, resembling rateless error-correcting codes. We compare Rateless IBLT with state-of-the-art set reconciliation schemes and demonstrate significant improvements. Rateless IBLT achieves 3--4x lower communication cost than non-rateless schemes with similar computation cost, and 2--2000x lower computation cost than schemes with similar communication cost. We show the real-world benefits of Rateless IBLT by applying it to synchronize the state of the Ethereum blockchain, and demonstrate 5.6x lower end-to-end completion time and 4.4x lower communication cost compared to the system used in production.


title: 3D NLTE Lithium abundances for late-type stars in GALAH DR3

abstract: Lithium's susceptibility to burning in stellar interiors makes it an invaluable tracer for delineating the evolutionary pathways of stars, offering insights into the processes governing their development. Observationally, the complex Li production and depletion mechanisms in stars manifest themselves as Li plateaus, and as Li-enhanced and Li-depleted regions of the HR diagram. The Li-dip represents a narrow range in effective temperature close to the main-sequence turn-off, where stars have slightly super-solar masses and strongly depleted Li. To study the modification of Li through stellar evolution, we measure 3D non-local thermodynamic equilibrium (NLTE) Li abundance for 581 149 stars released in GALAH DR3. We describe a novel method that fits the observed spectra using a combination of 3D NLTE Li line profiles with blending metal line strength that are optimized on a star-by-star basis. Furthermore, realistic errors are determined by a Monte Carlo nested sampling algorithm which samples the posterior distribution of the fitted spectral parameters. The method is validated by recovering parameters from a synthetic spectrum and comparing to 26 stars in the Hypatia catalogue. We find 228 613 Li detections, and 352 536 Li upper limits. Our abundance measurements are generally lower than GALAH DR3, with a mean difference of 0.23 dex. For the first time, we trace the evolution of Li-dip stars beyond the main sequence turn-off and up the subgiant branch. This is the first 3D NLTE analysis of Li applied to a large spectroscopic survey, and opens up a new era of precision analysis of abundances for large surveys.


title: On the integrability of extended test body dynamics around black holes

abstract: In general relativity, the motion of an extended test body is influenced by its proper rotation, or spin. We present a covariant and physically self-consistent Hamiltonian framework to study this motion, up to quadratic order in the body's spin, including a spin-induced quadrupole, and in an arbitrary background spacetime. The choice of spin supplementary condition and degeneracies associated with local Lorentz invariance are treated rigorously with adapted tools from Hamiltonian mechanics. Applying the formalism to a background space-time described by the Kerr metric, we prove that the motion of any test compact object around a rotating black hole defines an integrable Hamiltonian system to linear order in the body's spin. Moreover, this integrability still holds at quadratic order in spin when the compact object has the deformability expected for an isolated black hole. Our analytical results shed light on longstanding numerical conjectures regarding spin-induced chaos in the motion of asymmetric compact binaries, and provides a powerful framework to improve current gravitational waveform modelling to account for spin-induced extended body effects.


title: On star-homogeneous-graded polynomial identities of upper triangular matrices over an arbitrary field

abstract: We study the graded polynomial identities with a homogeneous involution on the algebra of upper triangular matrices endowed with a fine group grading. We compute their polynomial identities and a basis of the relatively free algebra, considering an arbitrary base field. We obtain the asymptotic behaviour of the codimension sequence when the characteristic of the base field is zero. As a consequence, we compute the exponent and the second exponent of the same algebra endowed with any group grading and any homogeneous involution.


title: Estimation of conditional average treatment effects on distributed data: A privacy-preserving approach

abstract: Estimation of conditional average treatment effects (CATEs) is an important topic in sciences. CATEs can be estimated with high accuracy if distributed data across multiple parties can be centralized. However, it is difficult to aggregate such data owing to privacy concerns. To address this issue, we proposed data collaboration double machine learning, a method that can estimate CATE models with privacy preservation of distributed data, and evaluated the method through simulations. Our contributions are summarized in the following three points. First, our method enables estimation and testing of semi-parametric CATE models without iterative communication on distributed data. Semi-parametric CATE models enable estimation and testing that is more robust to model mis-specification than parametric models. Second, our method enables collaborative estimation between multiple time points and different parties. Third, our method performed equally or better than other methods in simulations using synthetic, semi-synthetic and real-world datasets.


title: A Unified Framework of Multi-Stage Multi-Winner Voting: An Axiomatic Exploration

abstract: Multi-winner voting plays a crucial role in selecting representative committees based on voter preferences. Previous research has predominantly focused on single-stage voting rules, which are susceptible to manipulation during preference collection. In order to mitigate manipulation and increase the cost associated with it, we propose the introduction of multiple stages in the voting procedure, leading to the development of a unified framework of multi-stage multi-winner voting rules. To shed light on this framework of voting methods, we conduct an axiomatic study, establishing provable conditions for achieving desired axioms within our model. Our theoretical findings can serve as a guide for the selection of appropriate multi-stage multi-winner voting rules.


title: Modeling X-ray and gamma-ray emission from redback pulsar binaries

abstract: We investigated the multiband emission from the pulsar binaries XSS J12270-4859, PSR J2039-5617, and PSR J2339-0533, which exhibit orbital modulation in the X-ray and gamma-ray bands. We constructed the sources' broadband spectral energy distributions and multiband orbital light curves by supplementing our X-ray measurements with published gamma-ray results, and we modeled the data using intra-binary shock (IBS) scenarios. While the X-ray data were well explained by synchrotron emission from electrons/positrons in the IBS, the gamma-ray data were difficult to explain with the IBS components alone. Therefore, we explored other scenarios that had been suggested for gamma-ray emission from pulsar binaries: (1) inverse-Compton emission in the upstream unshocked wind zone and (2) synchrotron radiation from electrons/positrons interacting with a kilogauss magnetic field of the companion. Scenario (1) requires that the bulk motion of the wind substantially decelerates to ~1000km/s before reaching the IBS for increased residence time, in which case formation of a strong shock is untenable, inconsistent with the X-ray phenomenology. Scenario (2) can explain the data if we assume the presence of electrons/positrons with a Lorentz factor of ~$10^8$ (~0.1 PeV) that pass through the IBS and tap a substantial portion of the pulsar voltage drop. These findings raise the possibility that the orbitally-modulating gamma-ray signals from pulsar binaries can provide insights into the flow structure and energy conversion within pulsar winds and particle acceleration nearing PeV energies in pulsars. These signals may also yield greater understanding of kilogauss magnetic fields potentially hosted by the low-mass stars in these systems.


title: Verifiable evaluations of machine learning models using zkSNARKs

abstract: In a world of increasing closed-source commercial machine learning models, model evaluations from developers must be taken at face value. These benchmark results-whether over task accuracy, bias evaluations, or safety checks-are traditionally impossible to verify by a model end-user without the costly or impossible process of re-performing the benchmark on black-box model outputs. This work presents a method of verifiable model evaluation using model inference through zkSNARKs. The resulting zero-knowledge computational proofs of model outputs over datasets can be packaged into verifiable evaluation attestations showing that models with fixed private weights achieve stated performance or fairness metrics over public inputs. We present a flexible proving system that enables verifiable attestations to be performed on any standard neural network model with varying compute requirements. For the first time, we demonstrate this across a sample of real-world models and highlight key challenges and design solutions. This presents a new transparency paradigm in the verifiable evaluation of private models.