title: Effective Learning with Node Perturbation in Multi-Layer Neural Networks

abstract: Backpropagation (BP) remains the dominant and most successful method for training parameters of deep neural network models. However, BP relies on two computationally distinct phases, does not provide a satisfactory explanation of biological learning, and can be challenging to apply for training of networks with discontinuities or noisy node dynamics. By comparison, node perturbation (NP) proposes learning by the injection of noise into network activations, and subsequent measurement of the induced loss change. NP relies on two forward (inference) passes, does not make use of network derivatives, and has been proposed as a model for learning in biological systems. However, standard NP is highly data inefficient and unstable due to its unguided noise-based search process. In this work, we investigate different formulations of NP and relate it to the concept of directional derivatives as well as combining it with a decorrelating mechanism for layer-wise inputs. We find that a closer alignment with directional derivatives together with input decorrelation at every layer strongly enhances performance of NP learning with large improvements in parameter convergence and much higher performance on the test data, approaching that of BP. Furthermore, our novel formulation allows for application to noisy systems in which the noise process itself is inaccessible.


title: A sublinear time quantum algorithm for longest common substring problem between run-length encoded strings

abstract: We give a sublinear quantum algorithm for the longest common substring (LCS) problem on the run-length encoded (RLE) inputs, under the assumption that the prefix-sums of the runs are given. Our algorithm costs $\tilde{O}(n^{5/6})\cdot O(\mathrm{polylog}(\tilde{n}))$ time, where $n$ and $\tilde{n}$ are the encoded and decoded length of the inputs, respectively. We justify the use of the prefix-sum oracles by showing that, without the oracles, there is a $\Omega(n/\log^2n)$ lower-bound on the quantum query complexity of finding LCS given two RLE strings due to a reduction of $\mathsf{PARITY}$ to the problem.


title: MiCRO: Near-Zero Cost Gradient Sparsification for Scaling and Accelerating Distributed DNN Training

abstract: Gradient sparsification is a communication optimisation technique for scaling and accelerating distributed deep neural network (DNN) training. It reduces the increasing communication traffic for gradient aggregation. However, existing sparsifiers have poor scalability because of the high computational cost of gradient selection and/or increase in communication traffic. In particular, an increase in communication traffic is caused by gradient build-up and inappropriate threshold for gradient selection. To address these challenges, we propose a novel gradient sparsification method called MiCRO. In MiCRO, the gradient vector is partitioned, and each partition is assigned to the corresponding worker. Each worker then selects gradients from its partition, and the aggregated gradients are free from gradient build-up. Moreover, MiCRO estimates the accurate threshold to maintain the communication traffic as per user requirement by minimising the compression ratio error. MiCRO enables near-zero cost gradient sparsification by solving existing problems that hinder the scalability and acceleration of distributed DNN training. In our extensive experiments, MiCRO outperformed state-of-the-art sparsifiers with an outstanding convergence rate.


title: Variance-Aware Regret Bounds for Stochastic Contextual Dueling Bandits

abstract: Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and recommendation systems. While substantial efforts have been made to minimize the cumulative regret in dueling bandits, a notable gap in the current research is the absence of regret bounds that account for the inherent uncertainty in pairwise comparisons between the dueling arms. Intuitively, greater uncertainty suggests a higher level of difficulty in the problem. To bridge this gap, this paper studies the problem of contextual dueling bandits, where the binary comparison of dueling arms is generated from a generalized linear model (GLM). We propose a new SupLinUCB-type algorithm that enjoys computational efficiency and a variance-aware regret bound $\tilde O\big(d\sqrt{\sum_{t=1}^T\sigma_t^2} + d\big)$, where $\sigma_t$ is the variance of the pairwise comparison in round $t$, $d$ is the dimension of the context vectors, and $T$ is the time horizon. Our regret bound naturally aligns with the intuitive expectation in scenarios where the comparison is deterministic, the algorithm only suffers from an $\tilde O(d)$ regret. We perform empirical experiments on synthetic data to confirm the advantage of our method over previous variance-agnostic algorithms.


title: Two-Parameter Novikov-Shubin Invariants for Fibre Bundles

abstract: In this paper we construct a two-parameter version of spectral density functions and Novikov-Shubin invariants on fibre bundles. The aim of this approach is to gain a better understanding of how the near-zero spectrum of the Hodge Laplace operators on the fibre and the base of a fibre bundle contribute separately to the near-zero spectrum of the Laplace operators of the total space. We show that this two-parameter generalisation of the classical spectral density function still satisfies several invariance properties. As an example, we compute it explicitly for the three-dimensional Heisenberg group.


title: EALM: Introducing Multidimensional Ethical Alignment in Conversational Information Retrieval

abstract: Artificial intelligence (AI) technologies should adhere to human norms to better serve our society and avoid disseminating harmful or misleading information, particularly in Conversational Information Retrieval (CIR). Previous work, including approaches and datasets, has not always been successful or sufficiently robust in taking human norms into consideration. To this end, we introduce a workflow that integrates ethical alignment, with an initial ethical judgment stage for efficient data screening. To address the need for ethical judgment in CIR, we present the QA-ETHICS dataset, adapted from the ETHICS benchmark, which serves as an evaluation tool by unifying scenarios and label meanings. However, each scenario only considers one ethical concept. Therefore, we introduce the MP-ETHICS dataset to evaluate a scenario under multiple ethical concepts, such as justice and Deontology. In addition, we suggest a new approach that achieves top performance in both binary and multi-label ethical judgment tasks. Our research provides a practical method for introducing ethical alignment into the CIR workflow. The data and code are available at https://github.com/wanng-ide/ealm .


title: BeBOP -- Combining Reactive Planning and Bayesian Optimization to Solve Robotic Manipulation Tasks

abstract: Robotic systems for manipulation tasks are increasingly expected to be easy to configure for new tasks. While in the past, robot programs were often written statically and tuned manually, the current, faster transition times call for robust, modular and interpretable solutions that also allow a robotic system to learn how to perform a task. We propose the method Behavior-based Bayesian Optimization and Planning (BeBOP) that combines two approaches for generating behavior trees: we build the structure using a reactive planner and learn specific parameters with Bayesian optimization. The method is evaluated on a set of robotic manipulation benchmarks and is shown to outperform state-of-the-art reinforcement learning algorithms by being up to 46 times faster while simultaneously being less dependent on reward shaping. We also propose a modification to the uncertainty estimate for the random forest surrogate models that drastically improves the results.


title: On the completely positive kernels for nonuniform meshes

abstract: The complete positivity, i.e., positivity of the resolvent kernels, for convolutional kernels is an important property for the positivity property and asymptotic behaviors of Volterra equations. We inverstigate the discrete analogue of the complete positivity properties, especially for convolutional kernels on nonuniform meshes. Through an operation which we call pseudo-convolution, we introduce the complete positivity property for discrete kernels on nonuniform meshes and establish the criterion for the complete positivity. Lastly, we apply our theory to the L1 discretization of time fractional differential equations on nonuniform meshes.


title: Model-Checking in the Loop Model-Based Testing for Automotive Operating Systems

abstract: While vehicles have primarily been controlled through mechanical means in years past, an increasing number of embedded control systems are being installed and used, keeping pace with advances in electronic control technology and performance. Automotive systems consist of multiple components developed by a range of vendors. To accelerate developments in embedded control systems, industrial standards such as AUTOSAR are being defined for automotive systems, including the design of operating system and middleware technologies. Crucial to ensuring the safety of automotive systems, the operating system is foundational software on which many automotive applications are executed. In this paper, we propose an integrated model-based method for verifying automotive operating systems; our method is called Model-Checking in the Loop Model-Based Testing (MCIL-MBT). In MCIL-MBT, we create a model that formalizes specifications of automotive operating systems and verifies the specifications via model-checking. Next, we conduct model-based testing with the verified model to ensure that a specific operating system implementation conforms to the model. These verification and testing stages are iterated over until no flaws are detected. Our method has already been introduced to an automotive system supplier and an operating system vendor. Through our approach, we successfully identified flaws that were not detected by conventional review and testing methods.


title: The motivic Adams conjecture

abstract: We solve a motivic version of the Adams conjecture with the exponential characteristic of the base field inverted. In the way of the proof we show that the higher motivic stable stems are of bounded torsion and obtain a motivic version of mod k Dold theorem. We also give a motivic version of Brown's trick studying the homogeneous variety of maximal tori in a general linear group, which turns out to be not stably A1-connected.


title: Performance Analysis of Synchronous Motor Drives under Concurrent Errors in Position and Current Sensing

abstract: Field oriented control of permanent magnet synchronous motor drives involves the closed-loop regulation of currents in the synchronous reference frame. The current feedback is directly affected by errors in both position and stationary frame current measurements. This paper presents the exact analytical expression for estimated synchronous frame currents under simultaneous errors in both sensors along with a detailed analysis of the incorrect estimation on the closed-loop current control performance.


title: Fair Division with Subjective Divisibility

abstract: The classic fair division problems assume the resources to be allocated are either divisible or indivisible, or contain a mixture of both, but the agents always have a predetermined and uncontroversial agreement on the (in)divisibility of the resources. In this paper, we propose and study a new model for fair division in which agents have their own subjective divisibility over the goods to be allocated. That is, some agents may find a good to be indivisible and get utilities only if they receive the whole good, while others may consider the same good to be divisible and thus can extract utilities according to the fraction of the good they receive. We investigate fairness properties that can be achieved when agents have subjective divisibility. First, we consider the maximin share (MMS) guarantee and show that the worst-case MMS approximation guarantee is at most $2/3$ for $n \geq 2$ agents and this ratio is tight in the two- and three-agent cases. This is in contrast to the classic fair division settings involving two or three agents. We also give an algorithm that produces a $1/2$-MMS allocation for an arbitrary number of agents. Second, we adapt the notion of envy-freeness for mixed goods (EFM) to our model and show that EFM is incompatible with non-wastefulness, a rather weak economic efficiency notion. On the positive side, we prove that an EFM and non-wasteful allocation always exists for two agents if at most one good is discarded.


title: Position Sensing Errors in Synchronous Motor Drives

abstract: Non-ideal position estimation results in degraded performance of synchronous motor drive systems due to reduction of the average capability of the drive as well as torque harmonics of different orders. The signature and extent of the performance degradation is further dependent, quite significantly, on the current control architecture, i.e., feedforward or feedback control, employed. This paper presents a comprehensive analysis of non-idealities or errors in position estimation and their effects on the control performance of synchronous motor drives. Analytical models capturing the error in various signals caused by position sensing errors in the drive system for different control architectures are presented and are validated with simulation and experimental results on a prototype permanent magnet synchronous motor drive.


title: Convergence to decorated L\'evy processes in non-Skorohod topologies for dynamical systems

abstract: We present a general framework for weak convergence to decorated L\'evy processes in enriched spaces of c\`adl\`ag functions for vector-valued processes arising in deterministic systems. Applications include uniformly expanding maps and unbounded observables as well as nonuniformly expanding/hyperbolic maps with bounded observables. The latter includes intermittent maps and dispersing billiards with flat cusps. In many of these examples, convergence fails in all of the Skorohod topologies. Moreover, the enriched space picks up details of excursions that are not recorded by Skorohod or Whitt topologies.


title: Gevrey WKB method for PDO's of real principal type

abstract: In this article we investigate the Gevrey version of the WKB method known in the smooth and analytic categories. We use conjugation by FIO's and sketch a calculus of FIO's in our setting which the semi classic one. We have sub exponential remainders with respect to the parameter. We sketch also an alternative method using Gevrey local FBI transforms.


title: Exclusive production of $T^ {-} _{cc}$ in hadron-hadron ultraperipheral collisions

abstract: Understanding the production mechanisms and utilizing them as probes to investigate the structure of exotic states represent some of the most actively studied research areas in particle physics. In this study, we present a theoretical analysis of the charmed meson $T^{-}_{cc}$ in the $\gamma{}p\to{}D^{+}T^{-}_{cc}\Lambda^{+}_{c}$ and $\gamma\gamma\to{}D^{+}T^{-}_{cc}D^{*0}$ reactions, considering $T^{+}_{cc}$ as a $DD^{*}$ molecule. The differential cross-section and total cross-section for the photoproduction of $T^{-}_{cc}$ in the $\gamma{}p\to{}D^+T^{-}_{cc}\Lambda^{+}_{c}$ and $\gamma\gamma\to{}D^{+}T^{-}_{cc}D^{*0}$ reactions are presented for nucleus-nucleus (nucleon-nucleon) ultraperipheral collisions at HL-LHC and RHIC, respectively. Taking into account the integrated luminosity per typical run and the luminosity of photons from the nucleus (nucleon), we observe a significant event count for $T^ {-} _{cc}$ production in p-p ultraperipheral collisions at HL-LHC.


title: Using Reinforcement Learning to Optimize Responses in Care Processes: A Case Study on Aggression Incidents

abstract: Previous studies have used prescriptive process monitoring to find actionable policies in business processes and conducted case studies in similar domains, such as the loan application process and the traffic fine process. However, care processes tend to be more dynamic and complex. For example, at any stage of a care process, a multitude of actions is possible. In this paper, we follow the reinforcement approach and train a Markov decision process using event data from a care process. The goal was to find optimal policies for staff members when clients are displaying any type of aggressive behavior. We used the reinforcement learning algorithms Q-learning and SARSA to find optimal policies. Results showed that the policies derived from these algorithms are similar to the most frequent actions currently used but provide the staff members with a few more options in certain situations.


title: ViPlanner: Visual Semantic Imperative Learning for Local Navigation

abstract: Real-time path planning in outdoor environments still challenges modern robotic systems due to differences in terrain traversability, diverse obstacles, and the necessity for fast decision-making. Established approaches have primarily focused on geometric navigation solutions, which work well for structured geometric obstacles but have limitations regarding the semantic interpretation of different terrain types and their affordances. Moreover, these methods fail to identify traversable geometric occurrences, such as stairs. To overcome these issues, we introduce ViPlanner, a learned local path planning approach that generates local plans based on geometric and semantic information. The system is trained using the Imperative Learning paradigm, for which the network weights are optimized end-to-end based on the planning task objective. This optimization uses a differentiable formulation of a semantic costmap, which enables the planner to distinguish between the traversability of different terrains and accurately identify obstacles. The semantic information is represented in 30 classes using an RGB colorspace that can effectively encode the multiple levels of traversability. We show that the planner can adapt to diverse real-world environments without requiring any real-world training. In fact, the planner is trained purely in simulation, enabling a highly scalable training data generation. Experimental results demonstrate resistance to noise, zero-shot sim-to-real transfer, and a decrease of 38.02% in terms of traversability cost compared to purely geometric-based approaches. Code and models are made publicly available: https://github.com/leggedrobotics/viplanner.


title: Softening of $dd$ excitation in the resonant inelastic x-ray scattering spectra as a signature of Hund's coupling in nickelates

abstract: We investigate the effects of Hund's coupling on the resonant X-ray absorption spectra of the recently discovered family of layered nickelate superconductors. We contrast two scenarios depending on the relative strength of the ratio of the effective Hund's coupling ($J_H$) to the crystal fields ($\Delta$) in these systems. We carry out the cluster and DFT+DMFT simulations of the RIXS signal at the Ni $L$-edge for different values of Hund's coupling. We find the latter dominates for the parent compound while the former becomes important for sufficiently large doping. Our results are consistent with the observations of a softening of a RIXS peak as a function of doping by Rossi {\sl et al.}~\cite{PhysRevB.104.L220505}, only when the Hund coupling is sizeable. To interpret the results, we separate the theoretical RIXS signal into spin conserving and non-spin conserving channels and conclude that the infinite layer nickelates are in a regime where $\Delta$ and $J$ compete effectively and suggest further experimental tests of the theory.


title: Breaking Through the Plasma Wavelength Barrier to Extend the Transparency Range of Ultrathin Indium Tin Oxide Films into the Far Infrared

abstract: Indium tin oxide (ITO) film, which is the most commonly used transparent conductive film (TCF), has traditionally been believed to be transparent in the visible spectrum but to reflect infrared (IR) light beyond the plasma wavelength (${\lambda}_p$). However, our theoretical analysis challenges this notion by demonstrating that an ultrathin ITO TCF that is thinner than the light's penetration depth, can overcome the transmission barrier at ${\lambda}_p$. To validate the theoretical modeling, we have successfully fabricated ITO films that, despite having ${\lambda}_p \approx$ 1 ${\mu}$m, remain transparent from 400 nm to 20 ${\mu}$m. This represents the broadest transparency range ever reported for any In$_2$O$_3$-based TCF. The 10-nm-thick ITO TCFs have high visible transmittance (91.0% at 550 nm), low resistivity (5 $\times$ 10$^{-4}$ ${\Omega}\cdot$ cm), and good IR transmittance (averaging 60% over 1.35 $\unicode{x2013}$ 18.35 ${\mu}$m). Their IR transparency facilitates radiative cooling of the underlying circuitry. When an operational resistor is enclosed by commercial ITO TCFs that are 140 nm thick, its temperature increases. However, using 10-nm-thick ITO TCFs instead of the commercial ones can completely avoid this temperature rise. Moreover, attaching a silver grid to a 10-nm-thick ITO TCF can reduce the effective sheet resistance to ~10 ${\Omega}/\square$ at the expense of only ~3% transmittance. This development paves the way for large-scale applications that require low sheet resistance and far-IR transparency.


title: Breakdown of Linear Spin-Wave Theory in a Non-Hermitian Quantum Spin Chain

abstract: We present the spin-wave theory of the excitation spectrum and quench dynamics of the non-Hermitian transverse-field Ising model. The complex excitation spectrum is obtained for a generic hypercubic lattice using the linear approximation of the Holstein-Primakoff transformation together with the complex bosonic Bogolyubov transformation. In the one-dimensional case, our result compares very well with the exact quasiparticle dispersion relation obtained via a fermionic representation of the problem, at least in the regime of large dissipation and transverse field. When applied to the quench dynamics we show however that the linear spin-wave approximation breaks down and the bosonic theory is plagued by a divergence at finite times. We understand the origin of this instability using a single mode approximation. While limited to short times, we show that this approach allows us to characterize the dynamics arising from the quench of the dissipative term and the structure of the Lieb-Robinson light-cone of the propagation quantum correlations. Furthermore, for the one-dimensional case, the linear spin-wave dynamics shows good agreement with the exact fermionic solution, both for the local magnetization and the spin-spin correlations.


title: Multi-task Learning with 3D-Aware Regularization

abstract: Deep neural networks have become a standard building block for designing models that can perform multiple dense computer vision tasks such as depth estimation and semantic segmentation thanks to their ability to capture complex correlations in high dimensional feature space across tasks. However, the cross-task correlations that are learned in the unstructured feature space can be extremely noisy and susceptible to overfitting, consequently hurting performance. We propose to address this problem by introducing a structured 3D-aware regularizer which interfaces multiple tasks through the projection of features extracted from an image encoder to a shared 3D feature space and decodes them into their task output space through differentiable rendering. We show that the proposed method is architecture agnostic and can be plugged into various prior multi-task backbones to improve their performance; as we evidence using standard benchmarks NYUv2 and PASCAL-Context.


title: A Theoretical Analysis of the Test Error of Finite-Rank Kernel Ridge Regression

abstract: Existing statistical learning guarantees for general kernel regressors often yield loose bounds when used with finite-rank kernels. Yet, finite-rank kernels naturally appear in several machine learning problems, e.g.\ when fine-tuning a pre-trained deep neural network's last layer to adapt it to a novel task when performing transfer learning. We address this gap for finite-rank kernel ridge regression (KRR) by deriving sharp non-asymptotic upper and lower bounds for the KRR test error of any finite-rank KRR. Our bounds are tighter than previously derived bounds on finite-rank KRR, and unlike comparable results, they also remain valid for any regularization parameters.


title: Stability and Optimal Decay Rates for Abstract Systems with Thermal Damping of Cattaneo's Type

abstract: This paper studies the stability of an abstract thermoelastic system with Cattaneo's law, which describes finite heat propagation speed in a medium. We introduce a parameters region containing coupling, thermal dissipation, and possible inertial characteristics. The parameters region is partitioned into distinct subregions based on the spectral properties of the infinitesimal generator of the corresponding semigroup. By a careful estimation of the resolvent, we obtain distinct polynomial decay rates for systems with parameters located in different subregions. Furthermore, the optimality of these decay rates is proved. Finally, we apply our results to several coupled systems of partial differential equations.


title: On Two- and Three-valued Semantics for Impure Simplicial Complexes

abstract: Simplicial complexes are a convenient semantic primitive to reason about processes (agents) communicating with each other in synchronous and asynchronous computation. Impure simplicial complexes distinguish active processes from crashed ones, in other words, agents that are alive from agents that are dead. In order to rule out that dead agents reason about themselves and about other agents, three-valued epistemic semantics have been proposed where, in addition to the usual values true and false, the third value stands for undefined: the knowledge of dead agents is undefined and so are the propositional variables describing their local state. Other semantics for impure complexes are two-valued where a dead agent knows everything. Different choices in designing a semantics produce different three-valued semantics, and also different two-valued semantics. In this work, we categorize the available choices by discounting the bad ones, identifying the equivalent ones, and connecting the non-equivalent ones via a translation. The main result of the paper is identifying the main relevant distinction to be the number of truth values and bridging this difference by means of a novel embedding from three- into two-valued semantics. This translation also enables us to highlight quite fundamental modeling differences underpinning various two- and three-valued approaches in this area of combinatorial topology. In particular, pure complexes can be defined as those invariant under the translation.


title: TSO Games -- On the decidability of safety games under the total store order semantics

abstract: We consider an extension of the classical Total Store Order (TSO) semantics by expanding it to turn-based 2-player safety games. During her turn, a player can select any of the communicating processes and perform its next transition. We consider different formulations of the safety game problem depending on whether one player or both of them transfer messages from the process buffers to the shared memory. We give the complete decidability picture for all the possible alternatives.


title: Shock Waves in Holographic EPR pair

abstract: We study real-time correlators for $N=4$ super Yang Mill fields coupled to a pair of entangled quarks using holography, in the setup that energy quanta sent from one quark perturb the quantum state of the fields and affect the other quark. We make the connection with the ER=EPR conjecture by considering the situation when two quarks are uniformly accelerating opposite to each other. The dynamics of quarks, in the gravity dual, is described by the string worldsheet theory, which in this case has the induced metric describing a two-sided AdS black hole, or a wormhole. Energy quanta sent by one of the quarks produce the shock wave on the worldsheet. We find the effect of shock wave on the boundary field correlators and we discuss the consequence for the ER=EPR conjecture.


title: Logarithmic Sobolev, Hardy and Poincar\'e inequalities on the Heisenberg group

abstract: In this paper we first prove a number of important inequalities with explicit constants in the setting of the Heisenberg group. This includes the fractional and integer Sobolev, Gagliardo-Nirenberg, (weighted) Hardy-Sobolev, Nash inequalities, and their logarithmic versions. In the case of the first order Sobolev inequality, our constant recovers the sharp constant of Jerison and Lee. Remarkably, we also establish the analogue of the Gross inequality with a semi-probability measure on the Heisenberg group that allows -- as it happens in the Euclidean setting -- an extension to infinite dimensions, and particularly can be regarded as an inequality on the infinite dimensional $\mathbb{H}^{\infty}$. Finally, we prove the so-called generalised Poincar\'e inequality on the Heisenberg group both with respect to the aforementioned semi-probability measure and the Haar measure, also with explicit constants.


title: Self-consistent modeling of the energetic storm particle event of November 10, 2012

abstract: It is thought that solar energetic ions associated with coronal/interplanetary shock waves are accelerated to high energies by the diffusive shock acceleration mechanism. For this mechanism to be efficient, intense magnetic turbulence is needed in the vicinity of the shock. The enhanced turbulence upstream of the shock can be produced self-consistently by the accelerated particles themselves via streaming instability. Comparisons of quasi-linear-theory-based particle acceleration models that include this process with observations have not been fully successful so far, which has motivated the development of acceleration models of a different nature. The aim of this work is to test how well our self-consistent quasi-linear SOLar Particle Acceleration in Coronal Shocks (SOLPACS) simulation code, developed earlier to simulate proton acceleration in coronal shocks, models the particle foreshock region. We applied SOLPACS to model the energetic storm particle (ESP) event observed by the STEREO A spacecraft on November 10, 2012. In the simulations, all but one main input parameter of SOLPACS are fixed by the in-situ plasma measurements from the spacecraft. By comparing a simulated proton energy spectrum at the shock with the observed one, we were able to fix the last simulation input parameter related to the efficiency of particle injection to the acceleration process. A subsequent comparison of simulated proton time-intensity profiles in a number of energy channels with the observed ones shows a very good correspondence throughout the upstream region.

categories: astro-ph.SR astro-ph.HE physics.plasm-ph physics.space-ph


title: A Uniform One-Dimensional Fragment with Alternation of Quantifiers

abstract: The uniform one-dimensional fragment of first-order logic was introduced a few years ago as a generalization of the two-variable fragment of first-order logic to contexts involving relations of arity greater than two. Quantifiers in this logic are used in blocks, each block consisting only of existential quantifiers or only of universal quantifiers. In this paper we consider the possibility of mixing quantifiers in blocks. We identify a non-trivial variation of the logic with mixed blocks of quantifiers which retains some good properties of the two-variable fragment and of the uniform one-dimensional fragment: it has the finite (exponential) model property and hence decidable, NExpTime-complete satisfiability problem.


title: FMplex: A Novel Method for Solving Linear Real Arithmetic Problems

abstract: In this paper we introduce a novel quantifier elimination method for conjunctions of linear real arithmetic constraints. Our algorithm is based on the Fourier-Motzkin variable elimination procedure, but by case splitting we are able to reduce the worst-case complexity from doubly to singly exponential. The adaption of the procedure for SMT solving has strong correspondence to the simplex algorithm, therefore we name it FMplex. Besides the theoretical foundations, we provide an experimental evaluation in the context of SMT solving.


title: ARN: Analogical Reasoning on Narratives

abstract: As a core cognitive skill that enables the transferability of information across domains, analogical reasoning has been extensively studied for both humans and computational models. However, while cognitive theories of analogy often focus on narratives and study the distinction between surface, relational, and system similarities, existing work in natural language processing has a narrower focus as far as relational analogies between word pairs. This gap brings a natural question: can state-of-the-art large language models (LLMs) detect system analogies between narratives? To gain insight into this question and extend word-based relational analogies to relational system analogies, we devise a comprehensive computational framework that operationalizes dominant theories of analogy, using narrative elements to create surface and system mappings. Leveraging the interplay between these mappings, we create a binary task and benchmark for Analogical Reasoning on Narratives (ARN), covering four categories of far (cross-domain)/near (within-domain) analogies and disanalogies. We show that while all LLMs can largely recognize near analogies, even the largest ones struggle with far analogies in a zero-shot setting, with GPT4.0 scoring below random. Guiding the models through solved examples and chain-of-thought reasoning enhances their analogical reasoning ability. Yet, since even in the few-shot setting, the best model only performs halfway between random and humans, ARN opens exciting directions for computational analogical reasoners.


title: Handling of Past and Future with Phenesthe+

abstract: Writing temporal logic formulae for properties that combine instantaneous events with overlapping temporal phenomena of some duration is difficult in classical temporal logics. To address this issue, in previous work we introduced a new temporal logic with intuitive temporal modalities specifically tailored for the representation of both instantaneous and durative phenomena. We also provided an implementation of a complex event processing system, Phenesthe, based on this logic, that has been applied and tested on a real maritime surveillance scenario. In this work, we extend our temporal logic with two extra modalities to increase its expressive power for handling future formulae. We compare the expressive power of different fragments of our logic with Linear Temporal Logic and dyadic first-order logic. Furthermore, we define correctness criteria for stream processors that use our language. Last but not least, we evaluate empirically the performance of Phenesthe+, our extended implementation, and show that the increased expressive power does not affect efficiency significantly.


title: Modal Logic Characterizations of Forward, Reverse, and Forward-Reverse Bisimilarities

abstract: Reversible systems feature both forward computations and backward computations, where the latter undo the effects of the former in a causally consistent manner. The compositionality properties and equational characterizations of strong and weak variants of forward-reverse bisimilarity as well as of its two components, i.e., forward bisimilarity and reverse bisimilarity, have been investigated on a minimal process calculus for nondeterministic reversible systems that are sequential, so as to be neutral with respect to interleaving vs. truly concurrent semantics of parallel composition. In this paper we provide logical characterizations for the considered bisimilarities based on forward and backward modalities, which reveals that strong and weak reverse bisimilarities respectively correspond to strong and weak reverse trace equivalences. Moreover, we establish a clear connection between weak forward-reverse bisimilarity and branching bisimilarity, so that the former inherits two further logical characterizations from the latter over a specific class of processes.


title: CGAAL: Distributed On-The-Fly ATL Model Checker with Heuristics

abstract: We present CGAAL, our efficient on-the-fly model checker for alternating-time temporal logic (ATL) on concurrent game structures (CGS). We present how our tool encodes ATL as extended dependency graphs with negation edges and employs the distributed on-the-fly algorithm by Dalsgaard et al. Our tool offers multiple novel search strategies for the algorithm, including DHS which is inspired by PageRank and uses the in-degree of configurations as a heuristic, IHS which estimates instability of assignment values, and LPS which estimates the distance to a state satisfying the constituent property using linear programming. CGS are input using our modelling language LCGS, where composition and synchronisation are easily described. We prove the correctness of our encoding, and our experiments show that our tool CGAAL is often one to three orders of magnitude faster than the popular tool PRISM-games on case studies from PRISM's documentation and among case studies we have developed. In our evaluation, we also compare and evaluate our search strategies, and find that our custom search strategies are often significantly faster than the usual breadth-first and depth-first search strategies.


title: (Un)Decidability Bounds of the Synthesis Problem for Petri Games

abstract: Petri games are a multi-player game model for the automatic synthesis of distributed systems, where the players are represented as tokens on a Petri net and are grouped into environment players and system players. As long as the players move in independent parts of the net, they do not know of each other; when they synchronize at a joint transition, each player gets informed of the entire causal history of the other players. We show that the synthesis problem for two-player Petri games under a global safety condition is NP-complete and it can be solved within a non-deterministic exponential upper bound in the case of up to 4 players. Furthermore, we show the undecidability of the synthesis problem for Petri games with at least 6 players under a local safety condition.


title: Counterfactual Causality for Reachability and Safety based on Distance Functions

abstract: Investigations of causality in operational systems aim at providing human-understandable explanations of why a system behaves as it does. There is, in particular, a demand to explain what went wrong on a given counterexample execution that shows that a system does not satisfy a given specification. To this end, this paper investigates a notion of counterfactual causality in transition systems based on Stalnaker's and Lewis' semantics of counterfactuals in terms of most similar possible worlds and introduces a novel corresponding notion of counterfactual causality in two-player games. Using distance functions between paths in transition systems, this notion defines whether reaching a certain set of states is a cause for the violation of a reachability or safety property. Similarly, using distance functions between memoryless strategies in reachability and safety games, it is defined whether reaching a set of states is a cause for the fact that a given strategy for the player under investigation is losing. The contribution of the paper is two-fold: In transition systems, it is shown that counterfactual causality can be checked in polynomial time for three prominent distance functions between paths. In two-player games, the introduced notion of counterfactual causality is shown to be checkable in polynomial time for two natural distance functions between memoryless strategies. Further, a notion of explanation that can be extracted from a counterfactual cause and that pinpoints changes to be made to the given strategy in order to transform it into a winning strategy is defined. For the two distance functions under consideration, the problem to decide whether such an explanation imposes only minimal necessary changes to the given strategy with respect to the used distance function turns out to be coNP-complete and not to be solvable in polynomial time if P is not equal to NP, respectively.


title: Diffusion-controlled reactions: an overview

abstract: We review the milestones in the century-long development of the theory of diffusion-controlled reactions. Starting from the seminal work by von Smoluchowski who recognized the importance of diffusion in chemical reactions, we discuss perfect and imperfect surface reactions, their microscopic origins, and the underlying mathematical framework. Single-molecule reaction schemes, anomalous bulk diffusions, reversible binding/unbinding kinetics and many other extensions are presented. An alternative encounter-based approach to diffusion-controlled reactions is introduced, with emphasis on its advantages and potential applications. Some open problems and future perspectives are outlined.


title: Conflict-Aware Active Automata Learning

abstract: Active automata learning algorithms cannot easily handle conflict in the observation data (different outputs observed for the same inputs). This inherent inability to recover after a conflict impairs their effective applicability in scenarios where noise is present or the system under learning is mutating. We propose the Conflict-Aware Active Automata Learning (C3AL) framework to enable handling conflicting information during the learning process. The core idea is to consider the so-called observation tree as a first-class citizen in the learning process. Though this idea is explored in recent work, we take it to its full effect by enabling its use with any existing learner and minimizing the number of tests performed on the system under learning, specially in the face of conflicts. We evaluate C3AL in a large set of benchmarks, covering over 30 different realistic targets, and over 18,000 different scenarios. The results of the evaluation show that C3AL is a suitable alternative framework for closed-box learning that can better handle noise and mutations.


title: The Recursive Arrival Problem

abstract: We study an extension of the Arrival problem, called Recursive Arrival, inspired by Recursive State Machines, which allows for a family of switching graphs that can call each other in a recursive way. We study the computational complexity of deciding whether a Recursive Arrival instance terminates at a given target vertex. We show this problem is contained in NP \cap coNP, and we show that a search version of the problem lies in UEOPL, and hence in EOPL = PLS \cap PPAD. Furthermore, we show P-hardness of the Recursive Arrival decision problem. By contrast, the current best-known hardness result for Arrival is PL-hardness.


title: Analogy of space time as un elastic medium -- Can we establish a thermal expansion coefficient of space from the cosmological constant Lambda?

abstract: This paper advances the state of the art by extending the study of the analogy between the spacetime fabric and elasticity.As no prior work exists about a potential spacetime thermal expansion coeff Lambda, we explore the analogy of GR with the elasticity theory by considering the cosmological constant Lambda as an additional space curvature of the space frame due to a thermal gradient coming from the cosmic web and the cold vacuum and we propose ((AlphaxDeltaT)/e)^2=(1/Ro)^2=Lambda with Ro being the curvature radius of the space fabric.It follows from this analogy and from the supposed space model consisting of thin sheets of Planck thickness Lp curved by this thermal gradient DeltaT a possible thermal expansion coefficient of the equivalent elastic medium modeling the space AlphaS=(LpxLambda^(1/2))/DeltaT of the order of Alphas(QFT)=1.16x10-6 K-1.As space-time and not only space must be considered in GR, this paper also proposes an innovative approach which consists in introducing into the interval ds^2 of special relativity a temp effect T,(entropy variations correlated with time laps, based on temperature variations affecting always physically the clocks) based on different thermal expansion coefficients for space and time with for the flow of time t:cxt/cxnxtau=(kBxt)/nxhxDeltaT=AlphatxDeltaT.With T=10^6 K, n=1, the associate time interval is 4.8x10^-17s and Alphat=1.0x10^-6K^-1.The consequence of these hypothesis is that dark energy potentially becomes a thermal space-time curvature ((AlphafxT)/Lp)^2 with f equal to s or t depending of the temperature, the thermal entropy variation of the universe, the Planck thickness and time, that increases since the Bigbang, depending on thermal expansion coefficients for space-time Alphas and Alphat as a function respectively of Lambda, kB/hxt, in opposition to space-time curvature gravity due to mass/energy density as described in GR.


title: Comparative Analysis of Technical and Legal Frameworks of Various National Digial Identity Solutions

abstract: National digital identity systems have become a key requirement for easy access to online public services, specially during Covid-19. While many countries have adopted a national digital identity system, many are still in the process of establishing one. Through a comparative analysis of the technological and legal dimensions of a few selected national digital identity solutions currently being used in different countries, we highlight the diversity of technologies and architectures and the key role of the legal framework of a given digital identity solution. We also present several key issues related to the implementation of these solutions, how to ensure the State sovereignty over them, and how to strike the right balance between private sector and public sector needs. This position paper aims to help policy makers, software developers and concerned users understand the challenges of designing, implementing and using a national digital identity management system and establishing a legal framework for digital identity management, including personal data protection measures. The authors of this paper have a favorable position for self-sovereign identity management systems that are based on Blockchain technology, and we believe they are the most suitable for national digital identity systems.


title: On the Descriptive Complexity of Groups without Abelian Normal Subgroups (Extended Abstract)

abstract: In this paper, we explore the descriptive complexity theory of finite groups by examining the power of the second Ehrenfeucht-Fraisse bijective pebble game in Hella's (Ann. Pure Appl. Log., 1989) hierarchy. This is a Spoiler-Duplicator game in which Spoiler can place up to two pebbles each round. While it trivially solves graph isomorphism, it may be nontrivial for finite groups, and other ternary relational structures. We first provide a novel generalization of Weisfeiler-Leman (WL) coloring, which we call 2-ary WL. We then show that the 2-ary WL is equivalent to the second Ehrenfeucht-Fraisse bijective pebble game in Hella's hierarchy. Our main result is that, in the pebble game characterization, only O(1) pebbles and O(1) rounds are sufficient to identify all groups without Abelian normal subgroups (a class of groups for which isomorphism testing is known to be in P; Babai, Codenotti, & Qiao, ICALP 2012). In particular, we show that within the first few rounds, Spoiler can force Duplicator to select an isomorphism between two such groups at each subsequent round. By Hella's results (ibid.), this is equivalent to saying that these groups are identified by formulas in first-order logic with generalized 2-ary quantifiers, using only O(1) variables and O(1) quantifier depth.


title: An Objective Improvement Approach to Solving Discounted Payoff Games

abstract: While discounted payoff games and classic games that reduce to them, like parity and mean-payoff games, are symmetric, their solutions are not. We have taken a fresh view on the constraints that optimal solutions need to satisfy, and devised a novel way to converge to them, which is entirely symmetric. It also challenges the gospel that methods for solving payoff games are either based on strategy improvement or on value iteration.


title: Neyman-Pearson and equal opportunity: when efficiency meets fairness in classification

abstract: Organizations often rely on statistical algorithms to make socially and economically impactful decisions. We must address the fairness issues in these important automated decisions. On the other hand, economic efficiency remains instrumental in organizations' survival and success. Therefore, a proper dual focus on fairness and efficiency is essential in promoting fairness in real-world data science solutions. Among the first efforts towards this dual focus, we incorporate the equal opportunity (EO) constraint into the Neyman-Pearson (NP) classification paradigm. Under this new NP-EO framework, we (a) derive the oracle classifier, (b) propose finite-sample based classifiers that satisfy population-level fairness and efficiency constraints with high probability, and (c) demonstrate statistical and social effectiveness of our algorithms on simulated and real datasets.


title: Strategies Resilient to Delay: Games under Delayed Control vs. Delay Games

abstract: We compare games under delayed control and delay games, two types of infinite games modelling asynchronicity in reactive synthesis. Our main result, the interreducibility of the existence of sure winning strategies for the protagonist, allows to transfer known complexity results and bounds on the delay from delay games to games under delayed control, for which no such results had been known. We furthermore analyze existence of randomized strategies that win almost surely, where this correspondence between the two types of games breaks down.


title: Towards Fixing Clever-Hans Predictors with Counterfactual Knowledge Distillation

abstract: This paper introduces a novel technique called counterfactual knowledge distillation (CFKD) to detect and remove reliance on confounders in deep learning models with the help of human expert feedback. Confounders are spurious features that models tend to rely on, which can result in unexpected errors in regulated or safety-critical domains. The paper highlights the benefit of CFKD in such domains and shows some advantages of counterfactual explanations over other types of explanations. We propose an experiment scheme to quantitatively evaluate the success of CFKD and different teachers that can give feedback to the model. We also introduce a new metric that is better correlated with true test performance than validation accuracy. The paper demonstrates the effectiveness of CFKD on synthetically augmented datasets and on real-world histopathological datasets.


title: Unconstrained Stochastic CCA: Unifying Multiview and Self-Supervised Learning

abstract: The Canonical Correlation Analysis (CCA) family of methods is foundational in multiview learning. Regularised linear CCA methods can be seen to generalise Partial Least Squares (PLS) and be unified with a Generalized Eigenvalue Problem (GEP) framework. However, classical algorithms for these linear methods are computationally infeasible for large-scale data. Extensions to Deep CCA show great promise, but current training procedures are slow and complicated. First we propose a novel unconstrained objective that characterizes the top subspace of GEPs. Our core contribution is a family of fast algorithms for stochastic PLS, stochastic CCA, and Deep CCA, simply obtained by applying stochastic gradient descent (SGD) to the corresponding CCA objectives. Our algorithms show far faster convergence and recover higher correlations than the previous state-of-the-art on all standard CCA and Deep CCA benchmarks. These improvements allow us to perform a first-of-its-kind PLS analysis of an extremely large biomedical dataset from the UK Biobank, with over 33,000 individuals and 500,000 features. Finally, we apply our algorithms to match the performance of `CCA-family' Self-Supervised Learning (SSL) methods on CIFAR-10 and CIFAR-100 with minimal hyper-parameter tuning, and also present theory to clarify the links between these methods and classical CCA, laying the groundwork for future insights.


title: Periods modulo $p$ of integer sequences associated with division polynomials of genus $2$ curves

abstract: We study an integer sequence associated with Cantor's division polynomials of a genus $2$ curve having an integral point. We show that the modulo $p$ of such a sequence is periodic for all but finitely many primes $p$, and describe the relation between the period of the modulo $p$ of the sequence and the order of the integral point on the reduction modulo $p$ in the Jacobian variety explicitly. This generalizes Ward's results on elliptic divisibility sequences associated with division polynomials of elliptic curves.


title: Managing the Impact of Sensor's Thermal Noise in Machine Learning for Nuclear Applications

abstract: Sensors such as accelerometers, magnetometers, and gyroscopes are frequently utilized to perform measurements in nuclear power plants. For example, accelerometers are used for vibration monitoring of critical systems. With the recent rise of machine learning, data captured from such sensors can be used to build machine learning models for predictive maintenance and automation. However, these sensors are known to have thermal noise that can affect the sensor's accuracy. Thermal noise differs between sensors in terms of signal-to-noise ratio (SNR). This thermal noise will cause an accuracy drop in sensor-fusion-based machine learning models when deployed in production. This paper lists some applications for Canada Deuterium Uranium (CANDU) reactors where such sensors are used and therefore can be impacted by the thermal noise issue if machine learning is utilized. A list of recommendations to help mitigate the issue when building future machine learning models for nuclear applications based on sensor fusion is provided. Additionally, this paper demonstrates that machine learning algorithms can be impacted differently by the issue, therefore selecting a more resilient model can help in mitigating it.


title: EX-Graph: A Pioneering Dataset Bridging Ethereum and X

abstract: While numerous public blockchain datasets are available, their utility is constrained by an exclusive focus on blockchain data. This constraint limits the incorporation of relevant social network data into blockchain analysis, thereby diminishing the breadth and depth of insight that can be derived. To address the above limitation, we introduce EX-Graph, a novel dataset that authentically links Ethereum and X, marking the first and largest dataset of its kind. EX-Graph combines Ethereum transaction records (2 million nodes and 30 million edges) and X following data (1 million nodes and 3 million edges), bonding 30,667 Ethereum addresses with verified X accounts sourced from OpenSea. Detailed statistical analysis on EX-Graph highlights the structural differences between X-matched and non-X-matched Ethereum addresses. Extensive experiments, including Ethereum link prediction, wash-trading Ethereum addresses detection, and X-Ethereum matching link prediction, emphasize the significant role of X data in enhancing Ethereum analysis. EX-Graph is available at \url{https://exgraph.deno.dev/}.


title: Detecting and characterizing pulsar halos with the Cherenkov Telescope Array Observatory

abstract: The recently identified source class of pulsar halos may be populated and bright enough at TeV energies to constitute a large fraction of the sources that will be observed with the Cherenkov Telescope Array (CTA), especially in the context of the planned Galactic Plane Survey (GPS). In this study, we examine the prospects offered by CTA for the detection and characterization of such objects. CTA will cover energies from 20 GeV to 300 TeV, bridging the ranges already probed with the Fermi Large Area Telescope and High Altitude Water Cherenkov Observatory, and will also have a better angular resolution than the latter instruments, thus providing a complementary look at the phenomenon. From simple models for individual pulsar halos and their population in the Milky Way, we examine under which conditions such sources can be detected and studied from the GPS observations. In the framework of a full spatial-spectral likelihood analysis, using the most recent estimates for the instrument response function and prototypes for the science tools, we derive the spectral and morphological sensitivity of the CTA GPS to the specific intensity distribution of pulsar halos. From these, we quantify the physical parameters for which pulsar halos can be detected, identified, and characterized, and what fraction of the Galactic population could be accessible. We also discuss the effect of interstellar emission and data analysis systematics on these prospects.


title: The Porous Media Schr{\"o}dinger Equation : Feynman-type Motivation, Well-Posedness and Control Interpretation

abstract: This paper's aim is threefold. First, using Feynman's path approach to the derivation of the classical Schr{\"o}dinger's equation in [7] and by introducing a slight path (or wave) dependency of the action, we derive a new class of equations of Schr{\"o}dinger type where the driving operator is no longer the Laplace one but rather of complex porous media-type. Second, using suitable concepts of monotonicity in the complex setting and on appropriate functional spaces, we show the existence and uniqueness of the equation we have previously introduced. Finally, using Fitzpatrick's characterization of maximal monotone operators (cf. [8]), we propose a Br{\'e}zis-Ekeland type characterization of the solution via a control problem.


title: Controlling Vision-Language Models for Multi-Task Image Restoration

abstract: Vision-language models such as CLIP have shown great impact on diverse downstream tasks for zero-shot or label-free predictions. However, when it comes to low-level vision such as image restoration their performance deteriorates dramatically due to corrupted inputs. In this paper, we present a degradation-aware vision-language model (DA-CLIP) to better transfer pretrained vision-language models to low-level vision tasks as a multi-task framework for image restoration. More specifically, DA-CLIP trains an additional controller that adapts the fixed CLIP image encoder to predict high-quality feature embeddings. By integrating the embedding into an image restoration network via cross-attention, we are able to pilot the model to learn a high-fidelity image reconstruction. The controller itself will also output a degradation feature that matches the real corruptions of the input, yielding a natural classifier for different degradation types. In addition, we construct a mixed degradation dataset with synthetic captions for DA-CLIP training. Our approach advances state-of-the-art performance on both \emph{degradation-specific} and \emph{unified} image restoration tasks, showing a promising direction of prompting image restoration with large-scale pretrained vision-language models. Our code is available at https://github.com/Algolzw/daclip-uir.


title: Asymptotic stability of solitary waves for the 1D near-cubic non-linear Schr\"odinger equation in the absence of internal modes

abstract: We consider perturbations of the one-dimensional cubic Schr\"odinger equation, under the form $i \, \partial_t \psi + \partial_x^2 \psi + |\psi|^2 \psi - g( |\psi|^2 ) \psi = 0$. Under hypotheses on the function g that can be easily verified in some cases, we show that the linearized problem around a solitary wave does not have internal mode (nor resonance) and we prove the asymptotic stability of these solitary waves, for small frequencies.


title: A New Real-World Video Dataset for the Comparison of Defogging Algorithms

abstract: Video restoration for noise removal, deblurring or super-resolution is attracting more and more attention in the fields of image processing and computer vision. Works on video restoration with data-driven approaches for fog removal are rare however, due to the lack of datasets containing videos in both clear and foggy conditions which are required for deep learning and benchmarking. A new dataset, called REVIDE, was recently proposed for just that purpose. In this paper, we implement the same approach by proposing a new REal-world VIdeo dataset for the comparison of Defogging Algorithms (VIREDA), with various fog densities and ground truths without fog. This small database can serve as a test base for defogging algorithms. A video defogging algorithm is also mentioned (still under development), with the key idea of using temporal redundancy to minimize artefacts and exposure variations between frames. Inspired by the success of Transformers architecture in deep learning for various applications, we select this kind of architecture in a neural network to show the relevance of the proposed dataset.


title: Crystal nucleation in a vapor deposited Lennard-Jones mixture

abstract: Understanding the pathways to crystallization during the deposition of a vapor phase on a cold solid substrate is of great interest in industry, e.g., for the realization of electronic devices made of crystallites-free glassy materials, as well as in the atmospheric science in relation to ice nucleation and growth in clouds. Here we numerically investigate the nucleation process during the deposition of a glassformer by using a Lennard-Jones mixture, and compare the properties of this nucleation process with both its quenched counterpart and the bulk system. We find that all three systems homogeneously nucleate crystals in a narrow range of temperatures. However, the deposited layer shows a peculiar formation of ordered domains, promoted by the faster relaxation dynamics toward the free surface even in an as-deposited state. In contrast, the formation of such domains in the other systems occurs only when the structures are fully relaxed by quenching. Furthermore, the nucleus initially grows in an isotropic symmetrical manner, but eventually shows sub-3D growth due to its preference to grow along the basal plane, irrespective of the layer production procedure.


title: Subtractor-Based CNN Inference Accelerator

abstract: This paper presents a novel method to boost the performance of CNN inference accelerators by utilizing subtractors. The proposed CNN preprocessing accelerator relies on sorting, grouping, and rounding the weights to create combinations that allow for the replacement of one multiplication operation and addition operation by a single subtraction operation when applying convolution during inference. Given the high cost of multiplication in terms of power and area, replacing it with subtraction allows for a performance boost by reducing power and area. The proposed method allows for controlling the trade-off between performance gains and accuracy loss through increasing or decreasing the usage of subtractors. With a rounding size of 0.05 and by utilizing LeNet-5 with the MNIST dataset, the proposed design can achieve 32.03% power savings and a 24.59% reduction in area at the cost of only 0.1% in terms of accuracy loss.


title: Secluded Scalar Dark Matter and the Muon Anomalous Magnetic Moment

abstract: We consider a dark matter model with a singlet scalar, $\chi$, as our dark matter (DM) candidate which is secluded from the Standard Model (SM) and annihilates to the singlet scalar, $\phi$, via a contact interaction. The singlet scalar, $\phi$, has a leptophilic interaction with the SM leptons and may decay leptonically at tree level, and decays into a pair of photons at loop level. The focus in this work is to consider DM masses below 10 GeV. It is found a viable secluded region in the parameter space after imposing the observed relic density. There is a one-loop interaction between scalar dark matter and the atomic electron in this model. We then apply the available direct detection bounds from Xenon10, Xenon1T, and DarkSide on the DM-electron elastic scattering cross section. While the model can explain the muon anomalous magnetic moment, we put bounds from current and future lepton collider experiments.


title: Joint Source-Channel Coding System for 6G Communication: Design, Prototype and Future Directions

abstract: The goal of semantic communication is to surpass optimal Shannon's criterion regarding a notable problem for future communication which lies in the integration of collaborative efforts between the intelligence of the transmission source and the joint design of source coding and channel coding. The convergence of scholarly investigation and applicable products in the field of semantic communication is facilitated by the utilization of flexible structural hardware design, which is constrained by the computational capabilities of edge devices. This characteristic represents a significant benefit of joint source-channel coding (JSCC), as it enables the generation of source alphabets with diverse lengths and achieves a code rate of unity. Moreover, JSCC exhibits near-capacity performance while maintaining low complexity. Therefore, we leverage not only quasi-cyclic (QC) characteristics to propose a QC-LDPC code-based JSCC scheme but also Unequal Error Protection (UEP) to ensure the recovery of semantic importance. In this study, the feasibility for using a semantic encoder/decoder that is aware of UEP can be explored based on the existing JSCC system. This approach is aimed at protecting the significance of semantic task-oriented information. Additionally, the deployment of a JSCC system can be facilitated by employing Low-Density Parity-Check (LDPC) codes on a reconfigurable device. This is achieved by reconstructing the LDPC codes as QC-LDPC codes. The QC-LDPC layered decoding technique, which has been specifically optimized for hardware parallelism and tailored for channel decoding applications, can be suitably adapted to accommodate the JSCC system. The performance of the proposed system is evaluated by conducting BER measurements using both floating-point and 6-bit quantization.


title: Initial perturbations dependence of non-equilibrium continuous and discontinuous pattern transition

abstract: A phase separation in a spatially heterogeneous environment is closely related to intracellular science and material science. For the phase separation, initial heterogeneous perturbations play an important role in pattern formations. In this study, a pattern transition from a lamellar pattern to a columnar pattern is investigated in the presence of a slit pattern as the initial perturbations. Here it is found that the transition behavior depends on the initial slit width. When the initial slit width is close to the width of the columnar pattern at the steady state, the pattern transition is the second-order-like (continuous) transition. Meanwhile, the pattern transition becomes the first-order-like (discontinuous) transition if the width of the initial slit is much larger than that at the steady state. Then those transition behaviors can be explained by the dynamical path during the pattern formation. This finding will advance understanding of the initial perturbation dependence of nonequilibrium phenomena.


title: An OrthoBoXY-Method for Various Alternative Box Geometries

abstract: We have shown in a recent contribution [J. Phys. Chem.B 127, 7983-7987 (2023)] that for molecular dynamics (MD) simulations of isotropic fluids based on orthorhombic periodic boundary conditions with "magic" box length ratios of $L_z/L_x\!=\!L_z/L_y\!=\!2.7933596497$, the computed self-diffusion coefficients $D_x$ and $D_y$ in $x$- and $y$-direction become system size independent. They thus represent the true self-diffusion coefficient $D_0\!=\!(D_x+D_y)/2$, while the shear viscosity can be determined from diffusion coefficients in $x$-, $y$-, and $z$-direction, using the expression $\eta\!=\!k_\mathrm{B}T\cdot 8.1711245653/[3\pi L_z(D_{x}+D_{y}-2D_z)]$. Here we present a more generalized version of this "OrthoBoXY"-approach, which can be applied to any orthorhombic MD box. We would like to test, whether it is possible to improve the efficiency of the approach by using a shape more akin to the cubic form, albeit with different box-length ratios $L_x/L_z\!\neq\! L_y/L_z$ and $L_x\!<\!L_y\!<\!L_z$. We use simulations of systems of 1536 TIP4P/2005 water molecules as a benchmark and explore different box-geometries to determine the influence of the box shape on the computed statistical uncertainties for $D_0$ and $\eta$. Moreover, another "magical" set of box-length ratios is discovered with $L_y/L_z\!=\!0.57804765578$ and $L_x/L_z\!=\!0.33413909235$, where the self-diffusion coefficient in $x$-direction becomes system size independent, such that $D_0\!=\!D_x$.


title: Elemental Ferroelectric Topological Insulator in $\psi$-bismuthene

abstract: Ferroelectric quantum spin Hall insulator (FEQSHI) exhibits coexisting ferroelectricity and time-reversal symmetry protected edge states, holding fascinating prospects for inviting both scientific and application advances, especially in two dimensions. However, all of the previously demonstrated FEQSHIs consist two or more constituent elements. We herein propose the $\psi$-bismuthene, an uncharted allotrope of bilayer Bi (110), to be the first example of 2D elemental FEQSHI. It is demonstrated that $\psi$-bismuthene harbors measurable ferroelectric polarization and nontrivial band gap with moderate switching barrier, which are highly beneficial for the detection and observation of the ferroelectric topologically insulating states. In addition, all-angle auxetic behavior with giant negative Poisson's ratio and ferroelectric controllable persistent spin helix in $\psi$-bismuthene are also discussed. The emergent elemental FEQSHI represents a novel domain for both fundamental physics and technological innovation.


title: The PoW Landscape in the Aftermath of The Merge

abstract: On 15th September 2022, The Merge marked the Ethereum network's transition from computation-hardness-based consensus (proof-of-work) to a committee-based consensus mechanism (proof-of-stake). As a result, all the specialized hardware and GPUs that were being used by miners ceased to be profitable in the main Ethereum network. Miners were then left with the decision of how to re-purpose their hardware. One such choice was to try and make a profit mining another existing PoW system. In this study, we explore this choice by analyzing the hashrate increase in the top PoW networks following the merge. Our findings reveal that the peak increase in hashrate to other PoW networks following The Merge represents an adoption of at least 41% of the hashrate that was present in Ethereum, with 12% remaining more than 5 months later. Though we measure a drastic decrease in profitability by almost an order of magnitude, the continued presence of miners halts claims that power consumption was instantly addressed by Ethereum's switch to PoS.


title: Incorporating Supervised Domain Generalization into Data Augmentation

abstract: With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique to improve robustness, thanks to its ease of use and numerous benefits. However, it requires more training epochs, making it difficult to train large models with limited computational resources. To address this problem, we treat data augmentation as supervised domain generalization~(SDG) and benefit from the SDG method, contrastive semantic alignment~(CSA) loss, to improve the robustness and training efficiency of data augmentation. The proposed method only adds loss during model training and can be used as a plug-in for existing data augmentation methods. Experiments on the CIFAR-100 and CUB datasets show that the proposed method improves the robustness and training efficiency of typical data augmentations.


title: A Robust Machine Learning Approach for Path Loss Prediction in 5G Networks with Nested Cross Validation

abstract: The design and deployment of fifth-generation (5G) wireless networks pose significant challenges due to the increasing number of wireless devices. Path loss has a landmark importance in network performance optimization, and accurate prediction of the path loss, which characterizes the attenuation of signal power during transmission, is critical for effective network planning, coverage estimation, and optimization. In this sense, we utilize machine learning (ML) methods, which overcome conventional path loss prediction models drawbacks, for path loss prediction in a 5G network system to facilitate more accurate network planning, resource optimization, and performance improvement in wireless communication systems. To this end, we utilize a novel approach, nested cross validation scheme, with ML to prevent overfitting, thereby getting better generalization error and stable results for ML deployment. First, we acquire a publicly available dataset obtained through a comprehensive measurement campaign conducted in an urban macro-cell scenario located in Beijing, China. The dataset includes crucial information such as longitude, latitude, elevation, altitude, clutter height, and distance, which are utilized as essential features to predict the path loss in the 5G network system. We deploy Support Vector Regression (SVR), CatBoost Regression (CBR), eXtreme Gradient Boosting Regression (XGBR), Artificial Neural Network (ANN), and Random Forest (RF) methods to predict the path loss, and compare the prediction results in terms of Mean Absolute Error (MAE) and Mean Square Error (MSE). As per obtained results, XGBR outperforms the rest of the methods. It outperforms CBR with a slight performance differences by 0.4 % and 1 % in terms of MAE and MSE metrics, respectively. On the other hand, it outperforms the rest of the methods with clear performance differences.


title: Hydrodynamical modelling of tidal dissipation in gas giant planets at the time of space missions

abstract: Gas giant planets are differentially rotating magnetic objects that have strong and complex interactions with their environment. In our Solar system, they interact with their numerous moons while exoplanets with very short orbital periods (hot Jupiters), interact with their host star. The dissipation of waves excited by tidal forces in their interiors shapes the orbital architecture and the rotational dynamics of these systems. Recently, astrometric observations of Jupiter and Saturn systems have challenged our understanding of their formation and evolution, with stronger tidal dissipation in these planets than previously predicted, in contrast to what appears to be weaker in gas giant exoplanets. These new constraints are motivating the development of realistic models of tidal dissipation inside these planets. At the same time, the Juno and Cassini space missions have revolutionised our knowledge of the interiors of Jupiter and Saturn, whose structure is a combination of stably stratified zones and convective regions. In this work, we present results of hydrodynamical calculations modelling tidal waves and their dissipation in Jupiter, taking for the first time the latest, state-of-the-art interior model of the planet. We performed 2D numerical simulations of linear tidal gravito-inertial waves that propagate and dissipate within Jupiter interior by taking into account viscous, thermal and chemical diffusions. This new model allows us to explore the properties of the dissipation and the associated tidal torque as a function of all the key hydrodynamical and structural parameters.


title: The Fisher-Rao geometry of CES distributions

abstract: When dealing with a parametric statistical model, a Riemannian manifold can naturally appear by endowing the parameter space with the Fisher information metric. The geometry induced on the parameters by this metric is then referred to as the Fisher-Rao information geometry. Interestingly, this yields a point of view that allows for leveragingmany tools from differential geometry. After a brief introduction about these concepts, we will present some practical uses of these geometric tools in the framework of elliptical distributions. This second part of the exposition is divided into three main axes: Riemannian optimization for covariance matrix estimation, Intrinsic Cram\'er-Rao bounds, and classification using Riemannian distances.


title: M{\'e}thodologie de dimensionnement par optimisation bay{\'e}sienne d'une machine synchro-r{\'e}luctante assist{\'e}e d'aimants permanents

abstract: In this article, three optimization approaches are exploited to improve the performance of a permanent magnet-assisted synchronous reluctance machine: a first optimization using fixed substitution models and two Bayesian optimization approaches based on adaptive substitution models. The results show that Bayesian approaches lead to machines with better performance using the same computation time (same number of finite element simulations). Unlike optimization methodologies based on fixed substitution models, Bayesian approaches provide solutions directly based on finite element simulations and, therefore, do not require verification.


title: A Novel Approach for Machine Learning-based Load Balancing in High-speed Train System using Nested Cross Validation

abstract: Fifth-generation (5G) mobile communication networks have recently emerged in various fields, including highspeed trains. However, the dense deployment of 5G millimeter wave (mmWave) base stations (BSs) and the high speed of moving trains lead to frequent handovers (HOs), which can adversely affect the Quality-of-Service (QoS) of mobile users. As a result, HO optimization and resource allocation are essential considerations for managing mobility in high-speed train systems. In this paper, we model system performance of a high-speed train system with a novel machine learning (ML) approach that is nested cross validation scheme that prevents information leakage from model evaluation into the model parameter tuning, thereby avoiding overfitting and resulting in better generalization error. To this end, we employ ML methods for the high-speed train system scenario. Handover Margin (HOM) and Time-to-Trigger (TTT) values are used as features, and several KPIs are used as outputs, and several ML methods including Gradient Boosting Regression (GBR), Adaptive Boosting (AdaBoost), CatBoost Regression (CBR), Artificial Neural Network (ANN), Kernel Ridge Regression (KRR), Support Vector Regression (SVR), and k-Nearest Neighbor Regression (KNNR) are employed for the problem. Finally, performance comparisons of the cross validation schemes with the methods are made in terms of mean absolute error (MAE) and mean square error (MSE) metrics are made. As per obtained results, boosting methods, ABR, CBR, GBR, with nested cross validation scheme superiorly outperforms conventional cross validation scheme results with the same methods. On the other hand, SVR, KNRR, KRR, ANN with the nested scheme produce promising results for prediction of some KPIs with respect to their conventional scheme employment.


title: Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality

abstract: The problem of missing modalities is both critical and non-trivial to be handled in multi-modal models. It is common for multi-modal tasks that certain modalities contribute more compared to other modalities, and if those important modalities are missing, the model performance drops significantly. Such fact remains unexplored by current multi-modal approaches that recover the representation from missing modalities by feature reconstruction or blind feature aggregation from other modalities, instead of extracting useful information from the best performing modalities. In this paper, we propose a Learnable Cross-modal Knowledge Distillation (LCKD) model to adaptively identify important modalities and distil knowledge from them to help other modalities from the cross-modal perspective for solving the missing modality issue. Our approach introduces a teacher election procedure to select the most ``qualified'' teachers based on their single modality performance on certain tasks. Then, cross-modal knowledge distillation is performed between teacher and student modalities for each task to push the model parameters to a point that is beneficial for all tasks. Hence, even if the teacher modalities for certain tasks are missing during testing, the available student modalities can accomplish the task well enough based on the learned knowledge from their automatically elected teacher modalities. Experiments on the Brain Tumour Segmentation Dataset 2018 (BraTS2018) shows that LCKD outperforms other methods by a considerable margin, improving the state-of-the-art performance by 3.61% for enhancing tumour, 5.99% for tumour core, and 3.76% for whole tumour in terms of segmentation Dice score.


title: Generative AI for Integrated Sensing and Communication: Insights from the Physical Layer Perspective

abstract: As generative artificial intelligence (GAI) models continue to evolve, their generative capabilities are increasingly enhanced and being used extensively in content generation. Beyond this, GAI also excels in data modeling and analysis, benefitting wireless communication systems. In this article, we investigate applications of GAI in the physical layer and analyze its support for integrated sensing and communications (ISAC) systems. Specifically, we first provide an overview of GAI and ISAC, touching on GAI's potential support across multiple layers of ISAC. We then concentrate on the physical layer, investigating GAI's applications from various perspectives thoroughly, such as channel estimation, and demonstrate the value of these GAI-enhanced physical layer technologies for ISAC systems. In the case study, the proposed diffusion model-based method effectively estimates the signal direction of arrival under the near-field condition based on the uniform linear array, when antenna spacing surpassing half the wavelength. With a mean square error of 1.03 degrees, it confirms GAI's support for the physical layer in near-field sensing and communications.


title: SeisT: A foundational deep learning model for earthquake monitoring tasks

abstract: Seismograms, the fundamental seismic records, have revolutionized earthquake research and monitoring. Recent advancements in deep learning have further enhanced seismic signal processing, leading to even more precise and effective earthquake monitoring capabilities. This paper introduces a foundational deep learning model, the Seismogram Transformer (SeisT), designed for a variety of earthquake monitoring tasks. SeisT combines multiple modules tailored to different tasks and exhibits impressive out-of-distribution generalization performance, outperforming or matching state-of-the-art models in tasks like earthquake detection, seismic phase picking, first-motion polarity classification, magnitude estimation, back-azimuth estimation, and epicentral distance estimation. The performance scores on the tasks are 0.96, 0.96, 0.68, 0.95, 0.86, 0.55, and 0.81, respectively. The most significant improvements, in comparison to existing models, are observed in phase-P picking, phase-S picking, and magnitude estimation, with gains of 1.7%, 9.5%, and 8.0%, respectively. Our study, through rigorous experiments and evaluations, suggests that SeisT has the potential to contribute to the advancement of seismic signal processing and earthquake research.


title: Dataset Condensation for Recommendation

abstract: Training recommendation models on large datasets often requires significant time and computational resources. Consequently, an emergent imperative has arisen to construct informative, smaller-scale datasets for efficiently training. Dataset compression techniques explored in other domains show potential possibility to address this problem, via sampling a subset or synthesizing a small dataset. However, applying existing approaches to condense recommendation datasets is impractical due to following challenges: (i) sampling-based methods are inadequate in addressing the long-tailed distribution problem; (ii) synthesizing-based methods are not applicable due to discreteness of interactions and large size of recommendation datasets; (iii) neither of them fail to address the specific issue in recommendation of false negative items, where items with potential user interest are incorrectly sampled as negatives owing to insufficient exposure. To bridge this gap, we investigate dataset condensation for recommendation, where discrete interactions are continualized with probabilistic re-parameterization. To avoid catastrophically expensive computations, we adopt a one-step update strategy for inner model training and introducing policy gradient estimation for outer dataset synthesis. To mitigate amplification of long-tailed problem, we compensate long-tailed users in the condensed dataset. Furthermore, we propose to utilize a proxy model to identify false negative items. Theoretical analysis regarding the convergence property is provided. Extensive experiments on multiple datasets demonstrate the efficacy of our method. In particular, we reduce the dataset size by 75% while approximating over 98% of the original performance on Dianping and over 90% on other datasets.


title: Software Reconfiguration in Robotics

abstract: Since it has often been claimed by academics that reconfiguration is essential, many approaches to reconfiguration, especially of robotic systems, have been developed. Accordingly, the literature on robotics is rich in techniques for reconfiguring robotic systems. However, when talking to researchers in the domain, there seems to be no common understanding of what exactly reconfiguration is and how it relates to other concepts such as adaptation. Beyond this academic perspective, robotics frameworks provide mechanisms for dynamically loading and unloading parts of robotics applications. While we have a fuzzy picture of the state-of-the-art in robotic reconfiguration from an academic perspective, we lack a picture of the state-of-practice from a practitioner perspective. To fill this gap, we survey the literature on reconfiguration in robotic systems by identifying and analyzing 98 relevant papers, review how four major robotics frameworks support reconfiguration, and finally investigate the realization of reconfiguration in 48 robotics applications. When comparing the state-of-the-art with the state-of-practice, we observed a significant discrepancy between them, in particular, the scientific community focuses on complex structural reconfiguration, while in practice only parameter reconfiguration is widely used. Based on our observations, we discuss possible reasons for this discrepancy and conclude with a takeaway message for academics and practitioners interested in robotics.


title: Segmenting the motion components of a video: A long-term unsupervised model

abstract: Human beings have the ability to continuously analyze a video and immediately extract the motion components. We want to adopt this paradigm to provide a coherent and stable motion segmentation over the video sequence. In this perspective, we propose a novel long-term spatio-temporal model operating in a totally unsupervised way. It takes as input the volume of consecutive optical flow (OF) fields, and delivers a volume of segments of coherent motion over the video. More specifically, we have designed a transformer-based network, where we leverage a mathematically well-founded framework, the Evidence Lower Bound (ELBO), to derive the loss function. The loss function combines a flow reconstruction term involving spatio-temporal parametric motion models combining, in a novel way, polynomial (quadratic) motion models for the spatial dimensions and B-splines for the time dimension of the video sequence, and a regularization term enforcing temporal consistency on the segments. We report experiments on four VOS benchmarks, demonstrating competitive quantitative results, while performing motion segmentation on a whole sequence in one go. We also highlight through visual results the key contributions on temporal consistency brought by our method.


title: Language Model Decoding as Direct Metrics Optimization

abstract: Despite the remarkable advances in language modeling, current mainstream decoding methods still struggle to generate texts that align with human texts across different aspects. In particular, sampling-based methods produce less-repetitive texts which are often disjunctive in discourse, while search-based methods maintain topic coherence at the cost of increased repetition. Overall, these methods fall short in achieving holistic alignment across a broad range of aspects. In this work, we frame decoding from a language model as an optimization problem with the goal of strictly matching the expected performance with human texts measured by multiple metrics of desired aspects simultaneously. The resulting decoding distribution enjoys an analytical solution that scales the input language model distribution via a sequence-level energy function defined by these metrics. And most importantly, we prove that this induced distribution is guaranteed to improve the perplexity on human texts, which suggests a better approximation to the underlying distribution of human texts. To facilitate tractable sampling from this globally normalized distribution, we adopt the Sampling-Importance-Resampling technique. Experiments on various domains and model scales demonstrate the superiority of our method in metrics alignment with human texts and human evaluation over strong baselines.


title: Constrained Flows in Networks

abstract: The support of a flow $x$ in a network is the subdigraph induced by the arcs $uv$ for which $x(uv)>0$. We discuss a number of results on flows in networks where we put certain restrictions on structure of the support of the flow. Many of these problems are NP-hard because they generalize linkage problems for digraphs. For example deciding whether a network ${\cal N}=(D,s,t,c)$ has a maximum flow $x$ such that the maximum out-degree of the support $D_x$ of $x$ is at most 2 is NP-complete as it contains the 2-linkage problem as a very special case. Another problem which is NP-complete for the same reason is that of computing the maximum flow we can send from $s$ to $t$ along $p$ paths (called a maximum {\bf $p$-path-flow}) in ${\cal N}$. Baier et al. (2005) gave a polynomial time algorithm which finds a $p$-path-flow $x$ whose value is at least $\frac{2}{3}$ of the value of a optimum $p$-path-flow when $p\in \{2,3\}$, and at least $\frac{1}{2}$ when $p\geq 4$. When $p=2$, they show that this is best possible unless P=NP. We show for each $p\geq 2$ that the value of a maximum $p$-path-flow cannot be approximated by any ratio larger than $\frac{9}{11}$, unless P=NP. We also consider a variant of the problem where the $p$ paths must be disjoint. For this problem, we give an algorithm which gets within a factor $\frac{1}{H(p)}$ of the optimum solution, where $H(p)$ is the $p$'th harmonic number ($H(p) \sim \ln(p)$). We show that in the case where the network is acyclic, we can find such a maximum $p$-path-flow in polynomial time for every $p$. We determine the complexity of a number of related problems concerning the structure of flows. For the special case of acyclic digraphs, some of the results we obtain are in some sense best possible.


title: Decoding the Manhattan Project's Network: Unveiling Science, Collaboration, and Human Legacy

abstract: The Manhattan Project was one of the largest scientific collaborations ever undertaken. It operated thanks to a complex social network of extraordinary minds and it became undoubtedly one of the most remarkable intellectual efforts of human history. It also had devastating consequences during and after the atomic bombings of Hiroshima and Nagasaki. Despite the loss of hundreds of thousands of human lives during the bombing and the subsequent events, the scientific journey itself stands as a testament to human achievement, as highlighted in Christopher Nolan's film portrayal of Oppenheimer.


title: NIKA2 observations of starless cores in Taurus and Perseus

abstract: Dusty starless cores play an important role in regulating the initial phases of the formation of stars and planets. In their interiors, dust grains coagulate and ice mantles form, thereby changing the millimeter emissivities and hence the ability to cool. We mapped four regions with more than a dozen cores in the nearby Galactic filaments of Taurus and Perseus using the NIKA2 camera at the IRAM 30-meter telescope. Combining the 1mm to 2mm flux ratio maps with dust temperature maps from Herschel allowed to create maps of the dust emissivity index $\beta_{1,2}$ at resolutions of 2430 and 5600 a.u. in Taurus and Perseus, respectively. Here, we study the variation with total column densities and environment. $\beta_{1,2}$ values at the core centers ($A_V=12-19$mag) vary significantly between $\sim1.1$ and $2.3$. Several cores show a strong rise of $\beta_{1,2}$ from the outskirts at $\sim4$mag to the peaks of optical extinctions, consistent with the predictions of grain models and the gradual build-up of ice mantles on coagulated grains in the dense interiors of starless cores.


title: Tool-Augmented Reward Modeling

abstract: Reward modeling (a.k.a., preference modeling) is instrumental for aligning large language models with human preferences, particularly within the context of reinforcement learning from human feedback (RLHF). While conventional reward models (RMs) have exhibited remarkable scalability, they oft struggle with fundamental functionality such as arithmetic computation, code execution, and factual lookup. In this paper, we propose a tool-augmented preference modeling approach, named Themis, to address these limitations by empowering RMs with access to external environments, including calculators and search engines. This approach not only fosters synergy between tool utilization and reward grading but also enhances interpretive capacity and scoring reliability. Our study delves into the integration of external tools into RMs, enabling them to interact with diverse external sources and construct task-specific tool engagement and reasoning traces in an autoregressive manner. We validate our approach across a wide range of domains, incorporating seven distinct external tools. Our experimental results demonstrate a noteworthy overall improvement of 17.7% across eight tasks in preference ranking. Furthermore, our approach outperforms Gopher 280B by 7.3% on TruthfulQA task in zero-shot evaluation. In human evaluations, RLHF trained with Themis attains an average win rate of 32% when compared to baselines across four distinct tasks. Additionally, we provide a comprehensive collection of tool-related RM datasets, incorporating data from seven distinct tool APIs, totaling 15,000 instances. We have made the code, data, and model checkpoints publicly available to facilitate and inspire further research advancements\footnote{\url{https://github.com/ernie-research/Tool-Augmented-Reward-Model}}.


title: Epistemic integration and social segregation of AI in neuroscience

abstract: In recent years, Artificial Intelligence (AI) shows a spectacular ability of insertion inside a variety of disciplines which use it for scientific advancements and which sometimes improve it for their conceptual and methodological needs. According to the transverse science framework originally conceived by Shinn and Joerges, AI can be seen as an instrument which is progressively acquiring a universal character through its diffusion across science. In this paper we address empirically one aspect of this diffusion, namely the penetration of AI into a specific field of research. Taking neuroscience as a case study, we conduct a scientometric analysis of the development of AI in this field. We especially study the temporal egocentric citation network around the articles included in this literature, their represented journals and their authors linked together by a temporal collaboration network. We find that AI is driving the constitution of a particular disciplinary ecosystem in neuroscience which is distinct from other subfields, and which is gathering atypical scientific profiles who are coming from neuroscience or outside it. Moreover we observe that this AI community in neuroscience is socially confined in a specific subspace of the neuroscience collaboration network, which also publishes in a small set of dedicated journals that are mostly active in AI research. According to these results, the diffusion of AI in a discipline such as neuroscience didn't really challenge its disciplinary orientations but rather induced the constitution of a dedicated socio-cognitive environment inside this field.