title: The He star donor channel towards the black widow PSR J1953+1844

abstract: Black widows (BWs) are a type of eclipsing millisecond pulsars (MSPs) with low companion masses ($\lesssim0.05\,\rm M_\odot$) and tight orbits ($<1\,$d). PSR J1953+1844 is a BW with the shortest orbital period ($\sim53$ minutes) ever discovered, which was recently detected by Five-hundred-meter Aperture Spherical radio Telescope. Its companion mass is $\sim0.01\,\rm M_\odot$ according to its mass function, indicating that the companion may be a hydrogen-deficient star. However, the origin of PSR J1953+1844 is highly unclear. In this paper, we explored the origin of PSR J1953+1844 through the neutron star+He star channel, in which the system can experience ultracompact X-ray binary phase. We found that the He star donor channel can reproduce the characteristics of PSR J1953+1844, indicating that this work provides an alternative formation channel for this source. Meanwhile, the minimum orbital period of BWs formed by this channel is $\sim28$ minutes, corresponding to the companion mass of $0.058\,\rm M_\odot$. In addition, we note that even though PSR J1953+1844 has a short orbital period, it cannot be detected by the gravitational wave (GW) observatories like Laser Interferometer Space Antenna, TaiJi and TianQin. However, we still expect that the BWs with extremely tight orbit produced by this channel are the potential sources of future space-based GW observatories. Moreover, our simulations show that PSR J1953+1844 may eventually evolve into an isolated MSP.


title: Adaptive CPU Resource Allocation for Emulator in Kernel-based Virtual Machine

abstract: The technologies of heterogeneous multi-core architectures, co-location, and virtualization can be used to reduce server power consumption and improve system utilization, which are three important technologies for data centers. This article explores the scheduling strategy of Emulator threads within virtual machine processes in a scenario of co-location of multiple virtual machines on heterogeneous multi-core architectures. In this co-location scenario, the scheduling strategy for Emulator threads significantly affects the performance of virtual machines. This article focuses on this thread for the first time in the relevant field. This article found that the scheduling latency metric can well indicate the running status of the vCPU threads and Emulator threads in the virtualization environment, and applied this metric to the design of the scheduling strategy. This article designed an Emulator thread scheduler based on heuristic rules, which, in coordination with the host operating system's scheduler, dynamically adjusts the scheduling scope of Emulator threads to improve the overall performance of virtual machines. The article found that in real application scenarios, the scheduler effectively improved the performance of applications within virtual machines, with a maximum performance improvement of 40.7%.


title: On the Gromov hyperbolicity of the minimal metric

abstract: In this paper we study the hyperbolicity in the sense of Gromov of domains in $\mathbb{R}^d$ $(d\geq3)$ with respect to the minimal metric introduced by Forstneri\v{c} and Kalaj. In particular, we prove that every bounded strongly minimally convex domain is Gromov hyperbolic and its Gromov compactification is equivalent to its Euclindean closure. Moreover, we prove that the boundary of a Gromov hyperbolic convex domain does not contain non-trivial conformal harmonic disks. Finally, we study the relation between the minimal metric and the Hilbert metric in convex domains.


title: The Safety Challenges of Deep Learning in Real-World Type 1 Diabetes Management

abstract: Blood glucose simulation allows the effectiveness of type 1 diabetes (T1D) management strategies to be evaluated without patient harm. Deep learning algorithms provide a promising avenue for extending simulator capabilities; however, these algorithms are limited in that they do not necessarily learn physiologically correct glucose dynamics and can learn incorrect and potentially dangerous relationships from confounders in training data. This is likely to be more important in real-world scenarios, as data is not collected under strict research protocol. This work explores the implications of using deep learning algorithms trained on real-world data to model glucose dynamics. Free-living data was processed from the OpenAPS Data Commons and supplemented with patient-reported tags of challenging diabetes events, constituting one of the most detailed real-world T1D datasets. This dataset was used to train and evaluate state-of-the-art glucose simulators, comparing their prediction error across safety critical scenarios and assessing the physiological appropriateness of the learned dynamics using Shapley Additive Explanations (SHAP). While deep learning prediction accuracy surpassed the widely-used mathematical simulator approach, the model deteriorated in safety critical scenarios and struggled to leverage self-reported meal and exercise information. SHAP value analysis also indicated the model had fundamentally confused the roles of insulin and carbohydrates, which is one of the most basic T1D management principles. This work highlights the importance of considering physiological appropriateness when using deep learning to model real-world systems in T1D and healthcare more broadly, and provides recommendations for building models that are robust to real-world data constraints.


title: A Multi-timescale and Chance-Constrained Energy Dispatching Strategy of Integrated Heat-Power Community with Shared Hybrid Energy Storage

abstract: The community in the future may develop into an integrated heat-power system, which includes a high proportion of renewable energy, power generator units, heat generator units, and shared hybrid energy storage. In the integrated heat-power system with coupling heat-power generators and demands, the key challenges lie in the interaction between heat and power, the inherent uncertainty of renewable energy and consumers' demands, and the multi-timescale scheduling of heat and power. In this paper, we propose a game theoretic model of the integrated heat-power system. For the welfare-maximizing community operator, its energy dispatch strategy is under chance constraints, where the day-ahead scheduling determines the scheduled energy dispatching strategies, and the real-time dispatch considers the adjustment of generators. For utility-maximizing consumers, their demands are sensitive to the preference parameters. Taking into account the uncertainty in both renewable energy and consumer demand, we prove the existence and uniqueness of the Stackelberg game equilibrium and develop a fixed point algorithm to find the market equilibrium between the community operator and community consumers. Numerical simulations on integrated heat-power system validate the effectiveness of the proposed multi-timescale integrated heat and power model.


title: Time-Domain Channel Estimation for Extremely Large MIMO THz Communications with Beam Squint

abstract: In this paper, we study the problem of extremely large (XL) multiple-input multiple-output (MIMO) channel estimation in the Terahertz (THz) frequency band, considering the presence of propagation delays across the entire array apertures, which leads to frequency selectivity, a problem known as beam squint. Multi-carrier transmission schemes which are usually deployed to address this problem, suffer from high peak-to-average power ratio, which is specifically dominant in THz communications where low transmit power is realized. Diverging from the usual approach, we devise a novel channel estimation problem formulation in the time domain for single-carrier (SC) modulation, which favors transmissions in THz, and incorporate the beam-squint effect in a sparse vector recovery problem that is solved via sparse optimization tools. In particular, the beam squint and the sparse MIMO channel are jointly tracked by using an alternating minimization approach that decomposes the two estimation problems. The presented performance evaluation results validate that the proposed SC technique exhibits superior performance than the conventional one as well as than state-of-the-art multi-carrier approaches.


title: Homogenized lattice Boltzmann methods for fluid flow through porous media -- part I: kinetic model derivation

abstract: In this series of studies, we establish homogenized lattice Boltzmann methods (HLBM) for simulating fluid flow through porous media. Our contributions in part I are twofold. First, we assemble the targeted partial differential equation system by formally unifying the governing equations for nonstationary fluid flow in porous media. A matrix of regularly arranged, equally sized obstacles is placed into the domain to model fluid flow through porous structures governed by the incompressible nonstationary Navier--Stokes equations (NSE). Depending on the ratio of geometric parameters in the matrix arrangement, several homogenized equations are obtained. We review existing methods for homogenizing the nonstationary NSE for specific porosities and discuss the applicability of the resulting model equations. Consequently, the homogenized NSE are expressed as targeted partial differential equations that jointly incorporate the derived aspects. Second, we propose a kinetic model, the homogenized Bhatnagar--Gross--Krook Boltzmann equation, which approximates the homogenized nonstationary NSE. We formally prove that the zeroth and first order moments of the kinetic model provide solutions to the mass and momentum balance variables of the macrocopic model up to specific orders in the scaling parameter. Based on the present contributions, in the sequel (part II), the homogenized NSE are consistently approximated by deriving a limit consistent HLBM discretization of the homogenized Bhatnagar--Gross--Krook Boltzmann equation.

categories: math.NA cs.NA math-ph math.MP physics.comp-ph physics.flu-dyn


title: MCC-KD: Multi-CoT Consistent Knowledge Distillation

abstract: Large language models (LLMs) have showcased remarkable capabilities in complex reasoning through chain of thought (CoT) prompting. Recently, there has been a growing interest in transferring these reasoning abilities from LLMs to smaller models. However, achieving both the diversity and consistency in rationales presents a challenge. In this paper, we focus on enhancing these two aspects and propose Multi-CoT Consistent Knowledge Distillation (MCC-KD) to efficiently distill the reasoning capabilities. In MCC-KD, we generate multiple rationales for each question and enforce consistency among the corresponding predictions by minimizing the bidirectional KL-divergence between the answer distributions. We investigate the effectiveness of MCC-KD with different model architectures (LLaMA/FlanT5) and various model scales (3B/7B/11B/13B) on both mathematical reasoning and commonsense reasoning benchmarks. The empirical results not only confirm MCC-KD's superior performance on in-distribution datasets but also highlight its robust generalization ability on out-of-distribution datasets.


title: A Comparative Study of Portfolio Optimization Methods for the Indian Stock Market

abstract: This chapter presents a comparative study of the three portfolio optimization methods, MVP, HRP, and HERC, on the Indian stock market, particularly focusing on the stocks chosen from 15 sectors listed on the National Stock Exchange of India. The top stocks of each cluster are identified based on their free-float market capitalization from the report of the NSE published on July 1, 2022 (NSE Website). For each sector, three portfolios are designed on stock prices from July 1, 2019, to June 30, 2022, following three portfolio optimization approaches. The portfolios are tested over the period from July 1, 2022, to June 30, 2023. For the evaluation of the performances of the portfolios, three metrics are used. These three metrics are cumulative returns, annual volatilities, and Sharpe ratios. For each sector, the portfolios that yield the highest cumulative return, the lowest volatility, and the maximum Sharpe Ratio over the training and the test periods are identified.


title: Exploring hierarchical framework of nonlinear sparse Bayesian learning algorithm through numerical investigations

abstract: Sparse Bayesian learning (SBL) has been extensively utilized in data-driven modeling to combat the issue of overfitting. While SBL excels in linear-in-parameter models, its direct applicability is limited in models where observations possess nonlinear relationships with unknown parameters. Recently, a semi-analytical Bayesian framework known as nonlinear sparse Bayesian learning (NSBL) was introduced by the authors to induce sparsity among model parameters during the Bayesian inversion of nonlinear-in-parameter models. NSBL relies on optimally selecting the hyperparameters of sparsity-inducing Gaussian priors. It is inherently an approximate method since the uncertainty in the hyperparameter posterior is disregarded as we instead seek the maximum a posteriori (MAP) estimate of the hyperparameters (type-II MAP estimate). This paper aims to investigate the hierarchical structure that forms the basis of NSBL and validate its accuracy through a comparison with a one-level hierarchical Bayesian inference as a benchmark in the context of three numerical experiments: (i) a benchmark linear regression example with Gaussian prior and Gaussian likelihood, (ii) the same regression problem with a highly non-Gaussian prior, and (iii) an example of a dynamical system with a non-Gaussian prior and a highly non-Gaussian likelihood function, to explore the performance of the algorithm in these new settings. Through these numerical examples, it can be shown that NSBL is well-suited for physics-based models as it can be readily applied to models with non-Gaussian prior distributions and non-Gaussian likelihood functions. Moreover, we illustrate the accuracy of the NSBL algorithm as an approximation to the one-level hierarchical Bayesian inference and its ability to reduce the computational cost while adequately exploring the parameter posteriors.


title: Revisiting Yukawa's Bilocal Field Theory for Composite Scalar Bosons

abstract: Yukawa's old bilocal field theory, with modernization in the treatment of "relative time," can describe a relativistic bound state of chiral fermions. This connects to bosonized effective chiral Lagrangians and the Nambu-Jona-Lasinio (NJL) model, providing a description of the internal dynamics of the bound states. It features a static internal wave-function, $\phi(\vec{r})$, in the center-of-mass frame that satisfies a Schr\"odinger-Klein-Gordon equation with eigenvalues $m^2$. We analyze the "coloron" model (single perturbative massive gluon exchange) which yields a UV completion of the NJL model. This has a BCS-like enhancement of its interaction, $\propto N_c$, the number of colors. It is classically critical, with $g_{critical}$ remarkably close to the NJL quantum critical coupling. Negative eigenvalues for $m^2$ lead to spontaneous symmetry breaking, and the Yukawa coupling of the bound state to constituent fermions is emergent.


title: Efficient and Interpretable Bandit Algorithms

abstract: Motivated by the importance of explainability in modern machine learning, we design bandit algorithms that are efficient and interpretable. A bandit algorithm is interpretable if it explores with the objective of reducing uncertainty in the unknown model parameter. To quantify the interpretability, we introduce a novel metric of model error, which compares the rate reduction of the mean reward estimates to their actual means among all the plausible actions. We propose CODE, a bandit algorithm based on a Constrained Optimal DEsign, that is interpretable and maximally reduces the uncertainty. The key idea in CODE is to explore among all plausible actions, determined by a statistical constraint, to achieve interpretability. We implement CODE efficiently in both multi-armed and linear bandits and derive near-optimal regret bounds by leveraging the optimality criteria of the approximate optimal design. CODE can be also viewed as removing phases in conventional phased elimination, which makes it more practical and general. We demonstrate the advantage of CODE by numerical experiments on both synthetic and real-world problems. CODE outperforms other state-of-the-art interpretable designs while matching the performance of popular but uninterpretable designs, such as upper confidence bound algorithms.


title: Growth-induced stability in modified SLE curve

abstract: In this study, the non-equilibrium free energy corresponding to the curve generated by a modified stochastic Loewner evolution (SLE), which is driven by the Langevin equation, is theoretically investigated. Under certain conditions, we prove that the time derivative of the (generalized) free energy expressed by Kullback-Leibler divergence between the probability distributions of the curve and driving function has a positive value, indicating the negativity of Gibbs entropy production. In addition, it was implied that, in a certain restriction, the free energy can be expressed as a function of a Lyapunov-type exponent of the driving function. These results show a dissipative nature of conformal dynamics, and indicate the growth-induced stability of the modified SLE curve.


title: Rethinking Tokenizer and Decoder in Masked Graph Modeling for Molecules

abstract: Masked graph modeling excels in the self-supervised representation learning of molecular graphs. Scrutinizing previous studies, we can reveal a common scheme consisting of three key components: (1) graph tokenizer, which breaks a molecular graph into smaller fragments (i.e., subgraphs) and converts them into tokens; (2) graph masking, which corrupts the graph with masks; (3) graph autoencoder, which first applies an encoder on the masked graph to generate the representations, and then employs a decoder on the representations to recover the tokens of the original graph. However, the previous MGM studies focus extensively on graph masking and encoder, while there is limited understanding of tokenizer and decoder. To bridge the gap, we first summarize popular molecule tokenizers at the granularity of node, edge, motif, and Graph Neural Networks (GNNs), and then examine their roles as the MGM's reconstruction targets. Further, we explore the potential of adopting an expressive decoder in MGM. Our results show that a subgraph-level tokenizer and a sufficiently expressive decoder with remask decoding have a large impact on the encoder's representation learning. Finally, we propose a novel MGM method SimSGT, featuring a Simple GNN-based Tokenizer (SGT) and an effective decoding strategy. We empirically validate that our method outperforms the existing molecule self-supervised learning methods. Our codes and checkpoints are available at https://github.com/syr-cn/SimSGT.


title: Approximately well-balanced Discontinuous Galerkin methods using bases enriched with Physics-Informed Neural Networks

abstract: This work concerns the enrichment of Discontinuous Galerkin (DG) bases, so that the resulting scheme provides a much better approximation of steady solutions to hyperbolic systems of balance laws. The basis enrichment leverages a prior - an approximation of the steady solution - which we propose to compute using a Physics-Informed Neural Network (PINN). To that end, after presenting the classical DG scheme, we show how to enrich its basis with a prior. Convergence results and error estimates follow, in which we prove that the basis with prior does not change the order of convergence, and that the error constant is improved. To construct the prior, we elect to use parametric PINNs, which we introduce, as well as the algorithms to construct a prior from PINNs. We finally perform several validation experiments on four different hyperbolic balance laws to highlight the properties of the scheme. Namely, we show that the DG scheme with prior is much more accurate on steady solutions than the DG scheme without prior, while retaining the same approximation quality on unsteady solutions.


title: Partial Isometries Between Hilbert Modules and Their Compositions

abstract: Motivated by questions raised in the preprint [AL20] by Accardi and Lu (private communication), we examine criteria for when the product of two partial isometries between Hilbert spaces is again a partial isometry and we use this to define a new composition operation that always yields again a partial isometry. Then, we aim at promoting these results to (not necessarily adjointable) partial isometries between Hilbert modules as proposed by Shalit and Skeide [SS23]. The case of Hilbert spaces is elementary and rather simple, though not trivial, but -- we expect -- folkloric. The case of Hilbert modules suffers substantially from the fact that bounded right linear maps need not possess necessarily an adjoint. In fact, we show that the new composition law for partial isometries between Hilbert spaces can in no way be promoted directly to partial isometries between Hilbert modules, but that we have to pass to the more flexible class of partially defined isometries.


title: Finite-size scaling analysis of the two-dimensional random transverse-field Ising ferromagnet

abstract: The random transverse-field Ising ferromagnet (RTFIF) is a highly disordered quantum system which contains randomness in the coupling strengths as well as in the transverse-field strengths. In one dimension, the critical properties are governed by an infinite-randomness fixed point (IRFP), and renormalization-group studies argue that the two-dimensional (2D) model is also governed by an IRFP. However, even the location of the critical point remains unsettled among quantum Monte Carlo (QMC) studies. In this work, we perform extensive QMC simulations to locate the quantum critical point and attempt a finite-size scaling analysis to observe the critical behavior. We estimate the critical field strength of the 2D RTFIF as $\Gamma_c = 7.52(2)$, together with critical exponents such as $\beta=1.5(3)$, $\nu = 1.6(3)$, and $z=3.3(3)$ or $\psi=0.50(3)$. We have also considered the McCoy-Wu model, which has randomness in the ferromagnetic coupling strengths but not in the transverse-field strength. Our QMC calculation shows that the critical behavior of the 2D McCoy-Wu model is closer to that of the 2D transverse-field Ising spin glass than to that of the 2D RTFIF. These numerical findings enhance our understanding of disordered 2D quantum systems.


title: SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Research

abstract: Despite its relevance, the maturity of NLP for social media pales in comparison with general-purpose models, metrics and benchmarks. This fragmented landscape makes it hard for the community to know, for instance, given a task, which is the best performing model and how it compares with others. To alleviate this issue, we introduce a unified benchmark for NLP evaluation in social media, SuperTweetEval, which includes a heterogeneous set of tasks and datasets combined, adapted and constructed from scratch. We benchmarked the performance of a wide range of models on SuperTweetEval and our results suggest that, despite the recent advances in language modelling, social media remains challenging.


title: Optimizing IoT-Based Asset and Utilization Tracking: Efficient Activity Classification with MiniRocket on Resource-Constrained Devices

abstract: This paper introduces an effective solution for retrofitting construction power tools with low-power IoT to enable accurate activity classification. We address the challenge of distinguishing between when a power tool is being moved and when it is actually being used. To achieve classification accuracy and power consumption preservation a newly released algorithm called MiniRocket was employed. Known for its accuracy, scalability, and fast training for time-series classification, in this paper, it is proposed as a TinyML algorithm for inference on resource-constrained IoT devices. The paper demonstrates the portability and performance of MiniRocket on a resource-constrained, ultra-low power sensor node for floating-point and fixed-point arithmetic, matching up to 1% of the floating-point accuracy. The hyperparameters of the algorithm have been optimized for the task at hand to find a Pareto point that balances memory usage, accuracy and energy consumption. For the classification problem, we rely on an accelerometer as the sole sensor source, and BLE for data transmission. Extensive real-world construction data, using 16 different power tools, were collected, labeled, and used to validate the algorithm's performance directly embedded in the IoT device. Experimental results demonstrate that the proposed solution achieves an accuracy of 96.9% in distinguishing between real usage status and other motion statuses while consuming only 7kB of flash and 3kB of RAM. The final application exhibits an average current consumption of less than 15{\mu}W for the whole system, resulting in battery life performance ranging from 3 to 9 years depending on the battery capacity (250-500mAh) and the number of power tool usage hours (100-1500h).


title: Anomalous Kinetics of a Multi-Species Reaction-Diffusion System: Effect of Random Velocity Fluctuations

abstract: Reaction-diffusion systems, which consist of the reacting particles subject to diffusion process, constitute one of the common examples of non-linear statistical systems. In low space dimensions $d \leq 2$ the usual description by means of kinetic rate equations is not sufficient and the effect of density fluctuations has to be properly taken into account. Our aim here is to analyze a particular multi-species reaction-diffusion system characterized by reactions $\textit{A} +\textit{A} \rightarrow (\emptyset, A),$ $\textit{A} +\textit{B} \rightarrow \textit{A}$ at and below its critical dimension $d_c = 2$. In particular, we investigate effect of thermal fluctuations on the reaction kinetics, which are generated by means of random velocity field modelled by a stochastic Navier-Stokes equations. Main theoretical tool employed is field-theoretic perturbative renormalization group. The analysis is performed to the first order of the perturbation scheme (one-loop approximation).


title: On the Hardy-Ramanujan Theorem

abstract: In 1917, G.H.Hardy and S.Ramanujan proved that the `typical' number of prime factors of a positive integer $n$ is approximately $\ln\ln n$. In this technical paper we proffer a complete exposition of this proof, and further provide novel approaches based on probabalistic techniques in order to extract number theoretic results. Using elementary methods in probability theory, we expand on current methods to prove a substantially sharper distributional result than in current literature. We conclude the paper with an original proof of the Hardy-Ramanujan theorem.


title: A generalized pseudo-rotation with positive topological entropy

abstract: In this note we give examples of Hamiltonian diffeomorphisms which are on one hand dynamically complicated, for instance with positive topological entropy, and on the other hand minimal from the perspective of Floer theory. The minimality is in the sense that the barcode of the Floer complex of all iterates of these maps consists of only infinite bars. In particular, the maps have zero barcode entropy.


title: Native spaces and generalization of Wu functions

abstract: We prove that the native space of a Wu function is a dense subspace of a Sobolev space. An explicit characterization of the native spaces of Wu functions is given. Three definitions of Wu functions are introduced and proven to be equivalent. Based on these new equivalent definitions and the so called $f$-form tricks, we can generalize the Wu functions into the even-dimensional spaces $\R^{2k}$, while the original Wu functions are only defined in the odd-dimensional spaces $\R^{2k+1}$. Such functions in even-dimensional spaces are referred to as the `missing Wu functions'. Furthermore we can generalize the Wu functions into `fractional'-dimensional spaces. We call all these Wu functions the generalized Wu functions. The closed form of the generalized Wu functions are given in terms of hypergeometric functions. Finally we prove that the Wu functions and the missing Wu functions can be written as linear combinations of the generalized Wendland functions.


title: Externally Valid Policy Evaluation Combining Trial and Observational Data

abstract: Randomized trials are widely considered as the gold standard for evaluating the effects of decision policies. Trial data is, however, drawn from a population which may differ from the intended target population and this raises a problem of external validity (aka. generalizability). In this paper we seek to use trial data to draw valid inferences about the outcome of a policy on the target population. Additional covariate data from the target population is used to model the sampling of individuals in the trial study. We develop a method that yields certifiably valid trial-based policy evaluations under any specified range of model miscalibrations. The method is nonparametric and the validity is assured even with finite samples. The certified policy evaluations are illustrated using both simulated and real data.


title: Improved K-mer Based Prediction of Protein-Protein Interactions With Chaos Game Representation, Deep Learning and Reduced Representation Bias

abstract: Protein-protein interactions drive many biological processes, including the detection of phytopathogens by plants' R-Proteins and cell surface receptors. Many machine learning studies have attempted to predict protein-protein interactions but performance is highly dependent on training data; models have been shown to accurately predict interactions when the proteins involved are included in the training data, but achieve consistently poorer results when applied to previously unseen proteins. In addition, models that are trained using proteins that take part in multiple interactions can suffer from representation bias, where predictions are driven not by learned biological features but by learning of the structure of the interaction dataset. We present a method for extracting unique pairs from an interaction dataset, generating non-redundant paired data for unbiased machine learning. After applying the method to datasets containing _Arabidopsis thaliana_ and pathogen effector interations, we developed a convolutional neural network model capable of learning and predicting interactions from Chaos Game Representations of proteins' coding genes.


title: One-neutron transfer reaction in the $^{18}$O + $^{48}$Ti collision at 275 MeV

abstract: The present article reports new data on the $^{48}$Ti($^{18}$O,$^{17}$O)$^{49}$Ti reaction at 275 MeV incident energy as part of the systematic research pursued within the NUMEN project. Supplementary measurements of the same reaction on $^{16}$O and $^{27}$Al targets were also performed in order to estimate the background arising from the use of a composite target (TiO$_{2}$ + $^{27}$Al). These data were analyzed under the same theoretical framework as those obtained with the titanium target in order to reinforce the conclusions of our analysis. Differential cross-section angular distribution measurements for the $^{17}$O$^{8+}$ ejectiles were performed in a wide angular range by using the MAGNEX large acceptance magnetic spectrometer. The experimental results were analyzed within the distorted-wave and coupled-channels Born Approximation frameworks. The optical potentials at the entrance and exit channels were calculated in a double folding approach adopting the S\~ao Paulo potential, and the spectroscopic amplitudes for the projectile and target overlaps were obtained from large-scale shell model calculations. The differential cross-sections are well-described by the theoretical calculations, where a weak coupling to collective excitations of projectile and target is inferred. The sensitivity of transfer cross-sections on different model spaces adopted in nuclear structure calculations, is also discussed.


title: End-to-End Learning of Behavioural Inputs for Autonomous Driving in Dense Traffic

abstract: Trajectory sampling in the Frenet(road-aligned) frame, is one of the most popular methods for motion planning of autonomous vehicles. It operates by sampling a set of behavioural inputs, such as lane offset and forward speed, before solving a trajectory optimization problem conditioned on the sampled inputs. The sampling is handcrafted based on simple heuristics, does not adapt to driving scenarios, and is oblivious to the capabilities of downstream trajectory planners. In this paper, we propose an end-to-end learning of behavioural input distribution from expert demonstrations or in a self-supervised manner. Our core novelty lies in embedding a custom differentiable trajectory optimizer as a layer in neural networks, allowing us to update behavioural inputs by considering the optimizer's feedback. Moreover, our end-to-end approach also ensures that the learned behavioural inputs aid the convergence of the optimizer. We improve the state-of-the-art in the following aspects. First, we show that learned behavioural inputs substantially decrease collision rate while improving driving efficiency over handcrafted approaches. Second, our approach outperforms model predictive control methods based on sampling-based optimization.


title: Predicting COVID-19 Infections Using Multi-layer Centrality Measures in Population-scale Networks

abstract: Understanding the spread of SARS-CoV-2 has been one of the most pressing problems of the recent past. Network models present a potent approach to studying such spreading phenomena because of their ability to represent complex social interactions. While previous studies have shown that network centrality measures are generally able to identify influential spreaders in a susceptible population, it is not yet known if they can also be used to predict infection risks. However, information about infection risks at the individual level is vital for the design of targeted interventions. Here, we use large-scale administrative data from the Netherlands to study whether centrality measures can predict the risk and timing of infections with COVID-19-like diseases. We investigate this issue leveraging the framework of multi-layer networks, which accounts for interactions taking place in different contexts, such as workplaces, households and schools. In epidemic models simulated on real-world network data from over one million individuals, we find that existing centrality measures offer good predictions of relative infection risks, and are correlated with the timing of individual infections. We however find no association between centrality measures and real SARS-CoV-2 test data, which indicates that population-scale network data alone cannot aid predictions of virus transmission.


title: Policy Gradient with Kernel Quadrature

abstract: Reward evaluation of episodes becomes a bottleneck in a broad range of reinforcement learning tasks. Our aim in this paper is to select a small but representative subset of a large batch of episodes, only on which we actually compute rewards for more efficient policy gradient iterations. We build a Gaussian process modeling of discounted returns or rewards to derive a positive definite kernel on the space of episodes, run an ``episodic" kernel quadrature method to compress the information of sample episodes, and pass the reduced episodes to the policy network for gradient updates. We present the theoretical background of this procedure as well as its numerical illustrations in MuJoCo tasks.


title: An introduction to radar Automatic Target Recognition (ATR) technology in ground-based radar systems

abstract: This paper presents a brief examination of Automatic Target Recognition (ATR) technology within ground-based radar systems. It offers a lucid comprehension of the ATR concept, delves into its historical milestones, and categorizes ATR methods according to different scattering regions. By incorporating ATR solutions into radar systems, this study demonstrates the expansion of radar detection ranges and the enhancement of tracking capabilities, leading to superior situational awareness. Drawing insights from the Russo-Ukrainian War, the paper highlights three pressing radar applications that urgently necessitate ATR technology: detecting stealth aircraft, countering small drones, and implementing anti-jamming measures. Anticipating the next wave of radar ATR research, the study predicts a surge in cognitive radar and machine learning (ML)-driven algorithms. These emerging methodologies aspire to confront challenges associated with system adaptation, real-time recognition, and environmental adaptability. Ultimately, ATR stands poised to revolutionize conventional radar systems, ushering in an era of 4D sensing capabilities.


title: Theoretically Grounded Loss Functions and Algorithms for Score-Based Multi-Class Abstention

abstract: Learning with abstention is a key scenario where the learner can abstain from making a prediction at some cost. In this paper, we analyze the score-based formulation of learning with abstention in the multi-class classification setting. We introduce new families of surrogate losses for the abstention loss function, which include the state-of-the-art surrogate losses in the single-stage setting and a novel family of loss functions in the two-stage setting. We prove strong non-asymptotic and hypothesis set-specific consistency guarantees for these surrogate losses, which upper-bound the estimation error of the abstention loss function in terms of the estimation error of the surrogate loss. Our bounds can help compare different score-based surrogates and guide the design of novel abstention algorithms by minimizing the proposed surrogate losses. We experimentally evaluate our new algorithms on CIFAR-10, CIFAR-100, and SVHN datasets and the practical significance of our new surrogate losses and two-stage abstention algorithms. Our results also show that the relative performance of the state-of-the-art score-based surrogate losses can vary across datasets.


title: Evaluating the Knowledge Base Completion Potential of GPT

abstract: Structured knowledge bases (KBs) are an asset for search engines and other applications, but are inevitably incomplete. Language models (LMs) have been proposed for unsupervised knowledge base completion (KBC), yet, their ability to do this at scale and with high accuracy remains an open question. Prior experimental studies mostly fall short because they only evaluate on popular subjects, or sample already existing facts from KBs. In this work, we perform a careful evaluation of GPT's potential to complete the largest public KB: Wikidata. We find that, despite their size and capabilities, models like GPT-3, ChatGPT and GPT-4 do not achieve fully convincing results on this task. Nonetheless, they provide solid improvements over earlier approaches with smaller LMs. In particular, we show that, with proper thresholding, GPT-3 enables to extend Wikidata by 27M facts at 90% precision.


title: Predictor-Rejector Multi-Class Abstention: Theoretical Analysis and Algorithms

abstract: We study the key framework of learning with abstention in the multi-class classification setting. In this setting, the learner can choose to abstain from making a prediction with some pre-defined cost. We present a series of new theoretical and algorithmic results for this learning problem in the predictor-rejector framework. We introduce several new families of surrogate losses for which we prove strong non-asymptotic and hypothesis set-specific consistency guarantees, thereby resolving positively two existing open questions. These guarantees provide upper bounds on the estimation error of the abstention loss function in terms of that of the surrogate loss. We analyze both a single-stage setting where the predictor and rejector are learned simultaneously and a two-stage setting crucial in applications, where the predictor is learned in a first stage using a standard surrogate loss such as cross-entropy. These guarantees suggest new multi-class abstention algorithms based on minimizing these surrogate losses. We also report the results of extensive experiments comparing these algorithms to the current state-of-the-art algorithms on CIFAR-10, CIFAR-100 and SVHN datasets. Our results demonstrate empirically the benefit of our new surrogate losses and show the remarkable performance of our broadly applicable two-stage abstention algorithm.


title: The Galactic neutron star population II -- Systemic velocities and merger locations of binary neutron stars

abstract: The merger locations of binary neutron stars (BNSs) encode their galactic kinematics and provide insights into their connection to short gamma-ray bursts (SGRBs). In this work, we use the sample of Galactic BNSs with measured proper motions to investigate their kinematics and predict their merger locations. Using a synthetic image of the Milky Way and its Galactic potential we analyse the BNS mergers as seen from an extragalactic viewpoint and compare them to the location of SGRBs on and around their host galaxies. We find that the Galactocentric transverse velocities of the BNSs are similar in magnitude and direction to those of their Local Standards of Rest, which implies that the present-day systemic velocities are not isotropically oriented and the peculiar velocities might be as low as those of BNS progenitors. Both systemic and peculiar velocities fit a lognormal distribution, with the peculiar velocities being as low as $\sim 22-157$ km s$^{-1}$. We also find that the observed BNS sample is not representative of the whole Galactic population, but rather of systems born around the Sun's location with small peculiar velocities. When comparing the predicted BNS merger locations to SGRBs, we find that they cover the same range of projected offsets, host-normalized offsets, and fractional light. Therefore, the spread in SGRB locations can be reproduced by mergers of BNSs born in the Galactic disk with small peculiar velocities, although the median offset match is likely a coincidence due to the biased BNS sample.


title: Principled Approaches for Learning to Defer with Multiple Experts

abstract: We present a study of surrogate losses and algorithms for the general problem of learning to defer with multiple experts. We first introduce a new family of surrogate losses specifically tailored for the multiple-expert setting, where the prediction and deferral functions are learned simultaneously. We then prove that these surrogate losses benefit from strong $H$-consistency bounds. We illustrate the application of our analysis through several examples of practical surrogate losses, for which we give explicit guarantees. These loss functions readily lead to the design of new learning to defer algorithms based on their minimization. While the main focus of this work is a theoretical analysis, we also report the results of several experiments on SVHN and CIFAR-10 datasets.


title: Many-body quantum interference route to the two-channel Kondo effect: Inverse design for molecular junctions

abstract: Molecular junctions -- whether actual single molecules in nanowire break junctions or artificial molecules realized in coupled quantum dot devices -- offer unique functionality due to their orbital complexity, strong electron interactions, gate control, and many-body effects from hybridization with the external electronic circuit. Inverse design involves finding candidate structures that perform a desired function optimally. Here we develop an inverse design strategy for generalized quantum impurity models describing molecular junctions, and as an example, use it to demonstrate that many-body quantum interference can be leveraged to realize the two-channel Kondo critical point in simple 4- or 5-site molecular moieties. We show that remarkably high Kondo temperatures can be achieved, meaning that entropy and transport signatures should be experimentally accessible.


title: GPAW: An open Python package for electronic-structure calculations

abstract: We review the GPAW open-source Python package for electronic structure calculations. GPAW is based on the projector-augmented wave method and can solve the self-consistent density functional theory (DFT) equations using three different wave-function representations, namely real-space grids, plane waves, and numerical atomic orbitals. The three representations are complementary and mutually independent and can be connected by transformations via the real-space grid. This multi-basis feature renders GPAW highly versatile and unique among similar codes. By virtue of its modular structure, the GPAW code constitutes an ideal platform for implementation of new features and methodologies. Moreover, it is well integrated with the Atomic Simulation Environment (ASE) providing a flexible and dynamic user interface. In addition to ground-state DFT calculations, GPAW supports many-body GW band structures, optical excitations from the Bethe-Salpeter Equation (BSE), variational calculations of excited states in molecules and solids via direct optimization, and real-time propagation of the Kohn-Sham equations within time-dependent DFT. A range of more advanced methods to describe magnetic excitations and non-collinear magnetism in solids are also now available. In addition, GPAW can calculate non-linear optical tensors of solids, charged crystal point defects, and much more. Recently, support of GPU acceleration has been achieved with minor modifications of the GPAW code thanks to the CuPy library. We end the review with an outlook describing some future plans for GPAW.


title: Geographical Erasure in Language Generation

abstract: Large language models (LLMs) encode vast amounts of world knowledge. However, since these models are trained on large swaths of internet data, they are at risk of inordinately capturing information about dominant groups. This imbalance can propagate into generated language. In this work, we study and operationalise a form of geographical erasure, wherein language models underpredict certain countries. We demonstrate consistent instances of erasure across a range of LLMs. We discover that erasure strongly correlates with low frequencies of country mentions in the training corpus. Lastly, we mitigate erasure by finetuning using a custom objective.


title: Audio-Visual Speaker Tracking: Progress, Challenges, and Future Directions

abstract: Audio-visual speaker tracking has drawn increasing attention over the past few years due to its academic values and wide application. Audio and visual modalities can provide complementary information for localization and tracking. With audio and visual information, the Bayesian-based filter can solve the problem of data association, audio-visual fusion and track management. In this paper, we conduct a comprehensive overview of audio-visual speaker tracking. To our knowledge, this is the first extensive survey over the past five years. We introduce the family of Bayesian filters and summarize the methods for obtaining audio-visual measurements. In addition, the existing trackers and their performance on AV16.3 dataset are summarized. In the past few years, deep learning techniques have thrived, which also boosts the development of audio visual speaker tracking. The influence of deep learning techniques in terms of measurement extraction and state estimation is also discussed. At last, we discuss the connections between audio-visual speaker tracking and other areas such as speech separation and distributed speaker tracking.


title: PhD thesis "Extreme value statistics and optimization problems in stochastic processes"

abstract: This thesis is devoted to the study of extreme value statistics in stochastic processes and their applications. In the first part, we obtain exact analytical results on the extreme value statistics of both discrete-time and continuous-time random walks. In particular, we focus on the gap statistics of random walks and exhibit their asymptotic universality with respect to the jump distribution in the limit of a large number of steps. In addition, we compute the asymptotic behavior of the expected maximum of random walks in the presence of a bridge constraint and reveal a rich behavior in their finite-size correction. Moreover, we compute the expected length of the convex hull of Brownian motion confined in a disk and show that it converges slowly to the perimeter of the disk with a stretched exponential decay. In the second part, we focus on numerically sampling rare trajectories of stochastic processes. We introduce an efficient method to sample bridge discrete-time random walks. We illustrate it and apply it to various examples. We further extend the method to other stochastic processes, both Markovian and non-Markovian. We apply our method to sample surviving particles in the presence of a periodic trapping environment. Finally, we discuss several optimization problems in stochastic processes involving extreme value statistics. In particular, we introduce a new technique to optimally control dynamical systems undergoing a resetting policy.


title: Dance Your Latents: Consistent Dance Generation through Spatial-temporal Subspace Attention Guided by Motion Flow

abstract: The advancement of generative AI has extended to the realm of Human Dance Generation, demonstrating superior generative capacities. However, current methods still exhibit deficiencies in achieving spatiotemporal consistency, resulting in artifacts like ghosting, flickering, and incoherent motions. In this paper, we present Dance-Your-Latents, a framework that makes latents dance coherently following motion flow to generate consistent dance videos. Firstly, considering that each constituent element moves within a confined space, we introduce spatial-temporal subspace-attention blocks that decompose the global space into a combination of regular subspaces and efficiently model the spatiotemporal consistency within these subspaces. This module enables each patch pay attention to adjacent areas, mitigating the excessive dispersion of long-range attention. Furthermore, observing that body part's movement is guided by pose control, we design motion flow guided subspace align & restore. This method enables the attention to be computed on the irregular subspace along the motion flow. Experimental results in TikTok dataset demonstrate that our approach significantly enhances spatiotemporal consistency of the generated videos.


title: Programmable Photonic Simulator for Spin Glass Models

abstract: Spin glasses featured by frustrated interactions and metastable states have important applications in chemistry, material sciences and artificial neural networks. However, the solution of the spin glass models is hindered by the computational complexity that exponentially increases with the sample size. Photonic Ising machines based on spatial light modulation can speed up the calculation by obtaining the Hamiltonian from the modulated light intensity. However, the large-scale generalization to various spin couplings and higher dimensions is still elusive. Here, we develop a Fourier-mask method to program the spin couplings in photonic Ising machines. We observe the phase transition of the two-dimensional Mattis model and the J$\mathrm{_1}$-J$\mathrm{_2}$ model and study the critical phenomena. We also demonstrate that the three-dimensional Ising model, which has not been analytically solved, can be effectively constructed and simulated in two-dimensional lattices with Fourier masks. Our strategy provides a flexible route to tuning couplings and dimensions of statistical spin models, and improves the applicability of optical simulation in neural networks and combinatorial optimization problems.


title: Towards equilibrium molecular conformation generation with GFlowNets

abstract: Sampling diverse, thermodynamically feasible molecular conformations plays a crucial role in predicting properties of a molecule. In this paper we propose to use GFlowNet for sampling conformations of small molecules from the Boltzmann distribution, as determined by the molecule's energy. The proposed approach can be used in combination with energy estimation methods of different fidelity and discovers a diverse set of low-energy conformations for highly flexible drug-like molecules. We demonstrate that GFlowNet can reproduce molecular potential energy surfaces by sampling proportionally to the Boltzmann distribution.


title: Interpretable Deep Reinforcement Learning for Optimizing Heterogeneous Energy Storage Systems

abstract: Energy storage systems (ESS) are pivotal component in the energy market, serving as both energy suppliers and consumers. ESS operators can reap benefits from energy arbitrage by optimizing operations of storage equipment. To further enhance ESS flexibility within the energy market and improve renewable energy utilization, a heterogeneous photovoltaic-ESS (PV-ESS) is proposed, which leverages the unique characteristics of battery energy storage (BES) and hydrogen energy storage (HES). For scheduling tasks of the heterogeneous PV-ESS, cost description plays a crucial role in guiding operator's strategies to maximize benefits. We develop a comprehensive cost function that takes into account degradation, capital, and operation/maintenance costs to reflect real-world scenarios. Moreover, while numerous methods excel in optimizing ESS energy arbitrage, they often rely on black-box models with opaque decision-making processes, limiting practical applicability. To overcome this limitation and enable transparent scheduling strategies, a prototype-based policy network with inherent interpretability is introduced. This network employs human-designed prototypes to guide decision-making by comparing similarities between prototypical situations and encountered situations, which allows for naturally explained scheduling strategies. Comparative results across four distinct cases underscore the effectiveness and practicality of our proposed pre-hoc interpretable optimization method when contrasted with black-box models.


title: An Efficient Imbalance-Aware Federated Learning Approach for Wearable Healthcare with Autoregressive Ratio Observation

abstract: Widely available healthcare services are now getting popular because of advancements in wearable sensing techniques and mobile edge computing. People's health information is collected by edge devices such as smartphones and wearable bands for further analysis on servers, then send back suggestions and alerts for abnormal conditions. The recent emergence of federated learning allows users to train private data on local devices while updating models collaboratively. However, the heterogeneous distribution of the health condition data may lead to significant risks to model performance due to class imbalance. Meanwhile, as FL training is powered by sharing gradients only with the server, training data is almost inaccessible. The conventional solutions to class imbalance do not work for federated learning. In this work, we propose a new federated learning framework FedImT, dedicated to addressing the challenges of class imbalance in federated learning scenarios. FedImT contains an online scheme that can estimate the data composition during each round of aggregation, then introduces a self-attenuating iterative equivalent to track variations of multiple estimations and promptly tweak the balance of the loss computing for minority classes. Experiments demonstrate the effectiveness of FedImT in solving the imbalance problem without extra energy consumption and avoiding privacy risks.


title: Vision-Enhanced Semantic Entity Recognition in Document Images via Visually-Asymmetric Consistency Learning

abstract: Extracting meaningful entities belonging to predefined categories from Visually-rich Form-like Documents (VFDs) is a challenging task. Visual and layout features such as font, background, color, and bounding box location and size provide important cues for identifying entities of the same type. However, existing models commonly train a visual encoder with weak cross-modal supervision signals, resulting in a limited capacity to capture these non-textual features and suboptimal performance. In this paper, we propose a novel \textbf{V}isually-\textbf{A}symmetric co\textbf{N}sisten\textbf{C}y \textbf{L}earning (\textsc{Vancl}) approach that addresses the above limitation by enhancing the model's ability to capture fine-grained visual and layout features through the incorporation of color priors. Experimental results on benchmark datasets show that our approach substantially outperforms the strong LayoutLM series baseline, demonstrating the effectiveness of our approach. Additionally, we investigate the effects of different color schemes on our approach, providing insights for optimizing model performance. We believe our work will inspire future research on multimodal information extraction.


title: Computational Fluid Dynamics as an Emerging Supporting Clinical Tool: Review on Human Airways

abstract: Objectives: The main objective of this review article is to evaluate the usability of Computational Fluid Dynamics (CFD) as a supporting clinical tool for respiratory system. Data Source: The English articles referred for this review paper were identified from various International peer reviewed journals indexed in Science citation index. Study Selection: 26 high quality articles most relevant to the highlighted topic which were published in last fifteen years were selected from almost 120 articles. Results: The analysis done and the outcome obtained by this computational method is as accurate as Spirometry and Pulmonary function test (PFT) result. CFD can be very useful in the cases where patents is unable to perform PFT. Pressure drop, Velocity profile, Wall shear stress & other flow parameter, respiratory resistance, Pattern of drug deposition, Particles transport/deposition, etc. had also been predicted accurately using CFD. The effect of tracheal stenosis on the flow parameters has been predicted. The size and location of tracheal stenosis has also been correlated with breathing difficulties. The distribution of air in various lobes of the lungs can be accurately predicted with CFD tool. Conclusion: Virtual surgery is eventually possible by using CFD after further research with validation. With the help of this multi - disciplinary and efficient tool we can obtain accurate result while reducing cost and time.


title: An Algorithm for Approximating Implicit Functions by Polynomials without Higher-Order Differentiability

abstract: We consider an equation of multiple variables in which a partial derivative does not vanish at a point. The implicit function theorem provides a local existence and uniqueness of the function for the equation. In this paper, we propose an algorithm to approximate the function by a polynomial without using higher-order differentiability, which depends essentially on integrability. Moreover, we extend the method to a system of equations if the Jacobian determinant does not vanish. This is a robust method for implicit functions that are not differentiable to higher-order. Additionally, we present two numerical experiments to verify the theoretical results.


title: Specialized Deep Residual Policy Safe Reinforcement Learning-Based Controller for Complex and Continuous State-Action Spaces

abstract: Traditional controllers have limitations as they rely on prior knowledge about the physics of the problem, require modeling of dynamics, and struggle to adapt to abnormal situations. Deep reinforcement learning has the potential to address these problems by learning optimal control policies through exploration in an environment. For safety-critical environments, it is impractical to explore randomly, and replacing conventional controllers with black-box models is also undesirable. Also, it is expensive in continuous state and action spaces, unless the search space is constrained. To address these challenges we propose a specialized deep residual policy safe reinforcement learning with a cycle of learning approach adapted for complex and continuous state-action spaces. Residual policy learning allows learning a hybrid control architecture where the reinforcement learning agent acts in synchronous collaboration with the conventional controller. The cycle of learning initiates the policy through the expert trajectory and guides the exploration around it. Further, the specialization through the input-output hidden Markov model helps to optimize policy that lies within the region of interest (such as abnormality), where the reinforcement learning agent is required and is activated. The proposed solution is validated on the Tennessee Eastman process control.


title: Unital positive Schur multipliers on $S_n^p$ with a completely isometric dilation

abstract: Let $1<p\not=2<\infty$ and let $S^p_n$ be the associated Schatten von Neumann class over $n\times n$ matrices. We prove new characterizations of unital positive Schur multipliers $S^p_n\to S^p_n$ which can be dilated into an invertible complete isometry acting on a non-commutative $L^p$-space. Then we investigate the infinite dimensional case.


title: Weighted Joint Maximum Mean Discrepancy Enabled Multi-Source-Multi-Target Unsupervised Domain Adaptation Fault Diagnosis

abstract: Despite the remarkable results that can be achieved by data-driven intelligent fault diagnosis techniques, they presuppose the same distribution of training and test data as well as sufficient labeled data. Various operating states often exist in practical scenarios, leading to the problem of domain shift that hinders the effectiveness of fault diagnosis. While recent unsupervised domain adaptation methods enable cross-domain fault diagnosis, they struggle to effectively utilize information from multiple source domains and achieve effective diagnosis faults in multiple target domains simultaneously. In this paper, we innovatively proposed a weighted joint maximum mean discrepancy enabled multi-source-multi-target unsupervised domain adaptation (WJMMD-MDA), which realizes domain adaptation under multi-source-multi-target scenarios in the field of fault diagnosis for the first time. The proposed method extracts sufficient information from multiple labeled source domains and achieves domain alignment between source and target domains through an improved weighted distance loss. As a result, domain-invariant and discriminative features between multiple source and target domains are learned with cross-domain fault diagnosis realized. The performance of the proposed method is evaluated in comprehensive comparative experiments on three datasets, and the experimental results demonstrate the superiority of this method.


title: Tracking the distance to criticality in systems with unknown noise

abstract: Many real-world systems undergo abrupt changes in dynamics as they move across critical points, often with dramatic consequences. Much existing theory on identifying the time-series signatures of nearby critical points -- such as increased variance and slower timescales -- is derived for the case of fixed, low-amplitude noise. However, real-world systems are often corrupted by unknown levels of noise that can distort these temporal signatures. Here we aimed to develop noise-robust indicators of the distance to criticality (DTC) for systems affected by dynamical noise in two cases: when the noise amplitude is fixed, or is unknown and variable across recordings. To approach this problem, we compare the ability of over 7000 candidate time-series features to track the DTC in the vicinity of a supercritical Hopf bifurcation. We recover existing theory in the fixed-noise case, highlighting conventional time-series features that accurately track the DTC. But in the variable-noise setting, where these conventional indicators perform poorly, we highlight new types of high-performing time-series features and show that their success is accomplished by capturing the shape of the invariant density (which depends on both the DTC and the noise amplitude) relative to the spread of fast fluctuations (which depends on the noise amplitude). We introduce a new high-performing time-series statistic, the Rescaled Auto-Density (RAD), that combines these two algorithmic components. We then use RAD to provide new evidence that brain regions higher in the visual hierarchy are positioned closer to criticality, supporting existing hypotheses about patterns of brain organization that are not detected using conventional metrics of the DTC. Our results demonstrate how large-scale algorithmic comparison can yield theoretical insights that can motivate new theory and interpretable algorithms for real-world problems.


title: Evaluating synthetic fuel production: A case study on the influence of electricity and CO2 price variations

abstract: To combat climate change, we need to reduce emissions from the transport sector. Synthetic fuels are a long-term solution for aviation, maritime and heavy machinery. Large-scale use requires cost-effectiveness, efficient production and resilience to price changes. In this case study, we simultaneously optimize the cell voltage of the solid oxide electrolysis cell, the heat exchanger network and the heat supply of a PtL-plant. PtL-efficiency and production costs are used as objectives to generate multiple Pareto fronts for future price scenarios. The results show that the sensitivity to price changes has different impacts on design and operating parameters, which can lead to unattractive solution domains in the Pareto front. Currently, synthetic fuels can be produced at 1.83-2.36 EUR/kg. In the best case, at 1.42-1.97 EUR/kg and 3.88-4.28 EUR/kg in the worst case. This paper supports decision-makers in planning PtL-plants to ensure sustainable synthetic fuel availability on a global scale.


title: What do Deck Chairs and Sun Hats Have in Common? Uncovering Shared Properties in Large Concept Vocabularies

abstract: Concepts play a central role in many applications. This includes settings where concepts have to be modelled in the absence of sentence context. Previous work has therefore focused on distilling decontextualised concept embeddings from language models. But concepts can be modelled from different perspectives, whereas concept embeddings typically mostly capture taxonomic structure. To address this issue, we propose a strategy for identifying what different concepts, from a potentially large concept vocabulary, have in common with others. We then represent concepts in terms of the properties they share with the other concepts. To demonstrate the practical usefulness of this way of modelling concepts, we consider the task of ultra-fine entity typing, which is a challenging multi-label classification problem. We show that by augmenting the label set with shared properties, we can improve the performance of the state-of-the-art models for this task.


title: Spinors in extended Minkowski space

abstract: The exterior algebra of Minkowski space naturally has the structure of a sixteen-dimensional Clifford algebra representation, and so can be used as the space of spinors. We examine plane, circular, and spherical solutions to the free Dirac equation in this extended notion of Minkowski space, and indicate how they can be used to obtain solutions to the standard four-dimensional Dirac equation.


title: The Resident Space Objects Network: a complex system approach for shaping space sustainability

abstract: Near-Earth space continues to be the focus of critical services and capabilities provided to the society. With the steady increase of space traffic, the number of Resident Space Objects (RSOs) has recently boomed in the context of growing concern due to space debris. The need of a holistic and unified approach for addressing orbital collisions, assess the global in-orbit risk, and define sustainable practices for space traffic management has emerged as a major societal challenge. Here, we introduce and discuss a versatile framework using the complex network paradigm to introduce indices for space sustainability criteria. Based on neighbouring relationships, we introduce the Resident Space Object Network (RSONet) by connecting RSOs that experience near-collisions events over a finite-time window. The structural collisional properties of RSOs are thus encoded into the RSONet and analysed with the tools of network science. We formulate a geometrical index highlighting the key role of specific RSOs in building up the risk of collisions with respect to the rest of the population. Practical applications based on Two-Line Elements and Conjunction Data Message databases are presented.


title: A Novel Transfer Learning Method Utilizing Acoustic and Vibration Signals for Rotating Machinery Fault Diagnosis

abstract: Fault diagnosis of rotating machinery plays a important role for the safety and stability of modern industrial systems. However, there is a distribution discrepancy between training data and data of real-world operation scenarios, which causing the decrease of performance of existing systems. This paper proposed a transfer learning based method utilizing acoustic and vibration signal to address this distribution discrepancy. We designed the acoustic and vibration feature fusion MAVgram to offer richer and more reliable information of faults, coordinating with a DNN-based classifier to obtain more effective diagnosis representation. The backbone was pre-trained and then fine-tuned to obtained excellent performance of the target task. Experimental results demonstrate the effectiveness of the proposed method, and achieved improved performance compared to STgram-MFN.


title: On the density hypothesis for $L$-functions associated with holomorphic cusp forms

abstract: We study the range of validity of the density hypothesis for the zeros of $L$-functions associated with cusp Hecke eigenforms $f$ of even integral weight and prove that $N_{f}(\sigma, T) \ll T^{2(1-\sigma)+\varepsilon}$ holds for $\sigma \geq 1407/1601$. This improves upon a result of Ivi\'{c}, who had previously shown the zero-density estimate in the narrower range $\sigma\geq 53/60$. Our result relies on an improvement of the large value estimates for Dirichlet polynomials based on mixed moment estimates for the Riemann zeta function. The main ingredients in our proof are the Hal\'{a}sz-Montgomery inequality, Ivi\'{c}'s mixed moment bounds for the zeta function, Huxley's subdivision argument, Bourgain's dichotomy approach, and Heath-Brown's bound for double zeta sums.


title: Unrealistic assumptions may lead to unrealistic simulation results: Droplet nuclei are neglected in a COVID-19 transmission simulation (Comments)

abstract: Bale et al. [1] perform a numerical study of droplet/aerosol transport in the air to assess the probability of airborne transmission of COVID-19 from an infected person to a nearby healthy person. In their numerical study, the air flow field is solved by an implicit large eddy simulation model, and the airborne transport of the droplets/aerosols exhaled from an infected person is solved by a Lagrangian particle model which considers droplet/aerosol evaporation. In the model used for droplets/aerosols, I found that an unrealistic assumption is used which may have a significant impact on the numerical accuracy: Droplet nuclei contained in real respiratory droplets/aerosols are neglected.


title: Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languages

abstract: Chain-of-thought (CoT) is capable of eliciting models to explicitly generate reasoning paths, thus promoting reasoning accuracy and attracting increasing attention. Specifically, zero-shot CoT achieves remarkable improvements in a wide range of reasoning tasks by simply instructing the LLM with the prompt "Let's think step by step!". Despite the success of zero-shot CoT, the existing zero-shot prompting techniques remain limited to a single language, making it challenging to generalize to other languages and hindering global development. In this work, we introduce cross-lingual prompting (CLP), aiming to improve zero-shot CoT reasoning across languages. Specifically, CLP consists of two main components: (1) cross-lingual alignment prompting and (2) task-specific solver prompting. The cross-lingual alignment prompting is responsible for aligning representations across different languages, whereas the task-specific solver prompting is used to generate the final chain of thoughts and results for the reasoning task. In addition, we further introduce cross-lingual self-consistent prompting (CLSP) to ensemble different reasoning paths across languages. Our experimental evaluations on several benchmarks demonstrate that CLP and CLSP significantly outperform the existing prompting methods and achieve state-of-the-art performance. We hope this work will inspire further breakthroughs in cross-lingual CoT.


title: Complete zero-energy flat bands of surface states in fully gapped chiral noncentrosymmetric superconductors

abstract: Noncentrosymmetric superconductors can support flat bands of zero-energy surface states in part of their surface Brillouin zone. This requires that they obey time-reversal symmetry and have a sufficiently strong triplet-to-singlet-pairing ratio to exhibit nodal lines in the bulk. These bands are protected by a winding number that relies on chiral symmetry, which is realized as the product of time-reversal and particle-hole symmetry. We reveal a way to stabilize a flat band in the entire surface Brillouin zone, while the bulk dispersion is fully gapped. This idea could lead to a robust platform for quantum computation and represents an alternative route to strongly correlated flat bands in two dimensions, besides twisted bilayer graphene. The necessary ingredient is an additional spin-rotation symmetry that forces the direction of the spin-orbit-coupling vector not to depend on the momentum component normal to the surface. We define a winding number that leads to flat zero-energy surface bands due to bulk-boundary correspondence. We discuss under which conditions this winding number is nonzero in the entire surface Brillouin zone and verify the occurrence of zero-energy surface states by exact numerical diagonalization of the Bogoliubov-de Gennes Hamiltonian for a slab. In addition, we consider how a weak breaking of the additional symmetry affects the surface band, employing first-order perturbation theory and a quasiclassical approximation. We find that the surface states and the bulk gap persist for weak breaking of the additional symmetry but that the band does not remain perfectly flat. The broadening of the band strongly depends on the deviation of the spin-orbit-coupling vector from its unperturbed direction as well as on the spin-orbit-coupling strength and the triplet-pairing amplitude.


title: Maximum Betti numbers of \v{C}ech complexes

abstract: The Upper Bound Theorem for convex polytopes implies that the $p$-th Betti number of the \v{C}ech complex of any set of $N$ points in $\mathbb R^d$ and any radius satisfies $\beta_{p} = O(N^{m})$, with $m = \min \{ p+1, \lceil d/2 \rceil \}$. We construct sets in even and odd dimensions that prove this upper bound is asymptotically tight. For example, we describe a set of $N = 2(n+1)$ points in $\mathbb R^3$ and two radii such that the first Betti number of the \v{C}ech complex at one radius is $(n+1)^2 - 1$, and the second Betti number of the \v{C}ech complex at the other radius is $n^2$.


title: DocTrack: A Visually-Rich Document Dataset Really Aligned with Human Eye Movement for Machine Reading

abstract: The use of visually-rich documents (VRDs) in various fields has created a demand for Document AI models that can read and comprehend documents like humans, which requires the overcoming of technical, linguistic, and cognitive barriers. Unfortunately, the lack of appropriate datasets has significantly hindered advancements in the field. To address this issue, we introduce \textsc{DocTrack}, a VRD dataset really aligned with human eye-movement information using eye-tracking technology. This dataset can be used to investigate the challenges mentioned above. Additionally, we explore the impact of human reading order on document understanding tasks and examine what would happen if a machine reads in the same order as a human. Our results suggest that although Document AI models have made significant progress, they still have a long way to go before they can read VRDs as accurately, continuously, and flexibly as humans do. These findings have potential implications for future research and development of Document AI models. The data is available at \url{https://github.com/hint-lab/doctrack}.


title: Polarised cross sections for vector boson production with SHERPA

abstract: Measurements of vector boson polarisation in vector boson production processes offer a powerful probe of the electroweak symmetry breaking mechanism, scrutinising the Standard Model and new physics scenarios alike. Since massive vector bosons can only be observed as intermediate particles, polarised cross section templates from simulation are necessary to extract their polarisation from measurable unpolarised distributions. In this work we present an extension of the SHERPA Monte-Carlo event generator allowing the simulation of polarised cross sections for vector boson production processes. Based on the narrow-width approximation, polarised cross sections of all possible polarisation combinations for an arbitrary number of intermediate vector bosons can be simulated in a single simulation run. In addition, it is possible to directly predict the interference between different intermediate polarisation states, and various differing polarisation definitions can be studied simultaneously. Besides the simulation of polarised cross sections at fixed LO and LO+PS accuracy as well as in multijet merged calculations, we also present parton-shower-matched polarised cross sections with approximate NLO QCD corrections in the vector boson production processes. We demonstrate that the differences of this approximation to full NLO QCD predictions are small and it thus opens up the possibility for fully-simulated calculations at the hadron level including polarisation information and higher-order QCD effects for the first time.


title: Large Language Models can Share Images, Too!

abstract: This paper explores the image-sharing capability of Large Language Models (LLMs), such as InstructGPT, ChatGPT, and GPT-4, in a zero-shot setting, without the help of visual foundation models. Inspired by the two-stage process of image-sharing in human dialogues, we propose a two-stage framework that allows LLMs to predict potential image-sharing turns and generate related image descriptions using our effective restriction-based prompt template. With extensive experiments, we unlock the \textit{image-sharing} capability of LLMs in zero-shot prompting, with GPT-4 achieving the best performance. Additionally, we uncover the emergent \textit{image-sharing} ability in zero-shot prompting, demonstrating the effectiveness of restriction-based prompts in both stages of our framework. Based on this framework, we augment the PhotoChat dataset with images generated by Stable Diffusion at predicted turns, namely PhotoChat++. To our knowledge, this is the first study to assess the image-sharing ability of LLMs in a zero-shot setting without visual foundation models. The source code and the dataset will be released after publication.


title: Cross-Modal Conceptualization in Bottleneck Models

abstract: Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting the label relying on these concepts. The main difficulty in using CBMs comes from having to choose concepts that are predictive of the label and then having to label training examples with these concepts. In our approach, we adopt a more moderate assumption and instead use text descriptions (e.g., radiology reports), accompanying the images in training, to guide the induction of concepts. Our cross-modal approach treats concepts as discrete latent variables and promotes concepts that (1) are predictive of the label, and (2) can be predicted reliably from both the image and text. Through experiments conducted on datasets ranging from synthetic datasets (e.g., synthetic images with generated descriptions) to realistic medical imaging datasets, we demonstrate that cross-modal learning encourages the induction of interpretable concepts while also facilitating disentanglement. Our results also suggest that this guidance leads to increased robustness by suppressing the reliance on shortcut features.


title: Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation

abstract: The growing need for instant spoken language transcription and translation is driven by increased global communication and cross-lingual interactions. This has made offering translations in multiple languages essential for user applications. Traditional approaches to automatic speech recognition (ASR) and speech translation (ST) have often relied on separate systems, leading to inefficiencies in computational resources, and increased synchronization complexity in real time. In this paper, we propose a streaming Transformer-Transducer (T-T) model able to jointly produce many-to-one and one-to-many transcription and translation using a single decoder. We introduce a novel method for joint token-level serialized output training based on timestamp information to effectively produce ASR and ST outputs in the streaming setting. Experiments on {it,es,de}->en prove the effectiveness of our approach, enabling the generation of one-to-many joint outputs with a single decoder for the first time.


title: On Chaitin's Heuristic Principle and Halting Probability

abstract: It would be a heavenly reward if there were a method of weighing theories and sentences in such a way that a theory could never prove a heavier sentence (Chaitin's Heuristic Principle). Alas, no satisfactory measure has been found so far, and this dream seemed too good to ever come true. In the first part of this paper, we attempt to revive Chaitin's lost paradise of heuristic principle as much as logic allows. In the second part, which is a joint work with M. Jalilvand and B. Nikzad, we study Chaitin's well-known constant Omega, and show that this number is not a probability of halting the randomly chosen input-free programs under any infinite discrete measure. We suggest some methods for defining the halting probabilities by various measures.


title: The evolving of Data Science and the Saudi Arabia case. How much have we changed in 13 years?

abstract: A comprehensive examination of data science vocabulary usage over the past 13 years in this work is conducted. The investigation commences with a dataset comprising 16,018 abstracts that feature the term "data science" in either the title, abstract, or keywords. The study involves the identification of documents that introduce novel vocabulary and subsequently explores how this vocabulary has been incorporated into scientific literature. To achieve these objectives, I employ techniques such as Exploratory Data Analysis, Latent Semantic Analysis, Latent Dirichlet Analysis, and N-grams Analysis. A comparison of scientific publications between overall results and those specific to Saudi Arabia is presented. Based on how the vocabulary is utilized, representative articles are identified.


title: Learning spatio-temporal patterns with Neural Cellular Automata

abstract: Neural Cellular Automata (NCA) are a powerful combination of machine learning and mechanistic modelling. We train NCA to learn complex dynamics from time series of images and PDE trajectories. Our method is designed to identify underlying local rules that govern large scale dynamic emergent behaviours. Previous work on NCA focuses on learning rules that give stationary emergent structures. We extend NCA to capture both transient and stable structures within the same system, as well as learning rules that capture the dynamics of Turing pattern formation in nonlinear Partial Differential Equations (PDEs). We demonstrate that NCA can generalise very well beyond their PDE training data, we show how to constrain NCA to respect given symmetries, and we explore the effects of associated hyperparameters on model performance and stability. Being able to learn arbitrary dynamics gives NCA great potential as a data driven modelling framework, especially for modelling biological pattern formation.


title: Neural representation in active inference: using generative models to interact with -- and understand -- the lived world

abstract: This paper considers neural representation through the lens of active inference, a normative framework for understanding brain function. It delves into how living organisms employ generative models to minimize the discrepancy between predictions and observations (as scored with variational free energy). The ensuing analysis suggests that the brain learns generative models to navigate the world adaptively, not (or not solely) to understand it. Different living organisms may possess an array of generative models, spanning from those that support action-perception cycles to those that underwrite planning and imagination; namely, from "explicit" models that entail variables for predicting concurrent sensations, like objects, faces, or people - to "action-oriented models" that predict action outcomes. It then elucidates how generative models and belief dynamics might link to neural representation and the implications of different types of generative models for understanding an agent's cognitive capabilities in relation to its ecological niche. The paper concludes with open questions regarding the evolution of generative models and the development of advanced cognitive abilities - and the gradual transition from "pragmatic" to "detached" neural representations. The analysis on offer foregrounds the diverse roles that generative models play in cognitive processes and the evolution of neural representation.


title: Multi-criteria Optimization of Workflow-Based Assembly Tasks in Manufacturing

abstract: Industrial manufacturing is currently amidst it's fourth great revolution, pushing towards the digital transformation of production processes. One key element of this transformation is the formalization and digitization of processes, creating an increased potential to monitor, understand and optimize existing processes. However, one major obstacle in this process is the increased diversification and specialisation, resulting in the dependency on multiple experts, which are rarely amalgamated in small to medium sized companies. To mitigate this issue, this paper presents a novel approach for multi-criteria optimization of workflow-based assembly tasks in manufacturing by combining a workflow modeling framework and the HeuristicLab optimization framework. For this endeavour, a new generic problem definition is implemented in HeuristicLab, enabling the optimization of arbitrary workflows represented with the modeling framework. The resulting Pareto front of the multi-criteria optimization provides the decision makers a set of optimal workflows from which they can choose to optimally fit the current demands. The advantages of the herein presented approach are highlighted with a real world use case from an ongoing research project.


title: Microscopic theory for nonequilibrium correlation functions in dense active fluids

abstract: One of the key hallmarks of dense active matter in the liquid, supercooled, and solid phases is so-called equal-time velocity correlations. Crucially, these correlations can emerge spontaneously, i.e., they require no explicit alignment interactions, and therefore represent a generic feature of dense active matter. This indicates that for a meaningful comparison or possible mapping between active and passive liquids one not only needs to understand their structural properties, but also the impact of these velocity correlations. This has already prompted several simulation and theoretical studies, though they are mostly focused on athermal systems and thus overlook the effect of translational diffusion. Here we present a fully microscopic method to calculate nonequilibrium correlations in systems of thermal active Brownian particles (ABPs). We use the integration through transients (ITT) formalism together with (active) mode-coupling theory (MCT) and analytically calculate qualitatively consistent static structure factors and active velocity correlations. We complement our theoretical results with simulations of both thermal and athermal ABPs which exemplify the disruptive role that thermal noise has on velocity correlations.


title: Catastrophe conditions for vector fields in $\mathbb R^n$

abstract: Practical conditions are given here for finding and classifying high codimension intersection points of $n$ hypersurfaces in $n$ dimensions. By interpreting those hypersurfaces as the nullclines of a vector field in $\mathbb R^n$, we broaden the concept of Thom's catastrophes to find bifurcation points of (non-gradient) vector fields of any dimension. We introduce a family of determinants ${B}_j$, such that a codimension $r$ bifurcation point is found by solving the system ${B}_1=...={B}_r=0$, subject to certain non-degeneracy conditions. The determinants ${B}_j$ generalize the derivatives $\frac{\partial^j\;}{\partial x^j}F(x)$ that vanish at a catastrophe of a scalar function $F(x)$. We do not extend catastrophe theory or singularity theory themselves, but provide a means to apply them more readily to the multi-dimensional dynamical models that appear, for example, in the study of various engineered or living systems. For illustration we apply our conditions to locate butterfly and star catastrophes in a second order PDE.


title: Leveraging Ensemble Diversity for Robust Self-Training in the Presence of Sample Selection Bias

abstract: Self-training is a well-known approach for semi-supervised learning. It consists of iteratively assigning pseudo-labels to unlabeled data for which the model is confident and treating them as labeled examples. For neural networks, softmax prediction probabilities are often used as a confidence measure, although they are known to be overconfident, even for wrong predictions. This phenomenon is particularly intensified in the presence of sample selection bias, i.e., when data labeling is subject to some constraint. To address this issue, we propose a novel confidence measure, called $\mathcal{T}$-similarity, built upon the prediction diversity of an ensemble of linear classifiers. We provide the theoretical analysis of our approach by studying stationary points and describing the relationship between the diversity of the individual members and their performance. We empirically demonstrate the benefit of our confidence measure for three different pseudo-labeling policies on classification datasets of various data modalities. The code is available at https://github.com/ambroiseodt/tsim.


title: Deep learning denoiser assisted roughness measurements extraction from thin resists with low Signal-to-Noise Ratio(SNR) SEM images: analysis with SMILE

abstract: The technological advance of High Numerical Aperture Extreme Ultraviolet Lithography (High NA EUVL) has opened the gates to extensive researches on thinner photoresists (below 30nm), necessary for the industrial implementation of High NA EUVL. Consequently, images from Scanning Electron Microscopy (SEM) suffer from reduced imaging contrast and low Signal-to-Noise Ratio (SNR), impacting the measurement of unbiased Line Edge Roughness (uLER) and Line Width Roughness (uLWR). Thus, the aim of this work is to enhance the SNR of SEM images by using a Deep Learning denoiser and enable robust roughness extraction of the thin resist. For this study, we acquired SEM images of Line-Space (L/S) patterns with a Chemically Amplified Resist (CAR) with different thicknesses (15nm, 20nm, 25nm, 30nm), underlayers (Spin-On-Glass-SOG, Organic Underlayer-OUL) and frames of averaging (4, 8, 16, 32, and 64 Fr). After denoising, a systematic analysis has been carried out on both noisy and denoised images using an open-source metrology software, SMILE 2.3.2, for investigating mean CD, SNR improvement factor, biased and unbiased LWR/LER Power Spectral Density (PSD). Denoised images with lower number of frames present unaltered Critical Dimensions (CDs), enhanced SNR (especially for low number of integration frames), and accurate measurements of uLER and uLWR, with the same accuracy as for noisy images with a consistent higher number of frames. Therefore, images with a small number of integration frames and with SNR < 2 can be successfully denoised, and advantageously used in improving metrology throughput while maintaining reliable roughness measurements for the thin resist.


title: Modular Multi-Level Replanning TAMP Framework for Dynamic Environment

abstract: Task and Motion Planning (TAMP) algorithms can generate plans that combine logic and motion aspects for robots. However, these plans are sensitive to interference and control errors. To make TAMP more applicable in real-world, we propose the modular multi-level replanning TAMP framework(MMRF), blending the probabilistic completeness of sampling-based TAMP algorithm with the robustness of reactive replanning. MMRF generates an nominal plan from the initial state, then dynamically reconstructs this nominal plan in real-time, reorders robot manipulations. Following the logic-level adjustment, GMRF will try to replan a new motion path to ensure the updated plan is feasible at the motion level. Finally, we conducted real-world experiments involving stack and rearrange task domains. The result demonstrate MMRF's ability to swiftly complete tasks in scenarios with varying degrees of interference.


title: Text2Topic: Multi-Label Text Classification System for Efficient Topic Detection in User Generated Content with Zero-Shot Capabilities

abstract: Multi-label text classification is a critical task in the industry. It helps to extract structured information from large amount of textual data. We propose Text to Topic (Text2Topic), which achieves high multi-label classification performance by employing a Bi-Encoder Transformer architecture that utilizes concatenation, subtraction, and multiplication of embeddings on both text and topic. Text2Topic also supports zero-shot predictions, produces domain-specific text embeddings, and enables production-scale batch-inference with high throughput. The final model achieves accurate and comprehensive results compared to state-of-the-art baselines, including large language models (LLMs). In this study, a total of 239 topics are defined, and around 1.6 million text-topic pairs annotations (in which 200K are positive) are collected on approximately 120K texts from 3 main data sources on Booking.com. The data is collected with optimized smart sampling and partial labeling. The final Text2Topic model is deployed on a real-world stream processing platform, and it outperforms other models with 92.9% micro mAP, as well as a 75.8% macro mAP score. We summarize the modeling choices which are extensively tested through ablation studies, and share detailed in-production decision-making steps.


title: Elementary catastrophes underlying bifurcations of vector fields and PDEs

abstract: A practical method was proposed recently for finding local bifurcation points in an n-dimensional vector field F by seeking their 'underlying catastrophes'. Here we apply the idea to the homogeneous steady states of a partial differential equation as an example of the role that catastrophes can play in reaction diffusion. What are these 'underlying' catastrophes? We then show they essentially define a restricted class of 'solvable' rather than 'all classifiable' singularities, by identifying degenerate zeros of a vector field F without taking into account its vectorial character. As a result they are defined by a minimal set of r analytic conditions that provide a practical means to solve for them, and a huge reduction from the calculations needed to classify a singularity, which we will also enumerate here. In this way, underlying catastrophes seem to allow us apply Thom's elementary catastrophes in much broader contexts.


title: Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic

abstract: While significant progress has been made in benchmarking Large Language Models (LLMs) across various tasks, there is a lack of comprehensive evaluation of their abilities in responding to multi-turn instructions in less-commonly tested languages like Arabic. Our paper offers a detailed examination of the proficiency of open LLMs in such scenarios in Arabic. Utilizing a customized Arabic translation of the MT-Bench benchmark suite, we employ GPT-4 as a uniform evaluator for both English and Arabic queries to assess and compare the performance of the LLMs on various open-ended tasks. Our findings reveal variations in model responses on different task categories, e.g., logic vs. literacy, when instructed in English or Arabic. We find that fine-tuned base models using multilingual and multi-turn datasets could be competitive to models trained from scratch on multilingual data. Finally, we hypothesize that an ensemble of small, open LLMs could perform competitively to proprietary LLMs on the benchmark.