title: Game Agent Driven by Free-Form Text Command: Using LLM-based Code Generation and Behavior Branch

abstract: Several attempts have been made to implement text command control for game agents. However, current technologies are limited to processing predefined format commands. This paper proposes a pioneering text command control system for a game agent that can understand natural language commands expressed in free-form. The proposed system uses a large language model (LLM) for code generation to interpret and transform natural language commands into behavior branch, a proposed knowledge expression based on behavior trees, which facilitates execution by the game agent. This study conducted empirical validation within a game environment that simulates a Pok\'emon game and involved multiple participants. The results confirmed the system's ability to understand and carry out natural language commands, representing a noteworthy in the realm of real-time language interactive game agents. Notice for the use of this material. The copyright of this material is retained by the Japanese Society for Artificial Intelligence (JSAI). This material is published here with the agreement of JSAI. Please be complied with Copyright Law of Japan if any users wish to reproduce, make derivative work, distribute or make available to the public any part or whole thereof. All Rights Reserved, Copyright (C) The Japanese Society for Artificial Intelligence.


title: The I/O Complexity of Attention, or How Optimal is Flash Attention?

abstract: Self-attention is at the heart of the popular Transformer architecture, yet suffers from quadratic time and memory complexity. The breakthrough FlashAttention algorithm revealed I/O complexity as the true bottleneck in scaling Transformers. Given two levels of memory hierarchy, a fast cache (e.g. GPU on-chip SRAM) and a slow memory (e.g. GPU high-bandwidth memory), the I/O complexity measures the number of accesses to memory. FlashAttention computes attention using $\frac{N^2d^2}{M}$ I/O operations where $N$ is the dimension of the attention matrix, $d$ the head-dimension and $M$ the cache size. However, is this I/O complexity optimal? The known lower bound only rules out an I/O complexity of $o(Nd)$ when $M=\Theta(Nd)$, since the output that needs to be written to slow memory is $\Omega(Nd)$. This leads to the main question of our work: Is FlashAttention I/O optimal for all values of $M$? We resolve the above question in its full generality by showing an I/O complexity lower bound that matches the upper bound provided by FlashAttention for any values of $M \geq d^2$ within any constant factors. Further, we give a better algorithm with lower I/O complexity for $M < d^2$, and show that it is optimal as well. Moreover, our lower bounds do not rely on using combinatorial matrix multiplication for computing the attention matrix. We show even if one uses fast matrix multiplication, the above I/O complexity bounds cannot be improved. We do so by introducing a new communication complexity protocol for matrix compression, and connecting communication complexity to I/O complexity. To the best of our knowledge, this is the first work to establish a connection between communication complexity and I/O complexity, and we believe this connection could be of independent interest and will find many more applications in proving I/O complexity lower bounds in the future.


title: Malicious Package Detection using Metadata Information

abstract: Protecting software supply chains from malicious packages is paramount in the evolving landscape of software development. Attacks on the software supply chain involve attackers injecting harmful software into commonly used packages or libraries in a software repository. For instance, JavaScript uses Node Package Manager (NPM), and Python uses Python Package Index (PyPi) as their respective package repositories. In the past, NPM has had vulnerabilities such as the event-stream incident, where a malicious package was introduced into a popular NPM package, potentially impacting a wide range of projects. As the integration of third-party packages becomes increasingly ubiquitous in modern software development, accelerating the creation and deployment of applications, the need for a robust detection mechanism has become critical. On the other hand, due to the sheer volume of new packages being released daily, the task of identifying malicious packages presents a significant challenge. To address this issue, in this paper, we introduce a metadata-based malicious package detection model, MeMPtec. This model extracts a set of features from package metadata information. These extracted features are classified as either easy-to-manipulate (ETM) or difficult-to-manipulate (DTM) features based on monotonicity and restricted control properties. By utilising these metadata features, not only do we improve the effectiveness of detecting malicious packages, but also we demonstrate its resistance to adversarial attacks in comparison with existing state-of-the-art. Our experiments indicate a significant reduction in both false positives (up to 97.56%) and false negatives (up to 91.86%).


title: Top-$K$ ranking with a monotone adversary

abstract: In this paper, we address the top-$K$ ranking problem with a monotone adversary. We consider the scenario where a comparison graph is randomly generated and the adversary is allowed to add arbitrary edges. The statistician's goal is then to accurately identify the top-$K$ preferred items based on pairwise comparisons derived from this semi-random comparison graph. The main contribution of this paper is to develop a weighted maximum likelihood estimator (MLE) that achieves near-optimal sample complexity, up to a $\log^2(n)$ factor, where $n$ denotes the number of items under comparison. This is made possible through a combination of analytical and algorithmic innovations. On the analytical front, we provide a refined~$\ell_\infty$ error analysis of the weighted MLE that is more explicit and tighter than existing analyses. It relates the~$\ell_\infty$ error with the spectral properties of the weighted comparison graph. Motivated by this, our algorithmic innovation involves the development of an SDP-based approach to reweight the semi-random graph and meet specified spectral properties. Additionally, we propose a first-order method based on the Matrix Multiplicative Weight Update (MMWU) framework. This method efficiently solves the resulting SDP in nearly-linear time relative to the size of the semi-random comparison graph.

categories: stat.ML cs.IT cs.LG math.IT math.ST stat.TH


title: Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corpora

abstract: We conducted a detailed analysis on the quality of web-mined corpora for two low-resource languages (making three language pairs, English-Sinhala, English-Tamil and Sinhala-Tamil). We ranked each corpus according to a similarity measure and carried out an intrinsic and extrinsic evaluation on different portions of this ranked corpus. We show that there are significant quality differences between different portions of web-mined corpora and that the quality varies across languages and datasets. We also show that, for some web-mined datasets, Neural Machine Translation (NMT) models trained with their highest-ranked 25k portion can be on par with human-curated datasets.


title: Spectral asymptotics for linear elasticity with mixed boundary conditions

abstract: In this note, we shall show that the two-term spectral asymptotics for the operator of linear elasticity with mixed boundary conditions which were given by Capoferri and Mann in \cite{CaMa-24} essentially are old well-known results due to T. Branson, P. Gilkey, B. {\O}rsted and A. Pierzchalski in \cite{BGOP}. In addition, we further point out that the so-called ``general formulae'' in \cite{SaVa-97, CaFrLeVa-23} and the calculations for several examples in \cite{CaMa-24, CaFrLeVa-23} are all wrong.


title: AraSpider: Democratizing Arabic-to-SQL

abstract: This study presents AraSpider, the first Arabic version of the Spider dataset, aimed at improving natural language processing (NLP) in the Arabic-speaking community. Four multilingual translation models were tested for their effectiveness in translating English to Arabic. Additionally, two models were assessed for their ability to generate SQL queries from Arabic text. The results showed that using back translation significantly improved the performance of both ChatGPT 3.5 and SQLCoder models, which are considered top performers on the Spider dataset. Notably, ChatGPT 3.5 demonstrated high-quality translation, while SQLCoder excelled in text-to-SQL tasks. The study underscores the importance of incorporating contextual schema and employing back translation strategies to enhance model performance in Arabic NLP tasks. Moreover, the provision of detailed methodologies for reproducibility and translation of the dataset into other languages highlights the research's commitment to promoting transparency and collaborative knowledge sharing in the field. Overall, these contributions advance NLP research, empower Arabic-speaking researchers, and enrich the global discourse on language comprehension and database interrogation.


title: Magnetism and superconductivity in the $t-J$ model of $La_3Ni_2O_7$ under multiband Gutzwiller approximation

abstract: The recent discovery of possible high temperature superconductivity in single crystals of $La_3Ni_2O_7$ under pressure renews the interest in research on nickelates. The DFT calculations reveal that both $d_{z^2}$ and $d_{x^2-y^2}$ orbitals are active, which suggests a minimal two-orbital model to capture the low-energy physics of this system. In this work, we study a bilayer two-orbital $t-J$ model within multiband Gutzwiller approximation, and discuss the magnetism as well as the superconductivity over a wide range of the hole doping. Owing to the inter-orbital super-exchange process between $d_{z^2}$ and $d_{x^2-y^2}$ orbitals, the induced ferromagnetic coupling within layers competes with the conventional antiferromagnetic coupling, and leads to complicated hole doping dependence for the magnetic properties in the system. With increasing hole doping, the system transfers to A-AFM state from the starting G-AFM state. We also find the inter-layer superconducting pairing of $d_{x^2-y^2}$ orbitals dominates due to the large hopping parameter of $d_{z^2}$ along the vertical inter-layer bonds and significant Hund's coupling between $d_{z^2}$ and $d_{x^2-y^2}$ orbitals. Meanwhile, the G-AFM state and superconductivity state can coexist in the low hole doping regime. To take account of the pressure, we also analyze the impacts of inter-layer hopping amplitude on the system properties.


title: Machine learning mapping of lattice correlated data

abstract: We discuss a novel approach based on machine learning (ML) regression models to reduce the computational cost of disconnected diagrams in lattice QCD calculations. This method creates a mapping between the results of fermionic loops computed at different quark masses and flow times. The ML model, trained with just a small fraction of the complete data set, provides similar predictions and uncertainties over the calculation done over the whole ensemble, resulting in a significant computational gain.


title: The TESS-Keck Survey. XII. A Dense 1.8 R$_\oplus$ Ultra-Short-Period Planet Possibly Clinging to a High-Mean-Molecular-Weight Atmosphere After the First Gyr

abstract: The extreme environments of ultra-short-period planets (USPs) make excellent laboratories to study how exoplanets obtain, lose, retain, and/or regain gaseous atmospheres. We present the confirmation and characterization of the USP TOI-1347 b, a $1.8 \pm 0.1$ R$_\oplus$ planet on a 0.85 day orbit that was detected with photometry from the TESS mission. We measured radial velocities of the TOI-1347 system using Keck/HIRES and HARPS-N and found the USP to be unusually massive at $11.1 \pm 1.2$ M$_\oplus$. The measured mass and radius of TOI-1347 b imply an Earth-like bulk composition. A thin H/He envelope (>0.01% by mass) can be ruled out at high confidence. The system is between 1 and 1.8 Gyr old; therefore, intensive photoevaporation should have concluded. We detected a tentative phase curve variation (3$\sigma$) and a secondary eclipse (2$\sigma$) in TESS photometry, which if confirmed could indicate the presence of a high-mean-molecular-weight atmosphere. We recommend additional optical and infrared observations to confirm the presence of an atmosphere and investigate its composition.


title: TriAug: Out-of-Distribution Detection for Imbalanced Breast Lesion in Ultrasound

abstract: Different diseases, such as histological subtypes of breast lesions, have severely varying incidence rates. Even trained with substantial amount of in-distribution (ID) data, models often encounter out-of-distribution (OOD) samples belonging to unseen classes in clinical reality. To address this, we propose a novel framework built upon a long-tailed OOD detection task for breast ultrasound images. It is equipped with a triplet state augmentation (TriAug) which improves ID classification accuracy while maintaining a promising OOD detection performance. Meanwhile, we designed a balanced sphere loss to handle the class imbalanced problem. Experimental results show that the model outperforms state-of-art OOD approaches both in ID classification (F1-score=42.12%) and OOD detection (AUROC=78.06%).


title: Bandit-Feedback Online Multiclass Classification: Variants and Tradeoffs

abstract: Consider the domain of multiclass classification within the adversarial online setting. What is the price of relying on bandit feedback as opposed to full information? To what extent can an adaptive adversary amplify the loss compared to an oblivious one? To what extent can a randomized learner reduce the loss compared to a deterministic one? We study these questions in the mistake bound model and provide nearly tight answers. We demonstrate that the optimal mistake bound under bandit feedback is at most $O(k)$ times higher than the optimal mistake bound in the full information case, where $k$ represents the number of labels. This bound is tight and provides an answer to an open question previously posed and studied by Daniely and Helbertal ['13] and by Long ['17, '20], who focused on deterministic learners. Moreover, we present nearly optimal bounds of $\tilde{\Theta}(k)$ on the gap between randomized and deterministic learners, as well as between adaptive and oblivious adversaries in the bandit feedback setting. This stands in contrast to the full information scenario, where adaptive and oblivious adversaries are equivalent, and the gap in mistake bounds between randomized and deterministic learners is a constant multiplicative factor of $2$. In addition, our results imply that in some cases the optimal randomized mistake bound is approximately the square-root of its deterministic parallel. Previous results show that this is essentially the smallest it can get.


title: Quantum transport enabled by non-adiabatic transitions

abstract: Quantum transport of charge or energy in networks with discrete sites is central to diverse quantum technologies, from molecular electronics to light harvesting and quantum opto-mechanical metamaterials. A one dimensional network can be viewed as waveguide. We show that if such waveguide is hybridised with a control unit that contains a few sites, then transmission through the waveguide depends sensitively on the motion of the sites in the control unit. Together, the hybrid waveguide and its control-unit form a Fano-Anderson chain whose Born-Oppenheimer surfaces inherit characteristics from both components: A bandstructure from the waveguide and potential energy steps as a function of site coordinates from the control-unit. Using time-dependent quantum wave packets, we reveal conditions under which the hybrid structure becomes transmissive only if the control unit contains mobile sites that induce non-adiabatic transitions between the surfaces. Hence, our approach provides functional synthetic Born-Oppenheimer surfaces for hybrid quantum technologies combining mechanic and excitonic elements, and has possible applications such as switching and temperature sensing.


title: Bifurcations of an elastic disc coated with an elastic inextensible rod

abstract: An analytical solution is derived for the bifurcations of an elastic disc that is constrained on the boundary with an isoperimetric Cosserat coating. The latter is treated as an elastic circular rod, either perfectly or partially bonded (with a slip interface in the latter case) and is subjected to three different types of uniformly distributed radial loads (including hydrostatic pressure). The proposed solution technique employs complex potentials to treat the disc's interior and incremental Lagrangian equations to describe the prestressed elastic rod modelling the coating. The bifurcations of the disc occur with modes characterized by different circumferential wavenumbers, ranging between ovalization and high-order waviness, as a function of the ratio between the elastic stiffness of the disc and the bending stiffness of its coating. The presented results find applications in various fields, such as coated fibres, mechanical rollers, and the growth and morphogenesis of plants and fruits.


title: OS-Copilot: Towards Generalist Computer Agents with Self-Improvement

abstract: Autonomous interaction with the computer has been a longstanding challenge with great potential, and the recent proliferation of large language models (LLMs) has markedly accelerated progress in building digital agents. However, most of these agents are designed to interact with a narrow domain, such as a specific software or website. This narrow focus constrains their applicability for general computer tasks. To this end, we introduce OS-Copilot, a framework to build generalist agents capable of interfacing with comprehensive elements in an operating system (OS), including the web, code terminals, files, multimedia, and various third-party applications. We use OS-Copilot to create FRIDAY, a self-improving embodied agent for automating general computer tasks. On GAIA, a general AI assistants benchmark, FRIDAY outperforms previous methods by 35%, showcasing strong generalization to unseen applications via accumulated skills from previous tasks. We also present numerical and quantitative evidence that FRIDAY learns to control and self-improve on Excel and Powerpoint with minimal supervision. Our OS-Copilot framework and empirical findings provide infrastructure and insights for future research toward more capable and general-purpose computer agents.


title: A Note on Kernel Functions of Dirichlet Spaces

abstract: For a planar domain $\Omega$, we consider the Dirichlet spaces with respect to a base point $\zeta\in\Omega$ and the corresponding kernel functions. It is not known how these kernel functions behave as we vary the base point. In this note, we prove that these kernel functions vary smoothly. As an application of the smoothness result, we prove a Ramadanov-type theorem for these kernel functions on $\Omega\times\Omega$. This extends the previously known convergence results of these kernel functions. In fact, we have made these observations in a more general setting, that is, for weighted kernel functions and their higher-order counterparts.


title: On the Distance from Calibration in Sequential Prediction

abstract: We study a sequential binary prediction setting where the forecaster is evaluated in terms of the calibration distance, which is defined as the $L_1$ distance between the predicted values and the set of predictions that are perfectly calibrated in hindsight. This is analogous to a calibration measure recently proposed by B{\l}asiok, Gopalan, Hu and Nakkiran (STOC 2023) for the offline setting. The calibration distance is a natural and intuitive measure of deviation from perfect calibration, and satisfies a Lipschitz continuity property which does not hold for many popular calibration measures, such as the $L_1$ calibration error and its variants. We prove that there is a forecasting algorithm that achieves an $O(\sqrt{T})$ calibration distance in expectation on an adversarially chosen sequence of $T$ binary outcomes. At the core of this upper bound is a structural result showing that the calibration distance is accurately approximated by the lower calibration distance, which is a continuous relaxation of the former. We then show that an $O(\sqrt{T})$ lower calibration distance can be achieved via a simple minimax argument and a reduction to online learning on a Lipschitz class. On the lower bound side, an $\Omega(T^{1/3})$ calibration distance is shown to be unavoidable, even when the adversary outputs a sequence of independent random bits, and has an additional ability to early stop (i.e., to stop producing random bits and output the same bit in the remaining steps). Interestingly, without this early stopping, the forecaster can achieve a much smaller calibration distance of $\mathrm{polylog}(T)$.


title: Exploring topological entanglement through Dehn surgery

abstract: We compute the $\text{PSL}(2,\mathbb{C})$ Chern-Simons partition function of a closed 3-manifold obtained from Dehn fillings of the link complement $\mathbf S^3\backslash {\mathcal{L}}$, where $\mathcal{L}=\mathcal{K}# H$ is the connected sum of the knot $\mathcal {K}$ with the Hopf link $H$. Motivated by our earlier work on topological entanglement and the reduced density matrix $\sigma$ for such link complements, we wanted to determine a choice of Dehn filling so that the trace of the matrix $\sigma$ becomes equal to the $\text{PSL}(2,\mathbb{C})$ partition function of the closed 3-manifold. We use the SnapPy program and numerical techniques to show this equivalence up to the leading order. We have given explicit results for all hyperbolic knots $\mathcal{K}$ up to six crossings.


title: Anonymizing Test Data in Android: Does It Hurt?

abstract: Failure data collected from the field (e.g., failure traces, bug reports, and memory dumps) represent an invaluable source of information for developers who need to reproduce and analyze failures. Unfortunately, field data may include sensitive information and thus cannot be collected indiscriminately. Privacy-preserving techniques can address this problem anonymizing data and reducing the risk of disclosing personal information. However, collecting anonymized information may harm reproducibility, that is, the anonymized data may not allow the reproduction of a failure observed in the field. In this paper, we present an empirical investigation about the impact of privacy-preserving techniques on the reproducibility of failures. In particular, we study how five privacy-preserving techniques may impact reproducibilty for 19 bugs in 17 Android applications. Results provide insights on how to select and configure privacy-preserving techniques.


title: Simulating the spin-boson model with a controllable reservoir in an ion trap

abstract: The spin-boson model is a prototypical model for open quantum dynamics. Here we simulate the spin-boson model using a chain of trapped ions where a spin is coupled to a structured reservoir of bosonic modes. We engineer the spectral density of the reservoir by adjusting the ion number, the target ion location, the laser detuning to the phonon sidebands, and the number of frequency components in the laser, and we observe their effects on the collapse and revival of the initially encoded information. Our work demonstrates the ion trap as a powerful platform for simulating open quantum dynamics with complicated reservoir structures.


title: A Hormetic Approach to the Value-Loading Problem: Preventing the Paperclip Apocalypse?

abstract: The value-loading problem is a significant challenge for researchers aiming to create artificial intelligence (AI) systems that align with human values and preferences. This problem requires a method to define and regulate safe and optimal limits of AI behaviors. In this work, we propose HALO (Hormetic ALignment via Opponent processes), a regulatory paradigm that uses hormetic analysis to regulate the behavioral patterns of AI. Behavioral hormesis is a phenomenon where low frequencies of a behavior have beneficial effects, while high frequencies are harmful. By modeling behaviors as allostatic opponent processes, we can use either Behavioral Frequency Response Analysis (BFRA) or Behavioral Count Response Analysis (BCRA) to quantify the hormetic limits of repeatable behaviors. We demonstrate how HALO can solve the 'paperclip maximizer' scenario, a thought experiment where an unregulated AI tasked with making paperclips could end up converting all matter in the universe into paperclips. Our approach may be used to help create an evolving database of 'values' based on the hedonic calculus of repeatable behaviors with decreasing marginal utility. This positions HALO as a promising solution for the value-loading problem, which involves embedding human-aligned values into an AI system, and the weak-to-strong generalization problem, which explores whether weak models can supervise stronger models as they become more intelligent. Hence, HALO opens several research avenues that may lead to the development of a computational value system that allows an AI algorithm to learn whether the decisions it makes are right or wrong.


title: PyDMD: A Python package for robust dynamic mode decomposition

abstract: The dynamic mode decomposition (DMD) is a simple and powerful data-driven modeling technique that is capable of revealing coherent spatiotemporal patterns from data. The method's linear algebra-based formulation additionally allows for a variety of optimizations and extensions that make the algorithm practical and viable for real-world data analysis. As a result, DMD has grown to become a leading method for dynamical system analysis across multiple scientific disciplines. PyDMD is a Python package that implements DMD and several of its major variants. In this work, we expand the PyDMD package to include a number of cutting-edge DMD methods and tools specifically designed to handle dynamics that are noisy, multiscale, parameterized, prohibitively high-dimensional, or even strongly nonlinear. We provide a complete overview of the features available in PyDMD as of version 1.0, along with a brief overview of the theory behind the DMD algorithm, information for developers, tips regarding practical DMD usage, and introductory coding examples. All code is available at https://github.com/PyDMD/PyDMD .

categories: stat.CO cs.SY eess.SY math.DS physics.comp-ph


title: Two-point closed string amplitudes in the BRST formalism

abstract: Two-point tree-level amplitudes in bosonic closed string theory are described by a correlation function within the BRST formalism, which respects manifest Lorentz and conformal invariance. In the derivation of the two-point amplitudes, we use the mostly BRST exact operator, which has been introduced for two-point open string amplitudes, and a closed string vertex with ghost number three, which has been explored in our recent work, in addition to the conventional one.


title: Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker-Planck Equations

abstract: The Fokker-Planck (FP) equation is a foundational PDE in stochastic processes. However, curse of dimensionality (CoD) poses challenge when dealing with high-dimensional FP PDEs. Although Monte Carlo and vanilla Physics-Informed Neural Networks (PINNs) have shown the potential to tackle CoD, both methods exhibit numerical errors in high dimensions when dealing with the probability density function (PDF) associated with Brownian motion. The point-wise PDF values tend to decrease exponentially as dimension increases, surpassing the precision of numerical simulations and resulting in substantial errors. Moreover, due to its massive sampling, Monte Carlo fails to offer fast sampling. Modeling the logarithm likelihood (LL) via vanilla PINNs transforms the FP equation into a difficult HJB equation, whose error grows rapidly with dimension. To this end, we propose a novel approach utilizing a score-based solver to fit the score function in SDEs. The score function, defined as the gradient of the LL, plays a fundamental role in inferring LL and PDF and enables fast SDE sampling. Three fitting methods, Score Matching (SM), Sliced SM (SSM), and Score-PINN, are introduced. The proposed score-based SDE solver operates in two stages: first, employing SM, SSM, or Score-PINN to acquire the score; and second, solving the LL via an ODE using the obtained score. Comparative evaluations across these methods showcase varying trade-offs. The proposed method is evaluated across diverse SDEs, including anisotropic OU processes, geometric Brownian, and Brownian with varying eigenspace. We also test various distributions, including Gaussian, Log-normal, Laplace, and Cauchy. The numerical results demonstrate the score-based SDE solver's stability, speed, and performance across different settings, solidifying its potential as a solution to CoD for high-dimensional FP equations.

categories: cs.LG cs.AI cs.NA math.DS math.NA stat.ML


title: VCR: Video representation for Contextual Retrieval

abstract: Streamlining content discovery within media archives requires integrating advanced data representations and effective visualization techniques for clear communication of video topics to users. The proposed system addresses the challenge of efficiently navigating large video collections by exploiting a fusion of visual, audio, and textual features to accurately index and categorize video content through a text-based method. Additionally, semantic embeddings are employed to provide contextually relevant information and recommendations to users, resulting in an intuitive and engaging exploratory experience over our topics ontology map using OpenAI GPT-4.


title: You can monitor your hydration level using your smartphone camera

abstract: This work proposes for the first time to utilize the regular smartphone -- a popular assistive gadget -- to design a novel, non-invasive method for self-monitoring of one's hydration level on a scale of 1 to 4. The proposed method involves recording a small video of a fingertip using the smartphone camera. Subsequently, a photoplethysmography (PPG) signal is extracted from the video data, capturing the fluctuations in peripheral blood volume as a reflection of a person's hydration level changes over time. To train and evaluate the artificial intelligence models, a custom multi-session labeled dataset was constructed by collecting video-PPG data from 25 fasting subjects during the month of Ramadan in 2023. With this, we solve two distinct problems: 1) binary classification (whether a person is hydrated or not), 2) four-class classification (whether a person is fully hydrated, mildly dehydrated, moderately dehydrated, or extremely dehydrated). For both classification problems, we feed the pre-processed and augmented PPG data to a number of machine learning, deep learning and transformer models which models provide a very high accuracy, i.e., in the range of 95% to 99%. We also propose an alternate method where we feed high-dimensional PPG time-series data to a DL model for feature extraction, followed by t-SNE method for feature selection and dimensionality reduction, followed by a number of ML classifiers that do dehydration level classification. Finally, we interpret the decisions by the developed deep learning model under the SHAP-based explainable artificial intelligence framework. The proposed method allows rapid, do-it-yourself, at-home testing of one's hydration level, is cost-effective and thus inline with the sustainable development goals 3 & 10 of the United Nations, and a step-forward to patient-centric healthcare systems, smart homes, and smart cities of future.


title: Dynamics of Saturn's Polar Regions

abstract: We analyze data retrieved by the Imaging Science System onboard the Cassini spacecraft to study the horizontal velocity and vorticity fields of Saturn's Polar Regions (latitudes 60-90$^\circ$N in June-December 2013 and 60-90$^\circ$S in October 2006 and July-December 2008), including the Northern region where the hexagonal wave is prominent. With the aid of an automated two dimensional correlation algorithm we determine two-dimensional maps of zonal and meridional winds, and deduce vorticity maps. We extract zonal averages of zonal winds, providing wind profiles that reach latitudes as high 89.5$^\circ$ in the south and 89.9$^\circ$ in the north. Wind measurements cover the intense polar cyclonic vortices that reach similar peak velocities of 150 ms-1 at 88.5$^\circ$. The hexagonal wave lies in the core of an intense eastward jet at planetocentric latitude 75.8$^\circ$N with motions that become non-zonal at the hexagonal feature. In the south hemisphere the peak of the eastward jet is located at planetocentric latitude 70.4$^\circ$S. A large anticyclone (the South Polar Spot, SPS), similar to the North Polar Spot (NPS) observed at the Voyager times (1980-81), has been observed in images from April 2008 to January 2009 in the South Polar Region at latitude -66.1$^\circ$ close to the eastward jet. The SPS does not apparently excite a wave on the jet. We analyze the stability of the zonal jets, finding potential instabilities at the flanks of the eastward jets around 70$^\circ$ and we measure the eddy wind components, suggesting momentum transfer from eddy motion to the westward jets closer to the poles.


title: Transient growth of a wake vortex and its initiation via inertial particles

abstract: The transient dynamics of a wake vortex, modelled by a strong swirling $q$-vortex, are examined with an emphasis on exploring optimal transient growth constructed by continuous eigenmodes associated with continuous spectra. The pivotal contribution of the viscous critical-layer eigenmodes (Lee & Marcus, J. Fluid Mech., vol. 967) amongst the entire eigenmode families to optimal perturbations is numerically confirmed, based on a spectral collocation method for a radially unbounded domain that ensures correct analyticity and far-field behaviour. The consistence of the numerical method against numerical sensitivity provides reliability of results as well as flexibility for tuning. Both axisymmetric and helical perturbation cases with axial wavenumbers of order unity or less are considered in the study through both linearised theory and non-linear simulations, yielding results that align with literature on both energy growth curves and optimal perturbation structures. Additionally, the initiation process of transient growth is discussed to reveal its practicability. Inspired by ice crystals in contrails, the role of backward influences of inertial particles on the carrier vortex flow, especially via particle drag, is underscored. In the pursuit of optimal transient growth, the particles are initially distributed at the periphery of the vortex core to disturb the vortex. Two-way coupled vortex-particle simulations conclusively demonstrate clear indications of optimal transient growth during continual vortex-particle interactions, reinforcing the robustness and significance of the transient growth process in the original non-linear vortex system over finite time periods.


title: Pushing The Limit of LLM Capacity for Text Classification

abstract: The value of text classification's future research has encountered challenges and uncertainties, due to the extraordinary efficacy demonstrated by large language models (LLMs) across numerous downstream NLP tasks. In this era of open-ended language modeling, where task boundaries are gradually fading, an urgent question emerges: have we made significant advances in text classification under the full benefit of LLMs? To answer this question, we propose RGPT, an adaptive boosting framework tailored to produce a specialized text classification LLM by recurrently ensembling a pool of strong base learners. The base learners are constructed by adaptively adjusting the distribution of training samples and iteratively fine-tuning LLMs with them. Such base learners are then ensembled to be a specialized text classification LLM, by recurrently incorporating the historical predictions from the previous learners. Through a comprehensive empirical comparison, we show that RGPT significantly outperforms 8 SOTA PLMs and 7 SOTA LLMs on four benchmarks by 1.36% on average. Further evaluation experiments show a clear surpassing of RGPT over human classification.


title: Differentially Private Decentralized Learning with Random Walks

abstract: The popularity of federated learning comes from the possibility of better scalability and the ability for participants to keep control of their data, improving data security and sovereignty. Unfortunately, sharing model updates also creates a new privacy attack surface. In this work, we characterize the privacy guarantees of decentralized learning with random walk algorithms, where a model is updated by traveling from one node to another along the edges of a communication graph. Using a recent variant of differential privacy tailored to the study of decentralized algorithms, namely Pairwise Network Differential Privacy, we derive closed-form expressions for the privacy loss between each pair of nodes where the impact of the communication topology is captured by graph theoretic quantities. Our results further reveal that random walk algorithms tends to yield better privacy guarantees than gossip algorithms for nodes close from each other. We supplement our theoretical results with empirical evaluation on synthetic and real-world graphs and datasets.


title: Cartesian atomic cluster expansion for machine learning interatomic potentials

abstract: Machine learning interatomic potentials are revolutionizing large-scale, accurate atomistic modelling in material science and chemistry. Many potentials use atomic cluster expansion or equivariant message passing frameworks. Such frameworks typically use spherical harmonics as angular basis functions, and then use Clebsch-Gordan contraction to maintain rotational symmetry, which may introduce redundancies in representations and computational overhead. We propose an alternative: a Cartesian-coordinates-based atomic density expansion. This approach provides a complete set of polynormially indepedent features of atomic environments while maintaining interaction body orders. Additionally, we integrate low-dimensional embeddings of various chemical elements and inter-atomic message passing. The resulting potential, named Cartesian Atomic Cluster Expansion (CACE), exhibits good accuracy, stability, and generalizability. We validate its performance in diverse systems, including bulk water, small molecules, and 25-element high-entropy alloys.


title: Moments of real Dirichlet $L$-functions and multiple Dirichlet series

abstract: We consider the multiple Dirichlet series associated to the $k$th moment of real Dirichlet $L$-functions, and prove that it has a meromorphic continuation to a specific region in $\mathbb{C}^{k+1}$, which is conditional under the generalized Lindel\"of hypothesis for $k\geq 5$. As a corollary, we obtain asymptotic formulas for the first three moments with a power-saving error term, and detect the 0- and 1-swap terms in related problems for any $k$ (conditionally under the Generalized Lindel\"of Hypothesis), recovering the recent results of Conrey and Rodgers on long Dirichlet polynomials. The advantage of our method is its simplicity, since we don't need to modify the multiple Dirichlet series to obtain its meromorphic continuation. As a result, we obtain the asymptotic formulas directly in the form as they appear in the recipe predictions of Conrey, Farmer, Keating, Rubinstein and Snaith.


title: High-resolution Cryogenic Spectroscopy of Single Molecules in Nanoprinted Crystals

abstract: We perform laser spectroscopy at liquid helium temperatures (T=2 K) to investigate single dibenzoterrylene (DBT) molecules doped in anthracene crystals of nanoscopic height fabricated by electrohydrodynamic dripping. Using high-resolution fluorescence excitation spectroscopy, we show that zero-phonon lines of single molecules in printed nanocrystals are nearly as narrow as the Fourier-limited transitions observed for the same guest-host system in the bulk. Moreover, the spectral instabilities are comparable to or less than one linewidth. By recording super-resolution images of DBT molecules and varying the polarization of the excitation beam, we determine the dimensions of the printed crystals and the orientation of the crystals' axes. Electrohydrodynamic printing of organic nano and microcrystals paves the way for a series of applications, where controlled positioning of quantum emitters with narrow optical transitions is desirable.


title: A version of Bakry-\'Emery Ricci flow on a finite graph

abstract: In this paper, we study the Bakry-\'Emery Ricci flow on finite graphs. Our main result is the local existence and uniqueness of solutions to the Ricci flow. We prove the long-time convergence or finite-time blow up for the Bakry-\'Emery Ricci flow on finite trees and circles.


title: Expansion of higher-dimensional cubical complexes with application to quantum locally testable codes

abstract: We introduce a high-dimensional cubical complex, for any dimension t>0, and apply it to the design of quantum locally testable codes. Our complex is a natural generalization of the constructions by Panteleev and Kalachev and by Dinur et. al of a square complex (case t=2), which have been applied to the design of classical locally testable codes (LTC) and quantum low-density parity check codes (qLDPC) respectively. We turn the geometric (cubical) complex into a chain complex by relying on constant-sized local codes $h_1,\ldots,h_t$ as gadgets. A recent result of Panteleev and Kalachev on existence of tuples of codes that are product expanding enables us to prove lower bounds on the cycle and co-cycle expansion of our chain complex. For t=4 our construction gives a new family of "almost-good" quantum LTCs -- with constant relative rate, inverse-polylogarithmic relative distance and soundness, and constant-size parity checks. Both the distance of the quantum code and its local testability are proven directly from the cycle and co-cycle expansion of our chain complex.


title: Food Recommendation as Language Processing (F-RLP): A Personalized and Contextual Paradigm

abstract: State-of-the-art rule-based and classification-based food recommendation systems face significant challenges in becoming practical and useful. This difficulty arises primarily because most machine learning models struggle with problems characterized by an almost infinite number of classes and a limited number of samples within an unbalanced dataset. Conversely, the emergence of Large Language Models (LLMs) as recommendation engines offers a promising avenue. However, a general-purpose Recommendation as Language Processing (RLP) approach lacks the critical components necessary for effective food recommendations. To address this gap, we introduce Food Recommendation as Language Processing (F-RLP), a novel framework that offers a food-specific, tailored infrastructure. F-RLP leverages the capabilities of LLMs to maximize their potential, thereby paving the way for more accurate, personalized food recommendations.


title: A Comparison of Different Representations of Ordinal Patterns and Their Usability in Data Analysis

abstract: We describe and analyze different approaches to represent ordinal patterns. All of these can be found in the literature. The most important representations (plus sub-classes) are compared in terms of their applicability from different angles. Namely we consider digital implementation, inverse patterns and ties between values. At the end we provide a guideline on which occasions which representation should be used.


title: Fourth-order modon in a rotating self-gravitating fluid

abstract: We present a two-dimensional nonlinear equation to govern the dynamics of disturbances in a rotating self-gravitating fluid. The nonlinear term of the equation has the form of a Poisson bracket (Jacobian), and the linear part contains, along with the Laplacian, a biharmonic operator. A solution was found in the form of a dipole vortex (modon). The solution and all its derivatives up to the fourth order are continuous on the separatrix.


title: Topological safeguard for evasion attack interpreting the neural networks' behavior

abstract: In the last years, Deep Learning technology has been proposed in different fields, bringing many advances in each of them, but identifying new threats in these solutions regarding cybersecurity. Those implemented models have brought several vulnerabilities associated with Deep Learning technology. Moreover, those allow taking advantage of the implemented model, obtaining private information, and even modifying the model's decision-making. Therefore, interest in studying those vulnerabilities/attacks and designing defenses to avoid or fight them is gaining prominence among researchers. In particular, the widely known evasion attack is being analyzed by researchers; thus, several defenses to avoid such a threat can be found in the literature. Since the presentation of the L-BFG algorithm, this threat concerns the research community. However, it continues developing new and ingenious countermeasures since there is no perfect defense for all the known evasion algorithms. In this work, a novel detector of evasion attacks is developed. It focuses on the information of the activations of the neurons given by the model when an input sample is injected. Moreover, it puts attention to the topology of the targeted deep learning model to analyze the activations according to which neurons are connecting. This approach has been decided because the literature shows that the targeted model's topology contains essential information about if the evasion attack occurs. For this purpose, a huge data preprocessing is required to introduce all this information in the detector, which uses the Graph Convolutional Neural Network (GCN) technology. Thus, it understands the topology of the target model, obtaining promising results and improving the outcomes presented in the literature related to similar defenses.


title: On Salem numbers which are exceptional units II

abstract: We show that for any natural number $n$ satisfying $n\equiv 4 \mod 8$ and $n\not\equiv 0 \mod 5$, and for any odd integer $t\geq \frac{n+6}{2}$ there are infinitely many Salem numbers ${\alpha}$ of degree $2t$ such that ${\alpha}^n-1$ is a unit. This result, obtained using a generalization of a construction due to Gross and McMullen [5], partially completes the main result of [7].


title: Hypersurface data: General properties and Birkhoff theorem in spherical symmetry

abstract: The notions of (metric) hypersurface data were introduced in [Mars,2013] as a tool to analyze, from an abstract viewpoint, hypersurfaces of arbitrary signature in pseudo-riemannian manifolds. In this paper, general geometric properties of these notions are studied. In particular, the properties of the gauge group inherent to the geometric construction are analyzed and the metric hypersurface connection and its corresponding curvature tensor are studied. The results set up the stage for various potential applications. The particular but relevant case of spherical symmetry is considered in detail. In particular, a collection of gauge invariant quantities and a radial covariant derivative is introduced, such that the constraint equations of the Einstein field equations with matter can be written in a very compact form. The general solution of these equations in the vacuum case and Lorentzian ambient signature is obtained, and a generalization of the Birkhoff theorem to this abstract hypersurface setting is derived.


title: T-RAG: Lessons from the LLM Trenches

abstract: Large Language Models (LLM) have shown remarkable language capabilities fueling attempts to integrate them into applications across a wide range of domains. An important application area is question answering over private enterprise documents where the main considerations are data security, which necessitates applications that can be deployed on-prem, limited computational resources and the need for a robust application that correctly responds to queries. Retrieval-Augmented Generation (RAG) has emerged as the most prominent framework for building LLM-based applications. While building a RAG is relatively straightforward, making it robust and a reliable application requires extensive customization and relatively deep knowledge of the application domain. We share our experiences building and deploying an LLM application for question answering over private organizational documents. Our application combines the use of RAG with a finetuned open-source LLM. Additionally, our system, which we call Tree-RAG (T-RAG), uses a tree structure to represent entity hierarchies within the organization. This is used to generate a textual description to augment the context when responding to user queries pertaining to entities within the organization's hierarchy. Our evaluations, including a Needle in a Haystack test, show that this combination performs better than a simple RAG or finetuning implementation. Finally, we share some lessons learned based on our experiences building an LLM application for real-world use.


title: An elementary approach to mixing and dissipation enhancement by transport noise

abstract: We investigate the mixing properties of solutions to the stochastic transport equation $d u= \circ d W \cdot\nabla u$, where the driving noise $W(t,x)$ is white in time, colored and divergence-free in space. Furthermore, we prove the dissipation enhancement in the presence of a small viscous term. Applying our results, we also derive the mixing properties for a regularized stochastic 2D Euler equation.


title: MINT: Boosting Audio-Language Model via Multi-Target Pre-Training and Instruction Tuning

abstract: In the realm of audio-language pre-training (ALP), the challenge of achieving cross-modal alignment is significant. Moreover, the integration of audio inputs with diverse distributions and task variations poses challenges in developing generic audio-language models. In this study, we present MINT, a novel ALP framework boosting audio-language models through multi-target pre-training and instruction tuning. MINT leverages the strength of frozen pre-trained audio encoders and large language models (LLM) to improve audio-language pre-training, enabling effective transferablility to both audio-text understanding and generation tasks. To address the modality gap, we introduce Bridge-Net, a trainable module that enhances cross-modality alignment and the model's ability to follow instructions for a variety of audio-text tasks. Bridge-Net is pivotal within MINT, initially enhancing audio-language representation learning through a multi-target pre-training approach. Subsequently, Bridge-Net further boosts audio-to-language generative learning by integrating a frozen language model with instruction tuning. This integration empowers MINT to extract features in a flexible and effective manner, specifically tailored to the provided instructions for diverse tasks. Experimental results demonstrate that MINT attains superior performance across various audio-language understanding and generation tasks, highlighting its robust generalization capabilities even in zero-shot scenarios.


title: Travelling wave amplification in stationary gratings

abstract: We show that a grating amplitude stationary in space but oscillating in time can be accurately modelled as a set of independent gratings travelling in opposite directions, interacting almost exclusively with waves travelling in the same direction. This structure reproduces the key features of travelling gratings: amplification of a wave at points where the local wave speed equals the grating velocity. The same field compression and photon production is evident when even a single Fourier component of the grating profile has a velocity that matches the local wave speed. We speculate that these stationary but oscillating gratings may prove easier to realise experimentally than travelling gratings.


title: Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial

abstract: This is an expository article on the score-based diffusion models, with a particular focus on the formulation via stochastic differential equations (SDE). After a gentle introduction, we discuss the two pillars in the diffusion modeling -- sampling and score matching, which encompass the SDE/ODE sampling, score matching efficiency, the consistency models, and reinforcement learning. Short proofs are given to illustrate the main idea of the stated results. The article is primarily a technical introduction to the field, and practitioners may also find some analysis useful in designing new models or algorithms.


title: Abstract null geometry, energy-momentum map and applications to the constraint tensor

abstract: We introduce and study the notion of null manifold. This is a smooth manifold ${\mathcal N}$ endowed with a degenerate metric $\gamma$ with one-dimensional radical at every point. We also define the notion of ruled null manifold, which is a special case of null manifolds. We prove that ruled null manifolds are in one-to-one correspondence with equivalence classes of null metric hypersurface data. This correspondence is used to endow any null manifold $({\mathcal N},\gamma)$ with a family of torsion-free connections related to each other by a well-defined gauge group. The whole construction allows one to define and use geometric notions on arbitrary null manifolds. The paper has a second part where we introduce a canonical map on any null metric hypersurface data and use its algebraic properties to define a canonical decomposition of any symmetric (0,2)-covariant tensor. This decomposition, together with two new differential operators compatible with this splitting, are used to decompose the constraint tensor in full generality and at the purely abstract level. This leads to a hierarchical structure of the (detached) Einstein vacuum null constraint equations without the need of introducing special coordinates or special foliations. The results are applied to study null shells arising from the matching of two spacetimes across null boundaries. The equations governing such objects are obtained in hierarchical form without imposing any topological, gauge or coordinate conditions on the shell.


title: Network mechanism for generating genuinely correlative Gaussian states

abstract: Generating a long-distance quantum state with genuine quantum correlation (GQC) is one of the most essential functions of quantum networks to support quantum communication. Here, we provide a deterministic scheme for generating multimode Gaussian states with certain GQC (including genuine entanglement). Efficient algorithms of generating multimode states are also proposed. Our scheme is useful for resolving the bottleneck in generating some multimode Gaussian states and may pave the way towards real world applications of preparing multipartite quantum states in current quantum technologies.


title: Fermi arcs mediated transport in inversion symmetry-broken Weyl semimetal nanowire and its hybrid junctions

abstract: The emergence of gapless surface states, known as Fermi arcs (FAs), is one of the unique properties of the novel topological Weyl semimetal (WSM). However, extracting the signatures of FAs from the bulk states has always been a challenge as both of them are gapless in nature and connected to each other. We capture the signatures of FAs via transport in an inversion symmetry (IS)-broken WSM. We study the band structure and the properties of FAs like shape, spin polarization considering slab and nanowire (NW) geometry, and then compute the two-terminal conductance in WSM NW in terms of the scattering coefficients within the Landauer formalism. We find the FA-mediated conductance to be quantized in units of $2e^2/h$. We extend our study to the transport in WSM/Weyl superconductor (WSC) NW hybrid junction using the Blonder-Tinkham-Klapwijk (BTK) formalism. We show that due to the intricate spin textures, the signatures of the FAs can be captured via Andreev reflection process. We also show that our results of conductance are robust against delta-correlated quenched disorder and thus enhancing the experimental feasibility.


title: Ultra-fast Waveguide MUTC Photodiodes over 220 GHz

abstract: We present InP-based evanescently-coupled waveguide modified uni-traveling carrier photodiodes (MUTC-PDs) exhibiting a breakthrough in bandwidth. The optimization of carrier transport and optical coupling is achieved through a detailed discussion on the design of the cliff layer and waveguide layer. Addressing the parasitic capacitance challenge, we introduce benzocyclobutene (BCB) beneath the PD electrodes, effectively overcoming the bandwidth bottleneck associated with the RC time constant. Devices with sizes of 2 * 7 um2 and 2 * 10 um2 achieve 3-dB bandwidths over 220 GHz, along with external responsivities of 0.161 A/W and 0.237 A/W, respectively. Notably, the RF output power reaches a peak of -1.69 dBm at 215 GHz for 2 * 15 um2 PDs.


title: Convolutional Neural Networks for signal detection in real LIGO data

abstract: Searching the data of gravitational-wave detectors for signals from compact binary mergers is a computationally demanding task. Recently, machine learning algorithms have been proposed to address current and future challenges. However, the results of these publications often differ greatly due to differing choices in the evaluation procedure. The Machine Learning Gravitational-Wave Search Challenge was organized to resolve these issues and produce a unified framework for machine-learning search evaluation. Six teams submitted contributions, four of which are based on machine learning methods and two are state-of-the-art production analyses. This paper describes the submission from the team TPI FSU Jena and its updated variant. We also apply our algorithm to real O3b data and recover the relevant events of the GWTC-3 catalog.


title: Representations of the $su(1,1)$ current algebra and probabilistic perspectives

abstract: We construct three representations of the $su(1,1)$ current algebra: in extended Fock space, with Gamma random measures, and with negative binomial (Pascal) point processes. For the second and third representations, the lowering and neutral operators are generators of measure-valued branching processes (Dawson-Watanabe superprocesses) and spatial birth-death processes. The vacuum is the constant function $1$ and iterated application of raising operators yields Laguerre and Meixner polynomials. In addition, we prove a Baker-Campbell-Hausdorff formula and give an explicit formula for the action of unitaries $\exp( k^+(\xi) - k^-(\xi))\exp(2 \mathrm i k^0(\theta))$ on exponential vectors. We explain how the representations fit in with a general scheme proposed by Araki and with representations of the $SL(2,\mathbb{R})$ current group with Vershik, Gelfand and Graev's multiplicative measure.


title: Quaternionic lattices and poly-context-free word problem

abstract: A finitely generated group $G$ is called poly-context-free if its word problem $\mathrm{WP}(G)$ is an intersection of finitely many context-free languages. We consider the quaternionic lattices $\Gamma_\tau$ over the field $\mathbb{F}_{q}(t)$ constructed by Stix-Vdovina (2017), and prove that they are not poly-context-free. As a corollary, since all the groups $\Gamma_{\tau}$ are quasi-isometric to $F_2\times F_2$, the class of groups with poly-context-free word problem is not closed under quasi-isometries. The result follows from the description of the language $\mathrm{WP}(\Gamma_\tau)\cap a^*b^*c^*d^*$, which relies on the existence of anti-tori and certain power-type endomorphisms of the groups $\Gamma_\tau$.


title: Modeling blazar broadband emission with convolutional neural networks -- II. External Compton model

abstract: In the context of modeling spectral energy distributions (SEDs) for blazars, we extend the method that uses a convolutional neural network (CNN) to include external inverse Compton processes. The model assumes that relativistic electrons within the emitting region can interact and up-scatter external photon originating from the accretion disk, the broad-line region, and the torus, to produce the observed high-energy emission. We trained the CNN on a numerical model that accounts for the injection of electrons, their self-consistent cooling, and pair creation-annihilation processes, considering both internal and all external photon fields. Despite the larger number of parameters compared to the synchrotron self-Compton model and the greater diversity in spectral shapes, the CNN enables an accurate computation of the SED for a specified set of parameters. The performance of the CNN is demonstrated by fitting the SED of two flat-spectrum radio quasars, namely 3C 454.3 and CTA 102, and obtaining their parameter posterior distributions. For the first source, the available data in the low-energy band allowed us to constrain the minimum Lorentz factor of the electrons, $\gamma_{\rm min}$, while for the second source, due to the lack of these data, $\gamma_{\rm min} = 10^2$ was set. We used the obtained parameters to investigate the energetics of the system. The model developed here, along with one from B\'egu\'e et al. (2023), enables self-consistent, in-depth modeling of blazar broadband emissions within leptonic scenario.


title: Understanding Deep Learning defenses Against Adversarial Examples Through Visualizations for Dynamic Risk Assessment

abstract: In recent years, Deep Neural Network models have been developed in different fields, where they have brought many advances. However, they have also started to be used in tasks where risk is critical. A misdiagnosis of these models can lead to serious accidents or even death. This concern has led to an interest among researchers to study possible attacks on these models, discovering a long list of vulnerabilities, from which every model should be defended. The adversarial example attack is a widely known attack among researchers, who have developed several defenses to avoid such a threat. However, these defenses are as opaque as a deep neural network model, how they work is still unknown. This is why visualizing how they change the behavior of the target model is interesting in order to understand more precisely how the performance of the defended model is being modified. For this work, some defenses, against adversarial example attack, have been selected in order to visualize the behavior modification of each of them in the defended model. Adversarial training, dimensionality reduction and prediction similarity were the selected defenses, which have been developed using a model composed by convolution neural network layers and dense neural network layers. In each defense, the behavior of the original model has been compared with the behavior of the defended model, representing the target model by a graph in a visualization.


title: Hypolipidemic effect of brown seaweed (Sargassum crassifolium) extract in vivo (Study of histopathology, mRNA expression, and immunohistochemistry (IHC) with VCAM-1, ICAM-1, and MCP-1 parameters)

abstract: The purpose of this study was to obtain natural drugs from brown seaweed (Sargassum crassifolium) as antiatherosclerosis candidates through the study of hypolipidemic mechanisms of action. Modeling of dyslipidemia rats was carried out by feeding high-fat (HFF) and doses of crude fucoidan 100. 200. 400mg / KgBB. in both treatments measured blood lipid profile levels taken from the orbital sinuses. HE's histopathology. mRNA expression. immunohistochemistry (IHC) with parameters VCAM-1. ICAM-1. and MCP-1 were performed on adipose tissue. as well as liver. Total cholesterol values 51.07-225.2. triglycerides 30.43-115.73. HDL 13.1-24.86 mg/dl and LDL 20.22-189.68 mg/dl. In the treatment of crude fucoidan obtained the result of p value < {\alpha} (0.05. Histopathological features of adipose tissue after administration of HFF for 60 days resulted in an increase in adipose cell size. and the liver experienced structural damage and inflammation. but after 21 days of treatment the morphological picture of adipose tissue was similar to normal morphology and the liver also decreased in severity and inflammation. The results of histochemical staining after treatment showed a positive staining part on MCP-1. The result of p value < {\alpha} (0.05) of mRNA expression for administration of 3 treatment doses. A dyslipidemic mouse model with HFF administration for 60 days succeeded in becoming a dyslipidemic rat. and crude fucoidan had hypolipidemic activity. Doses of 100. 200. and 400 mg/KgBB crude fucoidan showed improvement in adipose and liver morphological features of severity and inflammation of dyslipidemic rats and decreased mRNA expression.


title: Accelerated Smoothing: A Scalable Approach to Randomized Smoothing

abstract: Randomized smoothing has emerged as a potent certifiable defense against adversarial attacks by employing smoothing noises from specific distributions to ensure the robustness of a smoothed classifier. However, the utilization of Monte Carlo sampling in this process introduces a compute-intensive element, which constrains the practicality of randomized smoothing on a larger scale. To address this limitation, we propose a novel approach that replaces Monte Carlo sampling with the training of a surrogate neural network. Through extensive experimentation in various settings, we demonstrate the efficacy of our approach in approximating the smoothed classifier with remarkable precision. Furthermore, we demonstrate that our approach significantly accelerates the robust radius certification process, providing nearly $600$X improvement in computation time, overcoming the computational bottlenecks associated with traditional randomized smoothing.


title: Efficient reduction of Feynman integrals on supercomputers

abstract: Feynman integral reduction by means of integration-by-parts identities is a major power gadget in a theorist toolbox indispensable for calculation of multiloop quantum effects relevant for particle phenomenology and formal theory alike. An algorithmic approach consists of solving a large sparse non-square system of homogeneous linear equations with polynomial coefficients. While an analytical way of doing this is legitimate and was pursued for decades, it undoubtedly has its limitations when applied in complicated circumstances. Thus, a complementary framework based on modular arithmetic becomes critical on the way to conquer the current `what is possible' frontier. This calls for use of supercomputers to address the reduction problem. In order to properly utilize these computational resources, one has to efficiently optimize the technique for this purpose. Presently, we discuss and implement various methods which allow us to significantly improve performance of Feynman integral reduction within the FIRE environment.


title: Simulations of linear polarization of precessing AGN jets at parsec scales

abstract: The latest results of the most detailed analysis of multi-epoch polarization-sensitive observations of active galactic nuclei (AGN) jets at parsecs scales by very long baseline interferometry (VLBI) reveal several characteristic patterns of linear polarization distribution and its variability (Pushkarev et al., 2023; Zobnina et al., 2023). Some of the observed profiles can be reproduced by a simple model of a jet threaded by a helical magnetic field. However, none of the models presented to date can explain the observed polarization profiles with an increase in its degree towards the edges of the jet, and accompanied by a 'fountain' type electric vector pattern and its high temporal variability in the center. Based on simulations of the VLBI observations of relativistic jets, we show here that the observed transverse linear polarization profiles, atypical for the simple magnetic field models can be naturally produced assuming the finite resolution of VLBI arrays and precession of a jet on ten-years scales, observational indications of which are found in an increasing number of AGN. In our simulations, we qualitatively reproduce the distribution of the electric vector and its variability, though the polarization images are characterized by a bright spine due to weak smearing, which is poorly consistent with observations. More effective depolarization can be obtained in models with the suppressed emission of the jet spine.


title: One Train for Two Tasks: An Encrypted Traffic Classification Framework Using Supervised Contrastive Learning

abstract: As network security receives widespread attention, encrypted traffic classification has become the current research focus. However, existing methods conduct traffic classification without sufficiently considering the common characteristics between data samples, leading to suboptimal performance. Moreover, they train the packet-level and flow-level classification tasks independently, which is redundant because the packet representations learned in the packet-level task can be exploited by the flow-level task. Therefore, in this paper, we propose an effective model named a Contrastive Learning Enhanced Temporal Fusion Encoder (CLE-TFE). In particular, we utilize supervised contrastive learning to enhance the packet-level and flow-level representations and perform graph data augmentation on the byte-level traffic graph so that the fine-grained semantic-invariant characteristics between bytes can be captured through contrastive learning. We also propose cross-level multi-task learning, which simultaneously accomplishes the packet-level and flow-level classification tasks in the same model with one training. Further experiments show that CLE-TFE achieves the best overall performance on the two tasks, while its computational overhead (i.e., floating point operations, FLOPs) is only about 1/14 of the pre-trained model (e.g., ET-BERT). We release the code at https://github.com/ViktorAxelsen/CLE-TFE


title: ClusterTabNet: Supervised clustering method for table detection and table structure recognition

abstract: We present a novel deep-learning-based method to cluster words in documents which we apply to detect and recognize tables given the OCR output. We interpret table structure bottom-up as a graph of relations between pairs of words (belonging to the same row, column, header, as well as to the same table) and use a transformer encoder model to predict its adjacency matrix. We demonstrate the performance of our method on the PubTables-1M dataset as well as PubTabNet and FinTabNet datasets. Compared to the current state-of-the-art detection methods such as DETR and Faster R-CNN, our method achieves similar or better accuracy, while requiring a significantly smaller model.


title: Affine term structure models driven by independent L\'evy processes

abstract: We characterize affine term structure models of non-negative short rate $R$ which may be obtained as solutions of autonomous SDEs driven by independent, one-dimensional L\'evy martingales, that is equations of the form $$ dR(r)=F(R(t))dt+\sum_{i=1}^{d}G_i(R(t-))dZ_i(t), \quad R(0)=r_0\geq 0, \quad t>0, \quad (1)$$ with deterministic real functions $F,G_1,...,G_d$ and independent one-dimensional L\'evy martingales $Z_1,...,Z_d$. Using a general result on the form of the generators of affine term structure models due to Filipovi\'c, it is shown, under the assumption that the Laplace transforms of the driving noises are regularly varying, that all possible solutions $R$ of (1) may be obtained also as solutions of autonomous SDEs driven by independent stable processes with stability indices in the range $(1,2]$. The obtained models include in particular the $\alpha$-CIR model, introduced by Jiao et al., which proved to be still simple yet more reliable than the classical CIR model. Results on heavy tails of $R$ and its limit distribution in terms of the stability indices are proven. Finally, results of numerical calibration of the obtained models to the market term structure of interest rates are presented and compared with the CIR and $\alpha$-CIR models.


title: Constraining CP violating nucleon-nucleon long range interactions in diatomic eEDM searches

abstract: The searches for CP violating effects in diatomic molecules, such as $\text{HfF}^+$ and ThO, are typically interpreted as a probe of the electron's electric dipole moment ($e\text{EDM}$), a new electron-nucleon interaction, and a new electron-electron interaction. However, in the case of a non-vanishing nuclear spin, a new CP violating nucleon-nucleon long range force will also affect the measurement. Here, we use the $\text{HfF}^+$ $e\text{EDM}$ search and derive a new bound on this hypothetical interaction, which is the most stringent from terrestrial experiments in the 1 eV-10 keV mass range. These multiple new physics sources motivate independent searches in different molecular species for CP violation at low energy that result in model independent bounds, which are insensitive to cancellation among them.


title: Dynamical phase transitions in $XY$ model: a Monte Carlo and mean-field theory study

abstract: We investigate the dynamical phases and phase transitions arising in a classical two-dimensional anisotropic $XY$ model under the influence of a periodically driven temporal external magnetic field in the form of a symmetric square wave. We use a combination of finite temperature classical Monte Carlo simulation, implemented within a CPU + GPU paradigm, utilizing local dynamics provided by the Glauber algorithm and a phenomenological equation-of-motion approach based on relaxational dynamics governed by the time-dependent free energy within a mean-field approximation to study the model. We investigate several parameter regimes of the variables (magnetic field, anisotropy, and the external drive frequency) that influence the anisotropic $XY$ system. We identify four possible dynamical phases -- Ising-SBO, Ising-SRO, $XY$-SBO and $XY$-SRO. Both techniques indicate that only three of them (Ising-SRO, Ising-SBO, and $XY$-SRO) are stable dynamical phases in the thermodynamic sense. Within the Monte Carlo framework, a finite size scaling analysis shows that $XY$-SBO does not survive in the thermodynamic limit giving way to either an Ising-SBO or a $XY$-SRO regime. The finite size scaling analysis further shows that the transitions between the three remaining dynamical phases either belong to the two-dimensional Ising universality class or are first-order in nature. The mean-field calculations yield three stable dynamical phases, i.e., Ising-SRO, Ising-SBO and $XY$-SRO, where the final steady state is independent of the initial condition chosen to evolve the equations of motion, as well as a region of bistability where the system either flows to Ising-SBO or $XY$-SRO (Ising-SRO) depending on the initial condition. Unlike the stable dynamical phases, the $XY$-SBO represents a transient feature that is eventually lost to either Ising-SBO or $XY$-SRO.


title: NeuralSentinel: Safeguarding Neural Network Reliability and Trustworthiness

abstract: The usage of Artificial Intelligence (AI) systems has increased exponentially, thanks to their ability to reduce the amount of data to be analyzed, the user efforts and preserving a high rate of accuracy. However, introducing this new element in the loop has converted them into attacked points that can compromise the reliability of the systems. This new scenario has raised crucial challenges regarding the reliability and trustworthiness of the AI models, as well as about the uncertainties in their response decisions, becoming even more crucial when applied in critical domains such as healthcare, chemical, electrical plants, etc. To contain these issues, in this paper, we present NeuralSentinel (NS), a tool able to validate the reliability and trustworthiness of AI models. This tool combines attack and defence strategies and explainability concepts to stress an AI model and help non-expert staff increase their confidence in this new system by understanding the model decisions. NS provide a simple and easy-to-use interface for helping humans in the loop dealing with all the needed information. This tool was deployed and used in a Hackathon event to evaluate the reliability of a skin cancer image detector. During the event, experts and non-experts attacked and defended the detector, learning which factors were the most important for model misclassification and which techniques were the most efficient. The event was also used to detect NS's limitations and gather feedback for further improvements.


title: Clustering Dynamics for Improved Speed Prediction Deriving from Topographical GPS Registrations

abstract: A persistent challenge in the field of Intelligent Transportation Systems is to extract accurate traffic insights from geographic regions with scarce or no data coverage. To this end, we propose solutions for speed prediction using sparse GPS data points and their associated topographical and road design features. Our goal is to investigate whether we can use similarities in the terrain and infrastructure to train a machine learning model that can predict speed in regions where we lack transportation data. For this we create a Temporally Orientated Speed Dictionary Centered on Topographically Clustered Roads, which helps us to provide speed correlations to selected feature configurations. Our results show qualitative and quantitative improvement over new and standard regression methods. The presented framework provides a fresh perspective on devising strategies for missing data traffic analysis.


title: Remarks on variable Lebesgue spaces and fractional Navier-Stokes equations

abstract: In this work we study the 3D Navier-Stokes equations, under the action of an external force and with the fractional Laplacian operator $(-\Delta)^{\alpha}$ in the diffusion term, from the point of view of variable Lebesgue spaces. Based on decay estimates of the fractional heat kernel we prove the existence and uniqueness of mild solutions on this functional setting. Thus, in a first theorem we obtain an unique local-in-time solution in the space $L^{p(\cdot)} \left( [0,T], L^{q} (\mathbb{R}^3) \right)$. As a bi-product, in a second theorem we prove the existence of an unique global-in-time solution in the mixed-space $\mathcal{L}^{p(\cdot)}_{\frac{3}{2\alpha -1}}(\mathbb{R}^3, L^\infty([0,T[))$.


title: First-order behavior of the time constant in non-isotropic continuous first-passage percolation

abstract: Let $N$ be a norm on $\mathbb{R}^d$ with $d\geq 2$ and consider $\chi$ a homogeneous Poisson point process on $\mathbb{R}^d$ with intensity $\varepsilon\in [0,\infty)$. We define the Boolean model $\Sigma_{N, \varepsilon}$ as the union of the balls of diameter $1$ for the norm $N$ and centered at the points of $\chi$. For every $x,y \in \mathbb{R}^d$, Let $T_{N, \varepsilon} (x,y)$ be the minimum time needed to travel from $x$ to $y$ if one travels at speed $1$ outside $\Sigma_{N,\varepsilon}$ and at infinite speed inside $\Sigma_{N,\varepsilon}$: this defines a continuous model of first-passage percolation, that has been studied in \cite{GT17,GT22} for $N=\| \cdot \|_2$, the Euclidean norm. The exact calculation of the time constant of this model $\mu_{N,\varepsilon} (x):=\lim_{n\rightarrow \infty}T_{N,\varepsilon} (0,n x) / n $ is out of reach. We investigate here the behavior of $\varepsilon \mapsto \mu_{N,\varepsilon} (x)$ near $0$, and enlight how the speed at which $N(x) - \mu_{N,\varepsilon} (x) $ goes to $0$ depends on $x$ and $N$. For instance, if $N$ is the $p$-norm for $p\in (1,\infty)$, we prove that $N(x) - \mu_{\| \cdot \|_p,\epsilon} (x)$ is of order $\varepsilon ^{\kappa_p(x)}$ with $$\kappa_p(x): = \frac{1}{d- \frac{d_1(x)-1}{2} - \frac{d-d_1 (x)}{p}}\,,$$where $d_1(x)$ is the number of non null coordinates of $x$.Together with the study of the time constant, we also prove a control on the $N$-length of the geodesics, and get some informations on the number of points of $\chi$ really useful to those geodesics. The results are in fact more natural to prove in a slightly different setting, where instead of centering a ball of diameter $1$ at each point of $\chi$ and traveling at infinite speed inside $\Sigma_{N\varepsilon}$, we put a reward of one unit of time at those points.


title: Secret Collusion Among Generative AI Agents

abstract: Recent capability increases in large language models (LLMs) open up applications in which teams of communicating generative AI agents solve joint tasks. This poses privacy and security challenges concerning the unauthorised sharing of information, or other unwanted forms of agent coordination. Modern steganographic techniques could render such dynamics hard to detect. In this paper, we comprehensively formalise the problem of secret collusion in systems of generative AI agents by drawing on relevant concepts from both the AI and security literature. We study incentives for the use of steganography, and propose a variety of mitigation measures. Our investigations result in a model evaluation framework that systematically tests capabilities required for various forms of secret collusion. We provide extensive empirical results across a range of contemporary LLMs. While the steganographic capabilities of current models remain limited, GPT-4 displays a capability jump suggesting the need for continuous monitoring of steganographic frontier model capabilities. We conclude by laying out a comprehensive research program to mitigate future risks of collusion between generative AI models.


title: Global subelliptic estimates for geometric Kramers-Fokker-Planck operators on closed manifolds

abstract: In this article we reconsider the proof of subelliptic estimates for Geometric Kramers-Fokker-Planck operators, a class which includes Bismut's hypoelliptic Laplacian, when the base manifold is closed (no boundary). The method is significantly different from the ones proposed by Bismut-Lebeau in [BiLe] and Lebeau in [Leb1] and [Leb2]. As a new result we are able to prove maximal subelliptic estimates with some control of the constants in the two asymptotic regimes of high (b $\rightarrow$ 0) and low (b $\rightarrow$ +$\infty$) friction. After a dyadic partition in the momentum variable, the analysis is essentially local in the position variable, contrary to the microlocal reduction techniques of the previous works. In particular this method will be easier to adapt on manifolds with boundaries. A byproduct of our analysis is the introduction of a very convenient double exponent Sobolev scale associated with globally defined differential operators. Applications of this convenient parameter dependent functional analysis to accurate spectral problems, in particular for Bismut's hypoelliptic Laplacian with all its specific geometry, is deferred to subsequent works.


title: Naked singularities and black hole Killing horizons

abstract: In this chapter, we study special photon orbits defined by means of Killing vectors and present a framework based on the properties of such null orbits. For concreteness, we restrict ourselves to the case of axially symmetric spacetimes describing either black holes with Killing horizons or naked singularities. The null-orbits framework is then applied to analyze properties of naked singularities and concepts of black hole thermodynamics.


title: The Balancing Act: Unmasking and Alleviating ASR Biases in Portuguese

abstract: In the field of spoken language understanding, systems like Whisper and Multilingual Massive Speech (MMS) have shown state-of-the-art performances. This study is dedicated to a comprehensive exploration of the Whisper and MMS systems, with a focus on assessing biases in automatic speech recognition (ASR) inherent to casual conversation speech specific to the Portuguese language. Our investigation encompasses various categories, including gender, age, skin tone color, and geo-location. Alongside traditional ASR evaluation metrics such as Word Error Rate (WER), we have incorporated p-value statistical significance for gender bias analysis. Furthermore, we extensively examine the impact of data distribution and empirically show that oversampling techniques alleviate such stereotypical biases. This research represents a pioneering effort in quantifying biases in the Portuguese language context through the application of MMS and Whisper, contributing to a better understanding of ASR systems' performance in multilingual settings.


title: Physics-informed machine learning as a kernel method

abstract: Physics-informed machine learning combines the expressiveness of data-based approaches with the interpretability of physical models. In this context, we consider a general regression problem where the empirical risk is regularized by a partial differential equation that quantifies the physical inconsistency. We prove that for linear differential priors, the problem can be formulated as a kernel regression task. Taking advantage of kernel theory, we derive convergence rates for the minimizer of the regularized risk and show that it converges at least at the Sobolev minimax rate. However, faster rates can be achieved, depending on the physical error. This principle is illustrated with a one-dimensional example, supporting the claim that regularizing the empirical risk with physical information can be beneficial to the statistical performance of estimators.


title: Gravitational Lensing and Clues of $r_{d}$ and $H_{0}$ Tension: Viscous Modified Chaplygin Gas and Variable Modified Chaplygin Gas in Loop Quantum Cosmology

abstract: This paper explores the accelerated cosmic expansion in the late Universe through the investigation of two dark energy models: viscous modified Chaplygin gas (VsMCG) and variable modified Chaplygin gas (VMCG), alongside the $\Lambda$CDM model. Our goal is to constrain fundamental cosmic parameters in these dark energy models with the $\Lambda$CDM model using 30 of the latest $H(z)$ measurements from the cosmic chronometers method (CC), including Type Ia Supernovae, Gamma-Ray Bursts (GRB), Quasars, and 24 uncorrelated baryon acoustic oscillations (BAO) measurements from recent galaxy surveys across a redshift range from (0.106 < z < 2.33). Additionally, we include the most recent Hubble constant measurement from Riess in 2022. In the $\Lambda$CDM, VsMCG, and VMCG frameworks, we determine best-fit parameters for the Hubble parameter ($H_{0}$) and sound horizon ($r_{d}$). The results reveal significant disparities between ($H_{0}$) and ($r_{d}$) values using late-time observational measurements, reflecting the widely recognized ($H_{0}$) and ($r_{d}$) tensions. We also study the gravitational lensing optical depth of the two dark energy models and find that the probability of finding gravitational lenses increases with source redshift $z_s$. Joint analysis of VsMCG and VMCG with the $\Lambda$CDM model shows divergence in the early Universe but indistinguishability at low redshifts. Finally, using the Akaike information criteria approach for model comparison, our analysis indicates that none of the two dark energy models can be dismissed based on the latest observational measurements.


title: The Haute Provence monochromatic heliograph (1958-1994)

abstract: Bernard Lyot invented the monochromatic birefringent filter in 1933 in order to investigate the coronal emissions of solar structures above the limb with the coronagraph installed at the Pic du Midi observatory. The filter was improved later and he made the first observations of the chromosphere above the solar disk in 1948, at Meudon. After his death, Grenat and Laborde continued the development in the frame of the coming International Geophysical Year (IGY 1957-1958). A modern H$\alpha$ heliograph was completed soon and the flare patrol started in 1956. This instrument was reproduced by two companies (SECASI and OPL) and disseminated around the world in order to contribute to the IGY common effort dedicated to the solar activity survey. We describe in this short paper the capabilities of one of these copies operating at Haute Provence station from 1958 to 1994.


title: The spectroastrometric detectability of nearby Solar System-like exomoons

abstract: Though efforts to detect them have been made with a variety of methods, no technique can claim a successful, confirmed detection of a moon outside the Solar System yet. Moon detection methods are restricted in capability to detecting moons of masses beyond what formation models would suggest, or they require surface temperatures exceeding what tidal heating simulations allow. We expand upon spectroastrometry, a method that makes use of the variation of the centre of light with wavelength as the result of an unresolved companion, which has previously been shown to be capable of detecting Earth-analogue moons around nearby exo-Jupiters, with the aim to place bounds on the types of moons detectable using this method. We derived a general, analytic expression for the spectroastrometric signal of a moon in any closed Keplerian orbit, as well as a new set of estimates on the noise due to photon noise, pointing inaccuracies, background and instrument noise, and a pixelated detector. This framework was consequently used to derive bounds on the temperature required for Solar System-like moons to be observable around super-Jupiters in nearby systems, with $\epsilon$ Indi Ab as an archetype. We show that such a detection is possible with the ELT for Solar System-like moons of moderate temperatures (150-300 K) in line with existing literature on tidal heating, and that the detection of large (Mars-sized or greater) icy moons of temperatures such as those observed in our Solar System in the very nearest systems may be feasible.


title: Resilient Watermarking for LLM-Generated Codes

abstract: With the development of large language models, multiple AIs are now made available for code generation (such as ChatGPT and StarCoder) and are adopted widely. It is often desirable to know whether a piece of code is generated by AI, and furthermore, which AI is the author. For instance, if a certain version of AI is known to generate vulnerable codes, it is particularly important to know the creator. Existing approaches are not satisfactory as watermarking codes are more challenging compared to watermarking text data, as codes can be altered with relative ease via widely-used code refactoring methods. In this work, we propose ACW (AI Code Watermarking), a novel method for watermarking AI-generated codes. The key idea of ACW is to selectively apply a set of carefully-designed semantic-preserving, idempotent code transformations, whose presence (or absence) allows us to determine the existence of the watermark. It is efficient as it requires no training or fine-tuning and works in a black-box manner. It is resilient as the watermark cannot be easily removed or tampered through common code refactoring methods. Our experimental results show that ACW is effective (i.e., achieving high accuracy, true positive rates and false positive rates) and resilient, significantly outperforming existing approaches.


title: MAFIA: Multi-Adapter Fused Inclusive LanguAge Models

abstract: Pretrained Language Models (PLMs) are widely used in NLP for various tasks. Recent studies have identified various biases that such models exhibit and have proposed methods to correct these biases. However, most of the works address a limited set of bias dimensions independently such as gender, race, or religion. Moreover, the methods typically involve finetuning the full model to maintain the performance on the downstream task. In this work, we aim to modularly debias a pretrained language model across multiple dimensions. Previous works extensively explored debiasing PLMs using limited US-centric counterfactual data augmentation (CDA). We use structured knowledge and a large generative model to build a diverse CDA across multiple bias dimensions in a semi-automated way. We highlight how existing debiasing methods do not consider interactions between multiple societal biases and propose a debiasing model that exploits the synergy amongst various societal biases and enables multi-bias debiasing simultaneously. An extensive evaluation on multiple tasks and languages demonstrates the efficacy of our approach.


title: Fortran... ok, and what's next?

abstract: Modern Fortran is a standardized language that includes object-oriented and parallel programming paradigms. The Fortran-lang community, created at the end of 2019, is actively working to modernize its ecosystem. New compilers are under development. And the fourth Fortran standard of the 21st century is due to be published in autumn 2023.


title: A step towards the integration of machine learning and small area estimation

abstract: The use of machine-learning techniques has grown in numerous research areas. Currently, it is also widely used in statistics, including the official statistics for data collection (e.g. satellite imagery, web scraping and text mining, data cleaning, integration and imputation) but also for data analysis. However, the usage of these methods in survey sampling including small area estimation is still very limited. Therefore, we propose a predictor supported by these algorithms which can be used to predict any population or subpopulation characteristics based on cross-sectional and longitudinal data. Machine learning methods have already been shown to be very powerful in identifying and modelling complex and nonlinear relationships between the variables, which means that they have very good properties in case of strong departures from the classic assumptions. Therefore, we analyse the performance of our proposal under a different set-up, in our opinion of greater importance in real-life surveys. We study only small departures from the assumed model, to show that our proposal is a good alternative in this case as well, even in comparison with optimal methods under the model. What is more, we propose the method of the accuracy estimation of machine learning predictors, giving the possibility of the accuracy comparison with classic methods, where the accuracy is measured as in survey sampling practice. The solution of this problem is indicated in the literature as one of the key issues in integration of these approaches. The simulation studies are based on a real, longitudinal dataset, freely available from the Polish Local Data Bank, where the prediction problem of subpopulation characteristics in the last period, with "borrowing strength" from other subpopulations and time periods, is considered.


title: Maximum number of rational points on hypersurfaces in weighted projective spaces over finite fields

abstract: An upper bound for the maximum number of rational points on an hypersurface in a projective space over a finite field has been conjectured by Tsfasman and proved by Serre in 1989. The analogue question for hypersurfaces on weighted projective spaces has been considered by Castryck, Ghorpade, Lachaud, O'Sullivan, Ram and the first author in 2017. A conjecture has been proposed there and proved in the particular case of the dimension 2. We prove here the conjecture in any dimension provided the second weight is also equal to one.


title: Using Ensemble Inference to Improve Recall of Clone Detection

abstract: Large-scale source-code clone detection is a challenging task. In our previous work, we proposed an approach (SSCD) that leverages artificial neural networks and approximates nearest neighbour search to effectively and efficiently locate clones in large-scale bodies of code, in a time-efficient manner. However, our literature review suggests that the relative efficacy of differing neural network models has not been assessed in the context of large-scale clone detection approaches. In this work, we aim to assess several such models individually, in terms of their potential to maximize recall, while preserving a high level of precision during clone detection. We investigate if ensemble inference (in this case, using the results of more than one of these neural network models in combination) can further assist in this task. To assess this, we employed four state-of-the-art neural network models and evaluated them individually/in combination. The results, on an illustrative dataset of approximately 500K lines of C/C++ code, suggest that ensemble inference outperforms individual models in all trialled cases, when recall is concerned. Of individual models, the ADA model (belonging to the ChatGPT family of models) has the best performance. However commercial companies may not be prepared to hand their proprietary source code over to the cloud, as required by that approach. Consequently, they may be more interested in an ensemble-combination of CodeBERT-based and CodeT5 models, resulting in similar (if slightly lesser) recall and precision results.


title: Semialgebraicity of the convergence domain of an algebraic power series

abstract: Given a power series in finitely many variables that is algebraic over the corresponding polynomial ring over a subfield of the reals, we show that its convergence domain is semialgebraic over the real closure of the subfield. This gives in particular that the convergence radius of a univariate Puiseux series that is algebraic in the above sense belongs to the real closure or is infinity.


title: Reinforcement learning based demand charge minimization using energy storage

abstract: Utilities have introduced demand charges to encourage customers to reduce their demand peaks, since a high peak may cause very high costs for both the utility and the consumer. We herein study the bill minimization problem for customers equipped with an energy storage device and a self-owned renewable energy production. A model-free reinforcement learning algorithm is carefully designed to reduce both the energy charge and the demand charge of the consumer. The proposed algorithm does not need forecasting models for the energy demand and the renewable energy production. The resulting controller can be used online, and progressively improved with newly gathered data. The algorithm is validated on real data from an office building of IFPEN Solaize site. Numerical results show that our algorithm can reduce electricity bills with both daily and monthly demand charges.