title: Sunburst quantum Ising battery

abstract: We study the energy transfer process in the recently proposed sunburst quantum Ising model, which consists of two interacting integrable systems: a transverse Ising chain with a very small transverse field and a finite number of external isolated qubits. We show that in this model of the quantum battery, coupling between the battery and charger can be used to optimize the ergotropy, which is the maximum amount of energy that can be extracted from the battery. At the same time, maximum charging power increases with the coupling strength, allowing for the simultaneous optimization of both ergotropy and charging power in the strong coupling limit. Furthermore, we show that both ergotropy and charging power are independent of the initial state of the charger.


title: Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicated

abstract: As LLMs rapidly advance, increasing concerns arise regarding risks about actual authorship of texts we see online and in real world. The task of distinguishing LLM-authored texts is complicated by the nuanced and overlapping behaviors of both machines and humans. In this paper, we challenge the current practice of considering LLM-generated text detection a binary classification task of differentiating human from AI. Instead, we introduce a novel ternary text classification scheme, adding an "undecided" category for texts that could be attributed to either source, and we show that this new category is crucial to understand how to make the detection result more explainable to lay users. This research shifts the paradigm from merely classifying to explaining machine-generated texts, emphasizing need for detectors to provide clear and understandable explanations to users. Our study involves creating four new datasets comprised of texts from various LLMs and human authors. Based on new datasets, we performed binary classification tests to ascertain the most effective SOTA detection methods and identified SOTA LLMs capable of producing harder-to-detect texts. We constructed a new dataset of texts generated by two top-performing LLMs and human authors, and asked three human annotators to produce ternary labels with explanation notes. This dataset was used to investigate how three top-performing SOTA detectors behave in new ternary classification context. Our results highlight why "undecided" category is much needed from the viewpoint of explainability. Additionally, we conducted an analysis of explainability of the three best-performing detectors and the explanation notes of the human annotators, revealing insights about the complexity of explainable detection of machine-generated texts. Finally, we propose guidelines for developing future detection systems with improved explanatory power.


title: An Order Theory Framework of Recurrence Equations for Static Cost Analysis $-$ Dynamic Inference of Non-Linear Inequality Invariants

abstract: Recurrence equations have played a central role in static cost analysis, where they can be viewed as abstractions of programs and used to infer resource usage information without actually running the programs with concrete data. Such information is typically represented as functions of input data sizes. More generally, recurrence equations have been increasingly used to automatically obtain non-linear numerical invariants. However, state-of-the-art recurrence solvers and cost analysers suffer from serious limitations when dealing with the (complex) features of recurrences arising from cost analyses. We address this challenge by developing a novel order-theoretical framework where recurrences are viewed as operators and their solutions as fixpoints, which allows leveraging powerful pre/postfixpoint search techniques. We prove useful properties and provide principles and insights that enable us to develop techniques and combine them to design new solvers. We have also implemented and experimentally evaluated an optimisation-based instantiation of the proposed approach. The results are quite promising: our prototype outperforms state-of-the-art cost analysers and recurrence solvers, and can infer tight non-linear lower/upper bounds, in a reasonable time, for complex recurrences representing diverse program behaviours.


title: Electron transporting bilayers for perovskite solar cells: spray coating deposition of c-TiO2/m-SnO2-quantum dots

abstract: Herein we present a comparative study among different mesoporous electron transporter layers (ETLs), namely nanometric m-TiO2, m-SnO2 and m-SnO2 quantum dots (QDs), deposited by spray coating method. The experimental data correlated with the photovoltaic parameters indicate that the SnO2 mesoporous layer obtained from the spray deposition of the in-house prepared QDs solution is the best candidate between the three used mesoporous ETLs. The use of the in-house prepared SnO2 QDs solution presents smaller agglomerates composed of 3 nm NPs resulting in the formation of a thinner, more uniform, and compact mesoporous ETL, compared with the other two ETL solutions. The formamidinium-methylamonium-potassium (FAMA@10K) perovskite deposited on this m-SnO2 QDs ETL presents a lower RMS, more uniformity and, a higher amount of PbI2. Interestingly, this higher concentration for PbI2 seems to enhance the performance of the perovskite solar cells (PSC), compared to the other two mesoporous ETLs. Our work reveals that SnO2 QDs solution can be easily produced in the laboratory and it is more suited for the deposition of the mesoporous ETL when choosing a FAMA@10K configuration perovskite solar cell with power conversion efficiency (PCE) higher than 10%.


title: GlucOS: Security, correctness, and simplicity for automated insulin delivery

abstract: Type 1 Diabetes (T1D) is a metabolic disorder where an individual's pancreas stops producing insulin. To compensate, they inject synthetic insulin. Computer systems, called automated insulin delivery systems, exist that inject insulin automatically. However, insulin is a dangerous hormone, where too much insulin can kill people in a matter of hours and too little insulin can kill people in a matter of days. In this paper, we take on the challenge of building a new trustworthy automated insulin delivery system, called GlucOS. In our design, we apply separation principles to keep our implementation simple, we use formal methods to prove correct the most critical parts of the system, and we design novel security mechanisms and policies to withstand malicious components and attacks on the system. We report on real world use for one individual for 6 months using GlucOS. Our data shows that for this individual, our ML-based algorithm runs safely and manages their T1D effectively. We also run our system on 21 virtual humans using simulations and show that our security and safety mechanisms enable ML to improve their core T1D measures of metabolic health by 4.3\% on average. Finally, we show that our security and safety mechanisms maintain recommended levels of control over T1D even in the face of active attacks that would have otherwise led to death. GlucOS is open source and our code is available on GitHub.


title: A Pre-trained Deep Potential Model for Sulfide Solid Electrolytes with Broad Coverage and High Accuracy

abstract: Solid electrolytes with fast ion transport are one of the key challenges for solid state lithium metal batteries. To improve ion conductivity, chemical doping has been the most effective strategy, and atomistic simulation with machine-learning potential helps find optimized doping by predicting ion conductivity for arbitrary composition. Yet most existing machine-learning models are trained on narrow chemistry, and new model has to be trained for each system, wasting transferable knowledge and incurring significant cost. Here, we propose a pre-trained deep potential model purpose-built for sulfide electrolytes with attention mechanism, known as DPA-SSE. The training set encompasses 15 elements and consists of both equilibrium and extensive out-of-equilibrium configurations. DPA-SSE achieves a high energy resolution of less than 2 meV/atom for dynamical trajectories up to 1150 K, and reproduces experimental ion conductivity of sulfide electrolytes with remarkable accuracy. DPA-SSE exhibits good transferability, covering a range of complex electrolytes with mixes of cation and anion atoms. Highly efficient dynamical simulation with DPA-SSE can be realized by model distillation which generates a faster model for given systems. DPA-SSE also serves as a platform for continuous learning, and the model fine-tune requires only a portion of downstream data. These results demonstrate the possibility of a new pathway for AI-driven development of solid electrolytes with exceptional performance.


title: Quantitative measurement of cooperative binding in partially dissociated water dimers at the hematite R-cut surface

abstract: Water-solid interfaces pervade the natural environment and modern technology. On some surfaces, water-water interactions induce the formation of partially dissociated interfacial layers; understanding why is important to model processes in catalysis or mineralogy. The complexity of the partially dissociated structures often make it difficult to probe them in a quantitative manner. Here, we utilize normal incidence x-ray standing waves (NIXSW) to study the structure of partially dissociated water dimers (H2O-OH) at the Fe2O3(012) surface (also called (1-102) or R-cut surface); a system simple enough to be tractable, yet complex enough to capture the essential physics. We find the H2O and terminal OH groups to be the same height above the surface within experimental error (1.45 +/- 0.04 Angstrom and 1.47 +/- 0.02 Angstrom, respectively), in line with DFT-based calculations that predict comparable Fe-O bond lengths for both water and OH species. This result is understood in the context of cooperative binding, where the formation of the H-bond between adsorbed H2O and OH induces the H2O to bind more strongly, and OH to bind more weakly compared to when these species are isolated on the surface. The surface OH formed by the liberated proton is found to be in plane with a bulk truncated (012) surface (-0.01 +/- 0.02 Angstrom). DFT calculations based on various functionals correctly model the cooperative effect, but overestimate the water-surface interaction.


title: Complexity Classes for Online Problems with and without Predictions

abstract: With the developments in machine learning, there has been a surge in interest and results focused on algorithms utilizing predictions, not least in online algorithms where most new results incorporate the prediction aspect for concrete online problems. While the structural computational hardness of problems with regards to time and space is quite well developed, not much is known about online problems where time and space resources are typically not in focus. Some information-theoretical insights were gained when researchers considered online algorithms with oracle advice, but predictions of uncertain quality is a very different matter. We initiate the development of a complexity theory for online problems with predictions, focusing on binary predictions for minimization problems. Based on the most generic hard online problem type, string guessing, we define a hierarchy of complexity classes and develop notions of reductions, class membership, hardness, and completeness. Our framework contains all the tools one expects to find when working with complexity, and we illustrate our tools by analyzing problems with different characteristics. Our work also implies the same results for classic online problems without predictions.


title: "Vorbe\c{s}ti Rom\^ane\c{s}te?" A Recipe to Train Powerful Romanian LLMs with English Instructions

abstract: In recent years, Large Language Models (LLMs) have achieved almost human-like performance on various tasks. While some LLMs have been trained on multilingual data, most of the training data is in English; hence, their performance in English greatly exceeds other languages. To our knowledge, we are the first to collect and translate a large collection of texts, instructions, and benchmarks and train, evaluate, and release open-source LLMs tailored for Romanian. We evaluate our methods on four different categories, including academic benchmarks, MT-Bench (manually translated), and a professionally built historical, cultural, and social benchmark adapted to Romanian. We argue for the usefulness and high performance of RoLLMs by obtaining state-of-the-art results across the board. We publicly release all resources (i.e., data, training and evaluation code, models) to support and encourage research on Romanian LLMs while concurrently creating a generalizable recipe, adequate for other low or less-resourced languages.


title: New ephemerides and detection of transit-timing variations in the K2-138 system using high-precision CHEOPS photometry

abstract: Multi-planet systems are a perfect laboratory for constraining planetary formation models. A few of these systems present planets that come very close to mean motion resonance, potentially leading to significant transit-timing variations (TTVs) due to their gravitational interactions. Of these systems, K2-138 represents a excellent laboratory for studying the dynamics of its six small planets (with radii ranging between $\sim1.5$ -- $3.3 R_\oplus$), as the five innermost planets are in a near 3:2 resonant chain. In this work, we aim to constrain the orbital properties of the six planets in the K2-138 system by monitoring their transits with CHaracterising ExOPlanets Satellite (CHEOPS). We also seek to use this new data to lead a TTV study on this system. We obtained twelve light curves of the system with transits of planets $d$, $e$, $f,$ and $g$. With these data, we were able to update the ephemerides of the transits for these planets and search for timing transit variations. With our measurements, we reduced the uncertainties in the orbital periods of the studied planets, typically by an order of magnitude. This allowed us to correct for large deviations, on the order of hours, in the transit times predicted by previous studies. This is key to enabling future reliable observations of the planetary transits in the system. We also highlight the presence of potential TTVs ranging from 10 minutes to as many as 60 minutes for planet $d$.


title: Exploring the Stellar Rotation of Early-type Stars in the LAMOST Medium-resolution Survey. III. Evolution

abstract: Stellar rotation significantly shapes the evolution of massive stars, yet the interplay of mass and metallicity remains elusive, limiting our capacity to construct accurate stellar evolution models and to better estimate the impact of rotation in chemical evolution of galaxies. Our goal is to investigate how mass and metallicity influence the rotational evolution of A-type stars on the main sequence (MS). We seek to identify deviations in rotational behaviors that could serve as new constraints to existing stellar models. Using the LAMOST median-resolution survey Data Release 9, we derived stellar parameters for a population of 104,752 A-type stars. Our study focused on the evolution of surface rotational velocities and their dependence on mass and metallicity in 84,683 `normal' stars. Normalized surface rotational revealed a prevailing evolutionary profile from 1.7 to 4.0 $M_\odot$. This profile features an initial rapid acceleration until $t/t_\mathrm{ms} = 0.25$, potentially a second acceleration peak near $t/t_\mathrm{ms} = 0.55$ for stars heavier than 2.5 $M_\odot$, followed by a steady decline and a `hook' feature at the end. Surpassing theoretical expectations, the initial acceleration likely stems from a concentrated distribution of angular momentum at ZAMS, resulting in a prolonged increase in speed. The inverse circulation becomes more efficient at lower metallicity, explaining the correlation of the slope of this deceleration phase with metallicity from -0.3 dex up to 0.1 dex. The metal-poor subsample suggests a mechanism dependent on metallicity for removing angular momentum during star formation. The proportion of fast rotators decreases with an increase in metallicity, up to $\log(Z/Z_\odot)\sim -0.2$, a trend consistent with observations of OB-type stars found in the Small and Large Magellanic Clouds.


title: Refining Potential Energy Surface through Dynamical Properties via Differentiable Molecular Simulation

abstract: Recently, machine learning potentials (MLP) largely enhances the reliability of molecular dynamics, but its accuracy is limited by the underlying $\textit{ab initio}$ methods. A viable approach to overcome this limitation is to refine the potential by learning from experimental data, which now can be done efficiently using modern automatic differentiation technique. However, potential refinement is mostly performed using thermodynamic properties, leaving the most accessible and informative dynamical data (like spectroscopy) unexploited. In this work, through a comprehensive application of adjoint and gradient truncation methods, we show that both memory and gradient explosion issues can be circumvented in many situations, so the dynamical property differentiation is well-behaved. Consequently, both transport coefficients and spectroscopic data can be used to improve the density functional theory based MLP towards higher accuracy. Essentially, this work contributes to the solution of the inverse problem of spectroscopy by extracting microscopic interactions from vibrational spectroscopic data.


title: Exploiting Data Significance in Remote Estimation of Discrete-State Markov Sources

abstract: We consider the semantics-aware remote estimation of a discrete-state Markov source with normal (low-priority) and alarm (high-priority) states. Erroneously announcing a normal state at the destination when the source is actually in an alarm state (i.e., missed alarm error) incurs a significantly higher cost than falsely announcing an alarm state when the source is in a normal state (i.e., false alarm error). Moreover, successive reception of an estimation error may cause significant lasting impact, e.g., maintenance cost and misoperations. Motivated by this, we assign different costs to different estimation errors and introduce two new age metrics, namely the Age of Missed Alarm (AoMA) and the Age of False Alarm (AoFA), to account for the lasting impact incurred by different estimation errors. Notably, the two age processes evolve dependently and can distinguish between different types of estimation errors and different synced states. The aim is to achieve an optimal trade-off between the cost of estimation error, lasting impact, and communication utilization. The problem is formulated as an average-cost, countably infinite state-space Markov decision process (MDP). We show that the optimal policy exhibits a switching-type structure, making it amenable to policy storage and algorithm design. Notably, when the source is symmetric and states are equally important, the optimal policy has identical thresholds, i.e., threshold-type. Theoretical and numerical results underscore that our approach extends the current understanding of the Age of Incorrect Information (AoII) and the cost of actuation error (CAE), showing that they are specific instances within our broader framework.


title: Measurement of Solar Differential Rotation by Absolutely Calibrated Iodine-Cell Spectroscopy

abstract: The iodine-cell technique, which is known to be efficient in precisely establishing Doppler velocity shifts, was once applied by the author to measuring the solar differential rotation based on full-disk spectroscopic observations (Takeda and Ueno, Sol. Phys. 270, 447, 2011). However, the data reduction procedure (in simple analogy with the stellar case) adopted therein was not necessarily adequate, because specific characteristic involved with the disk-resolved Sun (i.e., center-limb variation of line strengths) was not properly taken into consideration. Therefore, this problem is revisited based on the same data but with an application to theoretical spectrum fitting, which can yield absolute heliocentric radial velocities (v_obs) in a consistent manner as shown in the study of solar gravitational redshift (Takeda and Ueno, Sol. Phys. 281, 551, 2012). Likewise, instead of converting v_obs into omega (angular velocity) at each disk point, which suffers considerable errors especially near the central meridian, omega was derived this time by applying the least squares analysis to a dataset comprising v_obs values at many points. This new analysis resulted in omega (deg/day) = 13.92 (+/- 0.03) -1.69(+/- 0.34)(sin psi)^2 -2.37(+/- 0.62) (sin psi)^4 (psi: the heliographic latitude) along with the gravitational redshift of 675 m/s, which are favorably compared with previous publications. In addition, how the distribution of observing points on the disk affects the result is also examined, which reveals that rotation parameters may suffer appreciable errors depending on cases.


title: Charge and Spin Dynamics and Destabilization of Shallow Nitrogen-Vacancy Centers under UV and Blue Excitation

abstract: Shallow nitrogen-vacancy (NV) centers in diamond offer unique opportunities for studying photochemical reactions at the single-molecule level, such as the photogeneration of radical pairs in proximal molecules. A prerequesite for such experimental schemes is the detailed understanding of the charge and spin dynamics of NV centers exposed to the short-wavelength light required for photoexciting chemical species. Here, we measure and analyze the charge and spin dynamics of shallow NV centers under 445 nm (blue) and 375 nm (UV) illumination. With blue excitation, we observe a power-dependent charge-state preparation accompanied by modest preservation of spin initialization fidelity. Under UV excitation, we find a power-independent charge-state preparation and no spin polarization. We further observe an irreversible aging of NV centers under prolonged exposure to UV, and to a lesser extent, blue laser excitation, which we attribute to formation of new electronic trap states. This aging manifests itself in a reduced charge stability and spin contrast, and is detrimental to the NV sensing performance. We evaluate the prospects and limitations of NV centers for probing photogenerated radical pairs based on experimentally measured sensitivities following blue and UV excitation, and outline the design rules for possible sensing schemes.

categories: quant-ph cond-mat.mes-hall physics.bio-ph physics.chem-ph


title: Lift-and-Project Integrality Gaps for Santa Claus

abstract: This paper is devoted to the study of the MaxMinDegree Arborescence (MMDA) problem in layered directed graphs of depth $\ell\le O(\log n/\log \log n)$, which is a special case of the Santa Claus problem. Obtaining a poly-logarithmic approximation for MMDA in polynomial time is of high interest as it is the main obstacle towards the same guarantee for the general Santa Claus problem, which is itself a necessary condition to eventually improve the long-standing 2-approximation for makespan scheduling on unrelated machines by Lenstra, Shmoys, and Tardos [FOCS'87]. The only ways we have to solve the MMDA problem within an $O(\text{polylog}(n))$ factor is via a ``round-and-condition'' algorithm using the $(\ell-1)^{th}$ level of the Sherali-Adams hierarchy, or via a ``recursive greedy'' algorithm which also has quasi-polynomial time. However, very little is known about the limitations of these techniques, and it is even plausible that the round-and-condition algorithm could obtain the same approximation guarantee with only $1$ round of Sherali-Adams, which would imply a polynomial-time algorithm. As a main result, we construct an MMDA instance of depth $3$ for which an integrality gap of $n^{\Omega(1)}$ survives $1$ round of the Sherali-Adams hierarchy. This result is best possible since it is known that after only $2$ rounds the gap is at most poly-logarithmic on depth-3 graphs. Second, we show that our instance can be ``lifted'' via a simple trick to MMDA instances of any depth $\ell\in \Omega(1)\cap o(\log n/\log \log n)$, for which we conjecture that an integrality gap of $n^{\Omega(1/\ell)}$ survives $\Omega(\ell)$ rounds of Sherali-Adams. We show a number of intermediate results towards this conjecture, which also suggest that our construction is a significant challenge to the techniques used so far for Santa Claus.


title: Euclid preparation. Sensitivity to non-standard particle dark matter model

abstract: The Euclid mission of the European Space Agency will provide weak gravitational lensing and galaxy clustering surveys that can be used to constrain the standard cosmological model and its extensions, with an opportunity to test the properties of dark matter beyond the minimal cold dark matter paradigm. We present forecasts from the combination of these surveys on the parameters describing four interesting and representative non-minimal dark matter models: a mixture of cold and warm dark matter relics; unstable dark matter decaying either into massless or massive relics; and dark matter experiencing feeble interactions with relativistic relics. We model these scenarios at the level of the non-linear matter power spectrum using emulators trained on dedicated N-body simulations. We use a mock Euclid likelihood to fit mock data and infer error bars on dark matter parameters marginalised over other parameters. We find that the Euclid photometric probe (alone or in combination with CMB data from the Planck satellite) will be sensitive to the effect of each of the four dark matter models considered here. The improvement will be particularly spectacular for decaying and interacting dark matter models. With Euclid, the bounds on some dark matter parameters can improve by up to two orders of magnitude compared to current limits. We discuss the dependence of predicted uncertainties on different assumptions: inclusion of photometric galaxy clustering data, minimum angular scale taken into account, modelling of baryonic feedback effects. We conclude that the Euclid mission will be able to measure quantities related to the dark sector of particle physics with unprecedented sensitivity. This will provide important information for model building in high-energy physics. Any hint of a deviation from the minimal cold dark matter paradigm would have profound implications for cosmology and particle physics.


title: The power of prediction: spatiotemporal Gaussian process modeling for predictive control in slope-based wavefront sensing

abstract: Time-delay error is a significant error source in adaptive optics (AO) systems. It arises from the latency between sensing the wavefront and applying the correction. Predictive control algorithms reduce the time-delay error, providing significant performance gains, especially for high-contrast imaging. However, the predictive controller's performance depends on factors such as the WFS type, the measurement noise, the AO system's geometry, and the atmospheric conditions. This work studies the limits of prediction under different imaging conditions through spatiotemporal Gaussian process models. The method provides a predictive reconstructor that is optimal in the least-squares sense, conditioned on the fixed times series of WFS data and our knowledge of the atmosphere. We demonstrate that knowledge is power in predictive AO control. With an SHS-based extreme AO instrument, perfect knowledge of Frozen Flow evolution (wind and Cn2 profile) leads to a reduction of the residual wavefront phase variance up to a factor of 3.5 compared to a non-predictive approach. If there is uncertainty in the profile or evolution models, the gain is more modest. Still, assuming that only effective wind speed is available (without direction) led to reductions in variance by a factor of 2.3. We also study the value of data for predictive filters by computing the experimental utility for different scenarios to answer questions such as: How many past data frames should the prediction filter consider, and is it always most advantageous to use the most recent data? We show that within the scenarios considered, more data consistently increases prediction accuracy. Further, we demonstrate that given a computational limitation on how many past frames we can use, an optimized selection of $n$ past frames leads to a 10-15% additional improvement in RMS over using the n latest consecutive frames of data.


title: Sanskrit Knowledge-based Systems: Annotation and Computational Tools

abstract: We address the challenges and opportunities in the development of knowledge systems for Sanskrit, with a focus on question answering. By proposing a framework for the automated construction of knowledge graphs, introducing annotation tools for ontology-driven and general-purpose tasks, and offering a diverse collection of web-interfaces, tools, and software libraries, we have made significant contributions to the field of computational Sanskrit. These contributions not only enhance the accessibility and accuracy of Sanskrit text analysis but also pave the way for further advancements in knowledge representation and language processing. Ultimately, this research contributes to the preservation, understanding, and utilization of the rich linguistic information embodied in Sanskrit texts.


title: Hemispheric analysis of the magnetic flux in regular and irregular solar active regions

abstract: Studying the hemispheric distribution of active regions (ARs) with different magnetic morphology may clarify the features of the dynamo process that is hidden under the photospheric level. The magnetic flux data for 3047 ARs from the CrAO catalog between May 1996 and December 2021 (cycles 23 and 24) were used to study ARs cyclic variations and perform correlation analysis. According to the magneto-morphological classification (MMC) of ARs proposed earlier, subsets of the regular (obeying empirical rules for sunspots) and irregular (violating these rules) ARs were considered separately. Our analysis shows the following. For ARs of each MMC type, in each of the hemispheres, time profiles demonstrate a multi-peak structure. The double-peak structure of a cycle is formed by ARs of both MMC types in both hemispheres. For the irregular ARs, the pronounced peaks occur in the second maxima (close to the polar field reversal). Their significant hemispheric imbalance might be caused by a weakening of the toroidal field in one of the hemispheres due to the interaction between the dipolar and quadrupolar components of the global field, which facilitates the manifestation of the turbulent component of the dynamo. The similarity of the irregular ARs activity that was found in adjacent cycles in different hemispheres also hints at realization of the mix-parity dynamo solution. For the quadrupolar-like component of the flux (compiled in the simple axisymmetric approximation), signs of oscillations with a period of about 15 years are found, and they are pronounced specifically for the irregular groups. This MMC type ARs might also contribute in $\alpha$-quenching.


title: Generalized Deepfake Attribution

abstract: The landscape of fake media creation changed with the introduction of Generative Adversarial Networks (GAN s). Fake media creation has been on the rise with the rapid advances in generation technology, leading to new challenges in Detecting fake media. A fundamental characteristic of GAN s is their sensitivity to parameter initialization, known as seeds. Each distinct seed utilized during training leads to the creation of unique model instances, resulting in divergent image outputs despite employing the same architecture. This means that even if we have one GAN architecture, it can produce countless variations of GAN models depending on the seed used. Existing methods for attributing deepfakes work well only if they have seen the specific GAN model during training. If the GAN architectures are retrained with a different seed, these methods struggle to attribute the fakes. This seed dependency issue made it difficult to attribute deepfakes with existing methods. We proposed a generalized deepfake attribution network (GDA-N et) to attribute fake images to their respective GAN architectures, even if they are generated from a retrained version of the GAN architecture with a different seed (cross-seed) or from the fine-tuned version of the existing GAN model. Extensive experiments on cross-seed and fine-tuned data of GAN models show that our method is highly effective compared to existing methods. We have provided the source code to validate our results.


title: CAS: Confidence Assessments of classification algorithms for Semantic segmentation of EO data

abstract: Confidence assessments of semantic segmentation algorithms in remote sensing are important. It is a desirable property of models to a priori know if they produce an incorrect output. Evaluations of the confidence assigned to the estimates of models for the task of classification in Earth Observation (EO) are crucial as they can be used to achieve improved semantic segmentation performance and prevent high error rates during inference and deployment. The model we develop, the Confidence Assessments of classification algorithms for Semantic segmentation (CAS) model, performs confidence evaluations at both the segment and pixel levels, and outputs both labels and confidence. The outcome of this work has important applications. The main application is the evaluation of EO Foundation Models on semantic segmentation downstream tasks, in particular land cover classification using satellite Copernicus Sentinel-2 data. The evaluation shows that the proposed model is effective and outperforms other alternative baseline models.


title: Exploring quantum weight enumerators from the $n$-qubit parallelized SWAP test

abstract: Quantum weight enumerators play a crucial role in quantum error-correcting codes and multipartite entanglement. They can be used to investigate the existence of quantum error-correcting codes and $k$-uniform states. In this work, we build the connection between quantum weight enumerators and the $n$-qubit parallelized SWAP test. We discover that each shadow enumerator corresponds precisely to a probability in the $n$-qubit parallelized SWAP test, providing a computable and operational meaning for the shadow enumerators. Due to the non-negativity of probabilities, we obtain an elegant proof for the shadow inequalities. Concurrently, we can also calculate the Shor-Laflamme enumerators and the Rains unitary enumerators from the $n$-qubit parallelized SWAP test. For applications, we employ the $n$-qubit parallelized SWAP test to determine the distances of quantum error-correcting codes, and the $k$-uniformity of pure states. Our results indicate that quantum weight enumerators can be efficiently estimated on quantum computers, and opening a path to calculate the distances of quantum error-correcting codes.


title: Radio continuum emission from a tidal dwarf galaxy

abstract: Tidal dwarf galaxies (TDGs) form in the debris of galaxy mergers, making them ideal testbeds for investigating star formation in an extreme environment. We present radio continuum EVLA observations spanning 1-2 GHz of the interacting system Arp 94, which contains the TDG J1023+1952. We detect extended radio continuum emission from the disc of the TDG's putative parent galaxy, the spiral NGC 3227. The TDG lies in front of the spiral disc, partially overlapping in projection. This challenging alignment complicates the separation of the respective contributions of radio emission from the TDG and disc. However, we show that the radio continuum appears more prominent around the TDG's location, suggesting the detection of emission from the TDG. Quantifying this argument, we derive an upper limit of 2.2 mJy for the whole TDG's emission. Our derived in-band spectral index map of the system generally shows the expected behaviour of combined thermal and synchrotron radio emission in a galaxy disc, except for a region at the periphery of the disc and the TDG with a flat spectrum (spectral index ~-0.4) unrelated to regions with high H alpha emission. We speculate that at this location - which coincides with the intersection of faint tidal tails - the collision of gas clouds produces shocks which re-accelerate cosmic ray electrons, and thereby enhance the radio emission. Overall, this study provides new insights about the Arp 94 system and expands the sample of TDGs studied at radio frequencies, with only two confirmed detections so far.


title: Frank-Wolfe meets Shapley-Folkman: a systematic approach for solving nonconvex separable problems with linear constraints

abstract: We consider separable nonconvex optimization problems under affine constraints. For these problems, the Shapley-Folkman theorem provides an upper bound on the duality gap as a function of the nonconvexity of the objective functions, but does not provide a systematic way to construct primal solutions satisfying that bound. In this work, we develop a two-stage approach to do so. The first stage approximates the optimal dual value with a large set of primal feasible solutions. In the second stage, this set is trimmed down to a primal solution by computing (approximate) Caratheodory representations. The main computational requirement of our method is tractability of the Fenchel conjugates of the component functions and their (sub)gradients. When the function domains are convex, the method recovers the classical duality gap bounds obtained via Shapley-Folkman. When the function domains are nonconvex, the method also recovers classical duality gap bounds from the literature, based on a more general notion of nonconvexity.


title: Cascaded multi-phonon stimulated Raman scattering near second-harmonic-generation in thin-film lithium niobate microdisk

abstract: High-quality microresonators can greatly enhance light-matter interactions and are excellent platforms for studying nonlinear optics. Wavelength conversion through nonlinear processes is the key to many applications of integrated optics. The stimulated Raman scattering process can extend the emission wavelength of a laser source to a wider range. Lithium niobate, as a Raman active crystalline material, has remarkable potential for wavelength conversion. Here, we demonstrate the generation of cascaded multi-phonon Raman signals near the second-harmonic-generation peak in X-cut thin-film lithium niobate microdisk. Fine tuning of the specific cascaded Raman spectral lines has also been made by changing the pump wavelength. Raman lines can reach wavelength up to about 80 nm away from the SHG signal. We realize the SFG process associated with Raman signals in the visible range as well. Our work extends the use of WGM microresonators as effective optical upconversion wavelength converters in nonlinear optical applications.


title: RealTalk: Real-time and Realistic Audio-driven Face Generation with 3D Facial Prior-guided Identity Alignment Network

abstract: Person-generic audio-driven face generation is a challenging task in computer vision. Previous methods have achieved remarkable progress in audio-visual synchronization, but there is still a significant gap between current results and practical applications. The challenges are two-fold: 1) Preserving unique individual traits for achieving high-precision lip synchronization. 2) Generating high-quality facial renderings in real-time performance. In this paper, we propose a novel generalized audio-driven framework RealTalk, which consists of an audio-to-expression transformer and a high-fidelity expression-to-face renderer. In the first component, we consider both identity and intra-personal variation features related to speaking lip movements. By incorporating cross-modal attention on the enriched facial priors, we can effectively align lip movements with audio, thus attaining greater precision in expression prediction. In the second component, we design a lightweight facial identity alignment (FIA) module which includes a lip-shape control structure and a face texture reference structure. This novel design allows us to generate fine details in real-time, without depending on sophisticated and inefficient feature alignment modules. Our experimental results, both quantitative and qualitative, on public datasets demonstrate the clear advantages of our method in terms of lip-speech synchronization and generation quality. Furthermore, our method is efficient and requires fewer computational resources, making it well-suited to meet the needs of practical applications.


title: LLCoach: Generating Robot Soccer Plans using Multi-Role Large Language Models

abstract: The deployment of robots into human scenarios necessitates advanced planning strategies, particularly when we ask robots to operate in dynamic, unstructured environments. RoboCup offers the chance to deploy robots in one of those scenarios, a human-shaped game represented by a soccer match. In such scenarios, robots must operate using predefined behaviors that can fail in unpredictable conditions. This paper introduces a novel application of Large Language Models (LLMs) to address the challenge of generating actionable plans in such settings, specifically within the context of the RoboCup Standard Platform League (SPL) competitions where robots are required to autonomously execute soccer strategies that emerge from the interactions of individual agents. In particular, we propose a multi-role approach leveraging the capabilities of LLMs to generate and refine plans for a robotic soccer team. The potential of the proposed method is demonstrated through an experimental evaluation,carried out simulating multiple matches where robots with AI-generated plans play against robots running human-built code.


title: Effects of Using Synthetic Data on Deep Recommender Models' Performance

abstract: Recommender systems are essential for enhancing user experiences by suggesting items based on individual preferences. However, these systems frequently face the challenge of data imbalance, characterized by a predominance of negative interactions over positive ones. This imbalance can result in biased recommendations favoring popular items. This study investigates the effectiveness of synthetic data generation in addressing data imbalances within recommender systems. Six different methods were used to generate synthetic data. Our experimental approach involved generating synthetic data using these methods and integrating the generated samples into the original dataset. Our results show that the inclusion of generated negative samples consistently improves the Area Under the Curve (AUC) scores. The significant impact of synthetic negative samples highlights the potential of data augmentation strategies to address issues of data sparsity and imbalance, ultimately leading to improved performance of recommender systems.


title: Learning-rate-free Momentum SGD with Reshuffling Converges in Nonsmooth Nonconvex Optimization

abstract: In this paper, we propose a generalized framework for developing learning-rate-free momentum stochastic gradient descent (SGD) methods in the minimization of nonsmooth nonconvex functions, especially in training nonsmooth neural networks. Our framework adaptively generates learning rates based on the historical data of stochastic subgradients and iterates. Under mild conditions, we prove that our proposed framework enjoys global convergence to the stationary points of the objective function in the sense of the conservative field, hence providing convergence guarantees for training nonsmooth neural networks. Based on our proposed framework, we propose a novel learning-rate-free momentum SGD method (LFM). Preliminary numerical experiments reveal that LFM performs comparably to the state-of-the-art learning-rate-free methods (which have not been shown theoretically to be convergence) across well-known neural network training benchmarks.


title: A note on uniform definability of types over finite sets in partial orders of finite width

abstract: In "VC density in some theories without the independence property" the authors asked whether any partial order of finite width has the VC1 property (i.e. every formula in one variable has UDTFS in one parameter). We give a negative answer and some related remarks.


title: On Shilnikov's scenario with a homoclinic orbit in 3D

abstract: The paper provides a detailed proof that complicated motion exists in Shilnikov's scenario of a smooth vectorfield $V$ on $mathbb{R}^3$ with $V(0)=0$ so that the equation $x'=V(x)$ has a homoclinic solution $h$ with $\lim_{|t|\to\infty}h(t)=0$, and $DV(0)$ has eigenvalues $u>0$ and $\sigma\pm\mu$, $\sigma<0<\mu$, with $0<\sigma+u$.


title: The first Steklov eigenvalue on manifolds with nonnegative Ricci curvature and convex boundary

abstract: We establish a new lower bound for the first non-zero Steklov eigenvalue of a compact Riemannian manifold with non-negative Ricci curvature and (strictly) convex boundary. Related results are also obtained under weaker geometric hypotheses.


title: Specific heat analyses on optical-phonon-derived uniaxial negative thermal expansion system $Tr$Zr$_{2}$ ($Tr$ = Fe and Co$_{1-x}$Ni$_{x}$)

abstract: Recently, huge uniaxial negative thermal expansion (NTE) along a $c$-axis has been observed in transition-metal ($Tr$) zirconides $Tr$Zr$_{2}$ with a tetragonal CuAl$_{2}$-type structure. In a recent study on FeZr$_{2}$ [M. Xu et al., Nat. Commun. 14, 4439 (2023)], the importance of optical phonons to the emergence of the $c$-axis NTE in FeZr$_{2}$ has been proposed. In this study, the physical properties of $Tr$Zr$_{2}$ ($Tr$ = Fe and Co$_{1-x}$Ni$_{x}$) have been studied by specific heat, sound velocity measurements, and theoretical phonon calculations to discuss the importance of optical phonons to the emergence of the $c$-axis NTE in CoZr$_{2}$ and FeZr$_{2}$. From analyses of lattice specific heat, we found that Ni substitution results in a systematic decrease in oscillator strength for the Einstein modes with 8.74 meV (CoZr$_{2}$). From phonon calculations, the low-energy optical phonon branches at the $\Gamma$ point were observed for CoZr$_{2}$ and FeZr$_{2}$ with $c$-axis NTE, but not in NiZr$_{2}$ with positive thermal expansion. The enhancement of phonon density of states near the above-mentioned optical phonon energy in CoZr$_{2}$ and FeZr$_{2}$ is consistent with the specific heat analyses. We propose the importance of the low-energy optical phonons to the emergence of the $c$-axis NTE in TrZr$_{2}$.


title: Traces of quantum gravitational correction at third-order curvature through the black hole shadow and particle deflection at the weak field limit

abstract: This study investigates the impact of the quantum-gravity correction at the third-order curvature ($c_6$) on the black hole's shadow and deflection angle on the weak field regime, both involving finite distances of observers. While the calculation of the photonsphere and shadow radius $R_{\rm sh}$ can easily be achieved by the standard Lagrangian for photons, the deflection angle $\alpha$ employs the finite-distance version of the Gauss-Bonnet theorem (GBT). We find that the photonsphere reduces to the classical expression $r_{\rm ph} = 3M$ for both the Planck mass and the theoretical mass limit for BH, thus concealing the information about the applicability of the metric on the quantum and astrophysical grounds. Our calculation of the shadow, however, revealed that $c_6$ is strictly negative and constrains the applicability of the metric to quantum black holes. For instance, the bounds for the mass is $M/l_{\rm Pl} \in [0.192, 4.315]$. We also derived the analytic formula for the observer-dependent shadow, which confirms $c_6$'s influence on quantum black holes even for observers in the asymptotic regions. The influence of such a parameter also strengthens near the quantum black hole. Our analytic calculation of $\alpha$ is shown to be independent of $c_6$ if the finite distance $u \rightarrow 0$, and $c_6$ is not coupled to any time-like geodesic. Finally, the effect of $c_6$ manifests in two ways: if $M^2$ is large enough to offset the small value of $l_{\rm Pl}$ (which is beyond the theoretical mass limit), or if $b$ is comparable to $l_{\rm Pl}$ for a quantum black hole.


title: Combining Automated Optimisation of Hyperparameters and Reward Shape

abstract: There has been significant progress in deep reinforcement learning (RL) in recent years. Nevertheless, finding suitable hyperparameter configurations and reward functions remains challenging even for experts, and performance heavily relies on these design choices. Also, most RL research is conducted on known benchmarks where knowledge about these choices already exists. However, novel practical applications often pose complex tasks for which no prior knowledge about good hyperparameters and reward functions is available, thus necessitating their derivation from scratch. Prior work has examined automatically tuning either hyperparameters or reward functions individually. We demonstrate empirically that an RL algorithm's hyperparameter configurations and reward function are often mutually dependent, meaning neither can be fully optimised without appropriate values for the other. We then propose a methodology for the combined optimisation of hyperparameters and the reward function. Furthermore, we include a variance penalty as an optimisation objective to improve the stability of learned policies. We conducted extensive experiments using Proximal Policy Optimisation and Soft Actor-Critic on four environments. Our results show that combined optimisation significantly improves over baseline performance in half of the environments and achieves competitive performance in the others, with only a minor increase in computational costs. This suggests that combined optimisation should be best practice.


title: Hierarchical Context Pruning: Optimizing Real-World Code Completion with Repository-Level Pretrained Code LLMs

abstract: Some recently developed code large language models (Code LLMs) have been pre-trained on repository-level code data (Repo-Code LLMs), enabling these models to recognize repository structures and utilize cross-file information for code completion. However, in real-world development scenarios, simply concatenating the entire code repository often exceeds the context window limits of these Repo-Code LLMs, leading to significant performance degradation. In this study, we conducted extensive preliminary experiments and analyses on six Repo-Code LLMs. The results indicate that maintaining the topological dependencies of files and increasing the code file content in the completion prompts can improve completion accuracy; pruning the specific implementations of functions in all dependent files does not significantly reduce the accuracy of completions. Based on these findings, we proposed a strategy named Hierarchical Context Pruning (HCP) to construct completion prompts with high informational code content. The HCP models the code repository at the function level, maintaining the topological dependencies between code files while removing a large amount of irrelevant code content, significantly reduces the input length for repository-level code completion. We applied the HCP strategy in experiments with six Repo-Code LLMs, and the results demonstrate that our proposed method can significantly enhance completion accuracy while substantially reducing the length of input. Our code and data are available at https://github.com/Hambaobao/HCP-Coder.


title: Evaluating and Benchmarking Foundation Models for Earth Observation and Geospatial AI

abstract: When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We focus on the specific Computer Vision application of Foundation Models for Earth Observation (EO) and geospatial AI. These models can solve important problems we are tackling, including for example land cover classification, crop type mapping, flood segmentation, building density estimation, and road regression segmentation. In this paper, we show that for a limited number of labelled data, Foundation Models achieve improved performance compared to problem-specific models. In this work, we also present our proposed evaluation benchmark for Foundation Models for EO. Benchmarking the generalization performance of Foundation Models is important as it has become difficult to standardize a fair comparison across the many different models that have been proposed recently. We present the results using our evaluation benchmark for EO Foundation Models and show that Foundation Models are label efficient in the downstream tasks and help us solve problems we are tackling in EO and remote sensing.


title: Kink-kink solutions in BPS impurity models

abstract: We show that BPS-impurity theories may support BPS kink-kink solutions i.e., an energetically degenerated family of solutions describing two kinks at any mutual distance. This requires a singular impurity. As an example we consider the sine-Gordon and $\phi^6$ models coupled with such a BPS impurity. Interestingly, obtained solutions are identical to double sine-Gordon kinks and Christ-Lee kinks respectively. We also study the spectral flow on the moduli space. All the modes have an odd number of nodes to cancel the singularity of the impurity.


title: FactFinders at CheckThat! 2024: Refining Check-worthy Statement Detection with LLMs through Data Pruning

abstract: The rapid dissemination of information through social media and the Internet has posed a significant challenge for fact-checking, among others in identifying check-worthy claims that fact-checkers should pay attention to, i.e. filtering claims needing fact-checking from a large pool of sentences. This challenge has stressed the need to focus on determining the priority of claims, specifically which claims are worth to be fact-checked. Despite advancements in this area in recent years, the application of large language models (LLMs), such as GPT, has only recently drawn attention in studies. However, many open-source LLMs remain underexplored. Therefore, this study investigates the application of eight prominent open-source LLMs with fine-tuning and prompt engineering to identify check-worthy statements from political transcriptions. Further, we propose a two-step data pruning approach to automatically identify high-quality training data instances for effective learning. The efficiency of our approach is demonstrated through evaluations on the English language dataset as part of the check-worthiness estimation task of CheckThat! 2024. Further, the experiments conducted with data pruning demonstrate that competitive performance can be achieved with only about 44\% of the training data. Our team ranked first in the check-worthiness estimation task in the English language.


title: A model-independent determination of the sound horizon using recent BAO measurements and strong lensing systems

abstract: We propose an improved method to determine the sound horizon in a cosmological model-independent way by using the latest observations of BAO measurements from DES, BOSS/eBOSS, and DESI surveys and gravitationally time-delay lensed quasars from H0LiCOW collaboration. Combining the 6$D_{\Delta t}$ plus 4$D_{d}$ measurements and the reconstructed BAO datasets, we obtain a model-independent result of $r_d=139.7^{+5.2}_{-4.5}$ Mpc, with the precision at the $\sim3.7\%$ level, which is in agreement with the result of Planck 2018 within $\sim1.7\sigma$ uncertainty. Our method is independent of cosmological parameters such as the Hubble constant, dark energy, (and, more importantly, does not involve the cosmic curvature when using the $D_d$ measurements of the lenses, and also avoids the obstacle of mass-sheet degeneracy in gravitational lensing). Meanwhile, it does not need to consider the Eddington relation with concerning the transformation of distance. Since only two types of data are considered, the contribution of each can be clearly understood. Our results also highlight the Hubble tension and may give us a better understanding of the discordance between the datasets or reveal new physics beyond the standard model.


title: On the Descriptive Complexity of Vertex Deletion Problems

abstract: Vertex deletion problems for graphs are studied intensely in classical and parameterized complexity theory. They ask whether we can delete at most k vertices from an input graph such that the resulting graph has a certain property. Regarding k as the parameter, a dichotomy was recently shown based on the number of quantifier alternations of first-order formulas that describe the property. In this paper, we refine this classification by moving from quantifier alternations to individual quantifier patterns and from a dichotomy to a trichotomy, resulting in a complete classification of the complexity of vertex deletion problems based on their quantifier pattern. The more fine-grained approach uncovers new tractable fragments, which we show to not only lie in FPT, but even in parameterized constant-depth circuit complexity classes. On the other hand, we show that vertex deletion becomes intractable already for just one quantifier per alternation, that is, there is a formula of the form {\forall}x{\exists}y{\forall}z({\psi}), with {\psi} quantifier-free, for which the vertex deletion problem is W[1]-hard. The fine-grained analysis also allows us to uncover differences in the complexity landscape when we consider different kinds of graphs and more general structures: While basic graphs (undirected graphs without self-loops), undirected graphs, and directed graphs each have a different frontier of tractability, the frontier for arbitrary logical structures coincides with that of directed graphs.


title: Shadow and quasinormal modes of the rotating Einstein-Euler-Heisenberg black holes

abstract: The Einstein-Euler-Heisenberg (EEH) black hole model is an extension of classical black hole solutions in general relativity, incorporating quantum electrodynamics (QED) effects via the Euler-Heisenberg Lagrangian. The Euler-Heisenberg Lagrangian describes the nonlinear corrections to Maxwell's equations due to virtual electron-positron pair production in a strong electromagnetic field. When this Lagrangian is coupled with Einstein's field equations, it leads to modified black hole solutions that took into account these quantum corrections. In this paper, we investigate the impact of the screening parameter, acting as an effective dielectric constant endowed in a vacuum due to such QED effects, on the properties of the rotating and electrically charged Einstein-Euler-Heisenberg black holes (EEH). To this aim, we analyzed and discussed findings as to how the screening parameter, being positive or negative, affects certain black hole properties such as null regions, shadow cast and its observables, and quasinormal modes (QNMs) relative to the Kerr and Kerr-Newman cases. We find that the presence of a screened charge due to the associated QED effects in this screened Maxwell theory might noticeably alter the properties of black holes, offering insights into the interplay between gravity and quantum field effects.


title: MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research

abstract: Recently, multilingual artificial intelligence assistants, exemplified by ChatGPT, have gained immense popularity. As a crucial gateway to human-computer interaction, multilingual automatic speech recognition (ASR) has also garnered significant attention, as evidenced by systems like Whisper. However, the proprietary nature of the training data has impeded researchers' efforts to study multilingual ASR. This paper introduces MSR-86K, an evolving, large-scale multilingual corpus for speech recognition research. The corpus is derived from publicly accessible videos on YouTube, comprising 15 languages and a total of 86,300 hours of transcribed ASR data. We also introduce how to use the MSR-86K corpus and other open-source corpora to train a robust multilingual ASR model that is competitive with Whisper. MSR-86K will be publicly released on HuggingFace, and we believe that such a large corpus will pave new avenues for research in multilingual ASR.


title: Rank of the derivative of the projection to symmetrized polydisc

abstract: We prove that the rank of the derivative of the projection from spectral unit ball to symmetrized polydisc is equal to the degree of the minimal polynomial of the matrix at which we take derivative.


title: A population of mid-infrared large-amplitude variable young stellar objects from unTimely

abstract: Utilizing a decade-long unTimely dataset, supplemented by multi-band data from archives, we search for young stellar objects (YSOs) with variations larger than one magnitude in W1 band within a region of 110 square degrees in the Galactic plane, covered by VISTA Variables in the Via Lactea (VVV). A total of 641 candidate YSOs have been identified. We classified them into bursts, dips, faders, seculars, and irregulars. Within the burst category, 18 sources were identified as FUor candidates and 1 as an EXor candidate. Irregulars are the most prevalent in the sample. In both bursts and faders, the redder sources tend to show a pattern of bluer when brighter, whereas the bluer sources display the opposite trend, possibly related to the accretion structure of YSOs at different stages. Finally, we obtained the recurrence time scale for FUor eruptions at various stages of YSO evolution. Our findings indicate that younger YSOs generally experience more frequent eruptions compared to older ones.


title: Example-Based Reasoning about the Realizability of Polymorphic Programs

abstract: Parametricity states that polymorphic functions behave the same regardless of how they are instantiated. When developing polymorphic programs, Wadler's free theorems can serve as free specifications, which can turn otherwise partial specifications into total ones, and can make otherwise realizable specifications unrealizable. This is of particular interest to the field of program synthesis, where the unrealizability of a specification can be used to prune the search space. In this paper, we focus on the interaction between parametricity, input-output examples, and sketches. Unfortunately, free theorems introduce universally quantified functions that make automated reasoning difficult. Container morphisms provide an alternative representation for polymorphic functions that captures parametricity in a more manageable way. By using a translation to the container setting, we show how reasoning about the realizability of polymorphic programs with input-output examples can be automated.


title: S3: A Simple Strong Sample-effective Multimodal Dialog System

abstract: In this work, we present a conceptually simple yet powerful baseline for the multimodal dialog task, an S3 model, that achieves near state-of-the-art results on two compelling leaderboards: MMMU and AI Journey Contest 2023. The system is based on a pre-trained large language model, pre-trained modality encoders for image and audio, and a trainable modality projector. The proposed effective data mixture for training such an architecture demonstrates that a multimodal model based on a strong language model and trained on a small amount of multimodal data can perform efficiently in the task of multimodal dialog.


title: Neural Network-Based RIS Assisted NLoS DoA Estimation

abstract: This paper presents a learning-based approach for Direction of Arrival (DoA) estimation using a Reconfigurable Intelligent Surface (RIS) in a Non-Line-of-Sight (NLoS) scenario. The key innovation is the employment of a novel Neural Network (NN)-based fully connected layer, referred to as the NN-based RIS layer, within a generic Multi-Layer Perceptron (MLP) structure. The NN-based RIS layer is designed to learn the optimal RIS phase shifts that are tailored for the DoA estimation task. To achieve this, the pre-processed real-valued observations are fed into the RIS layer, which has a specialized structure. Unlike regular neural network layers, the weights of the NN-based RIS layer are constrained to be sinusoidal functions, with the phase arguments being the tunable parameters during the training process. This allows the layer to emulate the functionality of an RIS. Accordingly, the standard feed-forward and back-propagation procedures are modified to accommodate the unique structure of the NN-based RIS layer. Numerical simulations demonstrate that the proposed machine learning-based approach outperforms conventional non-learning-based methods for DoA estimation under almost every practical SNR range in an RIS-assisted scheme.


title: Five-Lee-weight linear codes over $\mathbb{F}_{q}+u\mathbb{F}_{q}$

abstract: In this study, linear codes having their Lee-weight distributions over the semi-local ring $\mathbb{F}_{q}+u\mathbb{F}_{q}$ with $u^{2}=1$ are constructed using the defining set and Gauss sums for an odd prime $q $. Moreover, we derive complete Hamming-weight enumerators for the images of the constructed linear codes under the Gray map. We finally show an application to secret sharing schemes.


title: Global existence of large solutions to 3-D incompressible Navier-Stokes system

abstract: This paper proves that the 3-D Navier-Stokes system has a unique global solution under an assumpution on the initial data. That allow the data to be arbitrarily large in the scale invariant space \dot{B}_{\infty,\infty}^{-1}, which contains all the known spaces in which there is a global solution for small data. Moreover, this result provides various examples of arbitrarily large initial data giving rise to global solutions.


title: Automated Immunophenotyping Assessment for Diagnosing Childhood Acute Leukemia using Set-Transformers

abstract: Acute Leukemia is the most common hematologic malignancy in children and adolescents. A key methodology in the diagnostic evaluation of this malignancy is immunophenotyping based on Multiparameter Flow Cytometry (FCM). However, this approach is manual, and thus time-consuming and subjective. To alleviate this situation, we propose in this paper the FCM-Former, a machine learning, self-attention based FCM-diagnostic tool, automating the immunophenotyping assessment in Childhood Acute Leukemia. The FCM-Former is trained in a supervised manner, by directly using flow cytometric data. Our FCM-Former achieves an accuracy of 96.5% assigning lineage to each sample among 960 cases of either acute B-cell, T-cell lymphoblastic, and acute myeloid leukemia (B-ALL, T-ALL, AML). To the best of our knowledge, the FCM-Former is the first work that automates the immunophenotyping assessment with FCM data in diagnosing pediatric Acute Leukemia.


title: Spatial-temporal Hierarchical Reinforcement Learning for Interpretable Pathology Image Super-Resolution

abstract: Pathology image are essential for accurately interpreting lesion cells in cytopathology screening, but acquiring high-resolution digital slides requires specialized equipment and long scanning times. Though super-resolution (SR) techniques can alleviate this problem, existing deep learning models recover pathology image in a black-box manner, which can lead to untruthful biological details and misdiagnosis. Additionally, current methods allocate the same computational resources to recover each pixel of pathology image, leading to the sub-optimal recovery issue due to the large variation of pathology image. In this paper, we propose the first hierarchical reinforcement learning framework named Spatial-Temporal hierARchical Reinforcement Learning (STAR-RL), mainly for addressing the aforementioned issues in pathology image super-resolution problem. We reformulate the SR problem as a Markov decision process of interpretable operations and adopt the hierarchical recovery mechanism in patch level, to avoid sub-optimal recovery. Specifically, the higher-level spatial manager is proposed to pick out the most corrupted patch for the lower-level patch worker. Moreover, the higher-level temporal manager is advanced to evaluate the selected patch and determine whether the optimization should be stopped earlier, thereby avoiding the over-processed problem. Under the guidance of spatial-temporal managers, the lower-level patch worker processes the selected patch with pixel-wise interpretable actions at each time step. Experimental results on medical images degraded by different kernels show the effectiveness of STAR-RL. Furthermore, STAR-RL validates the promotion in tumor diagnosis with a large margin and shows generalizability under various degradations. The source code is available at https://github.com/CUHK-AIM-Group/STAR-RL.


title: Online Learning of Multiple Tasks and Their Relationships : Testing on Spam Email Data and EEG Signals Recorded in Construction Fields

abstract: This paper examines an online multi-task learning (OMTL) method, which processes data sequentially to predict labels across related tasks. The framework learns task weights and their relatedness concurrently. Unlike previous models that assumed static task relatedness, our approach treats tasks as initially independent, updating their relatedness iteratively using newly calculated weight vectors. We introduced three rules to update the task relatedness matrix: OMTLCOV, OMTLLOG, and OMTLVON, and compared them against a conventional method (CMTL) that uses a fixed relatedness value. Performance evaluations on three datasets a spam dataset and two EEG datasets from construction workers under varying conditions demonstrated that our OMTL methods outperform CMTL, improving accuracy by 1\% to 3\% on EEG data, and maintaining low error rates around 12\% on the spam dataset.


title: AI-native Memory: A Pathway from LLMs Towards AGI

abstract: Large language models (LLMs) have demonstrated the world with the sparks of artificial general intelligence (AGI). One opinion, especially from some startups working on LLMs, argues that an LLM with nearly unlimited context length can realize AGI. However, they might be too optimistic about the long-context capability of (existing) LLMs -- (1) Recent literature has shown that their effective context length is significantly smaller than their claimed context length; and (2) Our reasoning-in-a-haystack experiments further demonstrate that simultaneously finding the relevant information from a long context and conducting (simple) reasoning is nearly impossible. In this paper, we envision a pathway from LLMs to AGI through the integration of \emph{memory}. We believe that AGI should be a system where LLMs serve as core processors. In addition to raw data, the memory in this system would store a large number of important conclusions derived from reasoning processes. Compared with retrieval-augmented generation (RAG) that merely processing raw data, this approach not only connects semantically related information closer, but also simplifies complex inferences at the time of querying. As an intermediate stage, the memory will likely be in the form of natural language descriptions, which can be directly consumed by users too. Ultimately, every agent/person should have its own large personal model, a deep neural network model (thus \emph{AI-native}) that parameterizes and compresses all types of memory, even the ones cannot be described by natural languages. Finally, we discuss the significant potential of AI-native memory as the transformative infrastructure for (proactive) engagement, personalization, distribution, and social in the AGI era, as well as the incurred privacy and security challenges with preliminary solutions.


title: Advancing Airport Tower Command Recognition: Integrating Squeeze-and-Excitation and Broadcasted Residual Learning

abstract: Accurate recognition of aviation commands is vital for flight safety and efficiency, as pilots must follow air traffic control instructions precisely. This paper addresses challenges in speech command recognition, such as noisy environments and limited computational resources, by advancing keyword spotting technology. We create a dataset of standardized airport tower commands, including routine and emergency instructions. We enhance broadcasted residual learning with squeeze-and-excitation and time-frame frequency-wise squeeze-and-excitation techniques, resulting in our BC-SENet model. This model focuses on crucial information with fewer parameters. Our tests on five keyword spotting models, including BC-SENet, demonstrate superior accuracy and efficiency. These findings highlight the effectiveness of our model advancements in improving speech command recognition for aviation safety and efficiency in noisy, high-stakes environments. Additionally, BC-SENet shows comparable performance on the common Google Speech Command dataset.


title: ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions

abstract: Deep learning approaches achieved significant progress in predicting protein structures. These methods are often applied to protein-protein interactions (PPIs) yet require Multiple Sequence Alignment (MSA) which is unavailable for various interactions, such as antibody-antigen. Computational docking methods are capable of sampling accurate complex models, but also produce thousands of invalid configurations. The design of scoring functions for identifying accurate models is a long-standing challenge. We develop a novel attention-based Graph Neural Network (GNN), ContactNet, for classifying PPI models obtained from docking algorithms into accurate and incorrect ones. When trained on docked antigen and modeled antibody structures, ContactNet doubles the accuracy of current state-of-the-art scoring functions, achieving accurate models among its Top-10 at 43% of the test cases. When applied to unbound antibodies, its Top-10 accuracy increases to 65%. This performance is achieved without MSA and the approach is applicable to other types of interactions, such as host-pathogens or general PPIs.


title: Existence result for a nonlinear mixed boundary value problem for the heat equation

abstract: In this paper we study the existence of solutions in parabolic Schauder space of a nonlinear mixed boundary value problem for the heat equation in a perforated domain. From a given regular open set $\Omega\subseteq\mathbb{R}^n$ we remove a cavity $\omega\subseteq \Omega$. On the exterior boundary of $\Omega\setminus\overline{\omega}$ we prescribe a Neumann boundary condition, while on the interior boundary we set a nonlinear Robin-type condition. Under suitable assumptions on the data and by means of Leray Schauder Fixed-Point Theorem, we prove the existence of (at least) one solution $u \in C_{0}^{\frac{1+\alpha}{2}; 1+\alpha}([0,T] \times (\overline{\Omega} \setminus \omega))$.


title: Trade-off between Gradient Measurement Efficiency and Expressivity in Deep Quantum Neural Networks

abstract: Quantum neural networks (QNNs) require an efficient training algorithm to achieve practical quantum advantages. A promising approach is the use of gradient-based optimization algorithms, where gradients are estimated through quantum measurements. However, it is generally difficult to efficiently measure gradients in QNNs because the quantum state collapses upon measurement. In this work, we prove a general trade-off between gradient measurement efficiency and expressivity in a wide class of deep QNNs, elucidating the theoretical limits and possibilities of efficient gradient estimation. This trade-off implies that a more expressive QNN requires a higher measurement cost in gradient estimation, whereas we can increase gradient measurement efficiency by reducing the QNN expressivity to suit a given task. We further propose a general QNN ansatz called the stabilizer-logical product ansatz (SLPA), which can reach the upper limit of the trade-off inequality by leveraging the symmetric structure of the quantum circuit. In learning an unknown symmetric function, the SLPA drastically reduces the quantum resources required for training while maintaining accuracy and trainability compared to a well-designed symmetric circuit based on the parameter-shift method. Our results not only reveal a theoretical understanding of efficient training in QNNs but also provide a standard and broadly applicable efficient QNN design.


title: ANDES, the high-resolution spectrograph for the ELT: RIZ Spectrograph preliminary design

abstract: We present here the preliminary design of the RIZ module, one of the visible spectrographs of the ANDES instrument 1. It is a fiber-fed high-resolution, high-stability spectrograph. Its design follows the guidelines of successful predecessors such as HARPS and ESPRESSO. In this paper we present the status of the spectrograph at the preliminary design stage. The spectrograph will be a warm, vacuum-operated, thermally controlled and fiber-fed echelle spectrograph. Following the phase A design, the huge etendue of the telescope will be reformed in the instrument with a long slit made of smaller fibers. We discuss the system design of the spectrographs system.


title: The Hoffman program for mixed graphs

abstract: We consider Hoffman's program about the limit points of the spectral radius of the Hermitian adjacency matrix of mixed graphs. In particular, we determine all mixed graphs without negative $4$-cycle whose spectral radius does not exceed $\sqrt{2+\sqrt{5}}$, and identify all limit points of spectral radii of mixed graphs.


title: A study of three butterflies: entanglement wedge method, OTOC and pole-skipping

abstract: In this work, we investigate two salient chaotic features, namely Lyapunov exponent and butterfly velocity, in the context of an asymptotically Lifshitz black hole background with an arbitrary critical exponent. These features are computed using three methods: entanglement wedge method, out-of-time-ordered correlator computation and pole-skipping. We provide a comparative analysis of the results from these methods, where the features derived from the entanglement wedge and OTOC methods are equivalent. On the contrary, the butterfly velocity obtained from pole-skipping matches only when the critical exponent becomes unity, i.e., the usual asymptotically AdS black hole. Furthermore, we evaluate the chaos at the classical level by computing the eikonal phase and Lyapunov exponent from the bulk gravity. These quantities emerge as nontrivial functions of the anisotropy index. By examining the classical eikonal phase, we uncover different scattering scenarios in the near-horizon and near-boundary regimes. We also discuss potential limitations regarding the choice of the turning point of the null geodesic in our approach.


title: The Effects of Data Split Strategies on the Offline Experiments for CTR Prediction

abstract: Click-through rate (CTR) prediction is a crucial task in online advertising to recommend products that users are likely to be interested in. To identify the best-performing models, rigorous model evaluation is necessary. Offline experimentation plays a significant role in selecting models for live user-item interactions, despite the value of online experimentation like A/B testing, which has its own limitations and risks. Often, the correlation between offline performance metrics and actual online model performance is inadequate. One main reason for this discrepancy is the common practice of using random splits to create training, validation, and test datasets in CTR prediction. In contrast, real-world CTR prediction follows a temporal order. Therefore, the methodology used in offline evaluation, particularly the data splitting strategy, is crucial. This study aims to address the inconsistency between current offline evaluation methods and real-world use cases, by focusing on data splitting strategies. To examine the impact of different data split strategies on offline performance, we conduct extensive experiments using both random and temporal splits on a large open benchmark dataset, Criteo.


title: MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data

abstract: Large language models (LLMs) have significantly advanced natural language understanding and demonstrated strong problem-solving abilities. Despite these successes, most LLMs still struggle with solving mathematical problems due to the intricate reasoning required. This paper investigates the mathematical problem-solving capabilities of LLMs using the newly developed "MathOdyssey" dataset. The dataset includes diverse mathematical problems at high school and university levels, created by experts from notable institutions to rigorously test LLMs in advanced problem-solving scenarios and cover a wider range of subject areas. By providing the MathOdyssey dataset as a resource to the AI community, we aim to contribute to the understanding and improvement of AI capabilities in complex mathematical problem-solving. We conduct benchmarking on open-source models, such as Llama-3 and DBRX-Instruct, and closed-source models from the GPT series and Gemini models. Our results indicate that while LLMs perform well on routine and moderately difficult tasks, they face significant challenges with Olympiad-level problems and complex university-level questions. Our analysis shows a narrowing performance gap between open-source and closed-source models, yet substantial challenges remain, particularly with the most demanding problems. This study highlights the ongoing need for research to enhance the mathematical reasoning of LLMs. The dataset, results, and code are publicly available.


title: A new quadrature for the generalized hydrodynamics equation and absence of shocks in the Lieb-Liniger model

abstract: In conventional fluids, it is well known that Euler-scale equations are plagued by ambiguities and instabilities. Smooth initial conditions may develop shocks, and weak solutions, such as for domain wall initial conditions (the paradigmatic Riemann problem of hydrodynamics), are not unique. The absence of shock formation experimentally observed in quasi-one-dimensional cold-atomic gases, which are described by the Lieb-Liniger model, provides perhaps the strongest pointer to a modification of the hydrodynamic equation due to integrability. Generalised hydrodynamics (GHD) is the required hydrodynamic theory, taking into account the infinite number of conserved quantities afforded by integrability. We provide a new quadrature for the GHD equation -- a solution in terms of a Banach fixed-point problem where time has been explicitly integrated. In the Lieb-Liniger model, this allows us to rigorously show for the first time that, from a wide class of initial conditions including zero- and finite-entropy states, no shock may appear at all times, and weak solutions are unique and entropy-preserving. This extends known results for finite-component linearly-degenerate hydrodynamics, to the continuum of hydrodynamic modes present in GHD. The new quadrature is also an efficient solution tool, which, combined with recent hydrodynamic fluctuation theories, gives rise to new expressions for correlations in non-stationary states.


title: Transition magnetic moment of Majorana neutrinos in the triplets next-to-minimal MSSM

abstract: The TNMSSM is an attractive extension of the Standard Model. It combines the advantages of the NMSSM and the TMSSM to give three tiny Majorana neutrinos masses via a type I+II seesaw mechanism. With the on-shell renormalization scheme, we consider the neutrino masses up to one loop approximation. Applying the effective Lagrangian method, we study the transition magnetic moments of Majorana neutrinos and consider the normal hierarchy (NH) and inverse hierarchy (IH) neutrino mass spectra within the constraints of experimental data on neutrino oscillations. The solar neutrino transition magnetic moment is further deduced, and compared with the XENONnT experiment limit.


title: Single atom chemical identification of TMD defects in ambient conditions

abstract: The presence of defects in transition metal dichalcogenides (TMDs) can lead to dramatic local changes in their properties which are of interest for a range of technologies including quantum security devices, hydrogen production, and energy storage. It is therefore essential to be able to study these materials in their native environments, including ambient conditions. Here we report single atom resolution imaging of atomic defects in MoS2, WSe2 and WS2 monolayers carried out in ambient conditions using conductive atomic force microscopy (C-AFM). By comparing measurements from a range of TMDs we use C-AFM to chemically identify the most likely atomic species for the defects observed and quantify their prevalence on each material, identifying oxygen chalcogen substitutions and transition metal substitutions as the most likely, and most common, defect types. Moreover, we demonstrate that C-AFM operated in ambient environments can resolve subtle changes in electronic structure with atomic resolution, which we apply to WSe2 monolayers doped using a nitrogen plasma, demonstrating the capability of C-AFM to resolve electronic, and chemical-specific, details at the atomic scale.


title: Linear codes with few weights over $\mathbb{F}_{p}+u\mathbb{F}_{p}$

abstract: For any positive integer $m$ and an odd prime $p$; let $\mathbb{F}_{q}+u\mathbb{F}_{q}$, where $q=p^{m}$, be a ring extension of the ring $\mathbb{F}_{p}+u\mathbb{F}_{p}.$ In this paper, we construct linear codes over $\mathbb{F}_{p}+u\mathbb{F}_{p}$ by using trace function defined on $\mathbb{F}_{q}+u\mathbb{F}_{q}$ and determine their Hamming weight distributions by employing symplectic-weight distributions of their Gray images.


title: PaCoST: Paired Confidence Significance Testing for Benchmark Contamination Detection in Large Language Models

abstract: Large language models (LLMs) are known to be trained on vast amounts of data, which may unintentionally or intentionally include data from commonly used benchmarks. This inclusion can lead to cheatingly high scores on model leaderboards, yet result in disappointing performance in real-world applications. To address this benchmark contamination problem, we first propose a set of requirements that practical contamination detection methods should follow. Following these proposed requirements, we introduce PaCoST, a Paired Confidence Significance Testing to effectively detect benchmark contamination in LLMs. Our method constructs a counterpart for each piece of data with the same distribution, and performs statistical analysis of the corresponding confidence to test whether the model is significantly more confident under the original benchmark. We validate the effectiveness of PaCoST and apply it on popular open-source models and benchmarks. We find that almost all models and benchmarks we tested are suspected contaminated more or less. We finally call for new LLM evaluation methods.


title: Multi-modal Evidential Fusion Network for Trusted PET/CT Tumor Segmentation

abstract: Accurate segmentation of tumors in PET/CT images is important in computer-aided diagnosis and treatment of cancer. The key issue of such a segmentation problem lies in the effective integration of complementary information from PET and CT images. However, the quality of PET and CT images varies widely in clinical settings, which leads to uncertainty in the modality information extracted by networks. To take the uncertainty into account in multi-modal information fusion, this paper proposes a novel Multi-modal Evidential Fusion Network (MEFN) comprising a Cross-Modal Feature Learning (CFL) module and a Multi-modal Trusted Fusion (MTF) module. The CFL module reduces the domain gap upon modality conversion and highlights common tumor features, thereby alleviating the needs of the segmentation module to handle modality specificity. The MTF module utilizes mutual attention mechanisms and an uncertainty calibrator to fuse modality features based on modality uncertainty and then fuse the segmentation results under the guidance of Dempster-Shafer Theory. Besides, a new uncertainty perceptual loss is introduced to force the model focusing on uncertain features and hence improve its ability to extract trusted modality information. Extensive comparative experiments are conducted on two publicly available PET/CT datasets to evaluate the performance of our proposed method whose results demonstrate that our MEFN significantly outperforms state-of-the-art methods with improvements of 2.15% and 3.23% in DSC scores on the AutoPET dataset and the Hecktor dataset, respectively. More importantly, our model can provide radiologists with credible uncertainty of the segmentation results for their decision in accepting or rejecting the automatic segmentation results, which is particularly important for clinical applications. Our code will be available at https://github.com/QPaws/MEFN.


title: PDFA Distillation via String Probability Queries {PDFA Distillation via String Probability Queries}

abstract: Probabilistic deterministic finite automata (PDFA) are discrete event systems modeling conditional probabilities over languages: Given an already seen sequence of tokens they return the probability of tokens of interest to appear next. These types of models have gained interest in the domain of explainable machine learning, where they are used as surrogate models for neural networks trained as language models. In this work we present an algorithm to distill PDFA from neural networks. Our algorithm is a derivative of the L# algorithm and capable of learning PDFA from a new type of query, in which the algorithm infers conditional probabilities from the probability of the queried string to occur. We show its effectiveness on a recent public dataset by distilling PDFA from a set of trained neural networks.


title: Quasinormal modes, thermodynamics and shadow of black holes in Hu-Sawicki f(R) gravity theory

abstract: We derive novel black hole solutions in a modified gravity theory, namely the Hu-Sawicki model of $f(R)$ gravity. After obtaining the black hole solution, we study the horizon radius of the black hole from the metric and then analyse the dependence of the model parameters on the horizon. We then use the 6th-order WKB method to study the quasinormal modes of oscillations (QNMs) of the black hole perturbed by a scalar field. The dependence of the amplitude and damping part of the QNMs are analysed with respect to variations in model parameters and the errors associated with the QNMs are also computed. After that, we study some thermodynamic properties associated with the black hole such as its thermodynamic temperature as well as greybody factors. It is found that the black hole has the possibility of showcasing negative temperatures. We also analyse the geodesics and derive the photon sphere radius as well as the shadow radius of the black hole. The photon radius is independent of the model parameters while the shadow radius showed a fair amount of dependence on the model parameters. We tried to constrain the parameters with the help of Keck and VLTI observational data and obtained some bounds on $m$ and $c_{2}$ parameters.


title: Molecular Diffusion Models with Virtual Receptors

abstract: Machine learning approaches to Structure-Based Drug Design (SBDD) have proven quite fertile over the last few years. In particular, diffusion-based approaches to SBDD have shown great promise. We present a technique which expands on this diffusion approach in two crucial ways. First, we address the size disparity between the drug molecule and the target/receptor, which makes learning more challenging and inference slower. We do so through the notion of a Virtual Receptor, which is a compressed version of the receptor; it is learned so as to preserve key aspects of the structural information of the original receptor, while respecting the relevant group equivariance. Second, we incorporate a protein language embedding used originally in the context of protein folding. We experimentally demonstrate the contributions of both the virtual receptors and the protein embeddings: in practice, they lead to both better performance, as well as significantly faster computations.


title: RISTRETTO: Manufacturing of a single-mode visible high resolution spectrograph

abstract: The Spectrograph of the RISTRETTO instrument is now currently being manufactured. RISTETTO is an instrument designed to detect and characterize the reflected light of nearby exoplanets. It combines high contrast imaging and high resolution spectroscopy to detect the light of exoplanets. The high resolution spectrograph subject of this paper uses the doppler effect to disentangle the planetary signal from the stellar light leaks. In this paper we describe the final design of the spectrograph and report the status of its construction. The RISTRETTO spectrograph has seven diffraction limited spaxels. The spectrograph's resolution is 130000 in the 620-840 nm band. It is designed in a similar way as HARPS and ESPRESSO, being a warm, thermally controlled spectrograph under vacuum. It is designed to be compact and self contained so that it could be installed on different telescopes. It is however tailored to be installed on a nasmyth platform of a VLT telescope. We present updates to the design and the manufacturing of the instrument. In particular we present the performance of the thermal enclosure.


title: Early Classification of Time Series: Taxonomy and Benchmark

abstract: In many situations, the measurements of a studied phenomenon are provided sequentially, and the prediction of its class needs to be made as early as possible so as not to incur too high a time penalty, but not too early and risk paying the cost of misclassification. This problem has been particularly studied in the case of time series, and is known as Early Classification of Time Series (ECTS). Although it has been the subject of a growing body of literature, there is still a lack of a systematic, shared evaluation protocol to compare the relative merits of the various existing methods. This document begins by situating these methods within a principle-based taxonomy. It defines dimensions for organizing their evaluation, and then reports the results of a very extensive set of experiments along these dimensions involving nine state-of-the art ECTS algorithms. In addition, these and other experiments can be carried out using an open-source library in which most of the existing ECTS algorithms have been implemented (see \url{https://github.com/ML-EDM/ml_edm}).


title: Continuous Sign Language Recognition Using Intra-inter Gloss Attention

abstract: Many continuous sign language recognition (CSLR) studies adopt transformer-based architectures for sequence modeling due to their powerful capacity for capturing global contexts. Nevertheless, vanilla self-attention, which serves as the core module of the transformer, calculates a weighted average over all time steps; therefore, the local temporal semantics of sign videos may not be fully exploited. In this study, we introduce a novel module in sign language recognition studies, called intra-inter gloss attention module, to leverage the relationships among frames within glosses and the semantic and grammatical dependencies between glosses in the video. In the intra-gloss attention module, the video is divided into equally sized chunks and a self-attention mechanism is applied within each chunk. This localized self-attention significantly reduces complexity and eliminates noise introduced by considering non-relative frames. In the inter-gloss attention module, we first aggregate the chunk-level features within each gloss chunk by average pooling along the temporal dimension. Subsequently, multi-head self-attention is applied to all chunk-level features. Given the non-significance of the signer-environment interaction, we utilize segmentation to remove the background of the videos. This enables the proposed model to direct its focus toward the signer. Experimental results on the PHOENIX-2014 benchmark dataset demonstrate that our method can effectively extract sign language features in an end-to-end manner without any prior knowledge, improve the accuracy of CSLR, and achieve the word error rate (WER) of 20.4 on the test set which is a competitive result compare to the state-of-the-art which uses additional supervisions.


title: Efficient and Accurate Explanation Estimation with Distribution Compression

abstract: Exact computation of various machine learning explanations requires numerous model evaluations and in extreme cases becomes impractical. The computational cost of approximation increases with an ever-increasing size of data and model parameters. Many heuristics have been proposed to approximate post-hoc explanations efficiently. This paper shows that the standard i.i.d. sampling used in a broad spectrum of algorithms for explanation estimation leads to an approximation error worthy of improvement. To this end, we introduce Compress Then Explain (CTE), a new paradigm for more efficient and accurate explanation estimation. CTE uses distribution compression through kernel thinning to obtain a data sample that best approximates the marginal distribution. We show that CTE improves the estimation of removal-based local and global explanations with negligible computational overhead. It often achieves an on-par explanation approximation error using 2-3x less samples, i.e. requiring 2-3x less model evaluations. CTE is a simple, yet powerful, plug-in for any explanation method that now relies on i.i.d. sampling.