title: Free Proxies Unmasked: A Vulnerability and Longitudinal Analysis of Free Proxy Services

abstract: Free-proxies have been widespread since the early days of the Web, helping users bypass geo-blocked content and conceal their IP addresses. Various proxy providers promise faster Internet or increased privacy while advertising their lists comprised of hundreds of readily available free proxies. However, while paid proxy services advertise the support of encrypted connections and high stability, free proxies often lack such guarantees, making them prone to malicious activities such as eavesdropping or modifying content. Furthermore, there is a market that encourages exploiting devices to install proxies. In this paper, we present a 30-month longitudinal study analyzing the stability, security, and potential manipulation of free web proxies that we collected from 11 providers. Our collection resulted in over 640,600 proxies, that we cumulatively tested daily. We find that only 34.5% of proxies were active at least once during our tests, showcasing the general instability of free proxies. Geographically, a majority of proxies originate from the US and China. Leveraging the Shodan search engine, we identified 4,452 distinct vulnerabilities on the proxies' IP addresses, including 1,755 vulnerabilities that allow unauthorized remote code execution and 2,036 that enable privilege escalation on the host device. Through the software analysis on the proxies' IP addresses, we find that 42,206 of them appear to run on MikroTik routers. Worryingly, we also discovered 16,923 proxies that manipulate content, indicating potential malicious intent by proxy owners. Ultimately, our research reveals that the use of free web proxies poses significant risks to users' privacy and security. The instability, vulnerabilities, and potential for malicious actions uncovered in our analysis lead us to strongly caution users against relying on free proxies.


title: On Latency Predictors for Neural Architecture Search

abstract: Efficient deployment of neural networks (NN) requires the co-optimization of accuracy and latency. For example, hardware-aware neural architecture search has been used to automatically find NN architectures that satisfy a latency constraint on a specific hardware device. Central to these search algorithms is a prediction model that is designed to provide a hardware latency estimate for a candidate NN architecture. Recent research has shown that the sample efficiency of these predictive models can be greatly improved through pre-training on some \textit{training} devices with many samples, and then transferring the predictor on the \textit{test} (target) device. Transfer learning and meta-learning methods have been used for this, but often exhibit significant performance variability. Additionally, the evaluation of existing latency predictors has been largely done on hand-crafted training/test device sets, making it difficult to ascertain design features that compose a robust and general latency predictor. To address these issues, we introduce a comprehensive suite of latency prediction tasks obtained in a principled way through automated partitioning of hardware device sets. We then design a general latency predictor to comprehensively study (1) the predictor architecture, (2) NN sample selection methods, (3) hardware device representations, and (4) NN operation encoding schemes. Building on conclusions from our study, we present an end-to-end latency predictor training strategy that outperforms existing methods on 11 out of 12 difficult latency prediction tasks, improving latency prediction by 22.5\% on average, and up to to 87.6\% on the hardest tasks. Focusing on latency prediction, our HW-Aware NAS reports a $5.8\times$ speedup in wall-clock time. Our code is available on \href{https://github.com/abdelfattah-lab/nasflat_latency}{https://github.com/abdelfattah-lab/nasflat\_latency}.


title: Compact Einstein-type manifolds with parallel Ricci tensor

abstract: In this paper, we deduce a Bochner-type identity for compact gradient Einstein-type manifolds with boundary. As consequence, we are able to show a rigidity result for Einstein-type manifolds assuming the parallel Ricci curvature condition. Moreover, we provide a condition on the norm of the gradient of the potential function in order to classify such structures.


title: Soft quasi-Newton: Guaranteed positive definiteness by relaxing the secant constraint

abstract: We propose a novel algorithm, termed soft quasi-Newton (soft QN), for optimization in the presence of bounded noise. Traditional quasi-Newton algorithms are vulnerable to such perturbations. To develop a more robust quasi-Newton method, we replace the secant condition in the matrix optimization problem for the Hessian update with a penalty term in its objective and derive a closed-form update formula. A key feature of our approach is its ability to maintain positive definiteness of the Hessian inverse approximation. Furthermore, we establish the following properties of soft QN: it recovers the BFGS method under specific limits, it treats positive and negative curvature equally, and it is scale invariant. Collectively, these features enhance the efficacy of soft QN in noisy environments. For strongly convex objective functions and Hessian approximations obtained using soft QN, we develop an algorithm that exhibits linear convergence toward a neighborhood of the optimal solution, even if gradient and function evaluations are subject to bounded perturbations. Through numerical experiments, we demonstrate superior performance of soft QN compared to state-of-the-art methods in various scenarios.


title: Optimizing Illuminant Estimation in Dual-Exposure HDR Imaging

abstract: High dynamic range (HDR) imaging involves capturing a series of frames of the same scene, each with different exposure settings, to broaden the dynamic range of light. This can be achieved through burst capturing or using staggered HDR sensors that capture long and short exposures simultaneously in the camera image signal processor (ISP). Within camera ISP pipeline, illuminant estimation is a crucial step aiming to estimate the color of the global illuminant in the scene. This estimation is used in camera ISP white-balance module to remove undesirable color cast in the final image. Despite the multiple frames captured in the HDR pipeline, conventional illuminant estimation methods often rely only on a single frame of the scene. In this paper, we explore leveraging information from frames captured with different exposure times. Specifically, we introduce a simple feature extracted from dual-exposure images to guide illuminant estimators, referred to as the dual-exposure feature (DEF). To validate the efficiency of DEF, we employed two illuminant estimators using the proposed DEF: 1) a multilayer perceptron network (MLP), referred to as exposure-based MLP (EMLP), and 2) a modified version of the convolutional color constancy (CCC) to integrate our DEF, that we call ECCC. Both EMLP and ECCC achieve promising results, in some cases surpassing prior methods that require hundreds of thousands or millions of parameters, with only a few hundred parameters for EMLP and a few thousand parameters for ECCC.


title: Exposure Conscious Path Planning for Equal Exposure Corridors

abstract: While maximizing line-of-sight coverage of specific regions or agents in the environment is a well-explored path planning objective, the converse problem of minimizing exposure to the entire environment during navigation is especially interesting in the context of minimizing detection risk. This work demonstrates that minimizing line-of-sight exposure to the environment is non-Markovian, which cannot be efficiently solved optimally with traditional path planning. The optimality gap of the graph-search algorithm A* and the trade-offs in optimality vs. computation time of several approximating heuristics is explored. Finally, the concept of equal-exposure corridors, which afford polynomial time determination of all paths that do not increase exposure, is presented.


title: Views Are My Own, but Also Yours: Benchmarking Theory of Mind Using Common Ground

abstract: Evaluating the theory of mind (ToM) capabilities of language models (LMs) has recently received a great deal of attention. However, many existing benchmarks rely on synthetic data, which risks misaligning the resulting experiments with human behavior. We introduce the first ToM dataset based on naturally occurring spoken dialogs, Common-ToM, and show that LMs struggle to demonstrate ToM. We then show that integrating a simple, explicit representation of beliefs improves LM performance on Common-ToM.


title: Programming the scalable optical learning operator with spatial-spectral optimization

abstract: Electronic computers have evolved drastically over the past years with an ever-growing demand for improved performance. However, the transfer of information from memory and high energy consumption have emerged as issues that require solutions. Optical techniques are considered promising solutions to these problems with higher speed than their electronic counterparts and with reduced energy consumption. Here, we use the optical reservoir computing framework we have previously described (Scalable Optical Learning Operator or SOLO) to program the spatial-spectral output of the light after nonlinear propagation in a multimode fiber. The novelty in the current paper is that the system is programmed through an output sampling scheme, similar to that used in hyperspectral imaging in astronomy. Linear and nonlinear computations are performed by light in the multimode fiber and the high dimensional spatial-spectral information at the fiber output is optically programmed before it reaches the camera. We then used a digital computer to classify the programmed output of the multi-mode fiber using a simple, single layer network. When combining front-end programming and the proposed spatial-spectral programming, we were able to achieve 89.9% classification accuracy on the dataset consisting of chest X-ray images from COVID-19 patients. At the same time, we obtained a decrease of 99% in the number of tunable parameters compared to an equivalently performing digital neural network. These results show that the performance of programmed SOLO is comparable with cutting-edge electronic computing platforms, albeit with a much-reduced number of electronic operations.


title: Charge and spin fluctuations in superconductors with intersublattice and interorbital interactions

abstract: Multiband superconductors have featured one of the main challenges to achieve a comprehensive understanding of unconventional superconductivity. Here, the multiband character is studied separately as orbital and sublattice degrees of freedom, as they have different effects for the superconducting and magnetic or charge orders. We build on the framework of the matrix random-phase approximation (RPA), which accounts for the RPA Feynman diagrams and also vertex corrections, to treat the electron-electron interactions in an off-site degenerate Hubbard model. As a result, systems without a sublattice degree of freedom tend to be dominated by spin fluctuations, while systems with multiple sublattice sites and orbitals have the charge fluctuations favored. Finally, we explicitly demonstrate that the known suppression of the superconducting pairing strength $\lambda$ by spin fluctuations from repulsive interactions at zero momentum transfer $\boldsymbol{q}$ is countered by the finite-$\boldsymbol{q}$ pairing, which always improves $\lambda$.


title: The Ink Splotch Effect: A Case Study on ChatGPT as a Co-Creative Game Designer

abstract: This paper studies how large language models (LLMs) can act as effective, high-level creative collaborators and ``muses'' for game design. We model the design of this study after the exercises artists use by looking at amorphous ink splotches for creative inspiration. Our goal is to determine whether AI-assistance can improve, hinder, or provide an alternative quality to games when compared to the creative intents implemented by human designers. The capabilities of LLMs as game designers are stress tested by placing it at the forefront of the decision making process. Three prototype games are designed across 3 different genres: (1) a minimalist base game, (2) a game with features and game feel elements added by a human game designer, and (3) a game with features and feel elements directly implemented from prompted outputs of the LLM, ChatGPT. A user study was conducted and participants were asked to blindly evaluate the quality and their preference of these games. We discuss both the development process of communicating creative intent to an AI chatbot and the synthesized open feedback of the participants. We use this data to determine both the benefits and shortcomings of AI in a more design-centric role.


title: The quest to discover supersymmetry at the ATLAS experiment

abstract: The search for supersymmetry with the ATLAS experiment at the CERN Large Hadron Collider intensified after the discovery of the Higgs boson in 2012. The search programme expanded in both breadth and depth, profiting from the increased integrated luminosity and higher centre-of-mass energy of Run 2, and gaining new sensitivity to unexplored areas of supersymmetry parameter space through the use of new experimental signatures and innovative analysis techniques. This report summarises the supersymmetry searches at ATLAS using up to 140 fb$^{-1}$ of $pp$ collisions at $\sqrt{s} = 13$ TeV, including the limits set on the production of gluinos, squarks, and electroweakinos for scenarios either with or without R-parity conservation, and including models where some of the supersymmetric particles are long-lived.


title: Benchmarking the IRDC G351.77-0.53: Gaia DR3 distance, mass distribution, and star formation content

abstract: While intensively studied, it remains unclear how the star formation (SF) in Infrared Dark Clouds (IRDCs) compares to that of nearby clouds. We study G351.77-0.53 (henceforth G351), a cluster-forming filamentary IRDC. We begin by characterizing its young stellar object (YSO) content. Based on the average parallax of likely members, we obtain a Gaia distance of $\sim\,2.0\pm0.14$ kpc, resolving the literature distance ambiguity. Using our Herschel-derived N(H$_2$) map, we measure a total gas mass of 10200 M$_{\odot}$ (within 11 pc$^2$) and the average line-mass profile of the entire filament, which we model as $\lambda =~1660 (w/\rm pc )^{0.62}\,\,M_{\odot}\,\rm{pc}^{-1}$. At $w < 0.63$ pc, our $\lambda$ profile is higher and has a steeper power-law index than $\lambda$ profiles extracted in Orion A and most of its substructures. Based on the YSOs inside the filament area, we estimate the SF efficiency (SFE) and SF rate (SFR). We calculate a factor of 5 incompleteness correction for our YSO catalog relative to Spitzer surveys of Orion A. The G351 SFE is $\sim 1.8$ times lower than that of Orion A and lower than the median value for local clouds. We measure SFR and gas masses to estimate the efficiency per free-fall time, $\epsilon _{\rm ff}$. We find that $\epsilon_{\rm ff}$ is $\sim$ 1.1 dex below the previously proposed mean local relation, and $\sim\,4.7\times$ below Orion A. These observations indicate that local SF-relations do not capture variations present in the Galaxy. We speculate that cloud youth and/or magnetic fields might account for the G351 inefficiency.


title: The relationships among solar flare impulsiveness, energy release, and ribbon development

abstract: We develop the impulsiveness index, a new classification system for solar flares using the SDO/EVE 304 {\AA} Sun-as-a-star light curves. Impulsiveness classifies events based on the duration and intensity of the initial high-energy deposition of energy into the chromosphere. In stellar flare U-band light curves, Kowalski et al. (2013) found that impulsiveness is related to quantities such as a proxy for the Balmer jump ratio. However, the lack of direct spatial resolution in stellar flares limits our ability to explain this phenomenon. We calculate impulsiveness for 1368 solar flares between 04/2010 and 05/2014. We divide events into categories of low, mid, and high impulsiveness. We find, in a sample of 480 flares, that events with high maximum reconnection rate tend to also have high impulsiveness. For six case studies, we compare impulsiveness to magnetic shear, ribbon evolution, and energy release. We find that the end of the 304 {\AA} light curve rise phase in these case studies corresponds to the cessation of PIL-parallel ribbon motion, while PIL-perpendicular motion persists afterward in most cases. The measured guide field ratio for low and mid-impulsiveness case study flares decreases about an order of magnitude during the impulsive flare phase. Finally, we find that, in four of the six case studies, flares with higher, more persistent shear tend to have low impulsiveness. Our study suggests that impulsiveness may be related to other properties of the impulsive phase, though more work is needed to verify this relationship and apply our findings to stellar flare physics.


title: Saturated Partial Embeddings of Planar Graphs

abstract: In this work, we study how far one can deviate from optimal behavior when embedding a planar graph. For a planar graph $G$, we say that a plane subgraph $H\subseteq G$ is a \textit{plane-saturated subgraph} if adding any edge (possibly with new vertices) to $H$ would either violate planarity or make the resulting graph no longer a subgraph of $G$. For a planar graph $G$, we define the \textit{plane-saturation ratio}, $\psr(G)$, as the minimum value of $\frac{e(H)}{e(G)}$ for a plane-saturated subgraph $H$ of $G$ and investigate how small $\psr(G)$ can be. While there exist planar graphs where $\psr(G)$ is arbitrarily close to $0$, we show that for all twin-free planar graphs, $\psr(G)>1/16$, and that there exist twin-free planar graphs where $\psr(G)$ is arbitrarily close to $1/16$. In fact, we study a broader category of planar graphs, focusing on classes characterized by a bounded number of degree $1$ and degree $2$ twin vertices. We offer solutions for some instances of bounds while positing conjectures for the remaining ones.


title: Cybersecurity competence of older adult users of mobile devices

abstract: This work reports on a cross-sectional study on device proficiency, support availability and cybersecurity competence of older adult users of smartphones and/or tablets. Results indicate that cybersecurity competence is associated with both device proficiency and support availability although the variance explained is relatively low. There were no differences in cybersecurity competence between users and non-users of either mobile devices. Users of both smartphones and tablets had significantly higher device proficiency than non-users. Users of tablets had significantly higher support availability than non-users while there were no significant differences between users and non-users of smartphones.


title: MagicClay: Sculpting Meshes With Generative Neural Fields

abstract: The recent developments in neural fields have brought phenomenal capabilities to the field of shape generation, but they lack crucial properties, such as incremental control - a fundamental requirement for artistic work. Triangular meshes, on the other hand, are the representation of choice for most geometry related tasks, offering efficiency and intuitive control, but do not lend themselves to neural optimization. To support downstream tasks, previous art typically proposes a two-step approach, where first a shape is generated using neural fields, and then a mesh is extracted for further processing. Instead, in this paper we introduce a hybrid approach that maintains both a mesh and a Signed Distance Field (SDF) representations consistently. Using this representation, we introduce MagicClay - an artist friendly tool for sculpting regions of a mesh according to textual prompts while keeping other regions untouched. Our framework carefully and efficiently balances consistency between the representations and regularizations in every step of the shape optimization; Relying on the mesh representation, we show how to render the SDF at higher resolutions and faster. In addition, we employ recent work in differentiable mesh reconstruction to adaptively allocate triangles in the mesh where required, as indicated by the SDF. Using an implemented prototype, we demonstrate superior generated geometry compared to the state-of-the-art, and novel consistent control, allowing sequential prompt-based edits to the same mesh for the first time.


title: Electroweak metastability and Higgs inflation

abstract: Extrapolating the Standard Model Higgs potential at high energies, we study the barrier between the electroweak and Planck scale minima. The barrier arises by taking the central values of the relevant experimental inputs, that is the strong coupling constant and the top quark and Higgs masses. We then extend the Standard Model by including a non-minimal coupling to gravity, and explore the phenomenology of the Higgs inflation model. We point out that even configurations that would be metastable in the Standard Model, become viable for inflation if the non-minimal coupling is large enough to flatten the Higgs potential at field values below the barrier; we find that the required value of the non-minimal coupling is smaller than the one needed for the conventional Higgs inflation scenario (which relies on a stable Standard Model Higgs potential, without any barrier); in addition, values of the top mass which are slightly larger than those required in the conventional scenario are allowed.


title: Edge states for tight-binding operators with soft walls

abstract: We study one- and two-dimensional periodic tight-binding models under the presence of a potential that grows to infinity in one direction, hence preventing the particles to escape in this direction (the soft wall). We prove that a spectral flow appears in these corresponding edge models, as the wall is shifted. We identity this flow as a number of Bloch bands, and provide a lower bound for the number of edge states appearing in such models.

categories: math-ph cond-mat.mtrl-sci math.MP math.SP


title: Tuning charge density wave of kagome metal ScV6Sn6

abstract: Compounds with a kagome lattice exhibit intriguing properties and the charge density wave (CDW) adds an additional layer of interest to research on them. In this study, we investigate the temperature and magnetic field dependent electrical properties under a chemical substitution and hydrostatic pressure of ScV6Sn6, a non-magnetic charge density wave (CDW) compound. Substituting 5 % Cr at the V site or applying 1.5 GPa of pressure shifts the CDW to 50 K from 92 K. This shift is attributed to the movement of the imaginary phonon band, as revealed by the phonon dispersion relation. The longitudinal and Hall resistivities respond differently under these stimuli. The magnetoresistance (MR) maintains its quasilinear behavior under pressure, but it becomes quadratic after Cr substitution. The anomalous Hall-like behavior of the parent compound persists up to the respective CDW transition under pressure, after which it sharply declines. In contrast, the longitudinal and Hall resistivities of Cr substituted compounds follow a two-band model and originates from the multi carrier effect. These results clearly highlight the role of phonon contributions in the CDW transition and call for further investigation into the origin of the anomalous Hall-like behavior in the parent compound.


title: Exploring Standing and Reflected Slow-mode Waves in Flaring Coronal Loops: A Parametric Study Using 2.5D MHD Modeling

abstract: Recent observations of reflected propagating and standing slow-mode waves in hot flaring coronal loops have spurred our investigation into their underlying excitation and damping mechanisms. To understand these processes, we conduct 2.5D magnetohydrodynamic (MHD) simulations using an arcade active region model that includes a hot and dense loop. Our simulations allow for in-depth parametric investigations complementing and expanding our previous 3D MHD modeling results. We excite these waves in two distinct models as motivated by observations from the SDO/AIA. Model 1 incorporates classical compressive viscosity coefficient, while Model 2 adopts a 10-times enhanced viscosity coefficient. We find that: (1) Our 2.5D MHD simulations reinforce previous conclusions derived from 1D and 3D MHD models that significantly enhanced viscosity is crucial for the rapid excitation of standing slow waves with damping times consistent with observations by Wang et al. (2015). (2) We uncover that nonlinearity in Model 1 delays the conversion of a reflected propagating wave into a standing wave. In contrast, Model 2 exhibits a much weak influence of nonlinearity. (3) Our results reveal that the transverse temperature structure holds more influence on wave behavior than the density structure. In Model 1, increased loop temperature contrast significantly enhances wave trapping within the structure, mitigating the impact of temperature-dependent viscous damping. Conversely, in Model 2, the impact of temperature structure on wave behavior weakens in comparison to the effect of viscosity. (4) Model 1 displays evident nonlinear coupling to the fast and kink magnetoacoustic waves and pronounced wave leakage into the corona. However, analyzing three observed wave events by SDO/AIA aligns with Model 2 predictions, providing further support for the substantial viscosity increase.


title: Equivariant automorphisms of the Cox construction and applications

abstract: In the present paper, we give a complete description of the group of holomorphic automorphisms of the Cox construction of a simplicial fan equivariant with respect to a large enough connected complex Lie subgroup of the large torus acting on the Cox construction. We then apply this description to find the groups of holomorphic automorphisms of rational moment-angle manifolds, including Calabi--Eckmann manifolds and Hopf manifolds. We also calculate the groups of equivariant automorphisms of complete simplicial toric varieties. This paper is the first in a series of two papers dedicated to studying the automorphism groups of toric stacks with applications to complex geometry.


title: Cosmic-ray diffusion in two local filamentary clouds

abstract: A fairly uniform cosmic-ray (CR) distribution is observed near the Sun, except in the nearby Eridu cloud, which shows an unexplained 30-50% deficit in GeV to TeV CR flux. To explore the origin of this deficit, we studied the Reticulum cloud, which shares notable traits with Eridu: a comparable distance in the low-density region of the Local Valley and a filamentary structure of atomic hydrogen extending along ordered magnetic-field lines that are steeply inclined to the Galactic plane. Using 14 years of Fermi-LAT data in the 0.16 to 63 GeV energy band, we found that the gamma-ray emissivity in the Reticulum cloud is fully consistent with the average spectrum measured in the solar neighbourhood, but this emissivity, and therefore the CR flux, is 1.57 $\pm$ 0.09 times larger than in Eridu across the whole energy band. The difference cannot be attributed to uncertainties in gas mass. Nevertheless, we find that the two clouds are similar in many respects at a parsec scale: both have magnetic-field strengths of a few micro-Gauss in the plane of the sky; both are in approximate equilibrium between magnetic and thermal pressures; they have similar turbulent velocities and sonic Mach numbers; and both show magnetic-field regularity with a dispersion in orientation lower than 10-15 degrees over large zones. The gas in Reticulum is colder and denser than in Eridu, but we find similar parallel diffusion coefficients around a few times 1e28 cm2/s in both clouds if CRs above 1 GV in rigidity diffuse on resonant, self-excited Alfv\'en waves that are damped by ion-neutral interactions. The loss of CRs in Eridu remains unexplained, but these two clouds provide important test cases to further study how magnetic turbulence, line tangling, and ion-neutral damping regulate CR diffusion in the dominant gas phase of the interstellar medium.


title: Applied Causal Inference Powered by ML and AI

abstract: An introduction to the emerging fusion of machine learning and causal inference. The book presents ideas from classical structural equation models (SEMs) and their modern AI equivalent, directed acyclical graphs (DAGs) and structural causal models (SCMs), and covers Double/Debiased Machine Learning methods to do inference in such models using modern predictive tools.


title: A Primal-dual hybrid gradient method for solving optimal control problems and the corresponding Hamilton-Jacobi PDEs

abstract: Optimal control problems are crucial in various domains, including path planning, robotics, and humanoid control, demonstrating their broad applicability. The connection between optimal control and Hamilton-Jacobi (HJ) partial differential equations (PDEs) underscores the need for solving HJ PDEs to address these control problems effectively. While numerous numerical methods exist for tackling HJ PDEs across different dimensions, this paper introduces an innovative optimization-based approach that reformulates optimal control problems and HJ PDEs into a saddle point problem using a Lagrange multiplier. Our method, based on the preconditioned primal-dual hybrid gradient (PDHG) method, offers a solution to HJ PDEs with first-order accuracy and numerical unconditional stability, enabling larger time steps and avoiding the limitations of explicit time discretization methods. Our approach has ability to handle a wide variety of Hamiltonian functions, including those that are non-smooth and dependent on time and space, through a simplified saddle point formulation that facilitates easy and parallelizable updates. Furthermore, our framework extends to viscous HJ PDEs and stochastic optimal control problems, showcasing its versatility. Through a series of numerical examples, we demonstrate the method's effectiveness in managing diverse Hamiltonians and achieving efficient parallel computation, highlighting its potential for wide-ranging applications in optimal control and beyond.


title: Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review

abstract: Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare, focusing on models designed for medical report generation and visual question answering (VQA). We provide background on NLP and CV, explaining how techniques from both fields are integrated into VLMs to enable learning from multimodal data. Key areas we address include the exploration of medical vision-language datasets, in-depth analyses of architectures and pre-training strategies employed in recent noteworthy medical VLMs, and comprehensive discussion on evaluation metrics for assessing VLMs' performance in medical report generation and VQA. We also highlight current challenges and propose future directions, including enhancing clinical validity and addressing patient privacy concerns. Overall, our review summarizes recent progress in developing VLMs to harness multimodal medical data for improved healthcare applications.


title: Improved modeling of in-ice particle showers for IceCube event reconstruction

abstract: The IceCube Neutrino Observatory relies on an array of photomultiplier tubes to detect Cherenkov light produced by charged particles in the South Pole ice. IceCube data analyses depend on an in-depth characterization of the glacial ice, and on novel approaches in event reconstruction that utilize fast approximations of photoelectron yields. Here, a more accurate model is derived for event reconstruction that better captures our current knowledge of ice optical properties. When evaluated on a Monte Carlo simulation set, the median angular resolution for in-ice particle showers improves by over a factor of three compared to a reconstruction based on a simplified model of the ice. The most substantial improvement is obtained when including effects of birefringence due to the polycrystalline structure of the ice. When evaluated on data classified as particle showers in the high-energy starting events sample, a significantly improved description of the events is observed.


title: Anisotropic examples of inflation-generating initial conditions for the big bang

abstract: The inflationary scenario, which states that the early universe underwent a brief but dramatic period of accelerated spatial expansion, has become the current paradigm of early universe cosmology. Although inflationary cosmology has its many successes, it does not (as of yet) have the status of an established physical theory. In this paper, we provide mathematical support for the inflationary scenario in a class of anisotropic spacetimes by generalizing the work in [21]. These anisotropic spacetimes satisfy certain initial conditions so that they are perfectly isotropic at the big bang but become less isotropic as time progresses. The resulting inflationary eras are a consequence of the initial conditions which force the energy-momentum tensor to be dominated by a cosmological constant at the big bang.


title: OffensiveLang: A Community Based Implicit Offensive Language Dataset

abstract: The widespread presence of hateful languages on social media has resulted in adverse effects on societal well-being. As a result, addressing this issue with high priority has become very important. Hate speech or offensive languages exist in both explicit and implicit forms, with the latter being more challenging to detect. Current research in this domain encounters several challenges. Firstly, the existing datasets primarily rely on the collection of texts containing explicit offensive keywords, making it challenging to capture implicitly offensive contents that are devoid of these keywords. Secondly, common methodologies tend to focus solely on textual analysis, neglecting the valuable insights that community information can provide. In this research paper, we introduce a novel dataset OffensiveLang, a community based implicit offensive language dataset generated by ChatGPT 3.5 containing data for 38 different target groups. Despite limitations in generating offensive texts using ChatGPT due to ethical constraints, we present a prompt-based approach that effectively generates implicit offensive languages. To ensure data quality, we evaluate the dataset with human. Additionally, we employ a prompt-based zero-shot method with ChatGPT and compare the detection results between human annotation and ChatGPT annotation. We utilize existing state-of-the-art models to see how effective they are in detecting such languages. The dataset is available here: https://github.com/AmitDasRup123/OffensiveLang


title: When do Convolutional Neural Networks Stop Learning?

abstract: Convolutional Neural Networks (CNNs) have demonstrated outstanding performance in computer vision tasks such as image classification, detection, segmentation, and medical image analysis. In general, an arbitrary number of epochs is used to train such neural networks. In a single epoch, the entire training data -- divided by batch size -- are fed to the network. In practice, validation error with training loss is used to estimate the neural network's generalization, which indicates the optimal learning capacity of the network. Current practice is to stop training when the training loss decreases and the gap between training and validation error increases (i.e., the generalization gap) to avoid overfitting. However, this is a trial-and-error-based approach which raises a critical question: Is it possible to estimate when neural networks stop learning based on training data? This research work introduces a hypothesis that analyzes the data variation across all the layers of a CNN variant to anticipate its near-optimal learning capacity. In the training phase, we use our hypothesis to anticipate the near-optimal learning capacity of a CNN variant without using any validation data. Our hypothesis can be deployed as a plug-and-play to any existing CNN variant without introducing additional trainable parameters to the network. We test our hypothesis on six different CNN variants and three different general image datasets (CIFAR10, CIFAR100, and SVHN). The result based on these CNN variants and datasets shows that our hypothesis saves 58.49\% of computational time (on average) in training. We further conduct our hypothesis on ten medical image datasets and compared with the MedMNIST-V2 benchmark. Based on our experimental result, we save $\approx$ 44.1\% of computational time without losing accuracy against the MedMNIST-V2 benchmark.


title: The Emotion Dynamics of Literary Novels

abstract: Stories are rich in the emotions they exhibit in their narratives and evoke in the readers. The emotional journeys of the various characters within a story are central to their appeal. Computational analysis of the emotions of novels, however, has rarely examined the variation in the emotional trajectories of the different characters within them, instead considering the entire novel to represent a single story arc. In this work, we use character dialogue to distinguish between the emotion arcs of the narration and the various characters. We analyze the emotion arcs of the various characters in a dataset of English literary novels using the framework of Utterance Emotion Dynamics. Our findings show that the narration and the dialogue largely express disparate emotions through the course of a novel, and that the commonalities or differences in the emotional arcs of stories are more accurately captured by those associated with individual characters.


title: Enhancing LLM Safety via Constrained Direct Preference Optimization

abstract: The rapidly increasing capabilities of large language models (LLMs) raise an urgent need to align AI systems with diverse human preferences to simultaneously enhance their usefulness and safety, despite the often conflicting nature of these goals. To address this important problem, a promising approach is to enforce a safety constraint at the fine-tuning stage through a constrained Reinforcement Learning from Human Feedback (RLHF) framework. This approach, however, is computationally expensive and often unstable. In this work, we introduce Constrained DPO (C-DPO), a novel extension of the recently proposed Direct Preference Optimization (DPO) approach for fine-tuning LLMs that is both efficient and lightweight. By integrating dual gradient descent and DPO, our method identifies a nearly optimal trade-off between helpfulness and harmlessness without using reinforcement learning. Empirically, our approach provides a safety guarantee to LLMs that is missing in DPO while achieving significantly higher rewards under the same safety constraint compared to a recently proposed safe RLHF approach. Warning: This paper contains example data that may be offensive or harmful.


title: A Simple Finite-Time Analysis of TD Learning with Linear Function Approximation

abstract: We study the finite-time convergence of TD learning with linear function approximation under Markovian sampling. Existing proofs for this setting either assume a projection step in the algorithm to simplify the analysis, or require a fairly intricate argument to ensure stability of the iterates. We ask: \textit{Is it possible to retain the simplicity of a projection-based analysis without actually performing a projection step in the algorithm?} Our main contribution is to show this is possible via a novel two-step argument. In the first step, we use induction to prove that under a standard choice of a constant step-size $\alpha$, the iterates generated by TD learning remain uniformly bounded in expectation. In the second step, we establish a recursion that mimics the steady-state dynamics of TD learning up to a bounded perturbation on the order of $O(\alpha^2)$ that captures the effect of Markovian sampling. Combining these pieces leads to an overall approach that considerably simplifies existing proofs. We conjecture that our inductive proof technique will find applications in the analyses of more complex stochastic approximation algorithms, and conclude by providing some examples of such applications.


title: Observation of Replica Symmetry Breaking in Standard Mode-Locked Fiber Laser

abstract: We report the first experimental demonstration of the replica symmetry breaking (RSB) phenomenon in a fiber laser system supporting standard mode-locking (SML) regime. Though theoretically predicted, this photonic glassy phase remained experimentally undisclosed so far. We employ an ytterbium-based mode-locked fiber laser with a very rich phase diagram. Two phase transitions are observed separating three different regimes: cw, quasi-mode-locking (QML), and SML. The regimes are intrinsically related to the distinct dynamics of intensity fluctuations in the laser spectra. We set the connection between the RSB glassy phase with frustrated modes and onset of L-shaped intensity distributions in the QML regime, which impact directly the replica overlap measure.


title: Permutation-Like Matrices

abstract: Permutation Matrices are a well known class of matrices which encode the elements of the symmetric group on $d$ elements as a square $d\times d$ matrix. Motivated by [4], we define a similar class of matrices which are a generalization of Permutation Matrices. We give explicit formulas for the multiplication of these matrices. Lastly, we discuss the spectral radius, eigenvalues, and periodicity before giving a form of Birkhoff-Von Neumann's Theorem for Left Stochastic Matrices.


title: Arctic curves of the T-system with Slanted Initial Data

abstract: We study the T-system of type $A_\infty$, also known as the octahedron recurrence/equation, viewed as a 2+1-dimensional discrete evolution equation. Generalizing the study of [P. Di Francesco and R. Soto-Garrido. Arctic curves of the octahedron equation. J. Phys. A, 47(28):285204, 34, 2014], we consider initial data along parallel ``slanted" planes perpendicular to an arbitrary admissible direction $(r,s,t)\in {\mathbb Z}_+^3$. The solution of the T-system is interpreted as the partition function of a dimer model on some suitable ``pinecone" graph introduced in [M. Bousquet-M\'elou, J. Propp, and J. West. Perfect matchings for the three-term Gale-Robinson sequences. Electron. J. Combin., 16(1):Research Paper 125, 37, 2009]. The T-system formulation and some exact solutions in uniform or periodic cases allow us to explore the thermodynamic limit of the corresponding dimer models and to derive exact arctic curves separating the various phases of the system.

categories: math-ph cond-mat.stat-mech math.CO math.MP


title: Approximating rational points on surfaces

abstract: Let $X$ be a smooth projective algebraic variety over a number field $k$ and $P$ in $X(k)$. In 2007, the second author conjectured that, in a precise sense, if rational points on $X$ are dense enough, then the best rational approximations to $P$ must lie on a curve. We present a strategy for deducing a slightly weaker conjecture from Vojta's conjecture, and execute this strategy for the full conjecture for split surfaces.


title: Characterizing Dynamic Majorana Hybridization for Universal Quantum Computing

abstract: Qubits built out of Majorana zero modes have long been theorized as a potential pathway toward fault-tolerant topological quantum computation. Almost unavoidable in these processes is Majorana wavefunction overlap, known as hybridization, which arise throughout the process when Majorana modes get close to each other. This breaks the ground state degeneracy, leading to qubit errors in the braiding process. This work presents an accessible method to track transitions within the low-energy subspace and predict the output of braids with hybridized Majorana modes. As an application, we characterize Pauli qubit-errors, as demonstrated on an X-gate, critical for the successful operation of any quantum computer. Further, we perform numerical simulations to demonstrate how to utilize the hybridization to implement arbitrary rotations, along with a two-qubit controlled magic gate, thus providing a demonstration of universal quantum computing.


title: MORBDD: Multiobjective Restricted Binary Decision Diagrams by Learning to Sparsify

abstract: In multicriteria decision-making, a user seeks a set of non-dominated solutions to a (constrained) multiobjective optimization problem, the so-called Pareto frontier. In this work, we seek to bring a state-of-the-art method for exact multiobjective integer linear programming into the heuristic realm. We focus on binary decision diagrams (BDDs) which first construct a graph that represents all feasible solutions to the problem and then traverse the graph to extract the Pareto frontier. Because the Pareto frontier may be exponentially large, enumerating it over the BDD can be time-consuming. We explore how restricted BDDs, which have already been shown to be effective as heuristics for single-objective problems, can be adapted to multiobjective optimization through the use of machine learning (ML). MORBDD, our ML-based BDD sparsifier, first trains a binary classifier to eliminate BDD nodes that are unlikely to contribute to Pareto solutions, then post-processes the sparse BDD to ensure its connectivity via optimization. Experimental results on multiobjective knapsack problems show that MORBDD is highly effective at producing very small restricted BDDs with excellent approximation quality, outperforming width-limited restricted BDDs and the well-known evolutionary algorithm NSGA-II.


title: Opinion inertia and coarsening in the Persistent Voter model

abstract: We consider the Persistent Voter model (PVM), a variant of the Voter model (VM) that includes transient, dynamically-induced zealots. Due to peer reinforcement, the internal confidence $\eta_i$ of a normal voter increases by steps of size $\Delta\eta$ and once it gets above a given threshold, it becomes a zealot. Then, its opinion remains frozen until enough interactions with the opposite opinion occur and its confidence is reset. No longer a zealot, the regular voter may change opinion once again. This opinion inertia mechanism, albeit simplified, is responsible for an effective surface tension and the PVM has a crossover from a fluctuation-driven dynamics, as in the VM, to a curvature-driven one, as in the Ising Model at low temperature (IM0). The average time $\tau$ to attain consensus is non-monotonic on $\Delta\eta$ and has a minimum at $\Delta\eta_{\min}$. In this paper we clarify the mechanisms that accelerate the system towards consensus close to $\Delta\eta_{\min}$. Close to the crossover at $\Delta\eta_{\min}$, the intermediate region around the domains where the regular voters accumulate (the active region, AR) is large and the surface tension, albeit small, is still enough to keep the shape and reduce the fragmentation of the domains. The large size of the AR in the region of $\Delta\eta_{\min}$ has two important effects that accelerates the dynamics. First, it dislodges the zealots in the bulk of the domains and second, it maximally suppresses the slowly-evolving stripes that normally form in Ising-like models. This suggests the importance of understanding the role of the AR, where the change of opinion is facilitated, and the interplay between regular voters and zealots when attempting to disrupt polarized states.


title: Encodings for Prediction-based Neural Architecture Search

abstract: Predictor-based methods have substantially enhanced Neural Architecture Search (NAS) optimization. The efficacy of these predictors is largely influenced by the method of encoding neural network architectures. While traditional encodings used an adjacency matrix describing the graph structure of a neural network, novel encodings embrace a variety of approaches from unsupervised pretraining of latent representations to vectors of zero-cost proxies. In this paper, we categorize and investigate neural encodings from three main types: structural, learned, and score-based. Furthermore, we extend these encodings and introduce \textit{unified encodings}, that extend NAS predictors to multiple search spaces. Our analysis draws from experiments conducted on over 1.5 million neural network architectures on NAS spaces such as NASBench-101 (NB101), NB201, NB301, Network Design Spaces (NDS), and TransNASBench-101. Building on our study, we present our predictor \textbf{FLAN}: \textbf{Fl}ow \textbf{A}ttention for \textbf{N}AS. FLAN integrates critical insights on predictor design, transfer learning, and \textit{unified encodings} to enable more than an order of magnitude cost reduction for training NAS accuracy predictors. Our implementation and encodings for all neural networks are open-sourced at \href{https://github.com/abdelfattah-lab/flan_nas}{https://github.com/abdelfattah-lab/flan\_nas}.


title: Balls in groups: volume, structure and growth

abstract: We give sharp bounds in Breuillard, Green and Tao's finitary version of Gromov's theorem on groups with polynomial growth. Precisely, we show that for every non-negative integer d there exists $c=c(d)>0$ such that if $G$ is a group with finite symmetric generating set $S$ containing the identity and $|S^n|\le cn^{d+1}|S|$ for some positive integer $n$ then there exist normal subgroups $H\le\Gamma\le G$ such that $H\subseteq S^n$, such that $\Gamma/H$ is $d$-nilpotent (i.e. has a central series of length $d$ with cyclic factors), and such that $[G:\Gamma]\le g(d)$, where $g(d)$ denotes the maximum order of a finite subgroup of $GL_d(\mathbb{Z})$. The bounds on both the nilpotence and index are sharp; the previous best bounds were $O(d)$ on the nilpotence, and an ineffective function of $d$ on the index. In fact, we obtain this as a small part of a much more detailed fine-scale description of the structure of $G$. These results have a wide range of applications in various aspects of the theory of vertex-transitive graphs: percolation theory, random walks, structure of finite groups, scaling limits of finite vertex-transitive graphs.... We obtain some of these applications in the present paper, and treat others in companion papers. Some are due to or joint with other authors.


title: Demonstrating a Robust Walking Algorithm for Underactuated Bipedal Robots in Non-flat, Non-stationary Environments

abstract: This work explores an innovative algorithm designed to enhance the mobility of underactuated bipedal robots across challenging terrains, especially when navigating through spaces with constrained opportunities for foot support, like steps or stairs. By combining ankle torque with a refined angular momentum-based linear inverted pendulum model (ALIP), our method allows variability in the robot's center of mass height. We employ a dual-strategy controller that merges virtual constraints for precise motion regulation across essential degrees of freedom with an ALIP-centric model predictive control (MPC) framework, aimed at enforcing gait stability. The effectiveness of our feedback design is demonstrated through its application on the Cassie bipedal robot, which features 20 degrees of freedom. Key to our implementation is the development of tailored nominal trajectories and an optimized MPC that reduces the execution time to under 500 microseconds--and, hence, is compatible with Cassie's controller update frequency. This paper not only showcases the successful hardware deployment but also demonstrates a new capability, a bipedal robot using a moving walkway.


title: Absorbing-state transitions in particulate systems under spatially varying driving

abstract: We study the absorbing state transition in particulate systems under spatially inhomogeneous driving using a modified random organization model. For smoothly varying driving the steady state results map onto the homogeneous absorbing state phase diagram, with the position of the boundary between absorbing and diffusive states being insensitive to the driving wavelength. Here the phenomenology is well-described by a one-dimensional continuum model that we pose. For discontinuously varying driving the position of the absorbing phase boundary and the exponent characterising the fraction of active particles are altered relative to the homogeneous case.


title: Torsion-free abelian groups of finite rank and fields of finite transcendence degree

abstract: Let $\operatorname{TFAb}_r$ be the class of torsion-free abelian groups of rank $r$, and let $\operatorname{FD}_r$ be the class of fields of characteristic $0$ and transcendence degree~$r$. We compare these classes using various notions. Considering Scott complexity of the structures in the classes and the complexity of the isomorphism relations on the classes, the classes seem very similar. Hjorth and Thomas showed that the $\operatorname{TFAb}_r$ are strictly increasing under Borel reducibility. This is not so for the classes $\operatorname{FD}_r$. Thomas and Velickovic showed that for sufficiently large $r$, the classes $\operatorname{FD}_r$ are equivalent under Borel reducibility. We try to compare the groups with the fields, using Borel reducibility, and also using some effective variants. We give functorial Turing computable embeddings of $\operatorname{TFAb}_r$ in $\operatorname{FD}_r$, and of $\operatorname{FD}_r$ in $\operatorname{FD}_{r+1}$. We show that under computable countable reducibility, $\operatorname{TFAb}_1$ lies on top among the classes we are considering. In fact, under computable countable reducibility, isomorphism on $\operatorname{TFAb}_1$ lies on top among equivalence relations that are effective $\Sigma_3$, along with the Vitali equivalence relation on $2^\omega$.


title: Precise Time-Domain Asteroseismology and a Revised Target List for TESS Solar-Like Oscillators

abstract: The TESS mission has provided a wealth of asteroseismic data for solar-like oscillators. However, these data are subject to varying cadences, large gaps, and unequal sampling, which complicates analysis in the frequency domain. One solution is to model the oscillations in the time domain by treating them as stochastically damped simple harmonic oscillators through a linear combination of Gaussian Process kernels. We demonstrate this method on the well-studied subgiant star nu Indi and a sample of Kepler red giant stars observed by TESS, finding that the time domain model achieves an almost two-fold increase in accuracy for measuring {\nu}max compared to typical frequency domain methods. To apply the method to new detections, we use stellar parameters from Gaia DR3 and the TESS input catalog to calculate revised asteroseismic detection probabilities for all TESS input catalog targets with T<12 mag and a predicted {\nu}max>240{\mu}Hz. We also provide a software tool to calculate detection probabilities for any target of interest. Using the updated detection probabilities we show that time-domain asteroseismology is sensitive enough to recover marginal detections, which may explain the current small number of frequency-based detections of TESS oscillations compared to pre-flight expectations.


title: Interpolation Polynomials, Binomial Coefficients, and Symmetric Function Inequalities

abstract: Inhomogeneous versions of Jack and Macdonald polynomials, called interpolation polynomials, have been introduced by Knop--Sahi (type $A$) and Okounkov (type $BC$). In this paper, we study binomial coefficients and Littlewood--Richardson (LR) coefficients for these interpolation polynomials. We extend to type $BC$ the weighted sum formula for binomial coefficients due to the second author in type $A$, and obtain a new weighted sum formula for LR coefficients for both types $A$ and $BC$. We prove that binomial coefficients are positive and monotone using the weighted sum formula and the combinatorial formulas due to Okounkov. As an application, we prove various inequalities on power-sums and Jack polynomials, including their specializations, monomial, Schur, Zonal and elementary symmetric polynomials, generalizing similar inequalities due to Cuttler--Greene--Skandera, Sra and Khare--Tao.


title: Ivie: Lightweight Anchored Explanations of Just-Generated Code

abstract: Programming assistants have reshaped the experience of programming into one where programmers spend less time writing and more time critically examining code. In this paper, we explore how programming assistants can be extended to accelerate the inspection of generated code. We introduce an extension to the programming assistant called Ivie, or instantly visible in-situ explanations. When using Ivie, a programmer's generated code is instantly accompanied by explanations positioned just adjacent to the code. Our design was optimized for extremely low-cost invocation and dismissal. Explanations are compact and informative. They describe meaningful expressions, from individual variables to entire blocks of code. We present an implementation of Ivie that forks VS Code, applying a modern LLM for timely segmentation and explanation of generated code. In a lab study, we compared Ivie to a contemporary baseline tool for code understanding. Ivie improved understanding of generated code, and was received by programmers as a highly useful, low distraction, desirable complement to the programming assistant.


title: Two results on complexities of decision problems of groups

abstract: We answer two questions on the complexities of decision problems of groups, each related to a classical result. First, C. Miller characterized the complexity of the isomorphism problem for finitely presented groups in 1971. We do the same for the isomorphism problem for recursively presented groups. Second, the fact that every Turing degree appears as the degree of the word problem of a finitely presented group is shown independently by multiple people in the 1960s. We answer the analogous question for degrees of ceers instead of Turing degrees. We show that the set of ceers which are computably equivalent to a finitely presented group is $\Sigma^0_3$-complete, which is the maximal possible complexity.


title: The class of Gorenstein injective modules is covering if and only if it is closed under direct limits

abstract: We prove that the class of Gorenstein injective modules is covering if and only if it is closed under direct limits. This adds to the list of examples that support Enochs conjecture: Every covering class of modules is closed under direct limits. We also show that the class of Gorenstein injective left R-modules is covering if and only if R is left noetherian, and such that character modules of Gorenstein injective left R modules are Gorenstein flat.


title: Direct visualization of defect-controlled diffusion in van der Waals gaps

abstract: Diffusion processes govern fundamental phenomena such as phase transformations, doping, and intercalation in van der Waals (vdW) bonded materials. Here, we quantify the diffusion dynamics of W atoms by visualizing the motion of individual atoms at three different vdW interfaces, BN/vacuum, BN/BN, and BN/WSe2, using scanning transmission electron microscopy movies. Supported by density functional theory calculations, we infer that in all cases diffusion is governed by intermittent trapping at electron beam-generated defect sites. This leads to diffusion properties that depend strongly on the number of defects. These results suggest that diffusion and intercalation processes in vdW materials are highly tunable and sensitive to crystal quality. Furthermore, the demonstration of atomic resolution imaging of materials inside vdW heterostructures offers possibilities for direct visualization of diffusion and atomic interactions, as well as for experiments exploring atomic structures, their in-situ modification, and electrical property measurement.


title: Pseudo-Labeling and Contextual Curriculum Learning for Online Grasp Learning in Robotic Bin Picking

abstract: The prevailing grasp prediction methods predominantly rely on offline learning, overlooking the dynamic grasp learning that occurs during real-time adaptation to novel picking scenarios. These scenarios may involve previously unseen objects, variations in camera perspectives, and bin configurations, among other factors. In this paper, we introduce a novel approach, SSL-ConvSAC, that combines semi-supervised learning and reinforcement learning for online grasp learning. By treating pixels with reward feedback as labeled data and others as unlabeled, it efficiently exploits unlabeled data to enhance learning. In addition, we address the imbalance between labeled and unlabeled data by proposing a contextual curriculum-based method. We ablate the proposed approach on real-world evaluation data and demonstrate promise for improving online grasp learning on bin picking tasks using a physical 7-DoF Franka Emika robot arm with a suction gripper. Video: https://youtu.be/OAro5pg8I9U


title: Choose Your Own Adventure: Interactive E-Books to Improve Word Knowledge and Comprehension Skills

abstract: The purpose of this feasibility study was to examine the potential impact of reading digital interactive e-books on essential skills that support reading comprehension with third-fifth grade students. Students read two e-Books that taught word learning and comprehension monitoring strategies in the service of learning difficult vocabulary and targeted science concepts about hurricanes. We investigated whether specific comprehension strategies including word learning and strategies that supported general reading comprehension, summarization, and question generation, show promise of effectiveness in building vocabulary knowledge and comprehension skills in the e-Books. Students were assigned to read one of three versions of each of the e-Books, each version implemented one strategy. The books employed a choose-your-adventure format with embedded comprehension questions that provided students with immediate feedback on their responses. Paired samples t-tests were run to examine pre-to-post differences in learning the targeted vocabulary and science concepts taught in both e-Books. For both e-Books, students demonstrated significant gains in word learning and on the targeted hurricane concepts. Additionally, Hierarchical Linear Modeling (HLM) revealed that no one strategy was more associated with larger gains than the other. Performance on the embedded questions in the books was also associated with greater posttest outcomes for both e-Books. This work discusses important considerations for implementation and future development of e-books that can enhance student engagement and improve reading comprehension.


title: Magnetic Localization for In-body Nano-communication Medical Systems

abstract: Nano-machines circulating inside the human body, collecting data on tissue conditions, represent a vital part of next-generation medical diagnostic systems. However, for these devices to operate effectively, they need to relay not only their medical measurements but also their positions. This paper introduces a novel localization method for in-body nano-machines based on the magnetic field, leveraging the advantageous magnetic permeability of all human tissues. The entire proposed localization system is described, starting from 10x10 ${\mu}m^2$ magnetometers to be integrated into the nano-machines, to a set of external wires generating the magnetic field. Mathematical equations for the localization algorithm are also provided, assuming the nano-machines do not execute the computations themselves, but transmit their magnetic field measurements together with medical data outside of the body. The whole system is validated with computer simulations that capture the measurement error of the magnetometers, the error induced by the Earth magnetic field, and a human body model assuming different possible positions of nano-machines. The results show a very high system accuracy with localization errors even below 1 cm.


title: Unifying uncertainties for rotor-like quantum systems

abstract: Quantum rotor represents the second simplest model after the harmonic oscillator with profound interdisciplinary but yet unexplored implications. It overreaches its mechanical meaning with significant consequences and promising applications in, e.g., singular optics, super-conductive circuits with Josephson junction or optimal pulse shaping in time frequency domains at ultimate quantum limit. Quantification of complementarity between angular momentum and angular variable is essential for exploitation of this canonical pair in quantum metrology. Whereas the natural measures for position and momentum are variances, the uncertainty associated with angular variable can be linked to moments of inertia of the unit ring about axes passing through its center of mass. This interpretation provides variants for saturable uncertainty relations which can be further used in quantum metrology of the quantum rotor and explains ambiguities in choice of possible uncertainty measures associated with sine and cosine functions of angular variable. Special attention will be payed to uncertainty products which are exactly or approximately minimised by von Mises states, which play the role of squeezed states for quantum rotor and allow optimal detection of quantum states at the ultimate limits.


title: The complexity of computing in continuous time: space complexity is precision

abstract: Models of computations over the integers are equivalent from a computability and complexity theory point of view by the Church-Turing thesis. It is not possible to unify discrete-time models over the reals. The situation is unclear but simpler for continuous-time models, as there is a unifying mathematical model provided by ordinary differential equations (ODEs). For example, the GPAC model of Shannon is known to correspond to polynomial ODEs. However, the question of a robust complexity theory for such models and its relations to classical (discrete) computation theory is an old problem. There was some recent significant progress: it has been proved that (classical) time complexity corresponds to the length of the involved curves. The question of whether there is a simple and robust way to measure space complexity remains. We argue that space complexity corresponds to precision and conversely. We propose and prove an algebraic characterisation of FPSPACE, using continuous ODEs. Recent papers proposed algebraic characterisations of polynomial-time and -space complexity classes over the reals, but with a discrete-time: those algebras rely on discrete ODE schemes. Here, we use classical (continuous) ODEs, with the classic definition of derivation and hence with the more natural context of continuous-time associated with ODEs. We characterise both the case of polynomial space functions over the integers and the reals. We prove that Turing machines, with a proper representation of real numbers, can be simulated by continuous ODEs and not just discrete ODEs. A major consequence is that the associated space complexity is provably related to the numerical stability of involved schemas and the associated required precision. We obtain that a problem can be solved in polynomial space if and only if it can be simulated by some numerically stable ODE, using a polynomial precision.


title: RVRAE: A Dynamic Factor Model Based on Variational Recurrent Autoencoder for Stock Returns Prediction

abstract: In recent years, the dynamic factor model has emerged as a dominant tool in economics and finance, particularly for investment strategies. This model offers improved handling of complex, nonlinear, and noisy market conditions compared to traditional static factor models. The advancement of machine learning, especially in dealing with nonlinear data, has further enhanced asset pricing methodologies. This paper introduces a groundbreaking dynamic factor model named RVRAE. This model is a probabilistic approach that addresses the temporal dependencies and noise in market data. RVRAE ingeniously combines the principles of dynamic factor modeling with the variational recurrent autoencoder (VRAE) from deep learning. A key feature of RVRAE is its use of a prior-posterior learning method. This method fine-tunes the model's learning process by seeking an optimal posterior factor model informed by future data. Notably, RVRAE is adept at risk modeling in volatile stock markets, estimating variances from latent space distributions while also predicting returns. Our empirical tests with real stock market data underscore RVRAE's superior performance compared to various established baseline methods.


title: Boundary Behavior of Compact Manifolds With Scalar Curvature Lower Bounds and Static Quasi-Local Mass of Tori

abstract: A classic result of Shi and Tam states that a 2-sphere of positive Gauss and mean curvature bounding a compact 3-manifold with nonnegative scalar curvature, must have total mean curvature not greater than that of the isometric embedding into Euclidean 3-space, with equality only for domains in this reference manifold. We generalize this result to 2-tori of Guass curvature greater than $-1$, which bound a compact 3-manifold having scalar curvature not less than $-6$ and at least one other boundary component satisfying a 'trapping condition'. The conclusion is that the total weighted mean curvature is not greater than that of an isometric embedding into the Kottler manifold, with equality only for domains in this space. Examples are given to show that the assumption of a secondary boundary component cannot be removed. The result gives a positive mass theorem for the static Brown-York mass of tori, in analogy to the Shi-Tam positivity of the standard Brown-York mass, and represents the first such quasi-local mass positivity result for non-spherical surfaces. Furthermore, we prove a Penrose-type inequality in this setting.


title: Trial and Error: Exploration-Based Trajectory Optimization for LLM Agents

abstract: Large Language Models (LLMs) have become integral components in various autonomous agent systems. In this study, we present an exploration-based trajectory optimization approach, referred to as ETO. This learning method is designed to enhance the performance of open LLM agents. Contrary to previous studies that exclusively train on successful expert trajectories, our method allows agents to learn from their exploration failures. This leads to improved performance through an iterative optimization framework. During the exploration phase, the agent interacts with the environment while completing given tasks, gathering failure trajectories to create contrastive trajectory pairs. In the subsequent training phase, the agent utilizes these trajectory preference pairs to update its policy using contrastive learning methods like DPO. This iterative cycle of exploration and training fosters continued improvement in the agents. Our experiments on three complex tasks demonstrate that ETO consistently surpasses baseline performance by a large margin. Furthermore, an examination of task-solving efficiency and potential in scenarios lacking expert trajectory underscores the effectiveness of our approach.


title: A Woven Klein Quartic

abstract: We describe a new method of weaving a model of the Klein quartic, a highly symmetric, but abstract genus-3 surface akin to a platonic polyhedron, with negatively-curved geometry. The Klein quartic cannot be realized in its fully symmetric form in three-dimensional space, but this model exhibits the most rigid symmetry that is possible. With remarkably little time and material you can have a Klein quartic of your own!


title: A Tutorial on the Pretrain-Finetune Paradigm for Natural Language Processing

abstract: The pretrain-finetune paradigm represents a transformative approach in natural language processing (NLP). This paradigm distinguishes itself through the use of large pretrained language models, demonstrating remarkable efficiency in finetuning tasks, even with limited training data. This efficiency is especially beneficial for research in social sciences, where the number of annotated samples is often quite limited. Our tutorial offers a comprehensive introduction to the pretrain-finetune paradigm. We first delve into the fundamental concepts of pretraining and finetuning, followed by practical exercises using real-world applications. We demonstrate the application of the paradigm across various tasks, including multi-class classification and regression. Emphasizing its efficacy and user-friendliness, the tutorial aims to encourage broader adoption of this paradigm. To this end, we have provided open access to all our code and datasets. The tutorial is particularly valuable for quantitative researchers in psychology, offering them an insightful guide into this innovative approach.


title: Shape-retaining beam-like morphing structures via localized snap through

abstract: In this study, we present a concept of morphing structure -- featuring an arch mounted on a compliant base -- that can be reconfigured via snap-through buckling and leverages bistability to retain its morphed shape. We show that one-dimensional arrays of such units yield beam-like structures that, upon localized snapping, can attain multiple, morphologically distinct stable shapes. Units are modeled using discrete elastic rods, a reduced-order formulation for beams and beam structures, and the results are validated via experiments. We leverage our model to understand the influence of the geometrical design parameters on the response and final shape of a unit. We then show that the morphed shapes of arrays of units can be predicted by concatenating results of simulations on single units, and leverage this idea to inverse-design structures that can be snapped into target stable shapes. Ultimately, our work suggests an up-scalable way to create shape-retaining morphing structures with target stable shapes.


title: Differentially Private Representation Learning via Image Captioning

abstract: Differentially private (DP) machine learning is considered the gold-standard solution for training a model from sensitive data while still preserving privacy. However, a major barrier to achieving this ideal is its sub-optimal privacy-accuracy trade-off, which is particularly visible in DP representation learning. Specifically, it has been shown that under modest privacy budgets, most models learn representations that are not significantly better than hand-crafted features. In this work, we show that effective DP representation learning can be done via image captioning and scaling up to internet-scale multimodal datasets. Through a series of engineering tricks, we successfully train a DP image captioner (DP-Cap) on a 233M subset of LAION-2B from scratch using a reasonable amount of computation, and obtaining unprecedented high-quality image features that can be used in a variety of downstream vision and vision-language tasks. For example, under a privacy budget of $\varepsilon=8$, a linear classifier trained on top of learned DP-Cap features attains 65.8% accuracy on ImageNet-1K, considerably improving the previous SOTA of 56.5%. Our work challenges the prevailing sentiment that high-utility DP representation learning cannot be achieved by training from scratch.


title: LQ Control of Traffic Flow Models via Variable Speed Limits

abstract: In this paper, an extension of a linear control design for hyperbolic linear partial differential equations is presented for a first-order traffic flow model. Starting from the Lighthill-Whitham-Richards (LWR) model, variable speed limit control (VSL) is applied through a modification of Greenshield's equilibrium flow model. Then, an optimal linear quadratic (LQ) controller is designed on the linear LWR model. The LQ state feedback function is found via the solution of a Riccati differential equation. Unlike previous studies, the control input is the rate of change of the input, not the input itself. The proposed controller is then verified on both the linear and nonlinear models. In both cases, the controller is able to drive the system to a desired density profile. In the nonlinear application, a higher control gain is needed to achieve similar results as in the linear case.


title: Collision Avoidance and Geofencing for Fixed-wing Aircraft with Control Barrier Functions

abstract: Safety-critical failures often have fatal consequences in aerospace control. Control systems on aircraft, therefore, must ensure the strict satisfaction of safety constraints, preferably with formal guarantees of safe behavior. This paper establishes the safety-critical control of fixed-wing aircraft in collision avoidance and geofencing tasks. A control framework is developed wherein a run-time assurance (RTA) system modulates the nominal flight controller of the aircraft whenever necessary to prevent it from colliding with other aircraft or crossing a boundary (geofence) in space. The RTA is formulated as a safety filter using control barrier functions (CBFs) with formal guarantees of safe behavior. CBFs are constructed and compared for a nonlinear kinematic fixed-wing aircraft model. The proposed CBF-based controllers showcase the capability of safely executing simultaneous collision avoidance and geofencing, as demonstrated by simulations on the kinematic model and a high-fidelity dynamical model.


title: SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Models

abstract: In recent years, large language models (LLMs) have become increasingly prevalent, offering remarkable text generation capabilities. However, a pressing challenge is their tendency to make confidently wrong predictions, highlighting the critical need for uncertainty quantification (UQ) in LLMs. While previous works have mainly focused on addressing aleatoric uncertainty, the full spectrum of uncertainties, including epistemic, remains inadequately explored. Motivated by this gap, we introduce a novel UQ method, sampling with perturbation for UQ (SPUQ), designed to tackle both aleatoric and epistemic uncertainties. The method entails generating a set of perturbations for LLM inputs, sampling outputs for each perturbation, and incorporating an aggregation module that generalizes the sampling uncertainty approach for text generation tasks. Through extensive experiments on various datasets, we investigated different perturbation and aggregation techniques. Our findings show a substantial improvement in model uncertainty calibration, with a reduction in Expected Calibration Error (ECE) by 50\% on average. Our findings suggest that our proposed UQ method offers promising steps toward enhancing the reliability and trustworthiness of LLMs.


title: On the onset of slip at adhesive elastic interfaces

abstract: The transition from static to dynamic friction when an elastic body is slid over another is now known to result from the motion of interface rupture fronts. These fronts may be either crack-like or pulse-like, with the latter involving reattachment in the wake of the front. How and why these fronts occur remains a subject of active theoretical and experimental investigation, given its wide ranging implications for a range of problems in tribology. In this work, we investigate this question using an elastic lattice-network representation; bulk and interface bonds are simulated to deform and, in the latter case, break and reform dynamically in response to an applied remote displacement. We find that, contrary to the oft-cited rigid body scenario with Coulomb-type friction laws, the type of rupture front observed depends intimately on the location of the applied boundary condition. Depending on whether the sliding solid is pulled, pushed or sheared -- all equivalent applications in the rigid case -- distinct interface rupture modes can occur. We quantify these rupture modes, evaluate the interface stresses that lead to their formation, and and study their subsequent propagation dynamics. A strong analogy between the sliding friction problem and mode II fracture emerges from our results, with attendant wave speeds ranging from slow to Rayleigh. We discuss how these fronts mediate interface motion and implications for the general transition mechanism from static to dynamic friction.


title: Proposed high order harmonic interferometer for aperture synthesis radio telescope: Theory and computer simulation

abstract: A new type of interferometer, called High Order Harmonic Interferometer (HOHI), was proposed by Wu (1996) for imaging by aperture synthesis radio telescope. Its feasibility was proven by theoretical analysis. Before putting HOHI in practical use, computer simulation is a necessary intermediate stage. In this paper the theoretical analysis is reviewed. Then, computer simulation, including its algorithm, calculation and generated maps, is presented. The theoretical analysis is validated by studying these maps.


title: Hybrid quantum programming with PennyLane Lightning on HPC platforms

abstract: We introduce PennyLane's Lightning suite, a collection of high-performance state-vector simulators targeting CPU, GPU, and HPC-native architectures and workloads. Quantum applications such as QAOA, VQE, and synthetic workloads are implemented to demonstrate the supported classical computing architectures and showcase the scale of problems that can be simulated using our tooling. We benchmark the performance of Lightning with backends supporting CPUs, as well as NVidia and AMD GPUs, and compare the results to other commonly used high-performance simulator packages, demonstrating where Lightning's implementations give performance leads. We show improved CPU performance by employing explicit SIMD intrinsics and multi-threading, batched task-based execution across multiple GPUs, and distributed forward and gradient-based quantum circuit executions across multiple nodes. Our data shows we can comfortably simulate a variety of circuits, giving examples with up to 30 qubits on a single device or node, and up to 41 qubits using multiple nodes.


title: Balancing Enhancement, Harmlessness, and General Capabilities: Enhancing Conversational LLMs with Direct RLHF

abstract: In recent advancements in Conversational Large Language Models (LLMs), a concerning trend has emerged, showing that many new base LLMs experience a knowledge reduction in their foundational capabilities following Supervised Fine-Tuning (SFT). This process often leads to issues such as forgetting or a decrease in the base model's abilities. Moreover, fine-tuned models struggle to align with user preferences, inadvertently increasing the generation of toxic outputs when specifically prompted. To overcome these challenges, we adopted an innovative approach by completely bypassing SFT and directly implementing Harmless Reinforcement Learning from Human Feedback (RLHF). Our method not only preserves the base model's general capabilities but also significantly enhances its conversational abilities, while notably reducing the generation of toxic outputs. Our approach holds significant implications for fields that demand a nuanced understanding and generation of responses, such as customer service. We applied this methodology to Mistral, the most popular base model, thereby creating Mistral-Plus. Our validation across 11 general tasks demonstrates that Mistral-Plus outperforms similarly sized open-source base models and their corresponding instruct versions. Importantly, the conversational abilities of Mistral-Plus were significantly improved, indicating a substantial advancement over traditional SFT models in both safety and user preference alignment.


title: Purpose for Open-Ended Learning Robots: A Computational Taxonomy, Definition, and Operationalisation

abstract: Autonomous open-ended learning (OEL) robots are able to cumulatively acquire new skills and knowledge through direct interaction with the environment, for example relying on the guidance of intrinsic motivations and self-generated goals. OEL robots have a high relevance for applications as they can use the autonomously acquired knowledge to accomplish tasks relevant for their human users. OEL robots, however, encounter an important limitation: this may lead to the acquisition of knowledge that is not so much relevant to accomplish the users' tasks. This work analyses a possible solution to this problem that pivots on the novel concept of `purpose'. Purposes indicate what the designers and/or users want from the robot. The robot should use internal representations of purposes, called here `desires', to focus its open-ended exploration towards the acquisition of knowledge relevant to accomplish them. This work contributes to develop a computational framework on purpose in two ways. First, it formalises a framework on purpose based on a three-level motivational hierarchy involving: (a) the purposes; (b) the desires, which are domain independent; (c) specific domain dependent state-goals. Second, the work highlights key challenges highlighted by the framework such as: the `purpose-desire alignment problem', the `purpose-goal grounding problem', and the `arbitration between desires'. Overall, the approach enables OEL robots to learn in an autonomous way but also to focus on acquiring goals and skills that meet the purposes of the designers and users.


title: Advancing Quantum Networking: Some Tools and Protocols for Ideal and Noisy Photonic Systems

abstract: Quantum networking at many scales will be critical to future quantum technologies and experiments on quantum systems. Photonic links enable quantum networking. They will connect co-located quantum processors to enable large-scale quantum computers, provide links between distant quantum computers to support distributed, delegated, and blind quantum computing, and will link distant nodes in space enabling new tests of fundamental physics. Here, we discuss recent work advancing photonic tools and protocols that support quantum networking. We provide analytical results and numerics for the effect of distinguishability errors on key photonic circuits; we considered a variety of error models and developed new metrics for benchmarking the quality of generated photonic states. We review a distillation protocol by one of the authors that mitigates distinguishability errors. We also review recent results by a subset of the authors on the efficient simulation of photonic circuits via approximation by coherent states. We study some interactions between the theory of universal sets, unitary t-designs, and photonics: while many of the results we state in this direction may be known to experts, we aim to bring them to the attention of the broader quantum information science community and to phrase them in ways that are more familiar to this community. We prove, translating a result from representation theory, that there are no non-universal infinite closed $2$-designs in $U(V)$ when $\dim V \geq 2$. As a consequence, we observe that linear optical unitaries form a $1$-design but not a 2-design. Finally, we apply a result of Oszmaniec and Zimbor\'{a}s to prove that augmenting the linear optical unitaries with any nontrivial SNAP gate is sufficient to achieve universality.


title: Observation of Seven Astrophysical Tau Neutrino Candidates with IceCube

abstract: We report on a measurement of astrophysical tau neutrinos with 9.7 years of IceCube data. Using convolutional neural networks trained on images derived from simulated events, seven candidate $\nu_\tau$ events were found with visible energies ranging from roughly 20 TeV to 1 PeV and a median expected parent $\nu_\tau$ energy of about 200 TeV. Considering backgrounds from astrophysical and atmospheric neutrinos, and muons from $\pi^\pm/K^\pm$ decays in atmospheric air showers, we obtain a total estimated background of about 0.5 events, dominated by non-$\nu_\tau$ astrophysical neutrinos. Thus, we rule out the absence of astrophysical $\nu_\tau$ at the $5\sigma$ level. The measured astrophysical $\nu_\tau$ flux is consistent with expectations based on previously published IceCube astrophysical neutrino flux measurements and neutrino oscillations.


title: Structural origin of relaxation in dense colloidal suspensions

abstract: Amorphous solids relax via slow molecular rearrangement induced by thermal fluctuations or applied stress. Although microscopic structural signatures predicting these structural relaxations have long been sought, a physically motivated structural measure relevant to diverse systems remains elusive. Here, we introduce a structural order parameter derived from the mean-field caging potential experienced by the particles due to their neighbors, which reliably predicts the occurrence of structural relaxations. The parameter, derived from density functional theory, is a measure of susceptibility to particle rearrangements that can effectively identify weak or defect-like regions in disordered systems. Using experiments on dense colloidal suspensions, we demonstrate a causal relationship between this order parameter and the structural relaxations of the amorphous solid. In quiescent suspensions, increasing the density leads to stronger correlations between the structure and dynamics. Under applied shear, the mean structural order parameter increases with increasing strain, signaling shear-induced softening, which is accompanied by the proliferation of plastic events. In both cases, the order parameter reliably identifies weak regions where the plastic rearrangements due to thermal fluctuation or applied shear preferentially occur. Our study paves the way to a structural understanding of the relaxation of a wide range of amorphous solids, from suspensions to metallic glasses.


title: MPI Errors Detection using GNN Embedding and Vector Embedding over LLVM IR

abstract: Identifying errors in parallel MPI programs is a challenging task. Despite the growing number of verification tools, debugging parallel programs remains a significant challenge. This paper is the first to utilize embedding and deep learning graph neural networks (GNNs) to tackle the issue of identifying bugs in MPI programs. Specifically, we have designed and developed two models that can determine, from a code's LLVM Intermediate Representation (IR), whether the code is correct or contains a known MPI error. We tested our models using two dedicated MPI benchmark suites for verification: MBI and MPI-CorrBench. By training and validating our models on the same benchmark suite, we achieved a prediction accuracy of 92% in detecting error types. Additionally, we trained and evaluated our models on distinct benchmark suites (e.g., transitioning from MBI to MPI-CorrBench) and achieved a promising accuracy of over 80%. Finally, we investigated the interaction between different MPI errors and quantified our models' generalization capabilities over new unseen errors. This involved removing error types during training and assessing whether our models could still predict them. The detection accuracy of removed errors varies significantly between 20% to 80%, indicating connected error patterns.


title: Position operators in terms of converging finite-dimensional matrices: Exploring their interplay with geometry, transport, and gauge theory

abstract: Position operator $\hat{r}$ appears as $i{\partial_p}$ in wave mechanics, while its matrix form is well known diverging in diagonals, causing serious difficulties in basis transformation, observable yielding, etc. We aim to find a convergent $r$-matrix (CRM) to improve the existing divergent $r$-matrix (DRM), and investigate its influence at both the conceptual and the application levels. Unlike the spin matrix, which affords a Lie algebra representation as the solution of $[s_i,s_j]={\epsilon}_{i,j,k}s_k$, the $r$-matrix cannot be a solution for $[\hat{r},p]=i\hbar$, namely Weyl algebra. Indeed: matrix representations of Weyl algebras prove not existing; thus, neither CRM nor DRM would afford a representation. Instead, the CRM should be viewed as a procedure of encoding $\hat{r}$ using matrices of arbitrary finite dimensions. Deriving CRM recognizes that the limited understanding about Weyl algebra has led to the divergence. A key modification is increasing the 1-st Weyl algebra (the familiar substitution $\hat{r}{\rightarrow}i{\partial_p}$) to the $N$-th Weyl algebra. Resolving the divergence makes $r$-matrix rigorously defined, and we are able to show $r$-matrix is distinct from a spin matrix in terms of its defining principles, transformation behavior, and the observable it yields. At the conceptual level, the CRM fills the logical gap between the $r$-matrix and the Berry connection; and helps to show that Bloch space $\mathcal{H}_B$ is incomplete for $\hat{r}$. At the application level, we focus on transport, and discover that the Hermitian matrix is not identical with the associative Hermitian operator, i.e., $r_{m,n}=r_{n,m}^*{\nLeftrightarrow}\hat{r}=\hat{r}^{\dagger}$. We also discuss how such a non-representation CRM can contribute to building a unified transport theory.


title: Layered-to-Spinel Phase Transformation in Li$_{0.5}$NiO$_2$ from First Principles

abstract: The phase transition layered Li$_{0.5}$NiO$_2$ to spinel Li(NiO$_2$)$_2$ is a potential degradation pathway in LiNiO$_2$-based lithium-ion battery cathodes. We investigated the mechanism of this phase transformation from first principles. Consistent with experimental observations reported in the literature, our results indicate a high energy barrier for the transformation due to high defect-formation energies, a complex charge-transfer mechanism, and electronic frustration. Our results suggest that partially inverse spinel phases are unlikely to form for Li$_{0.5}$NiO$_2$, a qualitative difference from the chemically similar Li$_{0.5}$MnO$_2$, in which the transformation occurs at room temperature. We show that Ni and Li atoms migrate concertedly towards their respective spinel sites for the layered-to-spinel transformation to occur. We investigated the charge ordering in layered phases along the LiNiO$_2$-NiO$_2$ composition line, finding a pronounced impact of the symmetry and space group on the layered-to-spinel transition in Li$_{0.5}$NiO$_2$. Finally, we evaluated the relative stability of different spinel space groups, finding that previously reported experimental observations are consistent with a temperature-averaged structure rather than the 0 Kelvin ground-state structure of Li(NiO$_2$)$_2$ spinel.


title: Complex structure that admits complete Nevanlinna-Pick spaces of Hardy type

abstract: In this paper, we will characterize those sets, over which every irreducible complete Nevanlinna-Pick space enjoys that its multiplier and supremum norms coincide. Moreover, we will prove that, if there exists an irreducible complete Nevanlinna-Pick space of holomorphic functions on a reduced complex space $X$ whose multiplier algebra is isometrically equal to the algebra of bounded holomorphic functions (we will say that such a space is of Hardy type in this paper), then $X$ must be a Riemann surface.


title: HeAR -- Health Acoustic Representations

abstract: Health acoustic sounds such as coughs and breaths are known to contain useful health signals with significant potential for monitoring health and disease, yet are underexplored in the medical machine learning community. The existing deep learning systems for health acoustics are often narrowly trained and evaluated on a single task, which is limited by data and may hinder generalization to other tasks. To mitigate these gaps, we develop HeAR, a scalable self-supervised learning-based deep learning system using masked autoencoders trained on a large dataset of 313 million two-second long audio clips. Through linear probes, we establish HeAR as a state-of-the-art health audio embedding model on a benchmark of 33 health acoustic tasks across 6 datasets. By introducing this work, we hope to enable and accelerate further health acoustics research.


title: Transformer for Times Series: an Application to the S&P500

abstract: The transformer models have been extensively used with good results in a wide area of machine learning applications including Large Language Models and image generation. Here, we inquire on the applicability of this approach to financial time series. We first describe the dataset construction for two prototypical situations: a mean reverting synthetic Ornstein-Uhlenbeck process on one hand and real S&P500 data on the other hand. Then, we present in detail the proposed Transformer architecture and finally we discuss some encouraging results. For the synthetic data we predict rather accurately the next move, and for the S&P500 we get some interesting results related to quadratic variation and volatility prediction.


title: Koopman operators with intrinsic observables in rigged reproducing kernel Hilbert spaces

abstract: This paper presents a novel approach for estimating the Koopman operator defined on a reproducing kernel Hilbert space (RKHS) and its spectra. We propose an estimation method, what we call Jet Dynamic Mode Decomposition (JetDMD), leveraging the intrinsic structure of RKHS and the geometric notion known as jets to enhance the estimation of the Koopman operator. This method refines the traditional Extended Dynamic Mode Decomposition (EDMD) in accuracy, especially in the numerical estimation of eigenvalues. This paper proves JetDMD's superiority through explicit error bounds and convergence rate for special positive definite kernels, offering a solid theoretical foundation for its performance. We also delve into the spectral analysis of the Koopman operator, proposing the notion of extended Koopman operator within a framework of rigged Hilbert space. This notion leads to a deeper understanding of estimated Koopman eigenfunctions and capturing them outside the original function space. Through the theory of rigged Hilbert space, our study provides a principled methodology to analyze the estimated spectrum and eigenfunctions of Koopman operators, and enables eigendecomposition within a rigged RKHS. We also propose a new effective method for reconstructing the dynamical system from temporally-sampled trajectory data of the dynamical system with solid theoretical guarantee. We conduct several numerical simulations using the van der Pol oscillator, the Duffing oscillator, the H\'enon map, and the Lorenz attractor, and illustrate the performance of JetDMD with clear numerical computations of eigenvalues and accurate predictions of the dynamical systems.