title: Landau-Zener without a Qubit: Unveiling Multiphoton Interference, Synthetic Floquet Dimensions, and Dissipative Quantum Chaos

abstract: Landau-Zener-St\"uckelberg-Majorana (LZSM) interference emerges when the parameters of a $\textit{qubit}$ are periodically modulated across an avoided level crossing. Here, we investigate the occurrence of the LZSM phenomenon in nonlinear multilevel bosonic systems, where the interference pattern is determined by multiple energy levels and cannot be described by a level crossing between only two states. We fabricate two superconducting resonators made of flux-tunable Josephson junction arrays. The first device is very weakly nonlinear (the nonlinearity is smaller than the photon-loss rate) and, when a weak driving field is applied, it behaves as a linear resonator, yet shows the same LZSM interference as in a two-level system. Notably, here the interference originates from multiple avoided level crossings of the harmonic ladder. When subjected to a stronger drive, nonlinear effects start playing a role, and the interference pattern departs from the one observed in two-level systems. We demonstrate that, when two or more LZSM interference peaks merge, dissipative quantum chaos emerges. In the second device, where the nonlinearity surpasses the photon-loss rate, we observe additional LZSM interference peaks due to Kerr multiphoton resonances. When described under the light of the Floquet theory, these resonances can be interpreted as synthetic modes of an array of coupled cavities. We derive a simple effective model highlighting the essential features of the entirety of these phenomena. As the control of LZSM in qubit systems led to the implementation of fast protocols for characterization and state preparation, our findings pave the way to better control of nonlinear resonators, with implications for diverse quantum technological platforms.


title: Tilted Accretion Disks

abstract: In this chapter, we review some of the interesting consequences that tilt between the spin axis of the black hole and angular momentum axis of the accretion disk can have on the dynamics, thermodynamics, and observational appearance of accreting systems, from precessing coronae and jets to standing nozzle shocks and quasi-periodic oscillations. We begin the chapter by examining some of the reasons tilted disks are interesting as well as present arguments for how ubiquitous they may be. We then review the existing simulation results in the literature, broadly dividing them into sections on thick disks, thin disks, and magnetically arrested disks (MADs). We finish by highlighting some of the phenomenology that is unique to tilted disk simulations and discuss how this may apply to observations.


title: Two-stage growth for highly ordered epitaxial C$_{60}$ films on Au(111)

abstract: As an organic semiconductor and a prototypical acceptor molecule in organic photovoltaics, C$_{60}$ has broad relevance to the world of organic thin film electronics. Although highly uniform C$_{60}$ thin films are necessary to conduct spectroscopic analysis of the electronic structure of these C$_{60}$-based materials, reported C$_{60}$ films show a relatively low degree of order beyond a monolayer. Here, we develop a generalizable two-stage growth technique that consistently produces single-domain C$_{60}$ films of controllable thicknesses, using Au(111) as an epitaxially well-matched substrate. We characterize the films using low-energy electron diffraction, low-energy electron microscopy, scanning tunneling microscopy, and angle-resolved photoemission spectroscopy (ARPES). We report highly oriented epitaxial film growth of C$_{60}$/Au(111) from 1 monolayer (ML) up to 20 ML films. The high-quality of the C$_{60}$ thin films enables the direct observation of the electronic dispersion of the HOMO and HOMO-1 bands via ARPES without need for small spot sizes. Our results indicate a path for the growth of organic films on metallic substrates with long-range ordering.


title: AIGeN: An Adversarial Approach for Instruction Generation in VLN

abstract: In the last few years, the research interest in Vision-and-Language Navigation (VLN) has grown significantly. VLN is a challenging task that involves an agent following human instructions and navigating in a previously unknown environment to reach a specified goal. Recent work in literature focuses on different ways to augment the available datasets of instructions for improving navigation performance by exploiting synthetic training data. In this work, we propose AIGeN, a novel architecture inspired by Generative Adversarial Networks (GANs) that produces meaningful and well-formed synthetic instructions to improve navigation agents' performance. The model is composed of a Transformer decoder (GPT-2) and a Transformer encoder (BERT). During the training phase, the decoder generates sentences for a sequence of images describing the agent's path to a particular point while the encoder discriminates between real and fake instructions. Experimentally, we evaluate the quality of the generated instructions and perform extensive ablation studies. Additionally, we generate synthetic instructions for 217K trajectories using AIGeN on Habitat-Matterport 3D Dataset (HM3D) and show an improvement in the performance of an off-the-shelf VLN method. The validation analysis of our proposal is conducted on REVERIE and R2R and highlights the promising aspects of our proposal, achieving state-of-the-art performance.


title: The Environmental Dependence of the Stellar Mass - Gas Metallicity Relation in Horizon Run 5

abstract: Metallicity offers a unique window into the baryonic history of the cosmos, being instrumental in probing evolutionary processes in galaxies between different cosmic environments. We aim to quantify the contribution of these environments to the scatter in the mass-metallicity relation (MZR) of galaxies. By analysing the galaxy distribution within the cosmic skeleton of the Horizon Run 5 cosmological hydrodynamical simulation at redshift $z = 0.625$, computed using a careful calibration of the T-ReX filament finder, we identify galaxies within three main environments: nodes, filaments and voids. We also classify galaxies based on the dynamical state of the clusters and the length of the filaments in which they reside. We find that the cosmic environment significantly contributes to the scatter in the MZR; in particular, both the gas metallicity and its average relative standard deviation increase when considering denser large-scale environments. The difference in the average metallicity between galaxies within relaxed and unrelaxed clusters is $\approx 0.1 \text{ dex}$, with both populations displaying positive residuals, $\delta Z_{g}$, from the averaged MZR. Moreover, the difference in metallicity between node and void galaxies accounts for $\approx 0.14 \, \text{dex}$ in the scatter of the MZR at stellar mass $M_{\star} \approx 10^{9.35}\,\text{M}_{\odot}$. Finally, both the average [O/Fe] in the gas and the galaxy gas fraction decrease when moving to higher large-scale densities in the simulation, suggesting that the cores of cosmic environments host, on average, older and more massive galaxies, whose enrichment is affected by a larger number of Type Ia Supernova events.


title: A critical study of the Monte Carlo replica method

abstract: We present a detailed mathematical study of the Monte Carlo replica method as applied in the global fitting literature from the high-energy physics theory community. For the first time, we provide a rigorous derivation of the parameter distributions implied by the method, and show that, whilst they agree with Bayesian posteriors for linear models, they disagree otherwise. We proceed to numerically quantify the disagreement between the Monte Carlo replica method and the Bayesian method in the context of two phenomenologically relevant scenarios: fits of the SMEFT Wilson coefficients, and fits of PDFs (albeit in a toy scenario). In both scenarios, we find that uncertainty estimates of the quantities of interest are discrepant between the two approaches when non-linearity is relevant. Our findings motivate future investigation of Bayesian methodologies for global PDF fits, especially in the context of simultaneous determination of PDFs and SMEFT Wilson coefficients.


title: Universal distributions of overlaps from unitary dynamics in generic quantum many-body systems

abstract: We study the preparation of a quantum state using a circuit of depth $t$ from a factorized state of $N$ sites. We argue that in the appropriate scaling limit of large $t$ and $N$, the overlap between states evolved under generic many-body chaotic dynamics belongs to a family of universal distribution that generalizes the celebrated Porter-Thomas distribution. This is a consequence of a mapping in the space of replicas to a model of dilute domain walls. Our result provides a rare example in which analysis at an arbitrary number of replicas is possible, giving rise to the complete overlap distribution. Our general picture is derived and corroborated by the exact solution of the random phase model and of an emergent random matrix model given by the Ginibre ensemble. Finally, numerical simulations of two distinct random circuits show excellent agreement, thereby demonstrating universality.

categories: cond-mat.stat-mech hep-th math-ph math.MP quant-ph


title: GHOST Commissioning Science Results III: Characterizing an iron-poor damped Lyman $\alpha$ system

abstract: The Gemini High-resolution Optical SpecTrograph (GHOST) is a new echelle spectrograph available on the Gemini-South telescope as of Semester 2024A. We present the first high resolution spectrum of the quasar J1449-1227 (redshift z_em=3.27) using data taken during the commissioning of GHOST. The observed quasar hosts an intervening iron-poor ([Fe/H] = -2.5) damped Lyman alpha (DLA) system at redshift z=2.904. Taking advantage of the high spectral resolving power of GHOST (R~55000), we are able to accurately model the metal absorption lines of the metal-poor DLA and find a supersolar [Si/Fe], suggesting the DLA gas is in an early stage of chemical enrichment. Using simple ionization models, we find that the large range in the C IV/Si IV column density ratio of individual components within the DLA's high ionization absorption profile can be reproduced by several metal-poor Lyman limit systems surrounding the low-ionization gas of the DLA. It is possible that this metal-poor DLA resides within a complex system of metal-poor galaxies or filaments with inflowing gas. The high spectral resolution, wavelength coverage and sensitivity of GHOST makes it an ideal spectrograph for characterizing the chemistry and kinematics of quasar absorption lines.


title: Beyond the Rings: Polar Ring Galaxy NGC 4262 and its Globular Cluster System

abstract: In the context of the hierarchical model of galaxy evolution, polar ring galaxies (PRGs) are considered the intermediate phase between ongoing mergers and quiescent galaxies. This study explores the globular cluster system (GCS) and its properties in the nearest PRG, NGC4262, serving as a pilot investigation to study GCS in nearby PRGs. We utilize wide and deep field observations of the CFHT as part of the NGVS to investigate the GCS of NGC4262. We presented the first optical image of NGC4262 with an optically faint ring component. The photometric analysis of the GCS displays a distinct color bimodality. We estimate the total number of GCs for NGC4262 to be 266$\pm$16 GCs with a specific frequency of 4.2$\pm$0.8 and a specific mass of 0.23$\pm$0.01, which is relatively high compared to other galaxies of similar mass and environmental conditions. The spatial and azimuthal distributions of subpopulations reveal strong evidence of previous interactions within the host galaxy. The color distribution of GCS in NGC4262 shows a gradient of -0.05$\pm$0.01 within 5.5\arcmin, supporting the notion of past interactions and evolutionary transitions. PRG NGC4262 conforms to the overall trend of the GCS mass with respect to the halo mass. Furthermore, our investigation of the global scaling relations between GCS and host galaxy parameters provides further support for the hypothesis that PRGs are an intermediate phase connecting ongoing mergers and quiescent galaxies.


title: The outflowing ionised gas of I Zw 1 observed by HST COS

abstract: We present an analysis of the HST COS spectrum of IZw1 aiming to probe the absorbing medium associated with the active galactic nucleus (AGN). We fitted the emission spectrum and performed spectral analysis of the identified absorption features to derive the corresponding ionic column densities and covering fractions of the associated outflows. We employed photoionisation modelling to constrain the total column density and the ionisation parameter of four detected kinematic components. By investigating the implications of the results together with the observed kinematic properties of both emission and absorption features, we derived constraints on the structure and geometry of the absorbing medium in the AGN environment. We find and characterise absorption line systems from outflowing ionised gas in four distinct kinematic components, located at -60, -280, -1950, and -2900 km/s with respect to the source rest frame. While the two slower outflows are consistent with a full covering of the underlying radiation source, the well-constrained doublet line ratios of the faster two, higher column density, outflows suggest partial covering, with a covering fraction of C_f~0.4. The faster outflows show also line-locking in the NV doublet, a signature of acceleration via line absorption. This makes IZw1 possibly the closest object that shows evidence for hosting line-driven winds. The observed -1950 km/s absorption is likely due to the same gas as an X-ray warm absorber. Furthermore, the behaviour in UV and X-ray bands implies that this outflow has a clumpy structure. We find that the highly asymmetric broad emission lines in IZw1, indicative of a collimated, outflowing broad line region, are covered by the absorbing gas. Finally, the strongest UV--X-ray absorber may be connected to some of the blueshifted line emission, indicative of a more spatially extended structure of this ionised medium.


title: SMEFT predictions for semileptonic processes

abstract: The $SU(2)_L\times U(1)_Y$ invariance of the Standard Model Effective Field Theory (SMEFT) predicts multiple restrictions in the space of Wilson coefficients of $U(1)_{em}$ invariant effective lagrangians such as the Low-energy Effective Field Theory (LEFT), used for low-energy flavor-physics observables, or the Higgs Effective Field Theory (HEFT) in unitary gauge, appropriate for weak-scale observables. In this work, we derive and list all such predictions for semileptonic operators up to dimension 6. We find that these predictions can be expressed as 2223 linear relations among the HEFT/LEFT Wilson coefficients, that are completely independent of any assumptions about the alignment of the mass and flavor bases. These relations connect diverse experimental searches such as rare meson decays, high-$p_T$ dilepton searches, top decays, $Z$-pole observables, charged lepton flavor violating observables and non-standard neutrino interaction searches. We demonstrate how these relations can be used to derive strong indirect constraints on multiple Wilson coefficients that are currently either weakly constrained from direct experiments or have no direct bound at all. These relations also imply, in general, that evidence for new physics in a particular search channel must be accompanied by correlated anomalies in other channels.


title: New infinite families in the stable homotopy groups of spheres

abstract: We identify seven new $192$-periodic infinite families of elements in the $2$-primary stable homotopy groups of spheres. Although their Hurewicz image is trivial for topological modular forms, they remain nontrivial after $\mathrm{T}(2)$- as well as $\mathrm{K}(2)$-localization. We also obtain new information about $2$-torsion and $2$-divisibility of some of the previously known $192$-periodic infinite families in the stable stems.


title: Adjusting for bias due to measurement error in functional quantile regression models with error-prone functional and scalar covariates

abstract: Wearable devices enable the continuous monitoring of physical activity (PA) but generate complex functional data with poorly characterized errors. Most work on functional data views the data as smooth, latent curves obtained at discrete time intervals with some random noise with mean zero and constant variance. Viewing this noise as homoscedastic and independent ignores potential serial correlations. Our preliminary studies indicate that failing to account for these serial correlations can bias estimations. In dietary assessments, epidemiologists often use self-reported measures based on food frequency questionnaires that are prone to recall bias. With the increased availability of complex, high-dimensional functional, and scalar biomedical data potentially prone to measurement errors, it is necessary to adjust for biases induced by these errors to permit accurate analyses in various regression settings. However, there has been limited work to address measurement errors in functional and scalar covariates in the context of quantile regression. Therefore, we developed new statistical methods based on simulation extrapolation (SIMEX) and mixed effects regression with repeated measures to correct for measurement error biases in this context. We conducted simulation studies to establish the finite sample properties of our new methods. The methods are illustrated through application to a real data set.


title: The Feasibility of Constrained Reinforcement Learning Algorithms: A Tutorial Study

abstract: Satisfying safety constraints is a priority concern when solving optimal control problems (OCPs). Due to the existence of infeasibility phenomenon, where a constraint-satisfying solution cannot be found, it is necessary to identify a feasible region before implementing a policy. Existing feasibility theories built for model predictive control (MPC) only consider the feasibility of optimal policy. However, reinforcement learning (RL), as another important control method, solves the optimal policy in an iterative manner, which comes with a series of non-optimal intermediate policies. Feasibility analysis of these non-optimal policies is also necessary for iteratively improving constraint satisfaction; but that is not available under existing MPC feasibility theories. This paper proposes a feasibility theory that applies to both MPC and RL by filling in the missing part of feasibility analysis for an arbitrary policy. The basis of our theory is to decouple policy solving and implementation into two temporal domains: virtual-time domain and real-time domain. This allows us to separately define initial and endless, state and policy feasibility, and their corresponding feasible regions. Based on these definitions, we analyze the containment relationships between different feasible regions, which enables us to describe the feasible region of an arbitrary policy. We further provide virtual-time constraint design rules along with a practical design tool called feasibility function that helps to achieve the maximum feasible region. We review most of existing constraint formulations and point out that they are essentially applications of feasibility functions in different forms. We demonstrate our feasibility theory by visualizing different feasible regions under both MPC and RL policies in an emergency braking control task.


title: Enhanced Low-Complexity Receiver Design for Short Block Transmission Systems

abstract: This paper presents a comprehensive analysis and performance enhancement of short block length channel detection incorporating training information. The current communication systems' short block length channel detection typically consists of least squares channel estimation followed by quasi-coherent detection. By investigating the receiver structure, specifically the estimator-correlator, we show that the non-coherent term, often disregarded in conventional detection metrics, results in significant losses in performance and sensitivity in typical operating regimes of 5G and 6G systems. A comparison with the fully non-coherent receiver in multi-antenna configurations reveals substantial losses in low spectral efficiency operating areas. Additionally, we demonstrate that by employing an adaptive DMRS-data power adjustment, it is possible to reduce the performance loss gap, which is amenable to a more sensitive quasi-coherent receiver. However, both of the aforementioned ML detection strategies can result in substantial computational complexity when processing long bit-length codes. We propose an approach to tackle this challenge by introducing the principle of block or segment coding using First-Order RM Codes, which is amenable to low-cost decoding through block-based fast Hadamard transforms. The Block-based FHT has demonstrated to be cost-efficient with regards to decoding time, as it evolves from quadric to quasi-linear complexity with a manageable decline in performance. Additionally, by incorporating an adaptive DMRS-data power adjustment technique, we are able to bridge/reduce the performance gap with respect to the conventional maximum likelihood receiver and attain high sensitivity, leading to a good trade-off between performance and complexity to efficiently handle small payloads.


title: Solar reflection of dark matter with dark-photon mediators

abstract: We consider the scattering of low-mass halo dark-matter particles in the hot plasma of the Sun, focusing on dark matter that interact with ordinary matter through a dark-photon mediator. The resulting ``solar-reflected'' dark matter (SRDM) component contains high-velocity particles, which significantly extend the sensitivity of terrestrial direct-detection experiments to sub-MeV dark-matter masses. We use a detailed Monte-Carlo simulation to model the propagation and scattering of dark-matter particles in the Sun, including thermal effects, with special emphasis on ultralight dark-photon mediators. We study the properties of the SRDM flux, obtain exclusion limits from various direct-detection experiments, and provide projections for future experiments, focusing especially on those with silicon and xenon targets. We find that proposed future experiments with xenon and silicon targets can probe the entire ``freeze-in benchmark,'' in which dark matter is coupled to an ultralight dark photon, including dark-matter masses as low as $\mathcal{O}$(keV). Our simulations and SRDM fluxes are publicly available.


title: The Rise of the $R$-Process in the Gaia-Sausage/Enceladus Dwarf Galaxy

abstract: Neutron star mergers (NSMs) produce copious amounts of heavy r-process elements after a time delayed inspiral process. Once NSMs are present in a galaxy, r-process elements, such as Eu, are expected to significantly increase with time. Yet, there has been limited observational data in support of Eu increasing within Local Group galaxies. We have obtained high-resolution Magellan/MIKE observations of 43 metal-poor stars in the Gaia-Sausage/Enceladus tidally disrupted galaxy with $-2.5 < \rm{[Fe/H]} < -1$. For the first time, we find a clear rise in [Eu/Mg] with increasing [Mg/H] within one galaxy. We use a chemical evolution model to study how such a rise can result from the interplay of prompt and delayed r-process enrichment events. Delayed r-process sources are required to explain the rise and subsequent leveling off of [Eu/Mg] in this disrupted galaxy. However, the rise may be explained by delayed r-process sources with either short ($\sim 10$ Myr) or long ($\sim 500$ Myr) minimum delay times. Future studies on the nature of r-process sources and their enrichment processes in the GSE will require additional stars in the GSE at even lower metallicities than the present study.


title: Dark Dimension and the Effective Field Theory limit

abstract: In [1] we pointed out that in the Dark Dimension scenario [2] theoretical issues arise when the prediction for the vacuum energy $\rho$, that is obtained from swampland conjectures in string theory, is confronted with the corresponding result for $\rho$ in the field theory limit. One of the problems arises from the field theory side and is due to previous results for $\rho$ that, according to our analysis, turn out to be incorrect, although widely spread. Our work was challenged in [3]. Here we show why in our opinion the claims in [3] are inconsistent, actually based on arguments deprived of physical meaning, providing further support to our findings. We conclude by discussing ideas on the physical mechanism that could trigger the suppression of large UV contributions to $\rho$.


title: Superpolarized Electron-Hole Liquid and Multiferroicity in Multilayer Graphene

abstract: We introduce a many-body state termed superpolarized electron-hole liquid to explain the multiferroic properties observed in a recent experiment on rhombohedral pentalayer graphene by Han et al. [Nature 623, 41-47, 2023] . Superpolarization refers to a state where electrons and holes are fully polarized in opposite directions within the extended spin-valley space, resulting in a polarization per charge that exceeds the saturated value of one. This state exhibits multiferroic order, characterized by spontaneous spin, layer, and valley polarization. We demonstrate the independent control of valley polarization and orbital magnetization in this state through the application of electric-displacement field and weak magnetic fields. The large magnetoelectric effect observed in the experiment is attributed to the substantial Berry curvature concentrated near the band edge. The concept of superpolarization can be probed experimentally through magnetic oscillation and local current distribution measurements to determine the area of the Fermi surfaces and their magnetic moments.


title: Microscopic Black Hole Events in Future Hadron Colliders

abstract: Microscopic black hole production at future hadron colliders is a promising avenue to explore low scale gravity models like ADD. This study investigates production cross-sections and final state properties of these black holes using the BlackMax event generator. We analyze scenarios with varying proton-proton collision energies (27 TeV and 100 TeV), number of extra dimensions (2, 4, and 6), and black hole rotation. Black holes are found to decay to up to seventeen particles, which have high transverse momentum (up to 30 TeV) and concentrated in the central region. This unique signature allows them to be distinguished from background processes. The parameter space explored suggests future colliders like HE-LHC and FCC-hh have the potential to probe low scale gravity models.


title: Dynamic Complex-Frequency Control of Grid-Forming Converters

abstract: Complex droop control, alternatively known as dispatchable virtual oscillator control (dVOC), stands out for its unique capabilities in synchronization and voltage stabilization among existing control strategies for grid-forming converters. Complex droop control leverages the novel concept of ``complex frequency'', thereby establishing a coupled connection between active and reactive power inputs and frequency and rate-of-change-of voltage outputs. However, its reliance on static droop gains limits its ability to exhibit crucial dynamic response behaviors required in future power systems. To address this limitation, this paper introduces \textit{dynamic complex-frequency control}, upgrading static droop gains with dynamic transfer functions to enhance the richness and flexibility in dynamic responses for frequency and voltage control. Unlike existing approaches, the complex-frequency control framework treats frequency and voltage dynamics collectively, ensuring small-signal stability for frequency synchronization and voltage stabilization simultaneously. The control framework is validated through detailed numerical case studies on the IEEE nine-bus system, also showcasing its applicability in multi-converter setups.


title: Debunking Robot Rights Metaphysically, Ethically, and Legally

abstract: In this work we challenge arguments for robot rights on metaphysical, ethical and legal grounds. Metaphysically, we argue that machines are not the kinds of things that may be denied or granted rights. Building on theories of phenomenology and post-Cartesian approaches to cognitive science, we ground our position in the lived reality of actual humans in an increasingly ubiquitously connected, controlled, digitized, and surveilled society. Ethically, we argue that, given machines current and potential harms to the most marginalized in society, limits on (rather than rights for) machines should be at the centre of current AI ethics debate. From a legal perspective, the best analogy to robot rights is not human rights but corporate rights, a highly controversial concept whose most important effect has been the undermining of worker, consumer, and voter rights by advancing the power of capital to exercise outsized influence on politics and law. The idea of robot rights, we conclude, acts as a smoke screen, allowing theorists and futurists to fantasize about benevolently sentient machines with unalterable needs and desires protected by law. While such fantasies have motivated fascinating fiction and art, once they influence legal theory and practice articulating the scope of rights claims, they threaten to immunize from legal accountability the current AI and robotics that is fuelling surveillance capitalism, accelerating environmental destruction, and entrenching injustice and human suffering.


title: Explainable Light-Weight Deep Learning Pipeline for Improved Drought Stress Identification

abstract: Early identification of drought stress in crops is vital for implementing effective mitigation measures and reducing yield loss. Non-invasive imaging techniques hold immense potential by capturing subtle physiological changes in plants under water deficit. Sensor based imaging data serves as a rich source of information for machine learning and deep learning algorithms, facilitating further analysis aimed at identifying drought stress. While these approaches yield favorable results, real-time field applications requires algorithms specifically designed for the complexities of natural agricultural conditions. Our work proposes a novel deep learning framework for classifying drought stress in potato crops captured by UAVs in natural settings. The novelty lies in the synergistic combination of a pre-trained network with carefully designed custom layers. This architecture leverages feature extraction capabilities of the pre-trained network while the custom layers enable targeted dimensionality reduction and enhanced regularization, ultimately leading to improved performance. A key innovation of our work involves the integration of Gradient-Class Activation Mapping (Grad-CAM), an explainability technique. Grad-CAM sheds light on the internal workings of the deep learning model, typically referred to as a black box. By visualizing the focus areas of the model within the images, Grad-CAM fosters interpretability and builds trust in the decision-making process of the model. Our proposed framework achieves superior performance, particularly with the DenseNet121 pre-trained network, reaching a precision of 97% to identify the stressed class with an overall accuracy of 91%. Comparative analysis of existing state-of-the-art object detection algorithms reveals the superiority of our approach in significantly higher precision and accuracy.


title: Nano-welding of quantum spin-$1/2$ chains at minimal dissipation

abstract: We consider the optimal control of switching on a coupling term between two quantum many-body systems. Specifically, we (i) quantify the energetic cost of establishing a weak junction between two quantum spin-$1/2$ chains in finite time $\tau$ and (ii) identify the energetically optimal protocol to realize it. For linear driving protocols, we find that for long times the excess (irreversible) work scales as $\tau^{-\eta}$, where $\eta=1, 2$ or a nonuniversal number depending on the phase of the chains. Interestingly, increasing a $J_z$ anisotropy in the chains suppresses the excess work thus promoting quasi-adiabaticity. The general optimal control problem is solved, employing a Chebyshev ansatz. We find that the optimal control protocol is intimately sensitive to the chain phases.


title: A strongly interacting, two-dimensional, dipolar spin ensemble in (111)-oriented diamond

abstract: Systems of spins with strong dipolar interactions and controlled dimensionality enable new explorations in quantum sensing and simulation. In this work, we investigate the creation of strong dipolar interactions in a two-dimensional ensemble of nitrogen-vacancy (NV) centers generated via plasma-enhanced chemical vapor deposition (PECVD) on (111)-oriented diamond substrates. We find that diamond growth on the (111) plane yields high incorporation of spins, both nitrogen and NV centers, where the density of the latter is tunable via the miscut of the diamond substrate. Our process allows us to form dense, preferentially aligned, 2D NV ensembles with volume-normalized AC sensitivity down to $\eta_{AC}$ = 810 pT um$^{3/2}$ Hz$^{-1/2}$. Furthermore, we show that (111) affords maximally positive dipolar interactions amongst a 2D NV ensemble, which is crucial for leveraging dipolar-driven entanglement schemes and exploring new interacting spin physics.


title: Field-Programmable Gate Array Architecture for Deep Learning: Survey & Future Directions

abstract: Deep learning (DL) is becoming the cornerstone of numerous applications both in datacenters and at the edge. Specialized hardware is often necessary to meet the performance requirements of state-of-the-art DL models, but the rapid pace of change in DL models and the wide variety of systems integrating DL make it impossible to create custom computer chips for all but the largest markets. Field-programmable gate arrays (FPGAs) present a unique blend of reprogrammability and direct hardware execution that make them suitable for accelerating DL inference. They offer the ability to customize processing pipelines and memory hierarchies to achieve lower latency and higher energy efficiency compared to general-purpose CPUs and GPUs, at a fraction of the development time and cost of custom chips. Their diverse high-speed IOs also enable directly interfacing the FPGA to the network and/or a variety of external sensors, making them suitable for both datacenter and edge use cases. As DL has become an ever more important workload, FPGA architectures are evolving to enable higher DL performance. In this article, we survey both academic and industrial FPGA architecture enhancements for DL. First, we give a brief introduction on the basics of FPGA architecture and how its components lead to strengths and weaknesses for DL applications. Next, we discuss different styles of DL inference accelerators on FPGA, ranging from model-specific dataflow styles to software-programmable overlay styles. We survey DL-specific enhancements to traditional FPGA building blocks such as logic blocks, arithmetic circuitry, and on-chip memories, as well as new in-fabric DL-specialized blocks for accelerating tensor computations. Finally, we discuss hybrid devices that combine processors and coarse-grained accelerator blocks with FPGA-like interconnect and networks-on-chip, and highlight promising future research directions.


title: The $N_{\rm eff}$ at CMB challenges $U(1)_X$ light gauge boson scenarios

abstract: The relativistic degrees of freedom ($N_{\rm eff}$) is one of the crucial cosmological parameters. The precise measurement of $N_{\rm eff}$ at the time of cosmic microwave background formation, by Planck 2018 can be used to understand the new fundamental interactions, in particular involving light mediators. Presence of any new particle with sufficient energy density and sizeable interactions with Standard Model particles at the temperature around $\sim$ MeV can significantly alter the neutrino decoupling and hence $N_{\rm eff}$. Thus the bound on $N_{\rm eff}$ can place stringent constraints on various beyond Standard Model paradigms involving light particles. $U(1)_X$ models are among such scenarios and are widely studied in several aspects. In this work, we consider several popular $U(1)_X$ models with light $Z'$ boson like $U(1)_{B-L}$, $U(1)_{B - 3L_i}$, $U(1)_{B_i - 3 L_j}$, $U(1)_{L_i - L_j}$; $i,j =1,2,3$ being the flavour indices and study their impact on $N_{\rm eff}$. We also examine the constraints from ground based experiments like Xenon1T, Borexino, trident, etc. Our analysis shows that for light mass $M_{Z'} \lesssim \mathcal{O} (\rm{MeV})$ the $N_{\rm eff}$ provides the most stringent constraints on the $Z'$ mass and coupling, far exceeding the existing constraints from other experiments.


title: Low-Light Image Enhancement Framework for Improved Object Detection in Fisheye Lens Datasets

abstract: This study addresses the evolving challenges in urban traffic monitoring detection systems based on fisheye lens cameras by proposing a framework that improves the efficacy and accuracy of these systems. In the context of urban infrastructure and transportation management, advanced traffic monitoring systems have become critical for managing the complexities of urbanization and increasing vehicle density. Traditional monitoring methods, which rely on static cameras with narrow fields of view, are ineffective in dynamic urban environments, necessitating the installation of multiple cameras, which raises costs. Fisheye lenses, which were recently introduced, provide wide and omnidirectional coverage in a single frame, making them a transformative solution. However, issues such as distorted views and blurriness arise, preventing accurate object detection on these images. Motivated by these challenges, this study proposes a novel approach that combines a ransformer-based image enhancement framework and ensemble learning technique to address these challenges and improve traffic monitoring accuracy, making significant contributions to the future of intelligent traffic management systems. Our proposed methodological framework won 5th place in the 2024 AI City Challenge, Track 4, with an F1 score of 0.5965 on experimental validation data. The experimental results demonstrate the effectiveness, efficiency, and robustness of the proposed system. Our code is publicly available at https://github.com/daitranskku/AIC2024-TRACK4-TEAM15.


title: Real analytic curves of almost complex structures

abstract: We prove that, on a compact almost complex manifold, the space of almost complex structures whose Nijenhuis tensor has rank at least $k$ at every point is either empty or dense in each path-connected component of the space of almost complex structures. In particular, this applies to maximally non-integrable almost complex structures.


title: Inclination instability of circumbinary planets

abstract: We analyze a tilt instability of the orbit of an outer planet in a two planet circumbinary system that we recently reported. The binary is on an eccentric orbit and the inner circumbinary planet is on a circular polar orbit that causes the the binary to undergo apsidal precession. The outer circumbinary planet is initially on a circular or eccentric orbit that is coplanar with respect to the binary. We apply a Hamiltonian in quadrupole order of the binary potential to show that the tilt instability is the result of a secular resonance in which the apsidal precession rate of the binary matches the nodal precession rate of the outer planet. Resonance is possible because the polar inner planet causes the apsidal precession of the binary to be retrograde. The outer planet periodically undergoes large tilt oscillations for which we analytically determine the initial evolution and maximum inclination. Following a typically relatively short adjustment phase, the tilt grows exponentially in time at a characteristic rate that is of order the absolute value of the binary apsidal precession rate. The analytic results agree well with numerical simulations. This instability is analogous to the Kozai-Lidov instability, but applied to a circumbinary object. The instability fails to operate if the binary mass ratio is too extreme. The instability occurs even if the outer planet is instead an object of stellar mass and involves tilt oscillations of the inner binary.


title: Synchronous PIV measurements of a self-powered blood turbine and pump couple for right ventricle support

abstract: A blood turbine-pump system (iATVA), resembling a turbocharger was proposed as a mechanical right-heart assist device without external drive power. In this study, the iATVA system is investigated with particular emphasis on the blood turbine flow dynamics. A time-resolved 2D particle image velocimetry (PIV) set-up equipped with a beam splitter and two high speed cameras, allowed simultaneous recordings from both the turbine and pump impellers at 7 different phased-locked instances. The iATVA prototype is 3D printed using an optically clear resin following our earlier PIV protocols. Results showed that magnetically coupled impellers operated synchronously. As the turbine flow rate increased from 1.6 to 2.4 LPM, the rotational speed and relative inlet flow angle increase from 630 to 900 rpm, and 38 to 55% respectively. At the trailing edges, backflow region spanned 3/5 of the total passage outlet flow, and an extra leakage flow was observed at the leading edge. For this initial turbine design, approximately, 75% of the turbine blade passage was not contributing to the impulse operation mode. The maximum non-wall shear rate was ~2288 s-1 near to the inlet exit, which is significantly lower than the commercial blood pumps, encouraging further research and blood experiments of this novel concept. Experimental results will improve the hydrodynamic design of the turbine impeller and volute regions and will be useful in computational fluid dynamics validation studies of similar passive devices.


title: Simple, efficient method of calculating the Detweiler-Whiting singular field to very high order

abstract: Most self-force calculations rely, in one way or another, on representations of a particle's Detweiler- Whiting singular field. We present a simple method of calculating the singular field to high order in a local expansion in powers of distance from the particle. As a demonstration, we compute the singular field to 14th order in distance, 10 orders beyond the previous state of the art, in the simple case of a scalar charge in circular orbit around a Schwarzschild black hole. We provide the result in both a 4-dimensional form and a decomposed form suitable for use in an m-mode puncture scheme. Our method should have applications in overcoming bottlenecks in current self-force calculations at both first and second order in perturbation theory.


title: Multi-domain spectral method for self-force calculations

abstract: Second-order self-force calculations will be critical for modelling extreme-mass-ratio inspirals, and they are now known to have high accuracy even for binaries with mass ratios $\sim 1:10$. Many of the challenges facing these calculations are related to slow convergence of spherical-harmonic (or spheroidal harmonic) mode sums in a region containing the small companion. In this paper, we begin to develop a multi-domain framework that can evade those problems. Building on recent work by Osburn and Nishimura, in the problematic region of spacetime we use a puncture scheme and decompose the punctured field equations into a basis of Fourier and azimuthal $m$ modes, avoiding a harmonic decomposition in the $\theta$ direction. Outside the problematic region, we allow for a complete spherical- or spheroidal-harmonic decomposition. As a demonstration, we implement this framework in the simple context of a scalar charge in circular orbit around a Schwarzschild black hole. Our implementation utilizes several recent advances: a spectral method in each region, hyperboloidal compactification, and an extremely high-order puncture.


title: Onsager's "Ideal Turbulence" Theory

abstract: Lars Onsager in 1945-1949 made an exact analysis of the high Reynolds-number limit for individual turbulent flow realizations modeled by incompressible Navier-Stokes equations, motivated by experimental observations that dissipation of kinetic energy does not vanish. I review here developments spurred by his key idea, that such flows are well-described by distributional or "weak" solutions of ideal Euler equations. 1/3 H\"older singularities of the velocity field were predicted by Onsager and since observed. His theory describes turbulent energy cascade without probabilistic assumptions and yields a local, deterministic version of the Kolmogorov 4/5th law. The approach is closely related to renormalization group methods in physics and envisages "conservation-law anomalies", as discovered later in quantum field theory. There are also deep connections with Large-Eddy Simulation modeling. More recently, dissipative Euler solutions of the type conjectured by Onsager have been constructed and his 1/3 H\"older singularity proved to be the sharp threshold for anomalous dissipation. This progress has been achieved by an unexpected connection with work of John Nash on isometric embeddings of low regularity or "convex integration" techniques. The dissipative Euler solutions yielded by this method are wildly non-unique for fixed initial data, suggesting "spontaneously stochastic" behavior of high-Reynolds number solutions. I focus in particular on applications to wall-bounded turbulence, leading to novel concepts of spatial cascades of momentum, energy and vorticity to or from the wall as deterministic, space-time local phenomena. This theory thus makes testable predictions and offers new perspectives on Large-Eddy Simulation in presence of solid walls.

categories: physics.flu-dyn cond-mat.stat-mech math-ph math.AP math.MP


title: The Average Spectrum Norm and Near-Optimal Tensor Completion

abstract: We introduce a new tensor norm, the average spectrum norm, to study sample complexity of tensor completion problems based on the canonical polyadic decomposition (CPD). Properties of the average spectrum norm and its dual norm are investigated, demonstrating their utility for low-rank tensor recovery analysis. Our novel approach significantly reduces the provable sample rate for CPD-based noisy tensor completion, providing the best bounds to date on the number of observed noisy entries required to produce an arbitrarily accurate estimate of an underlying mean value tensor. Under Poisson and Bernoulli multivariate distributions, we show that an $N$-way CPD rank-$R$ parametric tensor $\boldsymbol{\mathscr{M}}\in\mathbb{R}^{I\times \cdots\times I}$ generating noisy observations can be approximated by large likelihood estimators from $\mathcal{O}(IR^2\log^{N+2}(I))$ revealed entries. Furthermore, under nonnegative and orthogonal versions of the CPD we improve the result to depend linearly on the rank, achieving the near-optimal rate $\mathcal{O}(IR\log^{N+2}(I))$.


title: Empowering Enterprise Development by Building and Deploying Admin Dashboard using Refine Framework

abstract: This project proposes the development of an advanced admin dashboard tailored for enterprise development, leveraging the Refine framework, Ant Design, and GraphQL API. It promises heightened operational efficiency by optimizing backend integration and employing GraphQL's dynamic data subscription for real-time insights. With an emphasis on modern aesthetics and user-centric design, it ensures seamless data visualization and management. Key functionalities encompass user administration, data visualization, CRUD operations, real-time notifications, and seamless integration with existing systems. The deliverable includes a deployable dashboard alongside comprehensive documentation, aiming to empower enterprise teams with a cutting-edge, data-driven solution.


title: cuFastTuckerPlus: A Stochastic Parallel Sparse FastTucker Decomposition Using GPU Tensor Cores

abstract: Sparse tensors are prevalent in real-world applications, often characterized by their large-scale, high-order, and high-dimensional nature. Directly handling raw tensors is impractical due to the significant memory and computational overhead involved. The current mainstream approach involves compressing or decomposing the original tensor. One popular tensor decomposition algorithm is the Tucker decomposition. However, existing state-of-the-art algorithms for large-scale Tucker decomposition typically relax the original optimization problem into multiple convex optimization problems to ensure polynomial convergence. Unfortunately, these algorithms tend to converge slowly. In contrast, tensor decomposition exhibits a simple optimization landscape, making local search algorithms capable of converging to a global (approximate) optimum much faster. In this paper, we propose the FastTuckerPlus algorithm, which decomposes the original optimization problem into two non-convex optimization problems and solves them alternately using the Stochastic Gradient Descent method. Furthermore, we introduce cuFastTuckerPlus, a fine-grained parallel algorithm designed for GPU platforms, leveraging the performance of tensor cores. This algorithm minimizes memory access overhead and computational costs, surpassing the state-of-the-art algorithms. Our experimental results demonstrate that our method achieves a speedup of $3X$ to $5X$ compared to state-of-the-art algorithms.


title: Quantum Risk Analysis of Financial Derivatives

abstract: We introduce two quantum algorithms to compute the Value at Risk (VaR) and Conditional Value at Risk (CVaR) of financial derivatives using quantum computers: the first by applying existing ideas from quantum risk analysis to derivative pricing, and the second based on a novel approach using Quantum Signal Processing (QSP). Previous work in the literature has shown that quantum advantage is possible in the context of individual derivative pricing and that advantage can be leveraged in a straightforward manner in the estimation of the VaR and CVaR. The algorithms we introduce in this work aim to provide an additional advantage by encoding the derivative price over multiple market scenarios in superposition and computing the desired values by applying appropriate transformations to the quantum system. We perform complexity and error analysis of both algorithms, and show that while the two algorithms have the same asymptotic scaling the QSP-based approach requires significantly fewer quantum resources for the same target accuracy. Additionally, by numerically simulating both quantum and classical VaR algorithms, we demonstrate that the quantum algorithm can extract additional advantage from a quantum computer compared to individual derivative pricing. Specifically, we show that under certain conditions VaR estimation can lower the latest published estimates of the logical clock rate required for quantum advantage in derivative pricing by up to $\sim 30$x. In light of these results, we are encouraged that our formulation of derivative pricing in the QSP framework may be further leveraged for quantum advantage in other relevant financial applications, and that quantum computers could be harnessed more efficiently by considering problems in the financial sector at a higher level.


title: CFlow: Supporting Semantic Flow Analysis of Students' Code in Programming Problems at Scale

abstract: The high demand for computer science education has led to high enrollments, with thousands of students in many introductory courses. In such large courses, it can be overwhelmingly difficult for instructors to understand class-wide problem-solving patterns or issues, which is crucial for improving instruction and addressing important pedagogical challenges. In this paper, we propose a technique and system, CFlow, for creating understandable and navigable representations of code at scale. CFlow is able to represent thousands of code samples in a visualization that resembles a single code sample. CFlow creates scalable code representations by (1) clustering individual statements with similar semantic purposes, (2) presenting clustered statements in a way that maintains semantic relationships between statements, (3) representing the correctness of different variations as a histogram, and (4) allowing users to navigate through solutions interactively using semantic filters. With a multi-level view design, users can navigate high-level patterns, and low-level implementations. This is in contrast to prior tools that either limit their focus on isolated statements (and thus discard the surrounding context of those statements) or cluster entire code samples (which can lead to large numbers of clusters -- for example, if there are n code features and m implementations of each, there can be m^n clusters). We evaluated the effectiveness of CFlow with a comparison study, found participants using CFlow spent only half the time identifying mistakes and recalled twice as many desired patterns from over 6,000 submissions.


title: Intergenerational Insurance

abstract: How should successive generations insure each other when the young can default on previously promised transfers to the old? This paper studies intergenerational insurance that maximizes the expected discounted utility of all generations subject to participation constraints for each generation. If complete insurance is unattainable, the optimal intergenerational insurance is history-dependent even when the environment is stationary. The risk from a generational shock is spread into the future, with periodic resetting. Interpreting intergenerational insurance in terms of debt, the fiscal reaction function is nonlinear and the risk premium on debt is lower than the risk premium with complete insurance.


title: Empowering Federated Learning with Implicit Gossiping: Mitigating Connection Unreliability Amidst Unknown and Arbitrary Dynamics

abstract: Federated learning is a popular distributed learning approach for training a machine learning model without disclosing raw data. It consists of a parameter server and a possibly large collection of clients (e.g., in cross-device federated learning) that may operate in congested and changing environments. In this paper, we study federated learning in the presence of stochastic and dynamic communication failures wherein the uplink between the parameter server and client $i$ is on with unknown probability $p_i^t$ in round $t$. Furthermore, we allow the dynamics of $p_i^t$ to be arbitrary. We first demonstrate that when the $p_i^t$'s vary across clients, the most widely adopted federated learning algorithm, Federated Average (FedAvg), experiences significant bias. To address this observation, we propose Federated Postponed Broadcast (FedPBC), a simple variant of FedAvg. FedPBC differs from FedAvg in that the parameter server postpones broadcasting the global model till the end of each round. Despite uplink failures, we show that FedPBC converges to a stationary point of the original non-convex objective. On the technical front, postponing the global model broadcasts enables implicit gossiping among the clients with active links in round $t$. Despite the time-varying nature of $p_i^t$, we can bound the perturbation of the global model dynamics using techniques to control gossip-type information mixing errors. Extensive experiments have been conducted on real-world datasets over diversified unreliable uplink patterns to corroborate our analysis.


title: Integration of Federated Learning and Blockchain in Healthcare: A Tutorial

abstract: Wearable devices and medical sensors revolutionize health monitoring, raising concerns about data privacy in ML for healthcare. This tutorial explores FL and BC integration, offering a secure and privacy-preserving approach to healthcare analytics. FL enables decentralized model training on local devices at healthcare institutions, keeping patient data localized. This facilitates collaborative model development without compromising privacy. However, FL introduces vulnerabilities. BC, with its tamper-proof ledger and smart contracts, provides a robust framework for secure collaborative learning in FL. After presenting a taxonomy for the various types of data used in ML in medical applications, and a concise review of ML techniques for healthcare use cases, this tutorial explores three integration architectures for balancing decentralization, scalability, and reliability in healthcare data. Furthermore, it investigates how BCFL enhances data security and collaboration in disease prediction, medical image analysis, patient monitoring, and drug discovery. By providing a tutorial on FL, blockchain, and their integration, along with a review of BCFL applications, this paper serves as a valuable resource for researchers and practitioners seeking to leverage these technologies for secure and privacy-preserving healthcare ML. It aims to accelerate advancements in secure and collaborative healthcare analytics, ultimately improving patient outcomes.


title: Active pattern formation emergent from single-species nonreciprocity

abstract: Nonreciprocal forces violating Newton's third law are common in a plethora of nonequilibrium situations ranging from predator-prey systems to the swarming of birds and effective colloidal interactions under flow. While many recent studies have focused on two species with nonreciprocal coupling, much less is examined for the basic single-component system breaking the actio and reactio equality of force within the same species. Here, we systematically derive the fundamental field theory of single-species nonreciprocal interactions from microscopic dynamics, leading to a generic framework termed Active Model N (N denoting nonreciprocity). We explore the rich dynamics of pattern formation in this intrinsic nonreciprocal system and the emergence of self-traveling states with persistent variation and flowing of active branched patterns. One particular new characteristic pattern is an interwoven self-knitting "yarn" structure with a unique feature of simultaneous development of micro- and bulk phase separations. The growth dynamics of a "ball-of-wool" active droplet towards these self-knitted yarn or branched states exhibits a crossover between different scaling behaviors. The mechanism underlying this distinct class of active phase separation is attributed to the interplay between force nonreciprocity and competition. Our predictions can be applied to various biological and artificial active matter systems controlled by single-species nonreciprocity.


title: Towards DNA-Encoded Library Generation with GFlowNets

abstract: DNA-encoded libraries (DELs) are a powerful approach for rapidly screening large numbers of diverse compounds. One of the key challenges in using DELs is library design, which involves choosing the building blocks that will be combinatorially combined to produce the final library. In this paper we consider the task of protein-protein interaction (PPI) biased DEL design. To this end, we evaluate several machine learning algorithms on the PPI modulation task and use them as a reward for the proposed GFlowNet-based generative approach. We additionally investigate the possibility of using structural information about building blocks to design a hierarchical action space for the GFlowNet. The observed results indicate that GFlowNets are a promising approach for generating diverse combinatorial library candidates.


title: Synthetic Census Data Generation via Multidimensional Multiset Sum

abstract: The US Decennial Census provides valuable data for both research and policy purposes. Census data are subject to a variety of disclosure avoidance techniques prior to release in order to preserve respondent confidentiality. While many are interested in studying the impacts of disclosure avoidance methods on downstream analyses, particularly with the introduction of differential privacy in the 2020 Decennial Census, these efforts are limited by a critical lack of data: The underlying "microdata," which serve as necessary input to disclosure avoidance methods, are kept confidential. In this work, we aim to address this limitation by providing tools to generate synthetic microdata solely from published Census statistics, which can then be used as input to any number of disclosure avoidance algorithms for the sake of evaluation and carrying out comparisons. We define a principled distribution over microdata given published Census statistics and design algorithms to sample from this distribution. We formulate synthetic data generation in this context as a knapsack-style combinatorial optimization problem and develop novel algorithms for this setting. While the problem we study is provably hard, we show empirically that our methods work well in practice, and we offer theoretical arguments to explain our performance. Finally, we verify that the data we produce are "close" to the desired ground truth.


abstract: Recent advancements in sequence prediction have significantly improved the accuracy of video data interpretation; however, existing models often overlook the potential of attention-based mechanisms for next-frame prediction. This study introduces the Vision Augmentation Prediction Autoencoder with Attention Design (VAPAAD), an innovative approach that integrates attention mechanisms into sequence prediction, enabling nuanced analysis and understanding of temporal dynamics in video sequences. Utilizing the Moving MNIST dataset, we demonstrate VAPAAD's robust performance and superior handling of complex temporal data compared to traditional methods. VAPAAD combines data augmentation, ConvLSTM2D layers, and a custom-built self-attention mechanism to effectively focus on salient features within a sequence, enhancing predictive accuracy and context-aware analysis. This methodology not only adheres to human cognitive processes during video interpretation but also addresses limitations in conventional models, which often struggle with the variability inherent in video sequences. The experimental results confirm that VAPAAD outperforms existing models, especially in integrating attention mechanisms, which significantly improve predictive performance.


title: LegalPro-BERT: Classification of Legal Provisions by fine-tuning BERT Large Language Model

abstract: A contract is a type of legal document commonly used in organizations. Contract review is an integral and repetitive process to avoid business risk and liability. Contract analysis requires the identification and classification of key provisions and paragraphs within an agreement. Identification and validation of contract clauses can be a time-consuming and challenging task demanding the services of trained and expensive lawyers, paralegals or other legal assistants. Classification of legal provisions in contracts using artificial intelligence and natural language processing is complex due to the requirement of domain-specialized legal language for model training and the scarcity of sufficient labeled data in the legal domain. Using general-purpose models is not effective in this context due to the use of specialized legal vocabulary in contracts which may not be recognized by a general model. To address this problem, we propose the use of a pre-trained large language model which is subsequently calibrated on legal taxonomy. We propose LegalPro-BERT, a BERT transformer architecture model that we fine-tune to efficiently handle classification task for legal provisions. We conducted experiments to measure and compare metrics with current benchmark results. We found that LegalPro-BERT outperforms the previous benchmark used for comparison in this research.


title: Widths and rigidity of unconditional sets and random vectors

abstract: We prove that any unconditional set in $\mathbb{R}^N$ that is invariant under cyclic shifts of coordinates is rigid in $\ell_q^N$, $1\le q\le 2$, i.e. it can not be well approximated by linear spaces of dimension essentially smaller than $N$. We apply the approach of E.D.~Gluskin to the setting of averaged Kolmogorov widths of unconditional random vectors or vectors of independent mean zero random variables, and prove their rigidity. These results are obtained using a general lower bound for the averaged Kolmogorov width via weak moments of biorthogonal random vector. This paper continues the study of the rigidity initiated by the first author. We also provide several corollaries including lower bounds for Kolmogorov widths of mixed norm balls.


title: Feature selection in linear SVMs via hard cardinality constraint: a scalable SDP decomposition approach

abstract: In this paper, we study the embedded feature selection problem in linear Support Vector Machines (SVMs), in which a cardinality constraint is employed, leading to a fully explainable selection model. The problem is NP-hard due to the presence of the cardinality constraint, even though the original linear SVM amounts to a problem solvable in polynomial time. To handle the hard problem, we first introduce two mixed-integer formulations for which novel SDP relaxations are proposed. Exploiting the sparsity pattern of the relaxations, we decompose the problems and obtain equivalent relaxations in a much smaller cone, making the conic approaches scalable. To make the best usage of the decomposed relaxations, we propose heuristics using the information of its optimal solution. Moreover, an exact procedure is proposed by solving a sequence of mixed-integer decomposed SDPs. Numerical results on classical benchmarking datasets are reported, showing the efficiency and effectiveness of our approach.


title: LLM-based Test-driven Interactive Code Generation: User Study and Empirical Evaluation

abstract: Large language models (LLMs) have shown great potential in automating significant aspects of coding by producing natural code from informal natural language (NL) intent. However, given NL is informal, it does not lend easily to checking that the generated code correctly satisfies the user intent. In this paper, we propose a novel interactive workflow TiCoder for guided intent clarification (i.e., partial formalization) through tests to support the generation of more accurate code suggestions. Through a mixed methods user study with 15 programmers, we present an empirical evaluation of the effectiveness of the workflow to improve code generation accuracy. We find that participants using the proposed workflow are significantly more likely to correctly evaluate AI generated code, and report significantly less task-induced cognitive load. Furthermore, we test the potential of the workflow at scale with four different state-of-the-art LLMs on two python datasets, using an idealized proxy for a user feedback. We observe an average absolute improvement of 38.43% in the pass@1 code generation accuracy for both datasets and across all LLMs within 5 user interactions, in addition to the automatic generation of accompanying unit tests.


title: Quasilinear differential constraints for parabolic systems of Jordan-block type

abstract: We prove that linear degeneracy is a necessary conditions for systems in Jordan-block form to admit a compatible quasilinear differential constraint. Such condition is also sufficient for 2x2 systems and turns out to be equivalent to possess the Hamiltonian property. Some explicit solutions of parabolic systems are herein given: two principal hierarchies arising from the associativity theory and the delta-functional reduction of the El's equation in the hard rod case are integrated.


title: Chinchilla Scaling: A replication attempt

abstract: Hoffmann et al. (2022) propose three methods for estimating a compute-optimal scaling law. We attempt to replicate their third estimation procedure, which involves fitting a parametric loss function to a reconstruction of data from their plots. We find that the reported estimates are inconsistent with their first two estimation methods, fail at fitting the extracted data, and report implausibly narrow confidence intervals--intervals this narrow would require over 600,000 experiments, while they likely only ran fewer than 500. In contrast, our rederivation of the scaling law using the third approach yields results that are compatible with the findings from the first two estimation procedures described by Hoffmann et al.


title: An Enhanced Hybrid HHL Algorithm

abstract: We present a classical enhancement to improve the accuracy of the Hybrid variant (Hybrid HHL) of the quantum algorithm for solving liner systems of equations proposed by Harrow, Hassidim, and Lloyd (HHL). We achieve this by using higher precision quantum estimates of the eigenvalues relevant to the linear system, and an enhanced classical processing step to guide the eigenvalue inversion part of Hybrid HHL. We show that eigenvalue estimates with just two extra bits of precision results in tighter error bounds for our Enhanced Hybrid HHL compared to HHL. We also show that our enhancement reduces the error of Hybrid HHL by an average of 57 percent on an ideal quantum processor for a representative sample of 2x2 systems. On IBM Hanoi and IonQ Aria-1 hardware, we see that the error of Enhanced Hybrid HHL algorithm is on average 13 percent and 20 percent (respecitvely) less than that of HHL for a similar set of 2x2 systems. Finally, we use simulated eigenvalue estimates to perform an inversion of a 4x4 matrix on IonQ Aria-1 with a fidelity of 0.61. To our knowledge this is the largest HHL implementation with a fidelity greater than 0.5.


title: Chiral phase transition in soft-wall AdS/QCD with scalar-dilaton coupling

abstract: The chiral phase boundary of nuclear matter is expected to have a critical point where the rapid crossover of lattice methods at zero chemical potential becomes a first-order phase transition. Phenomenological models based on the AdS/CFT correspondence, known as AdS/ QCD, have succeeded in capturing many features of nuclear matter, with recent progress in producing the expected critical point. We study a model that produces a critical point in the chiral phase diagram by introducing a coupling between the scalar chiral field and the dilaton. We examine the effect of the scalar-dilaton coupling on the critical point. We also study the zero-temperature chiral dynamics, which must allow for spontaneous chiral symmetry breaking in the limit of zero quark mass. We find that when the scalar-dilaton coupling is large enough to ensure correct zero-temperature chiral dynamics, a critical point is present only if the quark mass is greater than 12.8 MeV.


title: Purple is the new green: biopigments and spectra of Earth-like purple worlds

abstract: With more than 5500 detected exoplanets, the search for life is entering a new era. Using life on Earth as our guide, we look beyond green landscapes to expand our ability to detect signs of surface life on other worlds. While oxygenic photosynthesis gives rise to modern green landscapes, bacteriochlorophyll-based anoxygenic phototrophs can also colour their habitats and could dominate a much wider range of environments on Earth-like exoplanets. Here, we characterize the reflectance spectra of a collection of purple sulfur and purple non-sulfur bacteria from a variety of anoxic and oxic environments. We present models for Earth-like planets where purple bacteria dominate the surface and show the impact of their signatures on the reflectance spectra of terrestrial exoplanets. Our research provides a new resource to guide the detection of purple bacteria and improves our chances of detecting life on exoplanets with upcoming telescopes. Our biological pigment data base for purple bacteria and the high-resolution spectra of Earth-like planets, including ocean worlds, snowball planets, frozen worlds, and Earth analogues, are available online, providing a tool for modellers and observers to train retrieval algorithms, optimize search strategies, and inform models of Earth-like planets, where purple is the new green.


title: Statistics for the triangle density in ERGM and its mean-field approximation

abstract: We consider the edge-triangle model (or Strauss model), and focus on the asymptotic behavior of the triangle density when the size of the graph increases to infinity. This random graph belongs to the class of exponential random graphs, which follows the statistical mechanics approach of introducing a Hamiltonian to weigh the probability measure on the state space of graphs. In the analyticity region of the free energy, we prove a law of large numbers for the triangle density. Along the critical curve, where analyticity breaks down, we show that the triangle density concentrates with high probability in a neighborhood of its typical value. A predominant part of our work is devoted to the study of a mean-field approximation of the edge-triangle model, where explicit computations are possible. In this setting we can go further, and additionally prove a standard and non-standard central limit theorem at the critical point, together with many concentration results obtained via large deviations and statistical mechanics techniques. Despite a rigorous comparison between these two models is still lacking, we believe that they are asymptotically equivalent in many respects, therefore we formulate conjectures on the edge-triangle model, partially supported by simulations, based on the mean-field investigation.


title: Design and Implementation of a Java-Based Client-Server Application

abstract: This report details the development of a networked distributed system named Group Communication System (GCS), implemented in Java to exemplify socket programming and communication protocols. GCS facilitates group-based client-server communication through a command-line interface (CLI), enabling seamless group interaction and management. The project emphasizes fault tolerance, design patterns, and version control system (VCS) utilization. The report offers insights into system architecture, implementation, and practical considerations, providing a comprehensive understanding of distributed systems' technical background and operational aspects.


title: GeoAI Reproducibility and Replicability: a computational and spatial perspective

abstract: GeoAI has emerged as an exciting interdisciplinary research area that combines spatial theories and data with cutting-edge AI models to address geospatial problems in a novel, data-driven manner. While GeoAI research has flourished in the GIScience literature, its reproducibility and replicability (R&R), fundamental principles that determine the reusability, reliability, and scientific rigor of research findings, have rarely been discussed. This paper aims to provide an in-depth analysis of this topic from both computational and spatial perspectives. We first categorize the major goals for reproducing GeoAI research, namely, validation (repeatability), learning and adapting the method for solving a similar or new problem (reproducibility), and examining the generalizability of the research findings (replicability). Each of these goals requires different levels of understanding of GeoAI, as well as different methods to ensure its success. We then discuss the factors that may cause the lack of R&R in GeoAI research, with an emphasis on (1) the selection and use of training data; (2) the uncertainty that resides in the GeoAI model design, training, deployment, and inference processes; and more importantly (3) the inherent spatial heterogeneity of geospatial data and processes. We use a deep learning-based image analysis task as an example to demonstrate the results' uncertainty and spatial variance caused by different factors. The findings reiterate the importance of knowledge sharing, as well as the generation of a "replicability map" that incorporates spatial autocorrelation and spatial heterogeneity into consideration in quantifying the spatial replicability of GeoAI research.


title: Rotation and flipping invariant self-organizing maps with astronomical images: A cookbook and application to the VLA Sky Survey QuickLook images

abstract: Modern wide field radio surveys typically detect millions of objects. Techniques based on machine learning are proving to be useful for classifying large numbers of objects. The self-organizing map (SOM) is an unsupervised machine learning algorithm that projects a many-dimensional dataset onto a two- or three-dimensional lattice of neurons. This dimensionality reduction allows the user to visualize common features of the data better and develop algorithms for classifying objects that are not otherwise possible with large datasets. To this aim, we use the PINK implementation of a SOM. PINK incorporates rotation and flipping invariance so that the SOM algorithm may be applied to astronomical images. In this cookbook we provide instructions for working with PINK, including preprocessing the input images, training the model, and offering lessons learned through experimentation. The problem of imbalanced classes can be improved by careful selection of the training sample and increasing the number of neurons in the SOM (chosen by the user). Because PINK is not scale-invariant, structure can be smeared in the neurons. This can also be improved by increasing the number of neurons in the SOM. We also introduce pyink, a Python package used to read and write PINK binary files, assist in common preprocessing operations, perform standard analyses, visualize the SOM and preprocessed images, and create image-based annotations using a graphical interface. A tutorial is also provided to guide the user through the entire process. We present an application of PINK to VLA Sky Survey (VLASS) images. We demonstrate that the PINK is generally able to group VLASS sources with similar morphology together. We use the results of PINK to estimate the probability that a given source in the VLASS QuickLook Catalogue is actually due to sidelobe contamination.


title: Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning

abstract: E-health allows smart devices and medical institutions to collaboratively collect patients' data, which is trained by Artificial Intelligence (AI) technologies to help doctors make diagnosis. By allowing multiple devices to train models collaboratively, federated learning is a promising solution to address the communication and privacy issues in e-health. However, applying federated learning in e-health faces many challenges. First, medical data is both horizontally and vertically partitioned. Since single Horizontal Federated Learning (HFL) or Vertical Federated Learning (VFL) techniques cannot deal with both types of data partitioning, directly applying them may consume excessive communication cost due to transmitting a part of raw data when requiring high modeling accuracy. Second, a naive combination of HFL and VFL has limitations including low training efficiency, unsound convergence analysis, and lack of parameter tuning strategies. In this paper, we provide a thorough study on an effective integration of HFL and VFL, to achieve communication efficiency and overcome the above limitations when data is both horizontally and vertically partitioned. Specifically, we propose a hybrid federated learning framework with one intermediate result exchange and two aggregation phases. Based on this framework, we develop a Hybrid Stochastic Gradient Descent (HSGD) algorithm to train models. Then, we theoretically analyze the convergence upper bound of the proposed algorithm. Using the convergence results, we design adaptive strategies to adjust the training parameters and shrink the size of transmitted data. Experimental results validate that the proposed HSGD algorithm can achieve the desired accuracy while reducing communication cost, and they also verify the effectiveness of the adaptive strategies.


title: From Predictive Algorithms to Automatic Generation of Anomalies

abstract: Machine learning algorithms can find predictive signals that researchers fail to notice; yet they are notoriously hard-to-interpret. How can we extract theoretical insights from these black boxes? History provides a clue. Facing a similar problem -- how to extract theoretical insights from their intuitions -- researchers often turned to ``anomalies:'' constructed examples that highlight flaws in an existing theory and spur the development of new ones. Canonical examples include the Allais paradox and the Kahneman-Tversky choice experiments for expected utility theory. We suggest anomalies can extract theoretical insights from black box predictive algorithms. We develop procedures to automatically generate anomalies for an existing theory when given a predictive algorithm. We cast anomaly generation as an adversarial game between a theory and a falsifier, the solutions to which are anomalies: instances where the black box algorithm predicts - were we to collect data - we would likely observe violations of the theory. As an illustration, we generate anomalies for expected utility theory using a large, publicly available dataset on real lottery choices. Based on an estimated neural network that predicts lottery choices, our procedures recover known anomalies and discover new ones for expected utility theory. In incentivized experiments, subjects violate expected utility theory on these algorithmically generated anomalies; moreover, the violation rates are similar to observed rates for the Allais paradox and Common ratio effect.


title: PRODIS -- a speech database and a phoneme-based language model for the study of predictability effects in Polish

abstract: We present a speech database and a phoneme-level language model of Polish. The database and model are designed for the analysis of prosodic and discourse factors and their impact on acoustic parameters in interaction with predictability effects. The database is also the first large, publicly available Polish speech corpus of excellent acoustic quality that can be used for phonetic analysis and training of multi-speaker speech technology systems. The speech in the database is processed in a pipeline that achieves a 90% degree of automation. It incorporates state-of-the-art, freely available tools enabling database expansion or adaptation to additional languages.


title: Can a radiation gauge be horizon-locking?

abstract: In this short Note, I answer the titular question: Yes, a radiation gauge can be horizon-locking. Radiation gauges are very common in black hole perturbation theory. It's also very convenient if a gauge choice is horizon-locking, i.e. the location of the horizon is not moved by a linear metric perturbation. Therefore it is doubly convenient that a radiation gauge can be horizon-locking, when some simple criteria are satisfied. Though the calculation is straightforward, it seemed useful enough to warrant writing this Note. Finally I show an example: the $\ell$ vector of the Hartle-Hawking tetrad in Kerr satisfies all the conditions for ingoing radiation gauge to keep the future horizon fixed.


title: Non-Monotonic Relations of Galaxy Star Formation, Radius, and Structure at Fixed Stellar Mass

abstract: We investigate the relation between galaxy structure and star formation rate (SFR) in a sample of $\sim2.9\times10^{4}$ central galaxies with $z<0.0674$ and axial ratios $b/a>0.5$. The star-forming main sequence (SFMS) shows a bend around the stellar mass of $M_\ast\leq{}M_c=2\times10^{10}{}M_{\odot}$. At $M_\ast\leq{}M_c$ the SFMS follows a power-law $\text{SFR}\propto{}M_\ast^{0.85}$, while at higher masses it flattens. $M_c$ corresponds to a dark matter halo mass of $M_\text{vir}\sim{}10^{11.8}M_{\odot}$ where virial shocks occurs. Some galaxy structure (e.g., half-light radius, $R_e$) exhibits a non-monotonic dependence across the SFMS at a fixed $M_\ast$. We find $\text{SFR}\propto{R_e^{-0.28}}$ at fixed $M_\ast$, consistent with the global Kennicutt-Schmidt (KS) law. This finding suggests that galaxy sizes contribute to the scatter of the SFMS. However, at $M_\ast>M_c$ the relationship between SFR and $R_e$ diminishes. Low-mass galaxies above the mean of the SFMS have smaller radii, exhibit compact and centrally concentrated profiles resembling green valley (GV) and quiescent galaxies at the same mass, and have higher $M_{\text{H}_2}/M_\text{HI}$. Conversely, those below the SFMS exhibit larger radii, lower densities, have no GV or quiescent counterparts at their mass and have lower $M_{\text{H}_2}/M_\text{HI}$. The above data suggest two pathways for quenching low-mass galaxies, $M_\ast\leq{}M_c$: a fast one that changes the morphology on the SFMS and a slow one that does not. Above $M_c$, galaxies below the SFMS resemble GV and quiescent galaxies structurally, implying that they undergo a structural transformation already within the SFMS. For these massive galaxies, CG are strongly bimodal, with SFMS galaxies exhibiting negative color gradients, suggesting most star formation occurs in their outskirts, maintaining them within the SFMS.


title: Multiple-Input Fourier Neural Operator (MIFNO) for source-dependent 3D elastodynamics

abstract: Numerical simulations are essential tools to evaluate the solution of the wave equation in complex settings, such as three-dimensional (3D) domains with heterogeneous properties. However, their application is limited by high computational costs and existing surrogate models lack the flexibility of numerical solvers. This work introduces the Multiple-Input Fourier Neural Operator (MIFNO) to deal with structured 3D fields representing material properties as well as vectors describing the source characteristics. The MIFNO is applied to the problem of elastic wave propagation in the Earth's crust. It is trained on the HEMEW^S-3D database containing 30000 earthquake simulations in different heterogeneous domains with random source positions and orientations. Outputs are time- and space-dependent surface wavefields. The MIFNO predictions are assessed as good to excellent based on Goodness-Of-Fit (GOF) criteria. Wave arrival times and wave fronts' propagation are very accurate since 80% of the predictions have an excellent phase GOF. The fluctuations amplitudes are good for 87% of the predictions. The envelope score is hindered by the small-scale fluctuations that are challenging to capture due to the complex physical phenomena associated with high-frequency features. Nevertheless, the MIFNO can generalize to sources located outside the training domain and it shows good generalization ability to a real complex overthrust geology. When focusing on a region of interest, transfer learning improves the accuracy with limited additional costs, since GOF scores improved by more than 1 GOF unit with only 500 additional specific samples. The MIFNO is the first surrogate model offering the flexibility of an earthquake simulator with varying sources and material properties. Its good accuracy and massive speed-up offer new perspectives to replace numerical simulations in many-query problems.


title: Symmetries and Thermal Radiation: A Classical Derivation of the Planck Spectrum

abstract: A derivation of the Planck spectrum for thermal radiation is given based upon wave fluctuations within relativistic classical physics. The derivation depends crucially on thermal fluctuations existing above the fundamental inertial-frame-independent fluctuations of classical zero-point radiation. Such frame-independent zero-point fluctuations exist only in a relativistic wave theory and cannot exist in a nonrelativistic wave theory. Thus such a classical derivation of the Planck spectrum exists in a Lorentz-covariant classical theory, such as classical electrodynamics, but not in a Galilean-covariant theory where all waves are based upon material media. Classical zero-point radiation provides a purely classical alternative to quanta in the analysis of the Planck spectrum.


title: Random sampling and polynomial-free interpolation by Generalized MultiQuadrics

abstract: We prove that interpolation matrices for Generalized MultiQuadrics (GMQ) of order greater than one are almost surely nonsingular without polynomial addition, in any dimension and with any continuous random distribution of sampling points. We also include a new class of generalized MultiQuadrics recently proposed by Buhmann and Ortmann.


title: Stochastic Thermodynamics at the Quantum-Classical Boundary: A Self-Consistent Framework Based on Adiabatic-Response Theory

abstract: Microscopic thermal machines promise to play an important role in future quantum technologies. Making such devices widely applicable will require effective strategies to channel their output into easily accessible storage systems like classical degrees of freedom. Here, we develop a self-consistent theoretical framework that makes it possible to model such quantum-classical hybrid devices in a thermodynamically consistent manner. Our approach is based on the assumption that the quantum part of the device is subject to strong decoherence and dissipation induced by a thermal reservoir. Due to the ensuing separation of time scales between slowly evolving classical and fast relaxing quantum degrees of freedom, the dynamics of the hybrid system can be described by means of adiabatic-response theory. We show that, upon including fluctuations in a minimally consistent way, the resulting equations of motion can be equipped with a first and second law, both on the ensemble level and on the level of individual trajectories of the classical part of the system, where thermodynamic quantities like heat and work become stochastic variables. As an application of our theory, we work out a physically transparent model of a quantum-classical hybrid engine, whose working system consists of a chain of Rydberg atoms, which is confined in an optical cavity and driven by periodic temperature variations. We show by means of numerical simulations that the engine can sustain periodic oscillations of a movable mirror, which acts as a classical load, against external friction and extract the full distributions of input heat and output work. By making the statistics of thermodynamic processes in quantum-classical hybrid systems accessible without the need to further specify a measurement protocol, our work contributes towards bridging the long-standing gap between classical and quantum stochastic thermodynamics.


title: Modeling scattering matrix containing evanescent modes for wavefront shaping applications in disordered media

abstract: We developed an open-source scalar wave transport model to estimate the generalized scattering matrix (S matrix) of a disordered medium in the diffusion regime. Here, the term generalization refers to the incorporation of evanescent wave field modes in addition to propagating modes while estimating the S matrix. For that we used the scalar Kirchhoff-Helmholtz boundary integral formulation together with the Green's function perturbation method to generalize the conventional Fisher-Lee relations to include evanescent modes as well. The estimated S matrix, which satisfies generalized unitarity and reciprocity conditions, is modeled for a 2D disordered waveguide. The generalized transmission matrix contained in the S matrix is used to estimate the optimal phase-conjugate wavefront for focusing onto an evanescent mode. The phenomena of universal transmission value of 2/3 for such an optimal phase conjugate wavefront is also shown in the context of evanescent wave mode focusing through a diffusive disorder. The presented code framework may be of interest to wavefront shaping researchers for visualizing and estimating wave transport properties in general.


title: Modelling adhesion in stochastic and mean-field models of cell migration

abstract: Adhesion between cells plays an important role in many biological processes such as tissue morphogenesis and homeostasis, wound healing and cancer cell metastasis. From a mathematical perspective, adhesion between multiple cell types has been previously analysed using discrete and continuum models including the Cellular Potts models and partial differential equations (PDEs). While these models can represent certain biological situations well, Cellular Potts models can be computationally expensive and continuum models only capture the macroscopic behaviour of a population of cells, ignoring stochasticity and the discrete nature of cell dynamics. Cellular automaton models allow us to address these problems and can be used for a wide variety of biological systems. In this paper, we consider a cellular automaton approach and develop an on-lattice agent-based model (ABM) for cell migration and adhesion in a population composed of two cell types. By deriving and comparing the corresponding PDEs to the ABM, we demonstrate that cell aggregation and cell sorting are not possible in the PDE model. Therefore, we propose a set of stochastic mean equations (SMEs) which better capture the behaviour of the ABM in one and two dimensions.


title: Convergence of reputations under indirect reciprocity

abstract: Previous research has shown how indirect reciprocity can promote cooperation through evolutionary game theoretic models. Most work in this field assumes a separation of time-scales: individuals' reputations equilibrate at a fast time scale for given frequencies of strategies while the strategies change slowly according to the replicator dynamics. Much of the previous research has focused on the behaviour and stability of equilibria for the replicator dynamics. Here we focus on the underlying reputational dynamics that occur on a fast time scale. We describe reputational dynamics as systems of differential equations and conduct stability analyses on their equilibria. We prove that reputations converge to a unique equilibrium for each of the five standard norms whether assessments are public or private. These results confirm a crucial but previously unconfirmed assumption underlying the theory of indirect reciprocity for the most studied set of norms.


title: Online Estimation via Offline Estimation: An Information-Theoretic Framework

abstract: $ $The classical theory of statistical estimation aims to estimate a parameter of interest under data generated from a fixed design ("offline estimation"), while the contemporary theory of online learning provides algorithms for estimation under adaptively chosen covariates ("online estimation"). Motivated by connections between estimation and interactive decision making, we ask: is it possible to convert offline estimation algorithms into online estimation algorithms in a black-box fashion? We investigate this question from an information-theoretic perspective by introducing a new framework, Oracle-Efficient Online Estimation (OEOE), where the learner can only interact with the data stream indirectly through a sequence of offline estimators produced by a black-box algorithm operating on the stream. Our main results settle the statistical and computational complexity of online estimation in this framework. $\bullet$ Statistical complexity. We show that information-theoretically, there exist algorithms that achieve near-optimal online estimation error via black-box offline estimation oracles, and give a nearly-tight characterization for minimax rates in the OEOE framework. $\bullet$ Computational complexity. We show that the guarantees above cannot be achieved in a computationally efficient fashion in general, but give a refined characterization for the special case of conditional density estimation: computationally efficient online estimation via black-box offline estimation is possible whenever it is possible via unrestricted algorithms. Finally, we apply our results to give offline oracle-efficient algorithms for interactive decision making.


title: Numerical methods for solving the linearized model of a hinged-free reduced plate arising in flow structure interactions

abstract: The problem of partially hinged and partially free rectangular plate that aims to represent a suspension bridge subject to some external forces (for example the wind) is considered in order to model and simulate the unstable end behavior. Such a problem can be modeled by a plate evolution equation, which is nonlinear with a nonlocal stretching effect in the spanwise direction. The external forces are periodic in time and cause the vortex shedding on the structure (on the surface of the plate) and thus it may cause damage to the material. Numerical study of the behavior of steady state solutions for different values of the force velocity are provided with two finite element methods of different type.


title: Epistemic Uncertainty Quantification For Pre-trained Neural Network

abstract: Epistemic uncertainty quantification (UQ) identifies where models lack knowledge. Traditional UQ methods, often based on Bayesian neural networks, are not suitable for pre-trained non-Bayesian models. Our study addresses quantifying epistemic uncertainty for any pre-trained model, which does not need the original training data or model modifications and can ensure broad applicability regardless of network architectures or training techniques. Specifically, we propose a gradient-based approach to assess epistemic uncertainty, analyzing the gradients of outputs relative to model parameters, and thereby indicating necessary model adjustments to accurately represent the inputs. We first explore theoretical guarantees of gradient-based methods for epistemic UQ, questioning the view that this uncertainty is only calculable through differences between multiple models. We further improve gradient-driven UQ by using class-specific weights for integrating gradients and emphasizing distinct contributions from neural network layers. Additionally, we enhance UQ accuracy by combining gradient and perturbation methods to refine the gradients. We evaluate our approach on out-of-distribution detection, uncertainty calibration, and active learning, demonstrating its superiority over current state-of-the-art UQ methods for pre-trained models.