title: Correction with Backtracking Reduces Hallucination in Summarization

abstract: Abstractive summarization aims at generating natural language summaries of a source document that are succinct while preserving the important elements. Despite recent advances, neural text summarization models are known to be susceptible to hallucinating (or more correctly confabulating), that is to produce summaries with details that are not grounded in the source document. In this paper, we introduce a simple yet efficient technique, CoBa, to reduce hallucination in abstractive summarization. The approach is based on two steps: hallucination detection and mitigation. We show that the former can be achieved through measuring simple statistics about conditional word probabilities and distance to context words. Further, we demonstrate that straight-forward backtracking is surprisingly effective at mitigation. We thoroughly evaluate the proposed method with prior art on three benchmark datasets for text summarization. The results show that CoBa is effective and efficient in reducing hallucination, and offers great adaptability and flexibility.


title: Temperature-induced reversal effects of kink dynamics in carbon nanotube on flat substrate

abstract: Carbon nanotubes are nano-objects with quite anisotropic properties, for example the mechanical properties in longitudinal and radial directions differ significantly. This feature of the carbon nanotubes yields many interesting phenomena investigated in last decades. One of them is the ability to form both hollow and collapsed states if the radius of the nanotube is large enough. The transitions between the two states have been also reported. In our study we present single-walled carbon nanotube interacting with a plane substrate and characterize the energy of interaction with the substrate using effective Lennard-Jones-type potential. We show energy of the homogeneous open and collapsed states depending on the radius of the carbon nanotube and report on the bi-stability in some range of the nanotube diameters. Using the molecular-dynamical simulations we look at the evolution of the initial half-opened, half-collapsed state and demonstrate that the transition area from one state to another is spatially localized having features of topological soliton (kink or anti-kink). We show that the value and the direction of the kink propagation speed depend significantly on the nanotube diameter as well as on the temperature of the system. We also discuss the mechanism of the process using a simplified model with asymmetric double-well potential and show the entropic nature of the transition.


title: Electron Emission Channeling for lattice location of radioactive isotopes in single crystals: Improvements from a Timepix3 quad detector and new PyFDD data analysis software

abstract: Electron Emission Channeling (EC) is a powerful technique for the investigation of the lattice location of radioactive isotopes implanted into single crystals. After implantation the isotopes occupy certain lattice locations in the crystal, which can in some cases be altered by annealing. Upon decay, the emission of a charged particle, typically a beta, may result in a channeling trajectory when its starting lattice location is aligned with major symmetry axes or planes of the crystal. By measuring the emission anisotropy in the direction of these axes for distinct annealing temperatures, the lattice location of the isotope can be determined with great precision and insightful information can be obtained on how annealing affects the occupied sites. This work reports on the installation of a Timepix3 quad detector and Katherine Gen2 readout in an experimental setup located at ISOLDE at CERN. The large increase in the number of pixels of the Timepix3, in comparison to previously used pad detectors, required more sophisticated tools for data treatment and fitting of channeling patterns. From this need, the PyFDD software was born. Its latest update features an intuitive graphical interface, with tools for noise masking, pattern visualization, simulations browsing, chi-square or maximum likelihood based fits and gamma background correction.


title: Nonlinear theory remedies the lack of invertibility in time periodic fluid flows

abstract: This paper provides a framework to strong time periodic solutions of quasilinear evolution equations. The novelty of this approach is that zero is allowed to be a spectral value of the underlying linearized operator. This approach is then applied to time periodic problems associated to the Navier-Stokes equations, generalized Newtonian fluids, quasilinear reaction-diffusion systems as well as to magneto-hydrodynamics.


title: Revisiting spin ice physics in the ferromagnetic Ising pyrochlore Pr$_2$Sn$_2$O$_7$

abstract: Pyrochlore materials are characterized by their hallmark network of corner-sharing rare-earth tetrahedra, which can produce a wide array of complex magnetic ground states. Ferromagnetic Ising pyrochlores often obey the "two-in-two-out" spin ice rules, which can lead to a highly-degenerate spin structure. Large moment systems, such as Ho$_2$Ti$_2$O$_7$ and Dy$_2$Ti$_2$O$_7$, tend to host a classical spin ice state with low-temperature spin freezing and emergent magnetic monopoles. Systems with smaller effective moments, such as Pr$^{3+}$-based pyrochlores, have been proposed as excellent candidates for hosting a "quantum spin ice" characterized by entanglement and a slew of exotic quasiparticle excitations. However, experimental evidence for a quantum spin ice state has remained elusive. Here, we show that the low-temperature magnetic properties of Pr$_2$Sn$_2$O$_7$ satisfy several important criteria for continued consideration as a quantum spin ice. We find that Pr$_2$Sn$_2$O$_7$ exhibits a partially spin-frozen ground state with a large volume fraction of dynamic magnetism. Our comprehensive bulk characterization and neutron scattering measurements enable us to map out the magnetic field-temperature phase diagram, producing results consistent with expectations for a ferromagnetic Ising pyrochlore. We identify key hallmarks of spin ice physics, and show that the application of small magnetic fields ($\mu_0 H_c \sim$0.75T) suppresses the spin ice state and induces a long-range ordered magnetic structure. Together, our work clarifies the current state of Pr$_2$Sn$_2$O$_7$ and encourages future studies aimed at exploring the potential for a quantum spin ice ground state in this system.


title: Hidden Citations Obscure True Impact in Science

abstract: References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.


title: Transplant arteriosclerosis: an enigmatic disease due to a misnomer

abstract: Solid organ transplantation across the allogeneic barrier, pioneered by Thomas Starzl, has by now become a common medical procedure. Unfortunately, the number of donor organs lost due to transplant arteriosclerosis (chronic rejection), remains significant and unchanged for decades. We argue that designation of transplant arteriosclerosis as chronic rejection, and its classification as a delayed long-lasting reaction of recipient immune effectors against donor alloantigens have given us a wrong impression that we have identified the necessary cause/pathogenesis of the tissue pathology. However, whatever treatment options we have in the anti-rejection toolbox, despite their success in treating classical rejection, do not work for the transplant arteriosclerosis. Yet, the scientific community has continued to conceptualize and approach the pathology within the alloimmunity model. Due to unproductive research from the alloimmunity and rejection perspective, the number of transplanted hearts lost due to this pathology today is almost the same as it was fifty years ago. We believe that this phenomenon falls under the rubric of linguistic relativity, and that language we chose to name the disease has restricted our cognitive ability to solve the problem. While the initial perception of the transplant arteriosclerosis as chronic rejection was logical and scientific, the subsequent experience revealed that such perception and approach have been fruitless, and likely are incorrect. Considering our tragic failure to prevent and treat the delayed arterial pathology of donor organs using all available knowledge on alloimmunity and rejection, we must finally disassociate the former from the latter. The only way to start this uncomfortable process is to change the words we are using; particularly, the words we chose to name the disease. We have to step out of the alloimmunity rejection box.


title: BLP-2023 Task 2: Sentiment Analysis

abstract: We present an overview of the BLP Sentiment Shared Task, organized as part of the inaugural BLP 2023 workshop, co-located with EMNLP 2023. The task is defined as the detection of sentiment in a given piece of social media text. This task attracted interest from 71 participants, among whom 29 and 30 teams submitted systems during the development and evaluation phases, respectively. In total, participants submitted 597 runs. However, a total of 15 teams submitted system description papers. The range of approaches in the submitted systems spans from classical machine learning models, fine-tuning pre-trained models, to leveraging Large Language Model (LLMs) in zero- and few-shot settings. In this paper, we provide a detailed account of the task setup, including dataset development and evaluation setup. Additionally, we provide a brief overview of the systems submitted by the participants. All datasets and evaluation scripts from the shared task have been made publicly available for the research community, to foster further research in this domain.


title: Shimura varieties

abstract: These are the notes of a course on Shimura varieties that I gave at the 2022 IHES summer school on the Langlands program. Lecture 1 gives an introduction to Shimura varieties over the complex numbers (defined here as a special type of locally symmetric spaces) and to the general theory of canonical models; it also discusses in more detail the example of the Siegel modular varieties. Lecture 2 presents some families of Shimura varieties (PEL type, Hodge type, abelian type) and the results that are known about their canonical and integral models. Finally, lecture 3 discusses the cohomology of Shimura varieties, concentrating mostly on the compact non-endoscopic case.


title: Visualizing Information on Smartwatch Faces: A Review and Design Space

abstract: We present a systematic review and design space for visualizations on smartwatches and the context in which these visualizations are displayed--smartwatch faces. A smartwatch face is the main smartwatch screen that wearers see when checking the time. Smartwatch faces are small data dashboards that present a variety of data to wearers in a compact form. Yet, the usage context and form factor of smartwatch faces pose unique design challenges for visualization. In this paper, we present an in-depth review and analysis of visualization designs for popular premium smartwatch faces based on their design styles, amount and types of data, as well as visualization styles and encodings they included. From our analysis we derive a design space to provide an overview of the important considerations for new data displays for smartwatch faces and other small displays. Our design space can also serve as inspiration for design choices and grounding of empirical work on smartwatch visualization design. We end with a research agenda that points to open opportunities in this nascent research direction. Supplementary material is available at: https://osf.io/nwy2r/.


title: Image Segmentation using U-Net Architecture for Powder X-ray Diffraction Images

abstract: Scientific researchers frequently use the in situ synchrotron high-energy powder X-ray diffraction (XRD) technique to examine the crystallographic structures of materials in functional devices such as rechargeable battery materials. We propose a method for identifying artifacts in experimental XRD images. The proposed method uses deep learning convolutional neural network architectures, such as tunable U-Nets to identify the artifacts. In particular, the predicted artifacts are evaluated against the corresponding ground truth (manually implemented) using the overall true positive rate or recall. The result demonstrates that the U-Nets can consistently produce great recall performance at 92.4% on the test dataset, which is not included in the training, with a 34% reduction in average false positives in comparison to the conventional method. The U-Nets also reduce the time required to identify and separate artifacts by more than 50%. Furthermore, the exclusion of the artifacts shows major changes in the integrated 1D XRD pattern, enhancing further analysis of the post-processing XRD data.


title: Efficient deep data assimilation with sparse observations and time-varying sensors

abstract: Variational Data Assimilation (DA) has been broadly used in engineering problems for field reconstruction and prediction by performing a weighted combination of multiple sources of noisy data. In recent years, the integration of deep learning (DL) techniques in DA has shown promise in improving the efficiency and accuracy in high-dimensional dynamical systems. Nevertheless, existing deep DA approaches face difficulties in dealing with unstructured observation data, especially when the placement and number of sensors are dynamic over time. We introduce a novel variational DA scheme, named Voronoi-tessellation Inverse operator for VariatIonal Data assimilation (VIVID), that incorporates a DL inverse operator into the assimilation objective function. By leveraging the capabilities of the Voronoi-tessellation and convolutional neural networks, VIVID is adept at handling sparse, unstructured, and time-varying sensor data. Furthermore, the incorporation of the DL inverse operator establishes a direct link between observation and state space, leading to a reduction in the number of minimization steps required for DA. Additionally, VIVID can be seamlessly integrated with Proper Orthogonal Decomposition (POD) to develop an end-to-end reduced-order DA scheme, which can further expedite field reconstruction. Numerical experiments in a fluid dynamics system demonstrate that VIVID can significantly outperform existing DA and DL algorithms. The robustness of VIVID is also accessed through the application of various levels of prior error, the utilization of varying numbers of sensors, and the misspecification of error covariance in DA.


title: Breaking of a floating particle raft by water waves

abstract: When particles of a few tens of microns are spread on the surface of water, they aggregate under the action of capillary forces and form a thin floating membrane, a particle raft. In a tank with a raft made of graphite powder, we generate in the laboratory gravity surface waves, whose wavelength {about 17 cm} is very large compared to the thickness of the raft {of order 10 microns}. For a sufficiently strong wave amplitude, the raft breaks up progressively by developing cracks and producing fragments whose sizes decrease on a time scale long compared to the period of the wave. We characterize the breaking mechanisms. Then, we investigate the area distribution of the fragments produced during the fragmentation process. The visual appearance of the fragments distributed in size and surrounded by open water bears a {notable} resemblance to the floes produced by the fracturing of sea ice by waves in the polar oceans. Fragmentation concepts and morphological tools built for sea ice floes can be applied to our macroscopic analog, on which the entire dynamic evolution is accessible. {However, the mechanic of the two systems differ, as our particle raft breaks due to the viscous stresses, whereas the sea-ice fractures due its bending by the waves.


title: Beyond Jacobian-based tasks: Extended set-based tasks for multi-task execution and prioritization

abstract: The ability of executing multiple tasks simultaneously is an important feature of redundant robotic systems. As a matter of fact, complex behaviors can often be obtained as a result of the execution of several tasks. Moreover, in safety-critical applications, tasks designed to ensure the safety of the robot and its surroundings have to be executed along with other nominal tasks. In such cases, it is also important to prioritize the former over the latter. In this paper, we formalize the definition of extended set-based tasks, i.e., tasks which can be executed by rendering subsets of the task space asymptotically stable or forward invariant. We propose a mathematical representation of such tasks that allows for the execution of more complex and time-varying prioritized stacks of tasks using kinematic and dynamic robot models alike. We present and analyze an optimization-based framework which is computationally efficient, accounts for input bounds, and allows for the stable execution of time-varying prioritized stacks of extended set-based tasks. The proposed framework is validated using extensive simulations and experiments with robotic manipulators.


title: Multilayer Environment and Toolchain for Holistic NetwOrk Design and Analysis

abstract: The recent developments and research in distributed ledger technologies and blockchain have contributed to the increasing adoption of distributed systems. To collect relevant insights into systems' behavior, we observe many evaluation frameworks focusing mainly on the system under test throughput. However, these frameworks often need more comprehensiveness and generality, particularly in adopting a distributed applications' cross-layer approach. This work analyses in detail the requirements for distributed systems assessment. We summarize these findings into a structured methodology and experimentation framework called METHODA. Our approach emphasizes setting up and assessing a broader spectrum of distributed systems and addresses a notable research gap. We showcase the effectiveness of the framework by evaluating four distinct systems and their interaction, leveraging a diverse set of eight carefully selected metrics and 12 essential parameters. Through experimentation and analysis we demonstrate the framework's capabilities to provide valuable insights across various use cases. For instance, we identify that a combination of Trusted Execution Environments with threshold signature scheme FROST introduces minimal overhead on the performance with average latency around \SI{40}{\ms}. We showcase an emulation of realistic systems behavior, e.g., Maximal Extractable Value is possible and could be used to further model such dynamics. The METHODA framework enables a deeper understanding of distributed systems and is a powerful tool for researchers and practitioners navigating the complex landscape of modern computing infrastructures.


title: Can Virtual Reality Protect Users from Keystroke Inference Attacks?

abstract: Virtual Reality (VR) has gained popularity by providing immersive and interactive experiences without geographical limitations. It also provides a sense of personal privacy through physical separation. In this paper, we show that despite assumptions of enhanced privacy, VR is unable to shield its users from side-channel attacks that steal private information. Ironically, this vulnerability arises from VR's greatest strength, its immersive and interactive nature. We demonstrate this by designing and implementing a new set of keystroke inference attacks in shared virtual environments, where an attacker (VR user) can recover the content typed by another VR user by observing their avatar. While the avatar displays noisy telemetry of the user's hand motion, an intelligent attacker can use that data to recognize typed keys and reconstruct typed content, without knowing the keyboard layout or gathering labeled data. We evaluate the proposed attacks using IRB-approved user studies across multiple VR scenarios. For 13 out of 15 tested users, our attacks accurately recognize 86%-98% of typed keys, and the recovered content retains up to 98% of the meaning of the original typed content. We also discuss potential defenses.


title: The role of tropical and extra-tropical waves in the Hadley circulation

abstract: The tropical overturning circulation is examined in a moist aquaplanet general circulation model forced using a non-interactive sea surface temperature (SST) distribution that varies between a present-day Earth-like profile and one that is globally uniform. A traditional Hadley Cell (HC)-like flow is observed in all experiments along with the poleward transport of heat and angular momentum. In simulations with non-zero SST gradients, latent heat released from organized convection near the equator sets up a deep tropical cell; midlatitude baroclinic Rossby waves flux heat and angular momentum poleward, reinforcing the thermally direct circulation. As the imposed SST gradient is weakened, the HC transitions from a thermally and eddy-driven regime to one that's completely eddy-driven. When the SST is globally uniform, equatorial waves concentrate precipitation in the tropics and facilitate the lower-level convergence necessary for the ascending branch of the HC. Conventional midlatitude Rossby waves become very weak, but upper-level baroclinicity generates waves that cause equatorward transport of heat and poleward transport of momentum. Moreover, these upper-level waves induce a circulation that opposes the time-mean HC, thus highlighting the role of tropical waves in driving a traditional overturning flow for uniform SSTs. In all cases, anomalies associated with the tropical waves closely resemble those that sum to give the upper-level zonal mean divergent outflow. Through their ability to modulate tropical rainfall and the related latent heating, equatorial waves cause considerable hemispheric asymmetry in the HC and impart synoptic and intraseasonal variability to the tropical overturning circulation.


title: Length is a Curse and a Blessing for Document-level Semantics

abstract: In recent years, contrastive learning (CL) has been extensively utilized to recover sentence and document-level encoding capability from pre-trained language models. In this work, we question the length generalizability of CL-based models, i.e., their vulnerability towards length-induced semantic shift. We verify not only that length vulnerability is a significant yet overlooked research gap, but we can devise unsupervised CL methods solely depending on the semantic signal provided by document length. We first derive the theoretical foundations underlying length attacks, showing that elongating a document would intensify the high intra-document similarity that is already brought by CL. Moreover, we found that isotropy promised by CL is highly dependent on the length range of text exposed in training. Inspired by these findings, we introduce a simple yet universal document representation learning framework, LA(SER)$^{3}$: length-agnostic self-reference for semantically robust sentence representation learning, achieving state-of-the-art unsupervised performance on the standard information retrieval benchmark.


title: Learning Low-Rank Latent Spaces with Simple Deterministic Autoencoder: Theoretical and Empirical Insights

abstract: The autoencoder is an unsupervised learning paradigm that aims to create a compact latent representation of data by minimizing the reconstruction loss. However, it tends to overlook the fact that most data (images) are embedded in a lower-dimensional space, which is crucial for effective data representation. To address this limitation, we propose a novel approach called Low-Rank Autoencoder (LoRAE). In LoRAE, we incorporated a low-rank regularizer to adaptively reconstruct a low-dimensional latent space while preserving the basic objective of an autoencoder. This helps embed the data in a lower-dimensional space while preserving important information. It is a simple autoencoder extension that learns low-rank latent space. Theoretically, we establish a tighter error bound for our model. Empirically, our model's superiority shines through various tasks such as image generation and downstream classification. Both theoretical and practical outcomes highlight the importance of acquiring low-dimensional embeddings.


title: Systematic Physics-Compliant Analysis of Over-the-Air Channel Equalization in RIS-Parametrized Wireless Networks-on-Chip

abstract: Wireless networks-on-chip (WNoCs) are an enticing complementary interconnect technology for multi-core chips but face severe resource constraints. Being limited to simple on-off-keying modulation, the reverberant nature of the chip enclosure imposes limits on allowed modulation speeds in sight of inter-symbol interference, casting doubts on the competitiveness of WNoCs as interconnect technology. Fortunately, this vexing problem was recently overcome by parametrizing the on-chip radio environment with a reconfigurable intelligent surface (RIS). By suitably configuring the RIS, selected channel impulse responses (CIRs) can be tuned to be (almost) pulse-like despite rich scattering thanks to judiciously tailored multi-bounce path interferences. However, the exploration of this "over-the-air" (OTA) equalization is thwarted by (i) the overwhelming complexity of the propagation environment, and (ii) the non-linear dependence of the CIR on the RIS configuration, requiring a costly and lengthy full-wave simulation for every optimization step. Here, we show that a reduced-basis physics-compliant model for RIS-parametrized WNoCs can be calibrated with a single full-wave simulation. Thereby, we unlock the possibility of predicting the CIR for any RIS configuration almost instantaneously without any additional full-wave simulation. We leverage this new tool to systematically explore OTA equalization in RIS-parametrized WNoCs regarding the optimal choice of delay time for the RIS-shaped CIR's peak. We also study the simultaneous optimization of multiple on-chip wireless links for broadcasting. Looking forward, the introduced tools will enable the efficient exploration of various types of OTA analog computing in RIS-parametrized WNoCs.


title: Electrothermal Actuation of NEMS Resonators: Modeling and Experimental Validation

abstract: We study the electrothermal actuation of nanomechanical motion using a combination of numerical simulations and analytical solutions. The nanoelectrothermal actuator structure is a u-shaped gold nanoresistor that is patterned on the anchor of a doubly-clamped nanomechanical beam or a microcantilever resonator. This design has been used in recent experiments successfully. In our finite-element analysis (FEA) based model, our input is an ac current; we first calculate the temperature oscillations due to Joule heating using Ohm's Law and the heat equation; we then determine the thermally induced bending moment and the displacement profile of the beam by coupling the temperature field to Euler-Bernoulli beam theory with tension. Our model efficiently combines transient and frequency-domain analyses: we compute the temperature field using a transient approach and then impose this temperature field as a harmonic perturbation for determining the mechanical response in the frequency domain. This unique modeling method offers lower computational complexity and improved accuracy, and is faster than a fully transient FEA approach. Our dynamical model computes the temperature and displacement fields in time domain over a broad range of actuation frequencies and amplitudes. We validate the numerical results by directly comparing them with experimentally measured displacement amplitudes of NEMS beams around their eigenmodes in vacuum. Our model predicts a thermal time constant of 1.9 ns in vacuum for our particular structures, indicating that electrothermal actuation is efficient up to ~80 MHz. We also investigate the thermal response of the actuator when immersed in a variety of fluids.


title: Background Summarization of Event Timelines

abstract: Generating concise summaries of news events is a challenging natural language processing task. While journalists often curate timelines to highlight key sub-events, newcomers to a news event face challenges in catching up on its historical context. In this paper, we address this need by introducing the task of background news summarization, which complements each timeline update with a background summary of relevant preceding events. We construct a dataset by merging existing timeline datasets and asking human annotators to write a background summary for each timestep of each news event. We establish strong baseline performance using state-of-the-art summarization systems and propose a query-focused variant to generate background summaries. To evaluate background summary quality, we present a question-answering-based evaluation metric, Background Utility Score (BUS), which measures the percentage of questions about a current event timestep that a background summary answers. Our experiments show the effectiveness of instruction fine-tuned systems such as Flan-T5, in addition to strong zero-shot performance using GPT-3.5.


title: Effects of the size and concentration of depleting agents on the stabilization of the double-helix structure and DNA condensation: a single molecule force spectroscopy study

abstract: We perform a single molecule force spectroscopy study to characterize the role of the size (molecular weight) and concentration of depleting agents on DNA condensation and on the stabilization of the double-helix structure, showing that important features such as the threshold concentration for DNA condensation, the force in which the melting plateau occurs and its average length strongly depend on the depletant size chosen. Such results are potentially important to understand how the presence of surrounding macromolecules influences DNA stabilization inside living cells and therefore advance in the understanding of the crowded cell environment on DNA-related functions.


title: Homogeneous control design using invariant ellipsoid method

abstract: The invariant ellipsoid method is aimed at minimization of the smallest invariant and attractive set of a linear control system operating under bounded external disturbances. This paper extends this technique to a class of the so-called generalized homogeneous system by defining the $\dn-$homogeneous invariant/attractive ellipsoid. The generalized homogeneous optimal (in the sense of invariant ellipsoid) controller allows further improvement of the control system providing a faster convergence and better precision. Theoretical results are supported by numerical simulations and experiments.


title: Nonparametric estimators of inequality curves and inequality measures

abstract: Classical inequality curves and inequality measures are defined for distributions with finite mean value. Moreover, their empirical counterparts are not resistant to outliers. For these reasons, quantile versions of known inequality curves such as the Lorenz, Bonferroni, Zenga and $D$ curves, and quantile versions of inequality measures such as the Gini, Bonferroni, Zenga and $D$ indices have been proposed in the literature. We propose various nonparametric estimators of quantile versions of inequality curves and inequality measures, prove their consistency, and compare their accuracy in a~simulation study. We also give examples of the use of quantile versions of inequality measures in real data analysis.


title: A Convex Parameterization of Controllers Constrained to use only Relative Measurements

abstract: The optimal controller design problem for systems equipped with sensors that measure only relative, rather than absolute, quantities is considered. This relative measurement structure is formulated as a design constraint; it is demonstrated that the resulting constrained controller design problem can be written as a convex program. Certain additional network structural constraints can be incorporated into this formulation, making it especially useful in distributed or networked settings. An illustrative example highlights the advantage of the proposed methodology over the standard formulation of the output feedback controller design problem. A numerical example is provided.


title: Existence of solution to a system of PDEs modeling the crystal growth inside lithium batteries

abstract: The life-cycle of electric batteries depends on a complex system of interacting electrochemical and growth phenomena that produce dendritic structures during the discharge cycle. We study herein a system of 3 partial differential equations combining an Allen--Cahn phase-field model (simulating the dendrite-electrolyte interface) with the Poisson--Nernst--Planck systems simulating the electrodynamics and leading to the formation of such dendritic structures. We prove novel existence, uniqueness and stability results for this system and use it to produce simulations based on a finite element code.


title: Multivariate Dynamic Mediation Analysis under a Reinforcement Learning Framework

abstract: Mediation analysis is an important analytic tool commonly used in a broad range of scientific applications. In this article, we study the problem of mediation analysis when there are multivariate and conditionally dependent mediators, and when the variables are observed over multiple time points. The problem is challenging, because the effect of a mediator involves not only the path from the treatment to this mediator itself at the current time point, but also all possible paths pointed to this mediator from its upstream mediators, as well as the carryover effects from all previous time points. We propose a novel multivariate dynamic mediation analysis approach. Drawing inspiration from the Markov decision process model that is frequently employed in reinforcement learning, we introduce a Markov mediation process paired with a system of time-varying linear structural equation models to formulate the problem. We then formally define the individual mediation effect, built upon the idea of simultaneous interventions and intervention calculus. We next derive the closed-form expression and propose an iterative estimation procedure under the Markov mediation process model. We study both the asymptotic property and the empirical performance of the proposed estimator, and further illustrate our method with a mobile health application.


title: Mass-based separation of active Brownian particles in an asymmetric channel

abstract: Inertial effects should be considered for micro- and nano-swimmers moving in a low-density medium confined by irregular structures that create entropic barriers, where viscous effects are no longer paramount. Here, we present a separation mechanism of self-propelled particles in a two-dimensional asymmetric channel, which leads to the drift of particles of different masses in opposite directions. In particular, this mechanism is based on the combined action of the spatial asymmetry of the channel structure, the temporal asymmetry inherent in particles dynamics, and an external static force. This work is relevant for potential applications that can be found in the development of lab-on-a-chip devices and artificial channels for separating particles of different masses.


title: Material Around the Centaur (2060) Chiron from the 2018 November 28 UT Stellar Occultation

abstract: A stellar occultation of Gaia DR3 2646598228351156352 by the Centaur (2060) Chiron was observed from the South African Astronomical Observatory on 2018 November 28 UT. Here we present a positive detection of material surrounding Chiron from the 74-in telescope for this event. Additionally, a global atmosphere is ruled out at the tens of mircobar level for several possible atmospheric compositions. There are multiple 3-sigma drops in the 74-in light curve: three during immersion and two during emersion. Occulting material is located between 242-270 km from the center of the nucleus in the sky plane. Assuming the ring-plane orientation proposed for Chiron from the 2011 occultation, the flux drops are located at 352, 344, and 316 km (immersion), and 357, and 364 km (emersion) from the center, with normal optical depths of 0.26, 0.36, and 0.22 (immersion) and 0.26 and 0.18 (emersion), and equivalent widths between 0.7-1.3 km. This detection is similar to the previously proposed two-ring system and is located within the error bars of that ring-pole plane; however, the normal optical depths are less than half of the previous values, and three features are detected on immersion. These results suggest that the properties of the surrounding material have evolved between the 2011, 2018, and 2022 observations.


title: Generalizations of Mezhirov's game semantics to predicate superintuitionistic logics and the Casari formula

abstract: Game semantics allows us to look at basic logical concepts from another side. This approach to logic has a long history, there are plenty of different types of games: provability games, semantic games, etc. And there is an interesting type of provability games called Mezhirov's game proposed by Iliya Mezhirov for intuitionistic logic of propositions and Grzegorczyk modal logic. Mezhirov's game semantics for intuitionistic logic is interesting because of its simplicity and strong connection with Kripke semantics and Kripke models. In my study, I try to generalize Mezhirov's result in two directions: to generalize to intuitionistic logic of predicates (or to some its extensions) and to the case of a connection not only between the game and tautologies of logic, but also between the game and entailment from infinite sets of formulas.


title: Propensity weighting plus adjustment in proportional hazards model is not doubly robust

abstract: Recently, it has become common for applied works to combine commonly used survival analysis modeling methods, such as the multivariable Cox model and propensity score weighting, with the intention of forming a doubly robust estimator of an exposure effect hazard ratio that is unbiased in large samples when either the Cox model or the propensity score model is correctly specified. This combination does not, in general, produce a doubly robust estimator, even after regression standardization, when there is truly a causal effect. We demonstrate via simulation this lack of double robustness for the semiparametric Cox model, the Weibull proportional hazards model, and a simple proportional hazards flexible parametric model, with both the latter models fit via maximum likelihood. We provide a novel proof that the combination of propensity score weighting and a proportional hazards survival model, fit either via full or partial likelihood, is consistent under the null of no causal effect of the exposure on the outcome under particular censoring mechanisms if either the propensity score or the outcome model is correctly specified and contains all confounders. Given our results suggesting that double robustness only exists under the null, we outline two simple alternative estimators that are doubly robust for the survival difference at a given time point (in the above sense), provided the censoring mechanism can be correctly modeled, and one doubly robust method of estimation for the full survival curve. We provide R code to use these estimators for estimation and inference in the supporting information.


title: Electronic structures and transport properties of cove-edged graphene nanoribbons

abstract: In this comprehensive study, we undertake a thorough theoretical examination of the electronic subband structures within cove-edged zigzag graphene nanoribbons (CZGNRs) using the tight-binding model. These unique nanostructures arise from the systematic removal of carbon atoms along the zigzag edges of conventional zigzag graphene nanoribbons (ZGNRs). Notably, CZGNRs that exhibit intriguing band gaps can be conceptualized as interconnected graphene quantum dots (GQDs). An essential finding of our investigation is the inverse relationship between the size of GQDs and the band gaps of CZGNRs, a relationship that remains consistent regardless of the number of GQDs present. Additionally, we delve into the examination of electron effective masses in proximity to the edges of the first conduction subband of CZGNRs as GQD sizes expand. We observe a significant increase in electron effective masses as GQDs become larger, which is attributed to the increasing similarity between larger GQDs and ZGNRs. To further understand the practical implications, we explore the transport properties of finite CZGNRs when connected to electrodes through line contacts. The presence of edge defects introduces intriguing asymmetries in the tunneling current, leading to a significant reduction in its magnitude. Notably, we observe that the saturation current magnitude is less influenced by the length of CZGNRs and is instead more sensitive to the choice of materials used for the contacted electrodes. Lastly, we investigate the tunneling currents through GQDs featuring boron nitride textures within the Coulomb blockade region, unveiling an irregular staircase-like pattern in the tunneling current behavior.


title: ELM Ridge Regression Boosting

abstract: We discuss a boosting approach for the Ridge Regression (RR) method, with applications to the Extreme Learning Machine (ELM), and we show that the proposed method significantly improves the classification performance and robustness of ELMs.


title: Sea-Land-Cloud Segmentation in Satellite Hyperspectral Imagery by Deep Learning

abstract: Satellites are increasingly adopting on-board AI for enhanced autonomy through in-orbit inference. In this context, the use of deep learning (DL) techniques for segmentation in hyperspectral (HS) satellite imagery offers advantages for remote sensing applications, and therefore, we train 16 different models, whose codes are made available through our study, which we consider to be relevant for on-board multi-class segmentation of HS imagery, focusing on classifying oceanic (sea), terrestrial (land), and cloud formations. We employ the HYPSO-1 mission as an illustrative case for sea-land-cloud segmentation, and to demonstrate the utility of the segments, we introduce a novel sea-land-cloud ranking application scenario. We consider how to prioritize HS image downlink based on sea, land, and cloud coverage levels from the segmented images. We comparatively evaluate the models for future in-orbit deployment, considering performance, parameter count, and inference time. The models include both shallow and deep models, and after we propose four new DL models, we demonstrate that segmenting single spectral signatures (1D) outperforms 3D data processing comprising both spectral (1D) and spatial (2D) contexts. We conclude that our lightweight DL model, called 1D-Justo-LiuNet, consistently surpasses state-of-the-art models for sea-land-cloud segmentation, such as U-Net and its variations, in terms of performance (0.93 accuracy) and parameter count (4,563). However, the 1D models present longer inference time (15s) in the tested processing architecture, which seems to be a suboptimal architecture for this purpose. Finally, after demonstrating that in-orbit segmentation should occur post L1b radiance calibration rather than on raw data, we also show that reducing spectral channels down to 3 lowers models' parameter counts and inference time, at the cost of weaker segmentation performance.


title: Resource Allocation for UAV-Assisted Industrial IoT User with Finite Blocklength

abstract: We consider a relay system empowered by an unmanned aerial vehicle (UAV) that facilitates downlink information delivery while adhering to finite blocklength requirements. The setup involves a remote controller transmitting information to both a UAV and an industrial Internet of Things (IIoT) or remote device, employing the non-orthogonal multiple access (NOMA) technique in the first phase. Subsequently, the UAV decodes and forwards this information to the remote device in the second phase. Our primary objective is to minimize the decoding error probability (DEP) at the remote device, which is influenced by the DEP at the UAV. To achieve this goal, we optimize the blocklength, transmission power, and location of the UAV. However, the underlying problem is highly non-convex and generally intractable to be solved directly. To overcome this challenge, we adopt an alternative optimization (AO) approach and decompose the original problem into three sub-problems. This approach leads to a sub-optimal solution, which effectively mitigates the non-convexity issue. In our simulations, we compare the performance of our proposed algorithm with baseline schemes. The results reveal that the proposed framework outperforms the baseline schemes, demonstrating its superiority in achieving lower DEP at the remote device. Furthermore, the simulation results illustrate the rapid convergence of our proposed algorithm, indicating its efficiency and effectiveness in solving the optimization problem.


title: ShadowSense: Unsupervised Domain Adaptation and Feature Fusion for Shadow-Agnostic Tree Crown Detection from RGB-Thermal Drone Imagery

abstract: Accurate detection of individual tree crowns from remote sensing data poses a significant challenge due to the dense nature of forest canopy and the presence of diverse environmental variations, e.g., overlapping canopies, occlusions, and varying lighting conditions. Additionally, the lack of data for training robust models adds another limitation in effectively studying complex forest conditions. This paper presents a novel method for detecting shadowed tree crowns and provides a challenging dataset comprising roughly 50k paired RGB-thermal images to facilitate future research for illumination-invariant detection. The proposed method (ShadowSense) is entirely self-supervised, leveraging domain adversarial training without source domain annotations for feature extraction and foreground feature alignment for feature pyramid networks to adapt domain-invariant representations by focusing on visible foreground regions, respectively. It then fuses complementary information of both modalities to effectively improve upon the predictions of an RGB-trained detector and boost the overall accuracy. Extensive experiments demonstrate the superiority of the proposed method over both the baseline RGB-trained detector and state-of-the-art techniques that rely on unsupervised domain adaptation or early image fusion. Our code and data are available: https://github.com/rudrakshkapil/ShadowSense


title: Bayes factor functions

abstract: We describe Bayes factors functions based on z, t, $\chi^2$, and F statistics and the prior distributions used to define alternative hypotheses. The non-local alternative prior distributions are centered on standardized effects, which index the Bayes factor function. The prior densities include a dispersion parameter that models the variation of effect sizes across replicated experiments. We examine the convergence rates of Bayes factor functions under true null and true alternative hypotheses. Several examples illustrate the application of the Bayes factor functions to replicated experimental designs and compare the conclusions from these analyses to other default Bayes factor methods.


title: Performance Tuning for GPU-Embedded Systems: Machine-Learning-based and Analytical Model-driven Tuning Methodologies

abstract: GPU-embedded systems have gained popularity across various domains due to their efficient power consumption. However, in order to meet the demands of real-time or time-consuming applications running on these systems, it is crucial for them to be tuned to exhibit high performance. This paper addresses the issue by developing and comparing two tuning methodologies on GPU-embedded systems, and also provides performance insights for developers and researchers seeking to optimize applications running on these architectures. We focus on parallel prefix operations, such as FFT, scan primitives, and tridiagonal system solvers, which are performance-critical components in many applications. The study introduces an analytical model-driven tuning methodology and a Machine Learning (ML)-based tuning methodology. We evaluate the performance of the two tuning methodologies for different parallel prefix implementations of the BPLG library in an NVIDIA Jetson system, and compare their performance to the ones achieved through an exhaustive search. The findings shed light on the best strategies for handling the open challenge of performance portability for major computational patterns among server and embedded devices, providing practical guidance for offline and online tuning. We also address the existing gap in performance studies for parallel computational patterns in GPU-embedded systems by comparing the BPLG performance against other state-of-the-art libraries, including CUSPARSE, CUB, and CUFFT.


title: Rotational magic conditions for ultracold molecules in the presence of Raman and Rayleigh scattering

abstract: Molecules have vibrational, rotational, spin-orbit and hyperfine degrees of freedom or quantum states, each of which responds in a unique fashion to external electromagnetic radiation. The control over superpositions of these quantum states is key to coherent manipulation of molecules. For example, the better the coherence time the longer quantum simulations can last. The important quantity for controlling an ultracold molecule with laser light is its complex-valued molecular dynamic polarizability. Its real part determines the tweezer or trapping potential as felt by the molecule, while its imaginary part limits the coherence time. Here, our study shows that efficient trapping of a molecule in its vibrational ground state can be achieved by selecting a laser frequency with a detuning on the order of tens of GHz relative to an electric-dipole-forbidden molecular transition. Close proximity to this nearly forbidden transition allows to create a sufficiently deep trapping potential for multiple rotational states without sacrificing coherence times among these states from Raman and Rayleigh scattering. In fact, we demonstrate that magic trapping conditions for multiple rotational states of the ultracold $^{23}$Na$^{87}$Rb polar molecule can be created.


title: An augmented Lagrangian-based preconditioning technique for a class of block three-by-three linear systems

abstract: We propose an augmented Lagrangian-based preconditioner to accelerate the convergence of Krylov subspace methods applied to linear systems of equations with a block three-by-three structure such as those arising from mixed finite element discretizations of the coupled Stokes-Darcy flow problem. We analyze the spectrum of the preconditioned matrix and we show how the new preconditioner can be efficiently applied. Numerical experiments are reported to illustrate the effectiveness of the preconditioner in conjunction with flexible GMRES for solving linear systems of equations arising from a 3D test problem.


title: Information-Theoretically Secret Reed-Muller Identification with Affine Designs

abstract: We consider the problem of information-theoretic secrecy in identification schemes rather than transmission schemes. In identification, large identities are encoded into small challenges sent with the sole goal of allowing at the receiver reliable verification of whether the challenge could have been generated by a (possibly different) identity of his choice. One of the reasons to consider identification is that it trades decoding for an exponentially larger rate, however this may come with such encoding complexity and latency that it can render this advantage unusable. Identification still bears one unique advantage over transmission in that practical implementation of information-theoretic secrecy becomes possible, even considering that the information-theoretic secrecy definition needed in identification is that of semantic secrecy. Here, we implement a family of encryption schemes, recently shown to achieve semantic-secrecy capacity, and apply it to a recently-studied family of identification codes, confirming that, indeed, adding secrecy to identification comes at essentially no cost. While this is still within the one-way communication scenario, it is a necessary step into implementing semantic secrecy with two-way communication, where the information-theoretic assumptions are more realistic.


title: Knowledge Editing for Large Language Models: A Survey

abstract: Large language models (LLMs) have recently transformed both the academic and industrial landscapes due to their remarkable capacity to understand, analyze, and generate texts based on their vast knowledge and reasoning ability. Nevertheless, one major drawback of LLMs is their substantial computational cost for pre-training due to their unprecedented amounts of parameters. The disadvantage is exacerbated when new knowledge frequently needs to be introduced into the pre-trained model. Therefore, it is imperative to develop effective and efficient techniques to update pre-trained LLMs. Traditional methods encode new knowledge in pre-trained LLMs through direct fine-tuning. However, naively re-training LLMs can be computationally intensive and risks degenerating valuable pre-trained knowledge irrelevant to the update in the model. Recently, Knowledge-based Model Editing (KME) has attracted increasing attention, which aims to precisely modify the LLMs to incorporate specific knowledge, without negatively influencing other irrelevant knowledge. In this survey, we aim to provide a comprehensive and in-depth overview of recent advances in the field of KME. We first introduce a general formulation of KME to encompass different KME strategies. Afterward, we provide an innovative taxonomy of KME techniques based on how the new knowledge is introduced into pre-trained LLMs, and investigate existing KME strategies while analyzing key insights, advantages, and limitations of methods from each category. Moreover, representative metrics, datasets, and applications of KME are introduced accordingly. Finally, we provide an in-depth analysis regarding the practicality and remaining challenges of KME and suggest promising research directions for further advancement in this field.


title: The Wagging Plasma Tail of Comet C/2020 S3 (Erasmus)

abstract: Long-period comet C/2020 S3 (Erasmus) reached perihelion at 0.398 au on UT 2020 December 12.67, making it a bright, near-Sun object. Images taken between mid-November and December 2020 using the HI-1 camera and COR2 coronagraph onboard STEREO-A, as well as the LASCO/C3 coronagraph onboard SoHO, show significant variations in the plasma tail position angles. To analyze these variations, a simple technique was developed to calculate the aberration angles. These angles are defined as the angle between the sun-comet line and the tail axis, measured in the orbital plane. The aberration angles were found to range from $1.2^\circ$ to $46.8^\circ$, with an average (median) value of approximately $20.3^\circ$ ($16.3^\circ$). By considering the aberration angles, the solar wind radial velocities during the observations were inferred to range from 73.9 km/s to 573.5 km/s, with mean (median) values of approximately 205.5 km/s (182.3 km/s). Throughout the observations, two periods were identified where the tails showed forward tilting, which cannot be explained by aberration alone. In one case, this anomalous position angle was sustained for at least 11 days and is possibly due to co-rotating interaction regions. In the other case, the tail exhibited dramatic excursions from 180$^\circ$ to 150$^\circ$ back to 210$^\circ$ over a limited period of around 34 hours. This behavior is tentatively explained as a consequence of the interaction with a halo Coronal Mass Ejection that was launched from NOAA 12786 and arrived at comet C/2020 S3 during the time when the tail displayed its wagging behavior.


title: Spatial dynamics formulation of magnetohydrostatics

abstract: We present a formalism for importing techniques from dynamical systems theory in the study of three-dimensional magnetohydrodynamic (MHD) equilibria. By treating toroidal angle as time, we reformulate the equilibrium equations as hydrodynamic equations on the unit disc. They satisfy a variational principle and comprise a Lie-Poisson Hamiltonian system. We use the variational principle to find conservation laws for circulation, vorticity when pressure vanishes, and energy in axisymmetric domains. Combining the Lie-Poisson structure with a construction due to Scovel-Weinstein, we develop a theory of smoothed particle magnetohydrostatics (SPMHS). SPMHS identifies a large class of exact particle-swarm solutions of regularized spatial dynamics equations. The regularization occurs at finer scales than the smallest scales within the physical purview of ideal MHD. Crucially, the SPMHS equations of motion comprise a finite-dimensional Hamiltonian system, which side steps perennial roadblocks to a satisfactory theory of three-dimensional equilibria. In large-aspect-ratio domains, we show the spatial dynamics equations comprise a fast-slow system, where fast dynamics corresponds to the elliptic part of the equilibrium equations and slow dynamics corresponds to the hyperbolic part. Because the fast dynamics is formally normally hyperbolic, Fenichel theory suggests the presence of an exact slow manifold for the spatial dynamics equations that contains all physical solutions. We formally carry out reduction to the slow manifold, obtaining a spatial dynamics formulation for equilibrium Strauss reduced MHD at leading order and a hierarchy of corrections at any desired order in perturbation theory. In large aspect-ratio domains, finding periodic solutions of the slow manifold reduced equations represents a second novel pathway to finding three-dimensional equilibria.


title: Hierarchical Randomized Smoothing

abstract: Real-world data is complex and often consists of objects that can be decomposed into multiple entities (e.g. images into pixels, graphs into interconnected nodes). Randomized smoothing is a powerful framework for making models provably robust against small changes to their inputs - by guaranteeing robustness of the majority vote when randomly adding noise before classification. Yet, certifying robustness on such complex data via randomized smoothing is challenging when adversaries do not arbitrarily perturb entire objects (e.g. images) but only a subset of their entities (e.g. pixels). As a solution, we introduce hierarchical randomized smoothing: We partially smooth objects by adding random noise only on a randomly selected subset of their entities. By adding noise in a more targeted manner than existing methods we obtain stronger robustness guarantees while maintaining high accuracy. We initialize hierarchical smoothing using different noising distributions, yielding novel robustness certificates for discrete and continuous domains. We experimentally demonstrate the importance of hierarchical smoothing in image and node classification, where it yields superior robustness-accuracy trade-offs. Overall, hierarchical smoothing is an important contribution towards models that are both - certifiably robust to perturbations and accurate.


title: Impacts of thermal aging and associated heat losses on the performance of a Pyromark 2500-coated concentrated solar power central receiver

abstract: Pyromark 2500 is a widely used coating for concentrated solar power central receiver systems due to its high absorptivity, ease in application, and relatively low cost. Pyromark's performance is quantified by its figure of merit (FOM), which relates the coating's heat losses to its solar-to-thermal conversion efficiency. After long-term exposure to high temperatures (>750{\deg}C) and irradiance levels, Pyromark's absorptivity and FOM decrease. The aim of this research is to evaluate changes in Pyromark's absorptivity, heat losses, and FOM as a function of thermal aging. This work also compares the most common FOM expression, which neglects convection losses, to an FOM that includes all heat losses experienced by a central receiver. Isothermal aging experiments are conducted on Pyromark-coated Inconel 600 substrates at 750{\deg}C. The spectral, hemispherical absorptivity of the samples is measured at room temperature with a spectrophotometer and input into a finite element analysis model that includes radiation and convection boundary conditions. The heat flux and temperature output by the model are used to determine the heat losses and FOM of the Pyromark samples. After 151 h of thermal aging, the sample with the thinnest Pyromark coat maintains the most stable total, hemispherical absorptivity. Conversely, the total, hemispherical absorptivity of the sample with the thickest Pyromark coat drops by a maximum of 1.73%, and the corresponding maximum drop in FOM is 1.90% when windy conditions (which are expected around central receivers) are assumed. In windy conditions, convection losses constitute between 21% and 24% of the samples' total heat loss; thus, the most common FOM expression in the literature overestimates the samples' FOM by ~4.40%. An analysis of the samples' heat losses indicates that reflection losses exceed emission losses when the absorptivity declines significantly.


title: How can the optical variation properties of active galactic nuclei be unbiasedly measured?

abstract: The variability of active galactic nuclei (AGNs) is ubiquitous but has not yet been understood. Measuring the optical variation properties of AGNs, such as variation timescale and amplitude, and then correlating them with their fundamental physical parameters, have long served as a critical way of exploring the origin of AGN variability and the associated physics of the accretion process in AGNs. Obtaining accurate variation properties of AGNs is thus essential. It has been found that the damped random walk (DRW) process can well describe the AGN optical variation, however, there is a controversy over how long a minimal monitoring baseline is required to obtain unbiased variation properties. In this work, we settle the controversy by exhaustively scrutinizing the complex combination of assumed priors, adopted best-fit values, ensemble averaging methods, and fitting methods. Then, the newly proposed is an optimized solution where unbiased variation properties of an AGN sample possessing the same variation timescale can be obtained with a minimal baseline of about 10 times their variation timescale. Finally, the new optimized solution is used to demonstrate the positive role of time domain surveys to be conducted by the Wide Field Survey Telescope in improving constraints on AGN variation properties.


title: Poison is Not Traceless: Fully-Agnostic Detection of Poisoning Attacks

abstract: The performance of machine learning models depends on the quality of the underlying data. Malicious actors can attack the model by poisoning the training data. Current detectors are tied to either specific data types, models, or attacks, and therefore have limited applicability in real-world scenarios. This paper presents a novel fully-agnostic framework, DIVA (Detecting InVisible Attacks), that detects attacks solely relying on analyzing the potentially poisoned data set. DIVA is based on the idea that poisoning attacks can be detected by comparing the classifier's accuracy on poisoned and clean data and pre-trains a meta-learner using Complexity Measures to estimate the otherwise unknown accuracy on a hypothetical clean dataset. The framework applies to generic poisoning attacks. For evaluation purposes, in this paper, we test DIVA on label-flipping attacks.


title: CleanCoNLL: A Nearly Noise-Free Named Entity Recognition Dataset

abstract: The CoNLL-03 corpus is arguably the most well-known and utilized benchmark dataset for named entity recognition (NER). However, prior works found significant numbers of annotation errors, incompleteness, and inconsistencies in the data. This poses challenges to objectively comparing NER approaches and analyzing their errors, as current state-of-the-art models achieve F1-scores that are comparable to or even exceed the estimated noise level in CoNLL-03. To address this issue, we present a comprehensive relabeling effort assisted by automatic consistency checking that corrects 7.0% of all labels in the English CoNLL-03. Our effort adds a layer of entity linking annotation both for better explainability of NER labels and as additional safeguard of annotation quality. Our experimental evaluation finds not only that state-of-the-art approaches reach significantly higher F1-scores (97.1%) on our data, but crucially that the share of correct predictions falsely counted as errors due to annotation noise drops from 47% to 6%. This indicates that our resource is well suited to analyze the remaining errors made by state-of-the-art models, and that the theoretical upper bound even on high resource, coarse-grained NER is not yet reached. To facilitate such analysis, we make CleanCoNLL publicly available to the research community.


title: TiC-CLIP: Continual Training of CLIP Models

abstract: Keeping large foundation models up to date on latest data is inherently expensive. To avoid the prohibitive costs of constantly retraining, it is imperative to continually train these models. This problem is exacerbated by the lack of any large scale continual learning benchmarks or baselines. We introduce the first set of web-scale Time-Continual (TiC) benchmarks for training vision-language models: TiC-DataComp, TiC-YFCC, and TiC-Redcaps. TiC-DataComp, our largest dataset, contains over 12.7B timestamped image-text pairs spanning 9 years (2014-2022). We first use our benchmarks to curate various dynamic evaluations to measure temporal robustness of existing models. We show OpenAI's CLIP (trained on data up to 2020) loses $\approx 8\%$ zero-shot accuracy on our curated retrieval task from 2021-2022 compared with more recently trained models in OpenCLIP repository. We then study how to efficiently train models on time-continuous data. We demonstrate that a simple rehearsal-based approach that continues training from the last checkpoint and replays old data reduces compute by $2.5\times$ when compared to the standard practice of retraining from scratch. Code is available at https://github.com/apple/ml-tic-clip.


title: Dynamical aspects of Galactic habitability in N-body simulations

abstract: Recent studies of Galactic evolution revealed that the dynamics of the stellar component might be one of the key factors when considering galactic habitability. We run an N-body simulation model of the Milky Way, which we evolve for 10 Gyr, to study the secular evolution of stellar orbits and the resulting galactic habitability-related properties, i.e., the density of the stellar component and close stellar encounters. The results indicate that radial migrations are not negligible, even in a simple axisymmetric model with mild levels of dynamical heating, and that the net outward diffusion of the stellar component can populate galactic outskirts with habitable systems. Habitable environment is also likely even at sub-Solar galactocentric radii, because the rate of close encounters should not significantly degrade habitability. Stars that evolve from non-circular to stable nearly-circular orbits typically migrate outwards, settling down in a broad Solar neighborhood. The region between $R \approx 3$ kpc and $R \approx 12$ kpc represents the zone of radial mixing, which can blur the boundaries of the Galactic Habitable Zone, as it has been conventionally understood. The present-day stable population of the stars in the Solar neighborhood originates from this radial mixing zone, with most of the stars coming from the inner regions. The Solar system can be considered as a typical Milky Way habitable system because it migrated outwards from the metal-rich inner regions of the Disk and has a circular orbit in the present epoch. We conclude that the boundaries of the Galactic Habitable Zone cannot be sharply confined for a given epoch because of the mixing caused by the stellar migrations and secular evolution of stellar orbits.


title: On the Foundations of Shortcut Learning

abstract: Deep-learning models can extract a rich assortment of features from data. Which features a model uses depends not only on predictivity-how reliably a feature indicates train-set labels-but also on availability-how easily the feature can be extracted, or leveraged, from inputs. The literature on shortcut learning has noted examples in which models privilege one feature over another, for example texture over shape and image backgrounds over foreground objects. Here, we test hypotheses about which input properties are more available to a model, and systematically study how predictivity and availability interact to shape models' feature use. We construct a minimal, explicit generative framework for synthesizing classification datasets with two latent features that vary in predictivity and in factors we hypothesize to relate to availability, and quantify a model's shortcut bias-its over-reliance on the shortcut (more available, less predictive) feature at the expense of the core (less available, more predictive) feature. We find that linear models are relatively unbiased, but introducing a single hidden layer with ReLU or Tanh units yields a bias. Our empirical findings are consistent with a theoretical account based on Neural Tangent Kernels. Finally, we study how models used in practice trade off predictivity and availability in naturalistic datasets, discovering availability manipulations which increase models' degree of shortcut bias. Taken together, these findings suggest that the propensity to learn shortcut features is a fundamental characteristic of deep nonlinear architectures warranting systematic study given its role in shaping how models solve tasks.


title: Global Impact and Balancing Act: Deciphering the Effect of Fluorination on B1s Binding Energies in Fluorinated $h$-BN Nanosheets

abstract: X-ray photoelectron spectroscopy (XPS) is an important characterization tool in the pursuit of controllable fluorination of two-dimensional hexagonal boron nitride ($h$-BN). However, there is a lack of clear spectral interpretation and seemingly conflicting measurements exist. To discern the structure-spectroscopy relation, we performed a comprehensive first-principles study on the boron 1s edge XPS of fluorinated $h$-BN (F-BN) nanosheets. By gradually introducing 1--6 fluorine atoms into different boron or nitrogen sites, we created various F-BN structures with doping ratios ranging from 1-6\%. Our calculations reveal that fluorines landed at boron or nitrogen sites exert competitive effects on the B1s binding energies (BEs), leading to red or blue shifts in different measurements. Our calculations affirmed the hypothesis that fluorination affects 1s BEs of all borons in the $\pi$-conjugated system, undermining the transferability from $h$-BN to F-BN. Additionally, we observe that BE generally increases with higher fluorine concentration when both borons and nitrogens are non-exclusively fluorinated. These findings provide critical insights into how fluorination affects boron's 1s BEs, contributing to a better understanding of fluorination functionalization processes in $h$-BN and its potential applications in materials science.


title: Nuclear modification factors and the Cronin effect

abstract: Nuclear modification factors (NMFs) applied to A-B collision systems consist of $p_t$ spectrum ratios rescaled by an estimated number of nucleon-nucleon binary collisions. Interest in NMFs is motivated by possible modification (suppression?) of jet production in more-central A-B collisions conjectured to arise from a deconfined quark-gluon plasma or QGP. Interpretation of NMFs is complicated by the so-called Cronin effect wherein similar ratios derived from fixed-target p-A data exhibited suppression at lower $p_t$ and enhancement at higher $p_t$ with increasing atomic weight A. This presentation describes precision analysis of identified-hadron spectra from 5 TeV $p$-Pb collisions that accurately isolates the entire jet contribution. Evolution of NMF spectrum ratios with $p$-Pb centrality is interpreted in terms of variation of corresponding jet contributions to spectra. The same method is then applied to Chicago-Princeton fixed-target spectrum data from the seventies wherein the Cronin effect was first observed. Soft and hard particle densities vary as fixed powers of $A$. Inferred jet contributions are quantitatively consistent with extrapolation from higher energies. The Cronin effect is a simple result of rescaling particle-density spectra by factor $1/A^{1/3}$.


title: Attention-Based Ensemble Pooling for Time Series Forecasting

abstract: A common technique to reduce model bias in time-series forecasting is to use an ensemble of predictive models and pool their output into an ensemble forecast. In cases where each predictive model has different biases, however, it is not always clear exactly how each model forecast should be weighed during this pooling. We propose a method for pooling that performs a weighted average over candidate model forecasts, where the weights are learned by an attention-based ensemble pooling model. We test this method on two time-series forecasting problems: multi-step forecasting of the dynamics of the non-stationary Lorenz `63 equation, and one-step forecasting of the weekly incident deaths due to COVID-19. We find that while our model achieves excellent valid times when forecasting the non-stationary Lorenz `63 equation, it does not consistently perform better than the existing ensemble pooling when forecasting COVID-19 weekly incident deaths.


title: The $L^2$-norm of the forward stochastic integral w.r.t. Fractional Brownian motion $H > \frac{1}{2}$

abstract: In this article, we present the exact expression of the $L^2$-norm of the forward stochastic integral driven by the multi-dimensional fractional Brownian motion with parameter $\frac{1}{2} < H < 1$. The class of integrands only requires rather weak integrability conditions compatible w.r.t. a random finite measure whose density is expressed as a second-order polynomial of the underlying driving Gaussian noise. A simple consequence of our results is the exact expression of the $L^2$-norm for the pathwise Young integral.


title: Space-time structure of particle emission and femtoscopy scales in ultrarelativistic heavy-ion collisions

abstract: The analysis of the spatiotemporal picture of particle radiation in relativistic heavy-ion collisions in terms of correlation femtoscopy scales, emission and source functions allows one to probe the character of evolution of the system created in the collision. Realistic models, like the integrated hydrokinetic model (iHKM), used in the present work, are able to simulate the entire evolution process of strongly interacting matter produced in high-energy nuclear collision. The mentioned model describes all the stages of the system's evolution, including formation of the very initial state and its consequent gradual thermalization, hydrodynamic expansion and afterburner hadronic cascade, that can help researchers to figure out the specific details of the process and better understand the formation mechanisms of certain observables. In the current paper we investigate the behavior of the pion and kaon interferometry radii and their connection with emission functions in ultrarelativistic heavy-ion collisions at the Large Hadron Collider within iHKM. We are focusing on the study of the emission time scales at different energies for both particle species (pions and kaons) aiming to get deeper insight into relation of these scales and the peculiarities of the mentioned system's collective expansion and decay with the experimentally observed femtoscopy radii. One of our main interests is the problem of the total system's lifetime estimation based on the femtoscopy analysis.


title: Pixel-Level Clustering Network for Unsupervised Image Segmentation

abstract: While image segmentation is crucial in various computer vision applications, such as autonomous driving, grasping, and robot navigation, annotating all objects at the pixel-level for training is nearly impossible. Therefore, the study of unsupervised image segmentation methods is essential. In this paper, we present a pixel-level clustering framework for segmenting images into regions without using ground truth annotations. The proposed framework includes feature embedding modules with an attention mechanism, a feature statistics computing module, image reconstruction, and superpixel segmentation to achieve accurate unsupervised segmentation. Additionally, we propose a training strategy that utilizes intra-consistency within each superpixel, inter-similarity/dissimilarity between neighboring superpixels, and structural similarity between images. To avoid potential over-segmentation caused by superpixel-based losses, we also propose a post-processing method. Furthermore, we present an extension of the proposed method for unsupervised semantic segmentation. We conducted experiments on three publicly available datasets (Berkeley segmentation dataset, PASCAL VOC 2012 dataset, and COCO-Stuff dataset) to demonstrate the effectiveness of the proposed framework. The experimental results show that the proposed framework outperforms previous state-of-the-art methods.


title: Modular law through GKM theory

abstract: The solution of Shareshian-Wachs conjecture by Brosnan-Chow and Guay-Paquet tied the graded chromatic symmetric functions on indifference graphs (or unit interval graphs) and the cohomology of regular semisimple Hessenberg varieties with the dot action. A similar result holds between unicellular LLT polynomials and twins of regular semisimple Hessenberg varieties. A recent result by Abreu-Nigro enabled us to prove these results by showing the modular law for the geometrical objects, and this is indeed done by Precup-Sommers and Kiem-Lee. In this paper, we give elementary and simpler proofs to the modular law through GKM theory.


title: Query-Efficient Algorithms to Find the Unique Nash Equilibrium in a Two-Player Zero-Sum Matrix Game

abstract: We study the query complexity of identifying Nash equilibria in two-player zero-sum matrix games. Grigoriadis and Khachiyan (1995) showed that any deterministic algorithm needs to query $\Omega(n^2)$ entries in worst case from an $n\times n$ input matrix in order to compute an $\varepsilon$-approximate Nash equilibrium, where $\varepsilon<\frac{1}{2}$. Moreover, they designed a randomized algorithm that queries $\mathcal O(\frac{n\log n}{\varepsilon^2})$ entries from the input matrix in expectation and returns an $\varepsilon$-approximate Nash equilibrium when the entries of the matrix are bounded between $-1$ and $1$. However, these two results do not completely characterize the query complexity of finding an exact Nash equilibrium in two-player zero-sum matrix games. In this work, we characterize the query complexity of finding an exact Nash equilibrium for two-player zero-sum matrix games that have a unique Nash equilibrium $(x_\star,y_\star)$. We first show that any randomized algorithm needs to query $\Omega(nk)$ entries of the input matrix $A\in\mathbb{R}^{n\times n}$ in expectation in order to find the unique Nash equilibrium where $k=|\text{supp}(x_\star)|$. We complement this lower bound by presenting a simple randomized algorithm that, with probability $1-\delta$, returns the unique Nash equilibrium by querying at most $\mathcal O(nk^4\cdot \text{polylog}(\frac{n}{\delta}))$ entries of the input matrix $A\in\mathbb{R}^{n\times n}$. In the special case when the unique Nash Equilibrium is a pure-strategy Nash equilibrium (PSNE), we design a simple deterministic algorithm that finds the PSNE by querying at most $\mathcal O(n)$ entries of the input matrix.


title: An entropy stable discontinuous Galerkin method for the spherical thermal shallow water equations

abstract: We present a novel discontinuous Galerkin finite element method for numerical simulations of the rotating thermal shallow water equations in complex geometries using curvilinear meshes, with arbitrary accuracy. We derive an entropy functional which is convex, and which must be preserved in order to preserve model stability at the discrete level. The numerical method is provably entropy stable and conserves mass, buoyancy, vorticity, and energy. This is achieved by using novel entropy stable numerical fluxes, summation-by-parts principle, and splitting the pressure and convection operators so that we can circumvent the use of chain rule at the discrete level. Numerical simulations on a cubed sphere mesh are presented to verify the theoretical results. The numerical experiments demonstrate the robustness of the method for a regime of well developed turbulence, where it can be run stably without any dissipation. The entropy stable fluxes are sufficient to control the grid scale noise generated by geostrophic turbulence, eliminating the need for artificial stabilisation.


title: Efficient GPU-accelerated fitting of observational health-scaled stratified and time-varying Cox models

abstract: The Cox proportional hazards model stands as a widely-used semi-parametric approach for survival analysis in medical research and many other fields. Numerous extensions of the Cox model have further expanded its versatility. Statistical computing challenges arise, however, when applying many of these extensions with the increasing complexity and volume of modern observational health datasets. To address these challenges, we demonstrate how to employ massive parallelization through graphics processing units (GPU) to enhance the scalability of the stratified Cox model, the Cox model with time-varying covariates, and the Cox model with time-varying coefficients. First we establish how the Cox model with time-varying coefficients can be transformed into the Cox model with time-varying covariates when using discrete time-to-event data. We then demonstrate how to recast both of these into a stratified Cox model and identify their shared computational bottleneck that results when evaluating the now segmented partial likelihood and its gradient with respect to regression coefficients at scale. These computations mirror a highly transformed segmented scan operation. While this bottleneck is not an immediately obvious target for multi-core parallelization, we convert it into an un-segmented operation to leverage the efficient many-core parallel scan algorithm. Our massively parallel implementation significantly accelerates model fitting on large-scale and high-dimensional Cox models with stratification or time-varying effect, delivering an order of magnitude speedup over traditional central processing unit-based implementations.


title: On Shor's r-Algorithm for Problems with Constraints

abstract: Shor's r-algorithm (Shor, Zhurbenko (1971), Shor (1979)) with space stretching in the direction of difference of two adjacent subgradients is a competitive method of nonsmooth optimization. However, the original r-algorithm is designed to minimize convex ravine functions without constraints. The standard technique for solving constraint problems with this algorithm is to use exact nonsmooth penalty functions (Eremin (1967), Zangwill (1967)). At the same time, it is necessary to choose the (sufficiently large) penalty coefficient in this method. In Norkin (2020, 2022) and Galvan et al. (2021), the so-called projective exact penalty function method is proposed, which does not formally require an exact definition of the penalty coefficient. In this paper, a nonsmooth optimization problem with convex constraints is first transformed into a constraintfree problem by the projective penalty function method, and then the r-algorithm is applied to solve the transformed problem. We present the results of testing this approach on problems with linear constraints using a program implemented in Matlab.


title: Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models

abstract: In this work, we propose a method that combines two popular research areas by injecting linguistic structures into pre-trained language models in the parameter-efficient fine-tuning (PEFT) setting. In our approach, parallel adapter modules encoding different linguistic structures are combined using a novel Mixture-of-Linguistic-Experts architecture, where Gumbel-Softmax gates are used to determine the importance of these modules at each layer of the model. To reduce the number of parameters, we first train the model for a fixed small number of steps before pruning the experts based on their importance scores. Our experiment results with three different pre-trained models show that our approach can outperform state-of-the-art PEFT methods with a comparable number of parameters. In addition, we provide additional analysis to examine the experts selected by each model at each layer to provide insights for future studies.


title: Task Grouping for Automated Multi-Task Machine Learning via Task Affinity Prediction

abstract: When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors, such as the similarity of the tasks, the sizes of the datasets, and so on; in fact, some tasks might not benefit from MTL and may even incur a loss of accuracy compared to STL. Hence, the question arises: which tasks should be learned together? Domain experts can attempt to group tasks together following intuition, experience, and best practices, but manual grouping can be labor-intensive and far from optimal. In this paper, we propose a novel automated approach for task grouping. First, we study the affinity of tasks for MTL using four benchmark datasets that have been used extensively in the MTL literature, focusing on neural network-based MTL models. We identify inherent task features and STL characteristics that can help us to predict whether a group of tasks should be learned together using MTL or if they should be learned independently using STL. Building on this predictor, we introduce a randomized search algorithm, which employs the predictor to minimize the number of MTL trainings performed during the search for task groups. We demonstrate on the four benchmark datasets that our predictor-driven search approach can find better task groupings than existing baseline approaches.


title: ZzzGPT: An Interactive GPT Approach to Enhance Sleep Quality

abstract: This paper explores the intersection of technology and sleep pattern comprehension, presenting a cutting-edge two-stage framework that harnesses the power of Large Language Models (LLMs). The primary objective is to deliver precise sleep predictions paired with actionable feedback, addressing the limitations of existing solutions. This innovative approach involves leveraging the GLOBEM dataset alongside synthetic data generated by LLMs. The results highlight significant improvements, underlining the efficacy of merging advanced machine-learning techniques with a user-centric design ethos. Through this exploration, we bridge the gap between technological sophistication and user-friendly design, ensuring that our framework yields accurate predictions and translates them into actionable insights.


title: On the prediction of spectral densities from Lattice QCD

abstract: Hadronic spectral densities play a pivotal role in particle physics, a prime example being the R-ratio defined from electron-positron scattering into hadrons. To predict them from first principles using Lattice QCD, we face a numerically ill-posed inverse problem, due to the Euclidean signature adopted in practical simulations. Here we present a recent numerical analysis of the vector isovector spectral density extracted using the multi-level algorithm (recently extended also to the case of dynamical fermions) and discuss its implications.


title: Derived Satake category and Affine Hecke category in mixed characteristics

abstract: We construct a new affine Grassmannian which connects an equal characteristic affine Grassmannian and Zhu's Witt vector affine Grassmannian. As a result, we deduce the mixed characteristic version of the Bezrukavnikov-Finkelberg's derived Satake equivalence. By the same argument, we also obtain the mixed characteristic version of the Bezrukavnikov's equivalence between two categorifications of an affine Hecke algebra.


title: Global existence of Weak Solutions for a model of nematic liquid crystal-colloidal interactions

abstract: In this paper we study a mathematical model describing the movement of a colloidal particle in a fixed, bounded three dimensional container filled with a nematic liquid crystal fluid. The motion of the fluid is governed by the Beris-Edwards model for nematohydrodynamics equations, which couples the incompressible Navier-Stokes equations with a parabolic system. The dynamics of colloidal particle within the nematic liquid crystal is described by the conservation laws of linear and angular momentum. We prove the existence of global weak solutions for the coupled system.


title: Design of General Purpose Minimal-Auxiliary Ising Machines

abstract: Ising machines are a form of quantum-inspired processing-in-memory computer which has shown great promise for overcoming the limitations of traditional computing paradigms while operating at a fraction of the energy use. The process of designing Ising machines is known as the reverse Ising problem. Unfortunately, this problem is in general computationally intractable: it is a nonconvex mixed-integer linear programming problem which cannot be naively brute-forced except in the simplest cases due to exponential scaling of runtime with number of spins. We prove new theoretical results which allow us to reduce the search space to one with quadratic scaling. We utilize this theory to develop general purpose algorithmic solutions to the reverse Ising problem. In particular, we demonstrate Ising formulations of 3-bit and 4-bit integer multiplication which use fewer total spins than previously known methods by a factor of more than three. Our results increase the practicality of implementing such circuits on modern Ising hardware, where spins are at a premium.


title: $L^p$-$L^q$ estimates for subelliptic pseudo-differential operators on compact Lie groups

abstract: We establish the $L^p$-$L^q$-boundedness of subelliptic pseudo-differential operators on a compact Lie group $G$. Effectively, we deal with the $L^p$-$L^q$-bounds for operators in the sub-Riemmanian setting because the subelliptic classes are associated to a H\"ormander sub-Laplacian. The Riemannian case associated with the Laplacian is also included as a special case. Then, applications to the $L^p$-$L^q$-boundedness of pseudo-differential operators in the H\"ormander classes on $G$ are given in the complete range $0\leq \delta\leq \rho\leq 1,$ $\delta<1.$ This also gives the $L^p$-$L^q$-bounds in the Riemannian setting, because the later classes are associated with the Laplacian on $G$. In both cases, in the Riemannian and the sub-Riemannian settings, necessary and sufficient conditions for the $L^p$-$L^q$-boundedness of operators are also anaysed.


title: GlotLID: Language Identification for Low-Resource Languages

abstract: Several recent papers have published good solutions for language identification (LID) for about 300 high-resource and medium-resource languages. However, there is no LID available that (i) covers a wide range of low-resource languages, (ii) is rigorously evaluated and reliable and (iii) efficient and easy to use. Here, we publish GlotLID-M, an LID model that satisfies the desiderata of wide coverage, reliability and efficiency. It identifies 1665 languages, a large increase in coverage compared to prior work. In our experiments, GlotLID-M outperforms four baselines (CLD3, FT176, OpenLID and NLLB) when balancing F1 and false positive rate (FPR). We analyze the unique challenges that low-resource LID poses: incorrect corpus metadata, leakage from high-resource languages, difficulty separating closely related languages, handling of macrolanguage vs varieties and in general noisy data. We hope that integrating GlotLID-M into dataset creation pipelines will improve quality and enhance accessibility of NLP technology for low-resource languages and cultures. GlotLID-M model, code, and list of data sources are available: https://github.com/cisnlp/GlotLID.


title: A clustering tool for interrogating finite element models based on eigenvectors of graph adjacency

abstract: This note introduces an unsupervised learning algorithm to debug errors in finite element (FE) simulation models and details how it was productionised. The algorithm clusters degrees of freedom in the FE model using numerical properties of the adjacency of its stiffness matrix. The algorithm has been deployed as a tool called `Model Stability Analysis' tool within the commercial structural FE suite Oasys GSA (www.oasys-software.com/gsa). It has been used successfully by end-users for debugging real world FE models and we present examples of the tool in action.


title: Radiation-dominated bouncing model with slow contraction and inflation

abstract: A very simple non-singular inflationary model is presented where the unique matter content is a radiation fluid. The model slowly contracts from a very large, almost empty and flat spacetime and realizes a bounce. It is then launched to a quasi-de Sitter inflationary expansion with more than sixty e-folds, which smoothly changes to the usual classical, decelerated radiation-dominated expansion before nucleosynthesis. The initial contracting and final expanding phases are classical, but the intermediate bounce and inflationary phases are induced by quantum cosmological effects emerging from a Gaussian wave function quickly moving in configuration space. During this quantum era, a huge number of photons is created. The scale factor describing all this rich evolution is a surprisingly simple analytic function of conformal time. The cosmological scalar perturbations arising from quantum vacuum fluctuations in the far past of the model present an almost scale invariant spectrum with an amplitude compatible with observations for reasonable values of the free parameters of the model.


title: Speakerly: A Voice-based Writing Assistant for Text Composition

abstract: We present Speakerly, a new real-time voice-based writing assistance system that helps users with text composition across various use cases such as emails, instant messages, and notes. The user can interact with the system through instructions or dictation, and the system generates a well-formatted and coherent document. We describe the system architecture and detail how we address the various challenges while building and deploying such a system at scale. More specifically, our system uses a combination of small, task-specific models as well as pre-trained language models for fast and effective text composition while supporting a variety of input modes for better usability.


title: Near-Optimal Pure Exploration in Matrix Games: A Generalization of Stochastic Bandits & Dueling Bandits

abstract: We study the sample complexity of identifying the pure strategy Nash equilibrium (PSNE) in a two-player zero-sum matrix game with noise. Formally, we are given a stochastic model where any learner can sample an entry $(i,j)$ of the input matrix $A\in[-1,1]^{n\times m}$ and observe $A_{i,j}+\eta$ where $\eta$ is a zero-mean 1-sub-Gaussian noise. The aim of the learner is to identify the PSNE of $A$, whenever it exists, with high probability while taking as few samples as possible. Zhou et al. (2017) presents an instance-dependent sample complexity lower bound that depends only on the entries in the row and column in which the PSNE lies. We design a near-optimal algorithm whose sample complexity matches the lower bound, up to log factors. The problem of identifying the PSNE also generalizes the problem of pure exploration in stochastic multi-armed bandits and dueling bandits, and our result matches the optimal bounds, up to log factors, in both the settings.


title: ConDefects: A New Dataset to Address the Data Leakage Concern for LLM-based Fault Localization and Program Repair

abstract: With the growing interest on Large Language Models (LLMs) for fault localization and program repair, ensuring the integrity and generalizability of the LLM-based methods becomes paramount. The code in existing widely-adopted benchmarks for these tasks was written before the the bloom of LLMs and may be included in the training data of existing popular LLMs, thereby suffering from the threat of data leakage, leading to misleadingly optimistic performance metrics. To address this issue, we introduce "ConDefects", a novel dataset of real faults meticulously curated to eliminate such overlap. ConDefects contains 1,254 Java faulty programs and 1,625 Python faulty programs. All these programs are sourced from the online competition platform AtCoder and were produced between October 2021 and September 2023. We pair each fault with fault locations and the corresponding repaired code versions, making it tailored for in fault localization and program repair related research. We also provide interfaces for selecting subsets based on different time windows and coding task difficulties. While inspired by LLM-based tasks, ConDefects can be adopted for benchmarking ALL types of fault localization and program repair methods. The dataset is publicly available, and a demo video can be found at https://www.youtube.com/watch?v=22j15Hj5ONk.