title: Grafting Laplace and Gaussian distributions: A new noise mechanism for differential privacy

abstract: The framework of differential privacy protects an individual's privacy while publishing query responses on congregated data. In this work, a new noise addition mechanism for differential privacy is introduced where the noise added is sampled from a hybrid density that resembles Laplace in the centre and Gaussian in the tail. With a sharper centre and light, sub-Gaussian tail, this density has the best characteristics of both distributions. We theoretically analyze the proposed mechanism, and we derive the necessary and sufficient condition in one dimension and a sufficient condition in high dimensions for the mechanism to guarantee (${\epsilon}$,${\delta}$)-differential privacy. Numerical simulations corroborate the efficacy of the proposed mechanism compared to other existing mechanisms in achieving a better trade-off between privacy and accuracy.


title: Classical linear chain behavior from dipolar droplets to supersolids

abstract: We investigate the classicality of linear dipolar droplet arrays through a normal mode analysis of the dynamical properties in comparison to the supersolid regime. The vibrational patterns of isolated-droplet crystals that time-evolve after a small initial kick closely follow the properties of a linear droplet chain. For larger kick velocities, however, droplets may coalesce and separate again, showing distinct deviations from classicality. In the supersolid regime the normal modes are eliminated by a counter-flow of mass between the droplets, signaled by a reduction of the center-of-mass motion.


title: Single-step first order phase transition and gravitational waves in a SIMP dark matter scenario

abstract: We investigate the non-zero temperature dynamics of a sub-GeV dark matter scenario freezing-out via self-interactions. As a prototype, we take up the case of a scalar dark matter species undergoing $3 \to 2$ number changing annihilations catalysed by another scalar. We study the shape of the thermal potential of this scenario in a parameter region accounting for the observed relic abundance. An analysis reveals the possibility of a first order phase transition with bubble nucleation occurring at sub-GeV temperatures. This finding can be correlated with the typical sub-GeV masses in the framework. The gravitational wave spectra associated with such a phase transition is subsequently computed.


title: The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges

abstract: Code-Switching, a common phenomenon in written text and conversation, has been studied over decades by the natural language processing (NLP) research community. Initially, code-switching is intensively explored by leveraging linguistic theories and, currently, more machine-learning oriented approaches to develop models. We introduce a comprehensive systematic survey on code-switching research in natural language processing to understand the progress of the past decades and conceptualize the challenges and tasks on the code-switching topic. Finally, we summarize the trends and findings and conclude with a discussion for future direction and open questions for further investigation.


title: CI and CO in Nearby Spiral Galaxies -- I. Line Ratio and Abundance Variations at ~ 200 pc Scales

abstract: We present new neutral atomic carbon [CI](3P1-3P0) mapping observations within the inner ~7 kpc and ~4 kpc of the disks of NGC3627 and NGC4321 at a spatial resolution of 190 pc and 270 pc, respectively, using the ALMA Atacama Compact Array (ACA). We combine these with the CO(2-1) data from PHANGS-ALMA, and literature [CI] and CO data for two other starburst and/or active galactic nucleus (AGN) galaxies (NGC1808, NGC7469), to study: a) the spatial distributions of CI and CO emission; b) the observed line ratio RCICO = I_[CI](1-0)/I_CO(2-1) as a function of various galactic properties; and c) the abundance ratio of [CI/CO]. We find excellent spatial correspondence between CI and CO emission and nearly uniform RCICO ~0.1 across the majority of the star-forming disks of NGC3627 and NGC4321. However, RCICO strongly varies from ~0.05 at the centre of NGC4321 to >0.2-0.5 in NGC1808's starburst centre and NGC7469's centre with an X-ray AGN. Meanwhile, RCICO does not obviously vary with $U$, similar to the prediction of PDR models. We also find a mildly decreasing RCICO with an increasing metallicity over 0.7-0.85 solar metallicity, consistent with the literature. Assuming various typical ISM conditions representing GMCs, active star-forming regions and strong starbursting environments, we calculate the LTE radiative transfer and estimate the [CI/CO] abundance ratio to be ~0.1 across the disks of NGC3627 and NGC4321, similar to previous large-scale findings in Galactic studies. However, this abundance ratio likely has a substantial increase to ~1 and >1-5 in NGC1808's starburst and NGC7469's strong AGN environments, respectively, in line with the expectations for cosmic-ray dominated region (CRDR) and X-ray dominated region (XDR) chemistry. Finally, we do not find a robust evidence for a generally CO-dark, CI-bright gas in the disk areas we probed. (abbreviated)


title: MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering

abstract: Visual language data such as plots, charts, and infographics are ubiquitous in the human world. However, state-of-the-art vision-language models do not perform well on these data. We propose MatCha (Math reasoning and Chart derendering pretraining) to enhance visual language models' capabilities in jointly modeling charts/plots and language data. Specifically, we propose several pretraining tasks that cover plot deconstruction and numerical reasoning which are the key capabilities in visual language modeling. We perform the MatCha pretraining starting from Pix2Struct, a recently proposed image-to-text visual language model. On standard benchmarks such as PlotQA and ChartQA, the MatCha model outperforms state-of-the-art methods by as much as nearly 20%. We also examine how well MatCha pretraining transfers to domains such as screenshots, textbook diagrams, and document figures and observe overall improvement, verifying the usefulness of MatCha pretraining on broader visual language tasks.


title: Norm of Word Embedding Encodes Information Gain

abstract: Distributed representations of words encode lexical semantic information, but what type of information is encoded and how? Focusing on the skip-gram with negative-sampling method, we found that the squared norm of static word embedding encodes the information gain conveyed by the word; the information gain is defined by the Kullback-Leibler divergence of the co-occurrence distribution of the word to the unigram distribution. Our findings are explained by the theoretical framework of the exponential family of probability distributions and confirmed through precise experiments that remove spurious correlations arising from word frequency. This theory also extends to contextualized word embeddings in language models or any neural networks with the softmax output layer. We also demonstrate that both the KL divergence and the squared norm of embedding provide a useful metric of the informativeness of a word in tasks such as keyword extraction, proper-noun discrimination, and hypernym discrimination.


title: Fast Low Rank column-wise Compressive Sensing for Accelerated Dynamic MRI

abstract: This work develops a novel set of algorithms, alternating Gradient Descent (GD) and minimization for MRI (altGDmin-MRI1 and altGDmin-MRI2), for accelerated dynamic MRI by assuming an approximate low-rank (LR) model on the matrix formed by the vectorized images of the sequence. The LR model itself is well-known in the MRI literature; our contribution is the novel GD-based algorithms which are much faster, memory efficient, and general compared with existing work; and careful use of a 3-level hierarchical LR model. By general, we mean that, with a single choice of parameters, our method provides accurate reconstructions for multiple accelerated dynamic MRI applications, multiple sampling rates and sampling schemes. We show that our methods outperform many of the popular existing approaches while also being faster than all of them, on average. This claim is based on comparisons on 8 different retrospectively under sampled multi-coil dynamic MRI applications, sampled using either 1D Cartesian or 2D pseudo radial under sampling, at multiple sampling rates. Evaluations on some prospectively under sampled datasets are also provided. Our second contribution is a mini-batch subspace tracking extension that can process new measurements and return reconstructions within a short delay after they arrive. The recovery algorithm itself is also faster than its batch counterpart.


title: Commutators, centralizers, and strong conciseness in profinite groups

abstract: A group $G$ is said to have restricted centralizers if for each $g \in G$ the centralizer $C_G(g)$ either is finite or has finite index in $G$. Shalev showed that a profinite group with restricted centralizers is virtually abelian. We take interest in profinite groups with restricted centralizers of uniform commutators, that is, elements of the form $[x_1,\dots,x_k]$, where $\pi(x_1)=\pi(x_2)=\dots=\pi(x_k)$. Here $\pi(x)$ denotes the set of prime divisors of the order of $x\in G$. It is shown that such a group necessarily has an open nilpotent subgroup. We use this result to deduce that $\gamma_k(G)$ is finite if and only if the cardinality of the set of uniform $k$-step commutators in $G$ is less than $2^{\aleph_0}$


title: MultiCoder: Multi-Programming-Lingual Pre-Training for Low-Resource Code Completion

abstract: Code completion is a valuable topic in both academia and industry. Recently, large-scale mono-programming-lingual (MonoPL) pre-training models have been proposed to boost the performance of code completion. However, the code completion on low-resource programming languages (PL) is difficult for the data-driven paradigm, while there are plenty of developers using low-resource PLs. On the other hand, there are few studies exploring the effects of multi-programming-lingual (MultiPL) pre-training for the code completion, especially the impact on low-resource programming languages. To this end, we propose the MultiCoder to enhance the low-resource code completion via MultiPL pre-training and MultiPL Mixture-of-Experts (MoE) layers. We further propose a novel PL-level MoE routing strategy (PL-MoE) for improving the code completion on all PLs. Experimental results on CodeXGLUE and MultiCC demonstrate that 1) the proposed MultiCoder significantly outperforms the MonoPL baselines on low-resource programming languages, and 2) the PL-MoE module further boosts the performance on six programming languages. In addition, we analyze the effects of the proposed method in details and explore the effectiveness of our method in a variety of scenarios.


title: Foveate, Attribute, and Rationalize: Towards Physically Safe and Trustworthy AI

abstract: Users' physical safety is an increasing concern as the market for intelligent systems continues to grow, where unconstrained systems may recommend users dangerous actions that can lead to serious injury. Covertly unsafe text is an area of particular interest, as such text may arise from everyday scenarios and are challenging to detect as harmful. We propose FARM, a novel framework leveraging external knowledge for trustworthy rationale generation in the context of safety. In particular, FARM foveates on missing knowledge to qualify the information required to reason in specific scenarios and retrieves this information with attribution to trustworthy sources. This knowledge is used to both classify the safety of the original text and generate human-interpretable rationales, shedding light on the risk of systems to specific user groups and helping both stakeholders manage the risks of their systems and policymakers to provide concrete safeguards for consumer safety. Our experiments show that FARM obtains state-of-the-art results on the SafeText dataset, showing absolute improvement in safety classification accuracy by 5.9%.


title: Task-Oriented Communications for NextG: End-to-End Deep Learning and AI Security Aspects

abstract: Communications systems to date are primarily designed with the goal of reliable transfer of digital sequences (bits). Next generation (NextG) communication systems are beginning to explore shifting this design paradigm to reliably executing a given task such as in task-oriented communications. In this paper, wireless signal classification is considered as the task for the NextG Radio Access Network (RAN), where edge devices collect wireless signals for spectrum awareness and communicate with the NextG base station (gNodeB) that needs to identify the signal label. Edge devices may not have sufficient processing power and may not be trusted to perform the signal classification task, whereas the transfer of signals to the gNodeB may not be feasible due to stringent delay, rate, and energy restrictions. Task-oriented communications is considered by jointly training the transmitter, receiver and classifier functionalities as an encoder-decoder pair for the edge device and the gNodeB. This approach improves the accuracy compared to the separated case of signal transfer followed by classification. Adversarial machine learning poses a major security threat to the use of deep learning for task-oriented communications. A major performance loss is shown when backdoor (Trojan) and adversarial (evasion) attacks target the training and test processes of task-oriented communications.


title: Fractal dimensions of fractal transformations and Quantization dimensions for bi-Lipschitz mappings

abstract: In this paper, we study the fractal dimension of the graph of a fractal transformation and also determine the quantization dimension of a probability measure supported on the graph of the fractal transformation. Moreover, we estimate the quantization dimension of the invariant measures corresponding to a weighted iterated function system consisting of bi-Lipschitz mappings under the strong open set condition.


title: StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfer

abstract: Text style transfer aims to alter the style of a sentence while preserving its content. Due to the lack of parallel corpora, most recent work focuses on unsupervised methods and often uses cycle construction to train models. Since cycle construction helps to improve the style transfer ability of the model by rebuilding transferred sentences back to original-style sentences, it brings about a content loss in unsupervised text style transfer tasks. In this paper, we propose a novel disentanglement-based style transfer model StyleFlow to enhance content preservation. Instead of the typical encoder-decoder scheme, StyleFlow can not only conduct the forward process to obtain the output, but also infer to the input through the output. We design an attention-aware coupling layers to disentangle the content representations and the style representations of a sentence. Besides, we propose a data augmentation method based on Normalizing Flow to improve the robustness of the model. Experiment results demonstrate that our model preserves content effectively and achieves the state-of-the-art performance on the most metrics.


title: Bohmian Mechanics as a Practical Tool

abstract: In this chapter, we will take a trip around several hot-spots where Bohmian mechanics and its capacity to describe the microscopic reality, even in the absence of measurements, can be harnessed as computational tools, in order to help in the prediction of phenomenologically accessible information (also useful for the followers of the Copenhagen theory). As a first example, we will see how a Stochastic Schr\"odinger Equation, when used to compute the reduced density matrix of a non-Markovian open quantum system, necessarily seems to employ the Bohmian concept of a conditional wavefunction. We will see that by dressing these conditional wavefunctions with an interpretation, the Bohmian theory can prove to be a useful tool to build general quantum frameworks, like a high-frequency electron transport model. As a second example, we will introduce how a Copenhagen "observable operator" can be derived from numerical properties of the Bohmian trajectories, which within Bohmian mechanics, are well-defined even for an "unmeasured" system. Most importantly in practice, even if these numbers are given no ontological meaning, not only we will be able to simulate (thus, predict and talk about) them, but we will see that they can be operationally determined in a weak value experiment. Therefore, they will be practical numbers to characterize a quantum system irrespective of the followed quantum theory.


title: Chemistry Lab Automation via Constrained Task and Motion Planning

abstract: Chemists need to perform many laborious and time-consuming experiments in the lab to discover and understand the properties of new materials. To support and accelerate this process, we propose a robot framework for manipulation that autonomously performs chemistry experiments. Our framework receives high-level abstract descriptions of chemistry experiments, perceives the lab workspace, and autonomously plans multi-step actions and motions. The robot interacts with a wide range of lab equipment and executes the generated plans. A key component of our method is constrained task and motion planning using PDDLStream solvers. Preventing collisions and spillage is done by introducing a constrained motion planner. Our planning framework can conduct different experiments employing implemented actions and lab tools. We demonstrate the utility of our framework on pouring skills for various materials and two fundamental chemical experiments for materials synthesis: solubility and recrystallization.


title: The pressure-wired Stokes element: a mesh-robust version of the Scott-Vogelius element

abstract: The Scott-Vogelius finite element pair for the numerical discretization of the stationary Stokes equation in 2D is a popular element which is based on a continuous velocity approximation of polynomial order $k$ and a discontinuous pressure approximation of order $k-1$. It employs a "singular distance" (measured by some geometric mesh quantity $ \Theta \left( \mathbf{z}\right) \geq 0$ for triangle vertices $\mathbf{z}$) and imposes a local side condition on the pressure space associated to vertices $\mathbf{z}$ with $\Theta \left( \mathbf{z}\right) =0$. The method is inf-sup stable for any fixed regular triangulation and $k\geq 4$. However, the inf-sup constant deteriorates if the triangulation contains nearly singular vertices $0<\Theta \left( \mathbf{z}\right) \ll 1$. In this paper, we introduce a very simple parameter-dependent modification of the Scott-Vogelius element such that the inf-sup constant is independent of nearly-singular vertices. We will show by analysis and also by numerical experiments that the effect on the divergence-free condition for the discrete velocity is negligibly small.


title: LR-Sum: Summarization for Less-Resourced Languages

abstract: This preprint describes work in progress on LR-Sum, a new permissively-licensed dataset created with the goal of enabling further research in automatic summarization for less-resourced languages. LR-Sum contains human-written summaries for 40 languages, many of which are less-resourced. We describe our process for extracting and filtering the dataset from the Multilingual Open Text corpus (Palen-Michel et al., 2022). The source data is public domain newswire collected from from Voice of America websites, and LR-Sum is released under a Creative Commons license (CC BY 4.0), making it one of the most openly-licensed multilingual summarization datasets. We describe how we plan to use the data for modeling experiments and discuss limitations of the dataset.


title: Molecular Outflows in z > 6 QSO Hosts Driven by Star Formation

abstract: Feedback and outflows in galaxies that are associated with a quasar phase are expected to be pivotal in quenching the most massive galaxies. However, observations targeting the molecular outflow phase, which dominates both the mass and momentum and removes the immediate fuel for star formation, are limited in high-z QSO hosts. Massive quiescent galaxies found at z ~ 4 are predicted to have already quenched star formation by z ~ 5 and undergone their most intense growth at z > 6. Here, we present two ALMA detections of molecular outflows, traced by blue-shifted absorption of the OH 119 micron doublet, from a sample of three z > 6 infrared luminous QSO hosts: J2310+1855 and P183+05. OH 119 micron is also detected in emission in P183+05, and tentatively in the third source: P036+03. Using similar assumptions as for high-z Dusty Star-Forming Galaxy outflows, we find that our QSOs drive molecular outflows with comparable mass outflow rates, and that are comparably energetic except for J2310+1855's significantly lower outflow energy flux. We do not find evidence, nor require additional input from the central AGN to drive the molecular outflow in J2310+1855 but can not rule out an AGN contribution in P183+05 if a significant AGN contribution to L_FIR is assumed and/or if the outflow covering fraction is high (> 53%), which evidence from the literature suggests is unlikely in these sources. Differences observed in the blue-shifted absorption spectral properties may instead be caused by the QSO hosts' more compact dust continuum, limiting observations to lower altitude and more central regions of the outflow.


title: Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publications

abstract: Scholarly text is often laden with jargon, or specialized language that can facilitate efficient in-group communication within fields but hinder understanding for out-groups. In this work, we develop and validate an interpretable approach for measuring scholarly jargon from text. Expanding the scope of prior work which focuses on word types, we use word sense induction to also identify words that are widespread but overloaded with different meanings across fields. We then estimate the prevalence of these discipline-specific words and senses across hundreds of subfields, and show that word senses provide a complementary, yet unique view of jargon alongside word types. We demonstrate the utility of our metrics for science of science and computational sociolinguistics by highlighting two key social implications. First, though most fields reduce their use of jargon when writing for general-purpose venues, and some fields (e.g., biological sciences) do so less than others. Second, the direction of correlation between jargon and citation rates varies among fields, but jargon is nearly always negatively correlated with interdisciplinary impact. Broadly, our findings suggest that though multidisciplinary venues intend to cater to more general audiences, some fields' writing norms may act as barriers rather than bridges, and thus impede the dispersion of scholarly ideas.


title: Excitonic insulators and superfluidity in 2D bilayers without external fields

abstract: We explore a new platform for realising excitonic insulators, namely van der Waals (vdW) bilayers comprising 2D Janus materials. In previous studies, Type-II heterobilayers have been brought to the excitonic insulating regime by tuning the band alignment using external gates. In contrast, the Janus bilayers of the current work represent intrinsic excitonic insulators. We first conduct ab initio calculations to obtain the quasiparticle band structures, screened Coulomb interaction, and interlayer exciton binding energies of the bilayers. These ab initio-derived quantities are then used to construct a BCS-like Hamiltonian of the exciton condensate. By solving the mean-field gap equation, we identify 16 vdW Janus bilayers with insulating ground states and superfluid properties. Our calculations expose a new class of advanced materials that are likely to exhibit novel excitonic phases at low temperatures, and highlight the subtle competition between interlayer hybridization, spin-orbit coupling, and dielectric screening that govern their properties.


title: Fragmentation and Novel Prethermal Dynamical Phases in Disordered, Strongly-Interacting Floquet Systems

abstract: We explore how disorder and interactions conspire in lattice models with sequentially activated hopping to produce novel k-body (or many-body) localized phases. Specifically, we show that when disorder is added to the set of interacting floquet models considered in [Wampler and Klich arXiv:2209.09180], regions in parameter space near the special points where classical-like dynamics emerge are stabilized prethermally (or via many-body localization in some cases) producing new families of interesting phases. We also find that this disordered system exhibits novel phases in regions of parameter space away from the special, Diophantine points. Furthermore, the regions in parameter space where Hilbert space fragmentation occurs in the clean system (leading to Krylov subspaces exhibiting frozen dynamics, cellular automation, and subspaces exhibiting signs of ergodic behavior) may also be stabilized by the addition of disorder. This leads to the emergence of exotic dynamics within the Krylov subspace.


title: Supercooled liquids are Fickian yet non-Gaussian

abstract: Reply to "Comment on 'Fickian non-Gaussian diffusion in glass-forming liquids' ". In [ArXiv:2210.07119v1], Berthier et al. questioned the findings of our letter [Phys. Rev. Lett. 128, 168001 (2022)], concerning the existence and the features of Fickian non-Gaussian diffusion in glass-forming liquids. Here we demonstrate that their arguments are either wrong, or not meaningful to our scope. Thus, we fully confirm the validity and novelty of our results.

categories: cond-mat.stat-mech cond-mat.dis-nn cond-mat.soft physics.chem-ph


title: Free Boundary Minimal Annuli Immersed in the Unit 3-Ball

abstract: Using the linearized doubling methodology we carry out a PDE gluing construction of a discrete family of non-rotational properly immersed free boundary minimal annuli in the Euclidean unit 3-ball. The surfaces we construct resemble equatorial disks joined by half-catenoidal bridges at the boundary.


title: Annual field-scale maps of tall and short crops at the global scale using GEDI and Sentinel-2

abstract: Crop type maps are critical for tracking agricultural land use and estimating crop production. Remote sensing has proven an efficient and reliable tool for creating these maps in regions with abundant ground labels for model training, yet these labels remain difficult to obtain in many regions and years. NASA's Global Ecosystem Dynamics Investigation (GEDI) spaceborne lidar instrument, originally designed for forest monitoring, has shown promise for distinguishing tall and short crops. In the current study, we leverage GEDI to develop wall-to-wall maps of short vs tall crops on a global scale at 10 m resolution for 2019-2021. Specifically, we show that (1) GEDI returns can reliably be classified into tall and short crops after removing shots with extreme view angles or topographic slope, (2) the frequency of tall crops over time can be used to identify months when tall crops are at their peak height, and (3) GEDI shots in these months can then be used to train random forest models that use Sentinel-2 time series to accurately predict short vs. tall crops. Independent reference data from around the world are then used to evaluate these GEDI-S2 maps. We find that GEDI-S2 performed nearly as well as models trained on thousands of local reference training points, with accuracies of at least 87% and often above 90% throughout the Americas, Europe, and East Asia. Systematic underestimation of tall crop area was observed in regions where crops frequently exhibit low biomass, namely Africa and South Asia, and further work is needed in these systems. Although the GEDI-S2 approach only differentiates tall from short crops, in many landscapes this distinction goes a long way toward mapping the main individual crop types. The combination of GEDI and Sentinel-2 thus presents a very promising path towards global crop mapping with minimal reliance on ground data.


title: Multilingual Sequence-to-Sequence Models for Hebrew NLP

abstract: Recent work attributes progress in NLP to large language models (LMs) with increased model size and large quantities of pretraining data. Despite this, current state-of-the-art LMs for Hebrew are both under-parameterized and under-trained compared to LMs in other languages. Additionally, previous work on pretrained Hebrew LMs focused on encoder-only models. While the encoder-only architecture is beneficial for classification tasks, it does not cater well for sub-word prediction tasks, such as Named Entity Recognition, when considering the morphologically rich nature of Hebrew. In this paper we argue that sequence-to-sequence generative architectures are more suitable for LLMs in the case of morphologically rich languages (MRLs) such as Hebrew. We demonstrate that by casting tasks in the Hebrew NLP pipeline as text-to-text tasks, we can leverage powerful multilingual, pretrained sequence-to-sequence models as mT5, eliminating the need for a specialized, morpheme-based, separately fine-tuned decoder. Using this approach, our experiments show substantial improvements over previously published results on existing Hebrew NLP benchmarks. These results suggest that multilingual sequence-to-sequence models present a promising building block for NLP for MRLs.


title: Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments

abstract: We present a human-in-the-loop evaluation framework for fact-checking novel misinformation claims and identifying social media messages that support them. Our approach extracts check-worthy claims, which are aggregated and ranked for review. Stance classifiers are then used to identify tweets supporting novel misinformation claims, which are further reviewed to determine whether they violate relevant policies. To demonstrate the feasibility of our approach, we develop a baseline system based on modern NLP methods for human-in-the-loop fact-checking in the domain of COVID-19 treatments. We make our data and detailed annotation guidelines available to support the evaluation of human-in-the-loop systems that identify novel misinformation directly from raw user-generated content.


title: Probing Gigahertz Coherent Acoustic Phonons in TiO$_{2}$ Mesoporous Thin Films

abstract: Ultrahigh-frequency acoustic-phonon resonators usually require atomically flat interfaces to avoid phonon scattering and dephasing, leading to expensive fabrication processes, such as molecular beam epitaxy. In contrast, mesoporous thin films are based on inexpensive wet chemical fabrication techniques. Here, we report mesoporous titanium dioxide-based acoustic resonators with resonances up to 90 GHz, and quality factors from 3 to 7. Numerical simulations show a good agreement with the picosecond ultrasonics experiments. We also numerically study the effect of changes in the speed of sound on the performance of the resonator. This change could be induced by liquid infiltration into the mesopores. Our findings constitute the first step towards the engineering of building blocks based on mesoporous thin films for reconfigurable optoacoustic sensors.


title: The VISCACHA survey -- VI. Dimensional study of the structure of 82 star clusters in the Magellanic Clouds

abstract: We present a study of the internal structure of 82 star clusters located at the outer regions of the Large Magellanic Cloud and the Small Magellanic Cloud using data of the VISCACHA Survey. Through the construction of the minimum spanning tree, which analyzes the relative position of stars within a given cluster, it was possible to characterize the internal structure and explore the fractal or subclustered distribution for each cluster. We computed the parameters m (which is the average length of the connected segments normalized by the area), s (which is the mean points separation in units of cluster radius), and Q (the ratio of these components). These parameters are useful to distinguish between radial, homogeneous, and substructured distributions of stars. The dependence of these parameters with the different characteristics of the clusters, such as their ages and spatial distribution, was also studied. We found that most of the studied clusters present a homogeneous stellar distribution or a distribution with a radial concentration. Our results are consistent with the models, suggesting that more dynamically evolved clusters seem to have larger Q values, confirming previous results from numerical simulations. There also seems to be a correlation between the internal structure of the clusters and their galactocentric distances, in the sense that for both galaxies, the more distant clusters have larger Q values. We also paid particular attention to the effects of contamination by non-member field stars and its consequences finding that field star decontamination is crucial for these kinds of studies.


title: A Natural Bias for Language Generation Models

abstract: After just a few hundred training updates, a standard probabilistic model for language generation has likely not yet learnt many semantic or syntactic rules of natural language, making it difficult to estimate the probability distribution over next tokens. Yet around this point, these models have identified a simple, loss-minimising behaviour: to output the unigram distribution of the target training corpus. The use of such a heuristic raises the question: Can we initialise our models with this behaviour and save precious compute resources and model capacity? Here we show that we can effectively endow standard neural language generation models with a separate module that reflects unigram frequency statistics as prior knowledge, simply by initialising the bias term in a model's final linear layer with the log-unigram distribution. We use neural machine translation as a test bed for this simple technique and observe that it: (i) improves learning efficiency; (ii) achieves better overall performance; and perhaps most importantly (iii) appears to disentangle strong frequency effects by encouraging the model to specialise in non-frequency-related aspects of language.


title: Forecasting per-patient dosimetric benefit from daily online adaptive radiotherapy for cervical cancer

abstract: Adaptive Radiotherapy (ART) is an emerging technique for treating cancer patients which facilitates higher delivery accuracy and has the potential to reduce toxicity. However, ART is also resource-intensive, requiring extra human and machine time compared to standard treatment methods. In this analysis, we sought to predict the subset of node-negative cervical cancer patients who benefit the most from ART. CT images, initial plan data, and on-treatment Cone-Beam CT (CBCT) images for 20 retrospective cervical cancer patients were used to simulate doses from daily non-adaptive and adaptive techniques. We evaluated the correlation (R$^2$) between dose and volume metrics from initial treatment plans and the dosimetric benefits to the Bowel V$_{40Gy}$, Bowel V$_{45Gy}$, Bladder D$_{mean}$, and Rectum D$_{mean}$ from adaptive radiotherapy using reduced 3mm or 5mm CTV-to-PTV margins. The LASSO technique was used to identify the most predictive metrics for Bowel V$_{40Gy}$. The three highest performing metrics were used to build multivariate models with leave-one-out validation for Bowel V$_{40Gy}$. Patients with higher initial bowel doses were correlated with the largest decreases in Bowel V$_{40Gy}$ from daily adaptation (linear best fit R$^2$=0.77 for a 3mm PTV margin and R$^2$=0.8 for a 5mm PTV margin). Other metrics had intermediate or no correlation. Selected covariates for the multivariate model were differences in the initial Bowel V$_{40Gy}$. and Bladder D$_{mean}$ using standard versus reduced margins and the initial bladder volume. Leave-one-out validation had an R$^2$ of 0.66 between the predicted and true adaptive Bowel V$_{40Gy}$ benefits for both margins. This work could be used to prospectively triage cervical cancer patients, and presents a critical foundation for predicting benefits from daily adaptation that can be extended to other patient cohorts.


title: Master Actions and Helicity Decomposition for Spin-4 Models in $3D$

abstract: The present work introduces a master action that interpolates between four self-dual models, $SD(i)$, for describing massive spin-4 particles in $D=2+1$ dimensions. These models are designated by $i=1,2,3$ and $4$, representing the order in derivatives. Our results show that the four descriptions are quantum equivalent through comparison of their correlation functions, up to contact terms. A geometrical approach is demonstrated to be a useful tool in describing the third and fourth order models. The construction of the master action relies on the introduction of mixing terms, which must be free of particle content. We use the helicity decomposition method to verify the absence of particle content in these terms, ensuring the proper functioning of the master action.


title: Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor

abstract: Instruction tuning enables pretrained language models to perform new tasks from inference-time natural language descriptions. These approaches rely on vast amounts of human supervision in the form of crowdsourced datasets or user interactions. In this work, we introduce Unnatural Instructions: a large dataset of creative and diverse instructions, collected with virtually no human labor. We collect 64,000 examples by prompting a language model with three seed examples of instructions and eliciting a fourth. This set is then expanded by prompting the model to rephrase each instruction, creating a total of approximately 240,000 examples of instructions, inputs, and outputs. Experiments show that despite containing a fair amount of noise, training on Unnatural Instructions rivals the effectiveness of training on open-source manually-curated datasets, surpassing the performance of models such as T0++ and Tk-Instruct across various benchmarks. These results demonstrate the potential of model-generated data as a cost-effective alternative to crowdsourcing for dataset expansion and diversification.


title: Perpendicular electric field drives Chern transitions and layer polarization changes in Hofstadter bands

abstract: Moir\'e superlattices engineer band properties and enable observation of fractal energy spectra of Hofstadter butterfly. Recently, correlated-electron physics hosted by flat bands in small-angle moir\'e systems has been at the foreground. However, the implications of moir\'e band topology within the single-particle framework are little explored experimentally. An outstanding problem is understanding the effect of band topology on Hofstadter physics, which does not require electron correlations. Our work experimentally studies Chern state switching in the Hofstadter regime using twisted double bilayer graphene (TDBG), which offers electric field tunable topological bands, unlike twisted bilayer graphene. Here we show that the nontrivial topology reflects in the Hofstadter spectra, in particular, by displaying a cascade of Hofstadter gaps that switch their Chern numbers sequentially while varying the perpendicular electric field. Our experiments together with theoretical calculations suggest a crucial role of charge polarization changing concomitantly with topological transitions in this system. Layer polarization is likely to play an important role in the topological states in few-layer twisted systems. Moreover, our work establishes TDBG as a novel Hofstadter platform with nontrivial magnetoelectric coupling.


title: Monopole and instanton effects on connected and disconnected correlations for scalar density

abstract: This study investigates the effects on the connected and disconnected correlations for the scalar density that are induced by created monopoles and instantons in the QCD vacuum. To reveal the effects, we add a monopole and anti-monopole pair in the gauge field configurations in \textit{SU}(3) by applying the monopole creation operator to the vacuum. We vary the magnetic charges of the monopole and anti-monopole and increase the number of monopoles and anti-monopoles in the configurations. The Dirac operator of overlap fermions preserves the exact chiral symmetry in lattice gauge theory and exact zero-modes exist in its spectrum. The eigenvalues and eigenvectors of the overlap Dirac operator have been calculated using these configurations, and the numbers of instantons and anti-instantons which are created by these additional monopoles and anti-monopoles have been estimated from the numbers of topological charges in our previous studies. In this study, we demonstrate the preliminary results that instantons and monopoles influence the masses that are evaluated from the connected and disconnected correlation functions for the scalar density using low-lying eigenvalues and eigenvectors of the overlap Dirac operator.


title: Analysis and Compilation of Normal Map Generation Techniques for Pixel Art

abstract: Pixel art is a popular artistic style adopted in the gaming industry, and nowadays, it is often accompanied by modern rendering techniques. One example is dynamic lighting for the game sprites, for which normal mapping defines how the light interacts with the material represented by each pixel. Although there are different methods to generate normal maps for 3D games, applying them for pixel art may not yield correct results due to the style specificities. Therefore, this work compiles different normal map generation methods and study their applicability for pixel art, reducing the scarcity of existing material on the techniques and contributing to a qualitative analysis of the behavior of these methods in different case studies.


title: Non-perturbative intertwining between spin and charge correlations: A "smoking gun" single-boson-exchange result

abstract: We study the microscopic mechanism controlling the interplay between local charge and local spin fluctuations in correlated electron systems via a thorough investigation of the generalized on-site charge susceptibility of several fundamental many-electron models, such as the Hubbard atom, the Anderson impurity model, and the Hubbard model. By decomposing the numerically determined generalized susceptibility in terms of physically transparent single-boson exchange processes, we unveil the microscopic mechanisms responsible for the breakdown of the self-consistent many-electron perturbation expansion. In particular, we unambiguously identify the origin of the significant suppression of its diagonal entries in (Matsubara) frequency space and the slight increase of the off-diagonal ones which cause the breakdown. The suppression effect on the diagonal elements originates directly from the electronic scattering on local magnetic moments, reflecting their increasingly longer lifetime as well as their enhanced effective coupling with the electrons. Instead, the slight and diffuse enhancement of the off-diagonal terms can be mostly ascribed to multiboson scattering processes. The strong intertwining between spin and charge sectors is partly weakened at the Kondo temperature due to a progressive reduction of the effective spin-fermion coupling of local magnetic fluctuations in the low frequency regime. Our analysis, thus, clarifies the precise mechanism through which the physical information is transferred between different scattering channels of interacting electron problems and highlights the pivotal role played by such an intertwining in the physics of correlated electrons beyond the perturbative regime.


title: Nodal-antinodal dichotomy from anisotropic quantum critical continua in holographic models

abstract: We demonstrate that the absence of stable quasiparticle excitations on parts of the Fermi surface, similar to the "nodal-antinodal dichotomy" in underdoped cuprate superconductors, can be reproduced in models of strongly correlated electrons defined via a holographic dual. We show analytically that the anisotropy of the quantum critical continuum, which is a feature of these models, may lead to washing out the quasiparticle peak in one direction while leaving it intact in the perpendicular one. The effect relies on the qualitatively different scaling of the self-energy in different directions. Using the explicit example of the anisotropic Q-lattice model, we demonstrate how this effect emerges due to specific features of the near horizon geometry of the black hole in the dual description.


title: LapH interpolating fields with open boundary conditions

abstract: The stochastic Laplacian Heaviside (LapH) method has proven to be successful in hadronic calculations. In this work, with charm-light spectroscopy in mind, we set up and optimise the LapH procedure limiting ourselves to the evaluation of two-point mesonic correlation functions. The calculations are performed on CLS ensembles with $N_f=2+1$ Wilson-Clover fermions on a $32^3\times64$ lattice with open boundary conditions. We analyse the interplay between the LapH parameters and the boundary effects, and implement a fitting procedure to isolate excitations coming from the border.


title: Algebraic Bethe Ansatz for the Open XXZ Spin Chain with Non-Diagonal Boundary Terms via $U_{\mathfrak{q}}\mathfrak{sl}_2$ Symmetry

abstract: We derive by the traditional algebraic Bethe ansatz method the Bethe equations for the general open XXZ spin chain with non-diagonal boundary terms under the Nepomechie constraint [J. Phys. A 37 (2004), 433-440, arXiv:hep-th/0304092]. The technical difficulties due to the breaking of $\mathsf{U}(1)$ symmetry and the absence of a reference state are overcome by an algebraic construction where the two-boundary Temperley-Lieb Hamiltonian is realised in a new $U_{\mathfrak{q}}\mathfrak{sl}_2$-invariant spin chain involving infinite-dimensional Verma modules on the edges [J. High Energy Phys. 2022 (2022), no. 11, 016, 64 pages, arXiv:2207.12772]. The equivalence of the two Hamiltonians is established by proving Schur-Weyl duality between $U_{\mathfrak{q}}\mathfrak{sl}_2$ and the two-boundary Temperley-Lieb algebra. In this framework, the Nepomechie condition turns out to have a simple algebraic interpretation in terms of quantum group fusion rules.

categories: hep-th cond-mat.stat-mech math-ph math.MP math.QA


title: Resolving ${\bf W}$ Boson Mass Shift and CKM Unitarity Violation in Left-Right Symmetric Models with Universal Seesaw

abstract: We explore the possibility of resolving simultaneously the $W$-boson mass shift reported by the CDF collaboration and the apparent deviation from unitarity in the first row of the CKM mixing matrix in a class of left-right symmetric models. The fermion masses are generated in these models through a universal seesaw mechanism, utilizing vector-like partners of the usual fermions. We find a unique solution to the two anomalies where the mixing of the down quark with a vector-like quark (VLQ) resolves the CKM unitarity puzzle, and the mixing of the top quark with a VLQ partner explains the $W$ boson mass shift. The validity of this setup is tested against the stability of the Higgs potential up to higher energies. We find upper bounds of $(5,\,4,\,4)$ TeV on the masses of the down-type VLQ, the top-partner VLQ, and a neutral scalar associated with $SU(2)_R$ gauge symmetry breaking, respectively. This class of models can solve the strong CP problem via parity symmetry without the need for an axion.


title: Multi-Meron Interactions and Statistics in Two-Dimensional Materials

abstract: As a fundamental type of topological spin textures in two-dimensional (2D) magnets, a magnetic meron carries half-integer topological charge and forms a pair with its antithesis to keep the stability in materials. However, it is challenging to quantitatively calculate merons and their dynamics by using the widely used continuum model because of the characteristic highly inhomogeneous spin textures. In this work, we develop a discrete method to address the concentrated spin structures around the core of merons. We reveal a logarithmic-scale interaction between merons when their distance is larger than twice their core size and obtain subsequent statistics of meron gas. The model also predicts how these properties of single and paired merons evolve with magnetic exchange interactions, and the results are in excellent agreement with the Monte Carlo simulations using the parameters of real 2D van der Waals magnetic materials. This discrete approach not only shows equilibrium static statistics of meron systems but also is useful to further explore the dynamic properties of merons through the quantified pairing interactions.


title: SegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentations

abstract: End-to-end Speech Translation is hindered by a lack of available data resources. While most of them are based on documents, a sentence-level version is available, which is however single and static, potentially impeding the usefulness of the data. We propose a new data augmentation strategy, SegAugment, to address this issue by generating multiple alternative sentence-level versions of a dataset. Our method utilizes an Audio Segmentation system, which re-segments the speech of each document with different length constraints, after which we obtain the target text via alignment methods. Experiments demonstrate consistent gains across eight language pairs in MuST-C, with an average increase of 2.5 BLEU points, and up to 5 BLEU for low-resource scenarios in mTEDx. Furthermore, when combined with a strong system, SegAugment establishes new state-of-the-art results in MuST-C. Finally, we show that the proposed method can also successfully augment sentence-level datasets, and that it enables Speech Translation models to close the gap between the manual and automatic segmentation at inference time.


title: Resolving Open-textured Rules with Templated Interpretive Arguments

abstract: Open-textured terms in written rules are typically settled through interpretive argumentation. Ongoing work has attempted to catalogue the schemes used in such interpretive argumentation. But how can the use of these schemes affect the way in which people actually use and reason over the proper interpretations of open-textured terms? Using the interpretive argument-eliciting game Aporia as our framework, we carried out an empirical study to answer this question. Differing from previous work, we did not allow participants to argue for interpretations arbitrarily, but to only use arguments that fit with a given set of interpretive argument templates. Finally, we analyze the results captured by this new dataset, specifically focusing on practical implications for the development of interpretation-capable artificial reasoners.


title: Graph-based Semantical Extractive Text Analysis

abstract: In the past few decades, there has been an explosion in the amount of available data produced from various sources with different topics. The availability of this enormous data necessitates us to adopt effective computational tools to explore the data. This leads to an intense growing interest in the research community to develop computational methods focused on processing this text data. A line of study focused on condensing the text so that we are able to get a higher level of understanding in a shorter time. The two important tasks to do this are keyword extraction and text summarization. In keyword extraction, we are interested in finding the key important words from a text. This makes us familiar with the general topic of a text. In text summarization, we are interested in producing a short-length text which includes important information about the document. The TextRank algorithm, an unsupervised learning method that is an extension of the PageRank (algorithm which is the base algorithm of Google search engine for searching pages and ranking them) has shown its efficacy in large-scale text mining, especially for text summarization and keyword extraction. this algorithm can automatically extract the important parts of a text (keywords or sentences) and declare them as the result. However, this algorithm neglects the semantic similarity between the different parts. In this work, we improved the results of the TextRank algorithm by incorporating the semantic similarity between parts of the text. Aside from keyword extraction and text summarization, we develop a topic clustering algorithm based on our framework which can be used individually or as a part of generating the summary to overcome coverage problems.


title: On Event Individuation for Document-Level Information Extraction

abstract: As information extraction (IE) systems have grown more adept at processing whole documents, the classic task of template filling has seen renewed interest as benchmark for document-level IE. In this position paper, we call into question the suitability of template filling for this purpose. We argue that the task demands definitive answers to thorny questions of event individuation -- the problem of distinguishing distinct events -- about which even human experts disagree. Through an annotation study and error analysis, we show that this raises concerns about the usefulness of template filling metrics, the quality of datasets for the task, and the ability of models to learn it. Finally, we consider possible solutions.


title: A Survey of Vectorization Methods in Topological Data Analysis

abstract: Attempts to incorporate topological information in supervised learning tasks have resulted in the creation of several techniques for vectorizing persistent homology barcodes. In this paper, we study thirteen such methods. Besides describing an organizational framework for these methods, we comprehensively benchmark them against three well-known classification tasks. Surprisingly, we discover that the best-performing method is a simple vectorization, which consists only of a few elementary summary statistics. Finally, we provide a convenient web application which has been designed to facilitate exploration and experimentation with various vectorization methods.


title: Rate-Privacy-Storage Tradeoff in Federated Learning with Top $r$ Sparsification

abstract: We investigate the trade-off between rate, privacy and storage in federated learning (FL) with top $r$ sparsification, where the users and the servers in the FL system only share the most significant $r$ and $r'$ fractions, respectively, of updates and parameters in the FL process, to reduce the communication cost. We present schemes that guarantee information theoretic privacy of the values and indices of the sparse updates sent by the users at the expense of a larger storage cost. To this end, we generalize the scheme to reduce the storage cost by allowing a certain amount of information leakage. Thus, we provide the general trade-off between the communication cost, storage cost, and information leakage in private FL with top $r$ sparsification, along the lines of two proposed schemes.


title: The determining role of covariances in large networks of stochastic neurons

abstract: Biological neural networks are notoriously hard to model due to their stochastic behavior and high dimensionality. We tackle this problem by constructing a dynamical model of both the expectations and covariances of the fractions of active and refractory neurons in the network's populations. We do so by describing the evolution of the states of individual neurons with a continuous-time Markov chain, from which we formally derive a low-dimensional dynamical system. This is done by solving a moment closure problem in a way that is compatible with the nonlinearity and boundedness of the activation function. Our dynamical system captures the behavior of the high-dimensional stochastic model even in cases where the mean-field approximation fails to do so. Taking into account the second-order moments modifies the solutions that would be obtained with the mean-field approximation, and can lead to the appearance or disappearance of fixed points and limit cycles. We moreover perform numerical experiments where the mean-field approximation leads to periodically oscillating solutions, while the solutions of the second-order model can be interpreted as an average taken over many realizations of the stochastic model. Altogether, our results highlight the importance of including higher moments when studying stochastic networks and deepen our understanding of correlated neuronal activity.


title: Multiple testing under negative dependence

abstract: The multiple testing literature has primarily dealt with three types of dependence assumptions between p-values: independence, positive regression dependence, and arbitrary dependence. In this paper, we provide what we believe are the first theoretical results under various notions of negative dependence (negative Gaussian dependence, negative regression dependence, negative association, negative orthant dependence and weak negative dependence). These include the Simes global null test and the Benjamini-Hochberg procedure, which are known experimentally to be anti-conservative under negative dependence. The anti-conservativeness of these procedures is bounded by factors smaller than that under arbitrary dependence (in particular, by factors independent of the number of hypotheses). We also provide new results about negatively dependent e-values, and provide several examples as to when negative dependence may arise. Our proofs are elementary and short, thus amenable to extensions.


title: Discrete geodesic local time converges under KPZ scaling

abstract: The directed landscape constructed in (Dauvergne-Ortmann-Virag '18) produces a directed, planar, random geometry, and is believed to be the universal scaling limit of two-dimensional first and last passage percolation models in the Kardar-Parisi-Zhang (KPZ) universality class. Geodesics in this random geometry form an important class of random continuous curves exhibiting fluctuation theory quite different from that of Brownian motion. In this vein, counterpart to Brownian local time, BLT (a self-similar measure supported on the set of zeros of Brownian motion), a local time for geodesics, GLT, was recently constructed and used to study fractal properties of the directed landscape in (Ganguly-Zhang '22). It is a classical fact and can be proven using the Markovian property of Brownian motion that the uniform discrete measure on the set of zeros of the simple random walk converges to BLT. In this paper, we prove the ''KPZ analog'' of this by showing that the local times for discrete geodesics in pre-limiting integrable last passage percolation models converge to GLT under suitable scaling guided by KPZ exponents. In absence of any Markovianity, our arguments rely on the recently proven convergence of geodesics in pre-limiting models to that in the directed landscape (Dauvergne-Virag '21). However, this input concerns macroscopic properties and is too coarse to capture the microscopic information required for local time analysis. To relate the macroscopic and microscopic behavior, a key ingredient is an a priori smoothness estimate of the local time in the discrete model, proved relying on geometric ideas such as the coalescence of geodesics as well as their stability under perturbations of boundary data.


title: Recurring outbursts of the supernova impostor AT 2016blu in NGC 4559

abstract: We present the first photometric analysis of the supernova (SN) impostor AT 2016blu in NGC 4559. This transient was discovered by the Lick Observatory Supernova Search in 2012 and has continued its outbursts since then. Optical and infrared photometry of AT 2016blu reveals at least 19 outbursts in 2012-2022. Similar photometry from 1999-2009 shows no outbursts, indicating that the star was relatively stable in the decade before discovery. Archival {\it Hubble Space Telescope} observations suggest that the progenitor had a minimum initial mass of $M >= 33$ M$_{\odot}$ and a luminosity of $L >= 10^{5.7}$ L$_{\odot}$. AT 2016blu's outbursts show irregular variability with multiple closely spaced peaks having typical amplitudes of 1-2 mag and durations of 1-4 weeks. While individual outbursts have irregular light curves, concentrations of these peaks recur with a period of $\sim 113 \pm 2$ d. Based on this period, we predict times for upcoming outbursts in 2023 and 2024. AT 2016blu shares similarities with SN 2000ch in NGC 3432, where outbursts may arise from periastron encounters in an eccentric binary containing a luminous blue variable (LBV). We propose that AT 2016blu's outbursts are also driven by interactions that intensify around periastron in an eccentric system. Intrinsic variability of the LBV-like primary star may cause different intensity and duration of binary interaction at each periastron passage. AT 2016blu also resembles the periastron encounters of $\eta$ Carinae prior to its Great Eruption and the erratic pre-SN eruptions of SN 2009ip. This similarity and the onset of eruptions in the past decade hint that AT 2016blu may also be headed for a catastrophe, making it a target of great interest.


title: Energy dissipation in viscoelastic Bessel media

abstract: We investigate the specific attenuation factor for the Bessel models of viscoelasticity. We find that the quality factor for this class can be expressed in terms of Kelvin functions and that its asymptotic behaviours confirm the analytical results found in previous studies for the rheological properties of these models.


title: Continual Learning for Instruction Following from Realtime Feedback

abstract: We propose and deploy an approach to continually train an instruction-following agent from feedback provided by users during collaborative interactions. During interaction, human users instruct an agent using natural language, and provide realtime binary feedback as they observe the agent following their instructions. We design a contextual bandit learning approach, converting user feedback to immediate reward. We evaluate through thousands of human-agent interactions, demonstrating 15.4% absolute improvement in instruction execution accuracy over time. We also show our approach is robust to several design variations, and that the feedback signal is roughly equivalent to the learning signal of supervised demonstration data.


title: Optimization and first electronic implementation of the Constant-Fraction Time-Over-Threshold pulse shape discrimination method

abstract: In this contribution we report on further investigations of the recently-evaluated Constant-Fraction Time-over-Threshold (CF-ToT) method for neutron/gamma-ray pulse shape discrimination (PSD). The superiority of the CF-ToT PSD method over the constant-threshold (CT-ToT) method was previously demonstrated, down to low neutron energy thresholds of 100 keVee. Here, we report on a quantitative comparison between the traditionally used Charge Comparison (CC) method and the CF-ToT method using a stilbene scintillator coupled to a silicon photomultiplier, implementing an offline analysis of recorded fast-neutron and gamma-ray waveforms. An optimization of the constant fraction value indicates that a 20%-fraction yields the optimum figure-of-merit (FOM) and gamma-ray peak-to-valley (P/V) ratio. The results obtained for a particle energy threshold of 100 keVee show that the FOM and P/V values achieved with the CF-ToT method are superior to those obtained using the standard CC method. In addition, a first electronic implementation of the CF-ToT method was performed using simple circuitry suitable for multichannel architecture. Initial results obtained with this circuit prototype are presented.


title: Universal Mechanism for Quantitative Understanding of Global Ozone Depletion

abstract: This paper formulates the cosmic-ray(CR)-driven electron-induced reaction (CRE) mechanism to provide a quantitative understanding of global ozone depletion. Based on a proposed electrostatic bonding mechanism for charged-induced adsorption of molecules on surfaces and on the measured dissociative electron transfer (DET) cross sections of ozone depletion substances (ODSs) adsorbed on ice, an analytical equation is derived to give atmospheric chlorine atom concentration: $$[Cl] = \sum_i k^i \theta_{ODS}^i \Phi_e^2,$$ where $\Phi_e$ is the CR-produced prehydrated electron ($e_{pre}^-$) flux on atmospheric particle surfaces, $\theta_{ODS}^i$ is the surface coverage of an ODS, and $k^i$ is the ODS's effective DET coefficient comprising the DET cross section, lifetimes of surface-trapped $e_{pre}^-$ and Cl$^-$, and particle surface area density. With concentrations of ODSs as the sole variable, our calculated results of time-series ozone depletion rates in global regions in the 1960s, 1980s and 2000s show generally good agreement with observations, particularly with ground-based ozonesonde data and satellite-measured data over Antarctica and with satellite data in the tropics in a narrow altitude band at 13-20 km. Good agreements with satellite data in the Arctic and midlatitudes are also found. A new insight into the denitrification effect on ozone loss is given quantitatively. But this equation overestimates tropospheric ozone loss at northern midlatitudes and the Arctic, likely due to increased ozone production by the halogen chemistry in polluted regions. Finally, ozone maps from ozonesonde data clearly reveal the scope of the tropical ozone hole. The results render confidence in applying the CRE equation to achieve a quantitative understanding of global ozone depletion.


title: A Probabilistic Framework for Lifelong Test-Time Adaptation

abstract: Test-time adaptation (TTA) is the problem of updating a pre-trained source model at inference time given test input(s) from a different target domain. Most existing TTA approaches assume the setting in which the target domain is stationary, i.e., all the test inputs come from a single target domain. However, in many practical settings, the test input distribution might exhibit a lifelong/continual shift over time. Moreover, existing TTA approaches also lack the ability to provide reliable uncertainty estimates, which is crucial when distribution shifts occur between the source and target domain. To address these issues, we present PETAL (Probabilistic lifElong Test-time Adaptation with seLf-training prior), which solves lifelong TTA using a probabilistic approach, and naturally results in (1) a student-teacher framework, where the teacher model is an exponential moving average of the student model, and (2) regularizing the model updates at inference time using the source model as a regularizer. To prevent model drift in the lifelong/continual TTA setting, we also propose a data-driven parameter restoration technique which contributes to reducing the error accumulation and maintaining the knowledge of recent domains by restoring only the irrelevant parameters. In terms of predictive error rate as well as uncertainty based metrics such as Brier score and negative log-likelihood, our method achieves better results than the current state-of-the-art for online lifelong test-time adaptation across various benchmarks, such as CIFAR-10C, CIFAR-100C, ImageNetC, and ImageNet3DCC datasets. The source code for our approach is accessible at https://github.com/dhanajitb/petal.


title: Elemental Dilution Effect on the Elastic Response due to a Quadrupolar Kondo Effect of the Non-Kramers System Y$_{1-x}$Pr$_x$Ir$_2$Zn$_{20}$

abstract: We measured the elastic constants $\left(C_{11}-C_{12}\right)/2$ and $C_{44}$ of the non-Kramers system $\rm{Y_{0.63}Pr_{0.37}Ir_{2}Zn_{20}}$ (Pr-37% system) by means of ultrasound to check how the single-site quadrupolar Kondo effect is modified by increasing the Pr concentration. The Curie-like softening of $\left(C_{11}-C_{12}\right)/2$ between 1 and 5 K of the present Pr-37% system can be reproduced by a multipolar susceptibility calculation based on the non-Kramers $\Gamma_3$ doublet crystalline-electric-field ground state. Further, on cooling below 0.15 K, a temperature dependence proportional to $\sqrt{T}$ was observed in $\left(C_{11}-C_{12}\right)/2$. This behavior rather corresponds to the theoretical prediction of the quadrupolar Kondo "lattice" model, unlike that of the Pr-3.4% system, which shows a logarithmic temperature dependence based on the "single-site" quadrupolar Kondo theory. In addition, we discuss the possibility to form a vibronic state by the coupling between the low-energy phonons and the electric quadrupoles of the non-Kramers doublet in the Pr-37% system, since we found a low-energy ultrasonic dispersion in the temperature region between 0.15 and 1 K.


title: Liquid Democracy. Two Experiments on Delegation in Voting

abstract: Proponents of participatory democracy praise Liquid Democracy: decisions are taken by referendum, but voters delegate their votes freely. When better informed voters are present, delegation can increase the probability of a correct decision. However, delegation must be used sparely because it reduces the information aggregated through voting. In two different experiments, we find that delegation underperforms both universal majority voting and the simpler option of abstention. In a tightly controlled lab experiment where the subjects' precision of information is conveyed in precise mathematical terms and very salient, the result is due to overdelegation. In a perceptual task run online where the precision of information is not known precisely, delegation remains very high and again underperforms both majority voting and abstention. In addition, subjects substantially overestimate the precision of the better informed voters, underlining that Liquid Democracy is fragile to multiple sources of noise. The paper makes an innovative methodological contribution by combining two very different experimental procedures: the study of voting rules would benefit from complementing controlled experiments with known precision of information with tests under ambiguity, a realistic assumption in many voting situations.


title: Differential geometry of space curves: Forgotten chapters

abstract: We study evolutes and involutes of space curves. Although much of the material presented is not new and can be found in classic treatises, we believe that a modern and unified treatment, complemented with several novel observations, may be useful. The results are illustrated with the help of computer graphics, a tool that was not not available to the classical geometers.


title: Integrated Quantum Optical Phase Sensor

abstract: The quantum noise of light fundamentally limits optical phase sensors. A semiclassical picture attributes this noise to the random arrival time of photons from a coherent light source such as a laser. An engineered source of squeezed states suppresses this noise and allows sensitivity beyond the standard quantum limit (SQL) for phase detection. Advanced gravitational wave detectors like LIGO have already incorporated such sources, and nascent efforts in realizing quantum biological measurements have provided glimpses into new capabilities emerging in quantum measurement. We need ways to engineer and use quantum light within deployable quantum sensors that operate outside the confines of a lab environment. Here we present a photonic integrated circuit fabricated in thin-film lithium niobate that provides a path to meet these requirements. We use the second-order nonlinearity to produce a squeezed state at the same frequency as the pump light and realize circuit control and sensing with electro-optics. Using a 26.2 milliwatts of optical power, we measure (2.7 $\pm$ 0.2 )$\%$ squeezing and apply it to increase the signal-to-noise ratio of phase measurement. We anticipate that on-chip photonic systems like this, which operate with low power and integrate all of the needed functionality on a single die, will open new opportunities for quantum optical sensing.


title: A proof of Saari's conjecture

abstract: We prove Saari's conjecture, which states that for any solution to the classical $n$-body problem that has constant (polar) moment of inertia has to behave as a rotating rigid body. Additionally, we remark how Saari's conjecture can be generalised well beyond the confines of the classical $n$-body problem.


title: Mitigating the measurement overhead of ADAPT-VQE with optimised informationally complete generalised measurements

abstract: ADAPT-VQE stands out as a robust algorithm for constructing compact ans\"atze for molecular simulation. It enables to significantly reduce the circuit depth with respect to other methods, such as UCCSD, while achieving higher accuracy and not suffering from so-called barren plateaus that hinder the variational optimisation of many hardware-efficient ans\"atze. In its standard implementation, however, it introduces a considerable measurement overhead in the form of gradient evaluations trough estimations of many commutator operators. In this work, we mitigate this measurement overhead by exploiting a recently introduced method for energy evaluation relying on Adaptive Informationally complete generalised Measurements (AIM). Besides offering an efficient way to measure the energy itself, Informationally Complete (IC) measurement data can be reused to estimate all the commutators of the operators in the operator pool of ADAPT-VQE, using only classically efficient post-processing. We present the AIM-ADAPT-VQE scheme in detail, and investigate its performance with several H4 Hamiltonians and operator pools. Our numerical simulations indicate that the measurement data obtained to evaluate the energy can be reused to implement ADAPT-VQE with no additional measurement overhead for the systems considered here. In addition, we show that, if the energy is measured within chemical precision, the CNOT count in the resulting circuits is close to the ideal one. With scarce measurement data, AIM-ADAPT-VQE still converges to the ground state with high probability, albeit with an increased circuit depth in some cases.


title: The case for 4-bit precision: k-bit Inference Scaling Laws

abstract: Quantization methods reduce the number of bits required to represent each parameter in a model, trading accuracy for smaller memory footprints and inference latencies. However, the final model size depends on both the number of parameters of the original model and the rate of compression. For example, a 30B 8-bit model and a 60B 4-bit model have the same number of bits but may have very different zero-shot accuracies. In this work, we study this trade-off by developing inference scaling laws of zero-shot performance in Large Language Models (LLMs) to determine the bit-precision and model size that maximizes zero-shot performance. We run more than 35,000 experiments with 16-bit inputs and k-bit parameters to examine which zero-shot quantization methods improve scaling for 3 to 8-bit precision at scales of 19M to 176B parameters across the LLM families BLOOM, OPT, NeoX/Pythia, and GPT-2. We find that it is challenging to improve the bit-level scaling trade-off, with the only improvements being the use of a small block size -- splitting the parameters into small independently quantized blocks -- and the quantization data type being used (e.g., Int vs Float). Overall, our findings show that {4-bit} precision is almost universally optimal for total model bits and zero-shot accuracy.


title: KNIFE: Distilling Reasoning Knowledge From Free-Text Rationales

abstract: Language models (LMs) have yielded impressive results on many language reasoning tasks, but their unexpected errors raise doubts about their reasoning abilities. In light of this, there is growing interest in finetuning/prompting LMs with both task instances and their associated free-text rationales (FTRs), which explain the correct reasoning process for predicting the correct task output (i.e., how to be "right for the right reasons"). However, existing finetuning methods fail to improve LM performance, while prompting needs prohibitively large (i.e., >50B) LMs to work well. We propose KNIFE, which shows that reasoning knowledge can be effectively distilled from FTRs into a small (i.e., <1B) LM and improve the LM's performance. First, KNIFE finetunes a teacher LM (given task input and FTR) to predict the task output, transferring reasoning knowledge from the FTRs to the teacher's hidden states. Second, KNIFE finetunes a student LM (given task input only) such that its hidden states are aligned with the teacher's. Thus, the student is endowed with reasoning knowledge but can be used for inference without direct FTR input. On two question-answering datasets, KNIFE outperforms various finetuning and prompting baselines in fully-supervised and low-resource settings. Also, we observe that FTR quality is crucial to KNIFE's performance.


title: Inspection of the detection cross section dependence of the Gallium Anomaly

abstract: We discuss in detail the dependence of the Gallium Anomaly on the detection cross section. We provide updated values of the size of the Gallium Anomaly and find that its significance is larger than about $5\sigma$ for all the detection cross section models. We discuss the dependence of the Gallium Anomaly on the assumed value of the half life of ${}^{71}\text{Ge}$, which determines the cross sections of the transitions from the ground state of ${}^{71}\text{Ga}$ to the ground state of ${}^{71}\text{Ge}$. We show that a value of the ${}^{71}\text{Ge}$ half life which is larger than the standard one can reduce or even solve the Gallium Anomaly. Considering the short-baseline neutrino oscillation interpretation of the Gallium Anomaly, we show that a value of the ${}^{71}\text{Ge}$ half life which is larger than the standard one can reduce the tension with the results of other experiments. Since the standard value of the ${}^{71}\text{Ge}$ half life was measured in 1985, we advocate the importance of new measurements with modern technique and apparatus for a better assessment of the Gallium Anomaly.


title: MANER: Mask Augmented Named Entity Recognition for Extreme Low-Resource Languages

abstract: This paper investigates the problem of Named Entity Recognition (NER) for extreme low-resource languages with only a few hundred tagged data samples. NER is a fundamental task in Natural Language Processing (NLP). A critical driver accelerating NER systems' progress is the existence of large-scale language corpora that enable NER systems to achieve outstanding performance in languages such as English and French with abundant training data. However, NER for low-resource languages remains relatively unexplored. In this paper, we introduce Mask Augmented Named Entity Recognition (MANER), a new methodology that leverages the distributional hypothesis of pre-trained masked language models (MLMs) for NER. The <mask> token in pre-trained MLMs encodes valuable semantic contextual information. MANER re-purposes the <mask> token for NER prediction. Specifically, we prepend the <mask> token to every word in a sentence for which we would like to predict the named entity tag. During training, we jointly fine-tune the MLM and a new NER prediction head attached to each <mask> token. We demonstrate that MANER is well-suited for NER in low-resource languages; our experiments show that for 100 languages with as few as 100 training examples, it improves on state-of-the-art methods by up to 48% and by 12% on average on F1 score. We also perform detailed analyses and ablation studies to understand the scenarios that are best-suited to MANER.


title: A Retrieve-and-Read Framework for Knowledge Graph Link Prediction

abstract: Knowledge graph (KG) link prediction aims to infer new facts based on existing facts in the KG. Recent studies have shown that using the graph neighborhood of a node via graph neural networks (GNNs) provides more useful information compared to just using the query information. Conventional GNNs for KG link prediction follow the standard message-passing paradigm on the entire KG, which leads to superfluous computation, over-smoothing of node representations, and also limits their expressive power. On a large scale, it becomes computationally expensive to aggregate useful information from the entire KG for inference. To address the limitations of existing KG link prediction frameworks, we propose a novel retrieve-and-read framework, which first retrieves a relevant subgraph context for the query and then jointly reasons over the context and the query with a high-capacity reader. As part of our exemplar instantiation for the new framework, we propose a novel Transformer-based GNN as the reader, which incorporates graph-based attention structure and cross-attention between query and context for deep fusion. This simple yet effective design enables the model to focus on salient context information relevant to the query. Empirical results on two standard KG link prediction datasets demonstrate the competitive performance of the proposed method. Furthermore, our analysis yields valuable insights for designing improved retrievers within the framework.


title: Anisotropic fluctuations of angular momentum of heavy quarks in the Glasma

abstract: We study the evolution of the angular momentum of the heavy quarks in the very early stage of high energy nuclear collisions, in which the background is made of evolving Glasma fields. Given the novelty of the problem, we limit ourselves to the use of toy heavy quarks with a large, unphysical mass, in order to implement the kinetic equations for the angular momentum in the non-relativistic limit. We find that as a consequence of the anisotropy of the background fields, angular momentum fluctuations are also anisotropic: we understand this in simple terms relating the fluctuations of the angular momentum, $L$, to those of linear momentum. While orbital angular momentum diffuses and develops substantial fluctuations and anisotropies, the spin does not. Hence, we can identify the fluctuations of $L$ with those of the total angular momentum $J=L + S$. Therefore, our study suggests that the total angular momentum of the heavy quarks in the early stage of high energy nuclear collisions will present anisotropic fluctuations.


title: Improving Faithfulness of Abstractive Summarization by Controlling Confounding Effect of Irrelevant Sentences

abstract: Lack of factual correctness is an issue that still plagues state-of-the-art summarization systems despite their impressive progress on generating seemingly fluent summaries. In this paper, we show that factual inconsistency can be caused by irrelevant parts of the input text, which act as confounders. To that end, we leverage information-theoretic measures of causal effects to quantify the amount of confounding and precisely quantify how they affect the summarization performance. Based on insights derived from our theoretical results, we design a simple multi-task model to control such confounding by leveraging human-annotated relevant sentences when available. Crucially, we give a principled characterization of data distributions where such confounding can be large thereby necessitating the use of human annotated relevant sentences to generate factual summaries. Our approach improves faithfulness scores by 20\% over strong baselines on AnswerSumm \citep{fabbri2021answersumm}, a conversation summarization dataset where lack of faithfulness is a significant issue due to the subjective nature of the task. Our best method achieves the highest faithfulness score while also achieving state-of-the-art results on standard metrics like ROUGE and METEOR. We corroborate these improvements through human evaluation.


title: Towards DNS of Droplet-Jet Collisions of Immiscible Liquids with FS3D

abstract: In-air microfluidics became a new method for technical production processes with ultra-high throughput formerly performed in micro channels. Direct Numerical Simulations (DNS) provide a valuable contribution for the fundamental understanding of multiphase flow and later application design. This chapter presents a feasibility study with first DNS results of droplet-jet collisions of immiscible liquids using the in-house software Free Surface 3D (FS3D). Two cases were investigated with a setup comparable to experiments by Baumgartner et al. [1], where a droplet chain of a glycerol solution hits a jet of silicon oil which encapsulates the droplets. The droplets' shapes present are observed to be more complex than comprehensible from the two-dimensional images from the experiments. Thus, DNS with FS3D can provide additional information like the surface area or the velocity contributions in order to find analytical models of such collision processes in the future. Simulations of such increasingly complex systems require constant improvement of the numerical solver regarding the code's performance. Thus, the red-black Gauss-Seidel smoother in the multi-grid solver, the iterative red-black scheme to compute the viscous forces as well as the momentum advection method were enhanced with a cache- and memory usage optimization. An overall performance gain of up to 33% was obtained for a representative test case.


title: Evolution of the radius of analyticity for the generalized Benjamin equation

abstract: In this work we consider the initial value problem for the generalized Benjamin equation \begin{equation}\label{Benj-IVP} \begin{cases} \partial_t u-l\mathcal{H} \partial_x^2u-\partial_x^3u+u^p\partial_xu = 0, \quad x,\; t\in \mathbb{R};\;\;,\; p\geq 1, \\ u(x,0) = u_0(x), \end{cases} \end{equation} where $u=u(x,t)$ is a real valued function, $0<l<1$ and $\mathcal{H}$ is the Hilbert transform. This model was introduced by T. B. Benjamin (J. Fluid Mech. 245 (1992) 401--411) and describes unidirectional propagation of long waves in a two-fluid system where the lower fluid with greater density is infinitely deep and the interface is subject to capillarity. We prove that the local solution to the IVP associated with the generalized Benjamin equation for given data in the spaces of functions analytic on a strip around the real axis continue to be analytic without shrinking the width of the strip in time. We also study the evolution in time of the radius of spatial analyticity and show that it can decrease as the time advances. Finally, we present an algebraic lower bound on the possible rate of decrease in time of the uniform radius of spatial analyticity.


title: Bistable perception, precision and neuromodulation

abstract: Bistable perception follows from observing a static, ambiguous, (visual) stimulus with two possible interpretations. Here, we present an active (Bayesian) inference account of bistable perception and posit that perceptual transitions between different interpretations (i.e., inferences) of the same stimulus ensue from specific eye movements that shift the focus to a different visual feature. Formally, these inferences are a consequence of precision control that determines how confident beliefs are and change the frequency with which one can perceive - and alternate between - two distinct percepts. We hypothesised that there are multiple, but distinct, ways in which precision modulation can interact to give rise to a similar frequency of bistable perception. We validated this using numerical simulations of the Necker's cube paradigm and demonstrate the multiple routes that underwrite the frequency of perceptual alternation. Our results provide an (enactive) computational account of the intricate precision balance underwriting bistable perception. Importantly, these precision parameters can be considered the computational homologues of particular neurotransmitters - i.e., acetylcholine, noradrenaline, dopamine - that have been previously implicated in controlling bistable perception, providing a computational link between the neurochemistry and perception.


title: Speaking Style Conversion in the Waveform Domain Using Discrete Self-Supervised Units

abstract: We introduce DISSC, a novel, lightweight method that converts the rhythm, pitch contour and timbre of a recording to a target speaker in a textless manner. Unlike DISSC, most voice conversion (VC) methods focus primarily on timbre, and ignore people's unique speaking style (prosody). The proposed approach uses a pretrained, self-supervised model for encoding speech to discrete units, which makes it simple, effective, and fast to train. All conversion modules are only trained on reconstruction like tasks, thus suitable for any-to-many VC with no paired data. We introduce a suite of quantitative and qualitative evaluation metrics for this setup, and empirically demonstrate that DISSC significantly outperforms the evaluated baselines. Code and samples are available at https://pages.cs.huji.ac.il/adiyoss-lab/dissc/.


title: The Bonsai algorithm: grow your own fermion-to-qubit mapping

abstract: Fermion-to-qubit mappings are used to represent fermionic modes on quantum computers, an essential first step in many quantum algorithms for electronic structure calculations. In this work, we present a formalism to design flexible fermion-to-qubit mappings from ternary trees. We discuss in an intuitive manner the connection between the generating trees' structure and certain properties of the resulting mapping, such as Pauli weight and the delocalisation of mode occupation. Moreover, we introduce a recipe that guarantees Fock basis states are mapped to computational basis states in qubit space, a desirable property for many applications in quantum computing. Based on this formalism, we introduce the Bonsai algorithm, which takes as input the potentially limited topology of the qubit connectivity of a quantum device and returns a tailored fermion-to-qubit mapping that reduces the SWAP overhead with respect to other paradigmatic mappings. We illustrate the algorithm by producing mappings for the heavy-hexagon topology widely used in IBM quantum computers. The resulting mappings have a favourable Pauli weight scaling $\mathcal{O}(\sqrt{N})$ on this connectivity, while ensuring that no SWAP gates are necessary for single excitation operations.


title: The Loom for General Fishnet CFTs

abstract: We propose a broad class of $d$-dimensional conformal field theories of $SU(N)$ adjoint scalar fields generalising the 4$d$ Fishnet CFT (FCFT) discovered by \"O. G\"urdogan and one of the authors as a special limit of $\gamma$-deformed $\mathcal{N}=4$ SYM theory. In the planar $N\to\infty $ limit the FCFTs are dominated by the ``fishnet" planar Feynman graphs. These graphs are explicitly integrable, as was shown long ago by A. Zamolodchikov. The Zamolodchikov's construction, based on the dual Baxter lattice (straight lines on the plane intersecting at arbitrary slopes) and the star-triangle identities, can serve as a ``loom" for ``weaving" the Feynman graphs of these FCFTs, with certain types of propagators, at any $d$. The Baxter lattice with $M$ different slopes and any number of lines parallel to those, generates an FCFT consisting of $M(M-1)$ fields and a certain number of chiral vertices of different valences with distinguished couplings. These non-unitary, logarithmic CFTs enjoy certain reality properties for their spectrum due to a symmetry similar to the PT-invariance of non-hermitian hamiltonians proposed by C. Bender. We discuss in more detail the theories generated by a loom with $M=2,3,4$, and the generalisation of the loom FCFTs for spinning fields in 4$d$.


title: Prospects for constraining twin stars with next-generation gravitational-wave detectors

abstract: Neutron star equations of state with strong phase transitions may support twin stars, hybrid and hadronic stars with the same mass but different tidal deformabilities. The presence of twin stars in the population of merging neutron stars produces distinctive gaps in the joint distribution of binary tidal deformabilities and chirp masses. We analyze a simulated population of binary neutron star mergers recovered with a network of next-generation (XG) ground-based gravitational-wave detectors to determine how many observations are needed to infer, or rule out, the existence of twin stars. Using a hierarchical inference framework based on a simple parametric twin-star model, we find that a single week of XG observations may suffice to detect a tidal deformability difference of several hundred between twins and measure the mass scale at which twins occur to within a few percent. For less pronounced twins, XG observations will place a stringent upper bound on the tidal deformability difference.


title: Characterization of norm forms via their values at integer points

abstract: Using homogeneous dynamical approach, we obtain a complete description of the forms with discrete set of values at the integer points and not representing zero non-trivially over the rational numbers. As a consequence, we obtain a general class of non-purely real forms for which the natural generalization of Cassels and Swinnerton-Dyer conjecture fails.


title: Correspondence Distillation from NeRF-based GAN

abstract: The neural radiance field (NeRF) has shown promising results in preserving the fine details of objects and scenes. However, unlike mesh-based representations, it remains an open problem to build dense correspondences across different NeRFs of the same category, which is essential in many downstream tasks. The main difficulties of this problem lie in the implicit nature of NeRF and the lack of ground-truth correspondence annotations. In this paper, we show it is possible to bypass these challenges by leveraging the rich semantics and structural priors encapsulated in a pre-trained NeRF-based GAN. Specifically, we exploit such priors from three aspects, namely 1) a dual deformation field that takes latent codes as global structural indicators, 2) a learning objective that regards generator features as geometric-aware local descriptors, and 3) a source of infinite object-specific NeRF samples. Our experiments demonstrate that such priors lead to 3D dense correspondence that is accurate, smooth, and robust. We also show that established dense correspondence across NeRFs can effectively enable many NeRF-based downstream applications such as texture transfer.


title: Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments

abstract: A key missing capacity of current language models (LMs) is grounding to real-world environments. Most existing work for grounded language understanding uses LMs to directly generate plans that can be executed in the environment to achieve the desired effects. It thereby casts the burden of ensuring grammaticality, faithfulness, and controllability all on the LMs. We propose Pangu, a generic framework for grounded language understanding that capitalizes on the discriminative ability of LMs instead of their generative ability. Pangu consists of a symbolic agent and a neural LM working in a concerted fashion: The agent explores the environment to incrementally construct valid plans, and the LM evaluates the plausibility of the candidate plans to guide the search process. A case study on the challenging problem of knowledge base question answering (KBQA), which features a massive environment, demonstrates the remarkable effectiveness and flexibility of Pangu: A BERT-base LM is sufficient for setting a new record on standard KBQA datasets, and larger LMs further bring substantial gains. Pangu also enables, for the first time, effective few-shot in-context learning for KBQA with large LMs such as Codex.


title: Position-guided Text Prompt for Vision-Language Pre-training

abstract: Vision-Language Pre-Training (VLP) has shown promising capabilities to align image and text pairs, facilitating a broad variety of cross-modal learning tasks. However, we observe that VLP models often lack the visual grounding/localization capability which is critical for many downstream tasks such as visual reasoning. In this work, we propose a novel Position-guided Text Prompt (PTP) paradigm to enhance the visual grounding ability of cross-modal models trained with VLP. Specifically, in the VLP phase, PTP divides the image into $N\times N$ blocks, and identifies the objects in each block through the widely used object detector in VLP. It then reformulates the visual grounding task into a fill-in-the-blank problem given a PTP by encouraging the model to predict the objects in the given blocks or regress the blocks of a given object, e.g. filling `P" or ``O" in aPTP ``The block P has a O". This mechanism improves the visual grounding capability of VLP models and thus helps them better handle various downstream tasks. By introducing PTP into several state-of-the-art VLP frameworks, we observe consistently significant improvements across representative cross-modal learning model architectures and several benchmarks, e.g. zero-shot Flickr30K Retrieval (+4.8 in average recall@1) for ViLT \cite{vilt} baseline, and COCO Captioning (+5.3 in CIDEr) for SOTA BLIP \cite{blip} baseline. Moreover, PTP achieves comparable results with object-detector based methods, and much faster inference speed since PTP discards its object detector for inference while the later cannot. Our code and pre-trained weight will be released at \url{https://github.com/sail-sg/ptp}.


title: Anisotropic resistance with a 90-degree twist in a ferromagnetic Weyl semimetal, Co2MnGa

abstract: Co$_2$MnGa is a ferromagnetic semimetal with Weyl nodal lines identified by ARPES. We studied electrical transport in thin Co$_2$MnGa lamellae (10 $\times$ 10 $\times$ 0.4-5 microns) cut from single-crystals using a focused ion beam. These crystals exhibit an unexpected and highly unusual planar resistance anisotropy ($\sim$10 times) with principal axes that rotate by 90 degrees between the upper and lower faces. Using symmetry arguments and simulations, we find that the observed resistance anisotropy resembles that of an isotropic conductor with anisotropic surface states that are impeded from hybridization with bulk states. The origin of these states awaits further experiments that can correlate the surface bands with the observed 90$^\circ$-twist geometry.