title: Localized Zeroth-Order Prompt Optimization

abstract: The efficacy of large language models (LLMs) in understanding and generating natural language has aroused a wide interest in developing prompt-based methods to harness the power of black-box LLMs. Existing methodologies usually prioritize a global optimization for finding the global optimum, which however will perform poorly in certain tasks. This thus motivates us to re-think the necessity of finding a global optimum in prompt optimization. To answer this, we conduct a thorough empirical study on prompt optimization and draw two major insights. Contrasting with the rarity of global optimum, local optima are usually prevalent and well-performed, which can be more worthwhile for efficient prompt optimization (Insight I). The choice of the input domain, covering both the generation and the representation of prompts, affects the identification of well-performing local optima (Insight II). Inspired by these insights, we propose a novel algorithm, namely localized zeroth-order prompt optimization (ZOPO), which incorporates a Neural Tangent Kernel-based derived Gaussian process into standard zeroth-order optimization for an efficient search of well-performing local optima in prompt optimization. Remarkably, ZOPO outperforms existing baselines in terms of both the optimization performance and the query efficiency, which we demonstrate through extensive experiments.


title: SLICK: Strong Lensing Identification of Candidates Kindred in gravitational wave data

abstract: By the end of the next decade, we hope to have detected strongly lensed gravitational waves by galaxies or clusters. Although there exist optimal methods for identifying lensed signal, it is shown that machine learning (ML) algorithms can give comparable performance but are orders of magnitude faster than non-ML methods. We present the SLICK pipeline which comprises a parallel network based on deep learning. We analyse the Q-transform maps (QT maps) and the Sine-Gaussian maps (SGP-maps) generated for the binary black hole signals injected in Gaussian as well as real noise. We compare our network performance with the previous work and find that the efficiency of our model is higher by a factor of 5 at a false positive rate of 0.001. Further, we show that including SGP maps with QT maps data results in a better performance than analysing QT maps alone. When combined with sky localisation constraints, we hope to get unprecedented accuracy in the predictions than previously possible. We also evaluate our model on the real events detected by the LIGO--Virgo collaboration and find that our network correctly classifies all of them, consistent with non-detection of lensing.


title: Mitigating Label Flipping Attacks in Malicious URL Detectors Using Ensemble Trees

abstract: Malicious URLs provide adversarial opportunities across various industries, including transportation, healthcare, energy, and banking which could be detrimental to business operations. Consequently, the detection of these URLs is of crucial importance; however, current Machine Learning (ML) models are susceptible to backdoor attacks. These attacks involve manipulating a small percentage of training data labels, such as Label Flipping (LF), which changes benign labels to malicious ones and vice versa. This manipulation results in misclassification and leads to incorrect model behavior. Therefore, integrating defense mechanisms into the architecture of ML models becomes an imperative consideration to fortify against potential attacks. The focus of this study is on backdoor attacks in the context of URL detection using ensemble trees. By illuminating the motivations behind such attacks, highlighting the roles of attackers, and emphasizing the critical importance of effective defense strategies, this paper contributes to the ongoing efforts to fortify ML models against adversarial threats within the ML domain in network security. We propose an innovative alarm system that detects the presence of poisoned labels and a defense mechanism designed to uncover the original class labels with the aim of mitigating backdoor attacks on ensemble tree classifiers. We conducted a case study using the Alexa and Phishing Site URL datasets and showed that LF attacks can be addressed using our proposed defense mechanism. Our experimental results prove that the LF attack achieved an Attack Success Rate (ASR) between 50-65% within 2-5%, and the innovative defense method successfully detected poisoned labels with an accuracy of up to 100%.


title: A Convex Optimization Framework for Computing Robustness Margins of Kalman Filters

abstract: This paper proposes a novel convex optimization framework for designing robust Kalman filters that guarantee a user-specified steady-state error while maximizing process and sensor noise. The proposed framework simultaneously determines the Kalman gain and the robustness margin in terms of the process and sensor noise. This is the first paper to present such a joint formulation for Kalman filtering. The proposed methodology is validated through two distinct examples: the Clohessy-Wiltshire-Hill equations for a chaser spacecraft in an elliptical orbit and the longitudinal motion model of an F-16 aircraft.


title: Cover Edge-Based Novel Triangle Counting

abstract: Listing and counting triangles in graphs is a key algorithmic kernel for network analyses, including community detection, clustering coefficients, k-trusses, and triangle centrality. In this paper, we propose the novel concept of a cover-edge set that can be used to find triangles more efficiently. Leveraging the breadth-first search (BFS) method, we can quickly generate a compact cover-edge set. Novel sequential and parallel triangle counting algorithms that employ cover-edge sets are presented. The novel sequential algorithm performs competitively with the fastest previous approaches on both real and synthetic graphs, such as those from the Graph500 Benchmark and the MIT/Amazon/IEEE Graph Challenge. We implement 22 sequential algorithms for performance evaluation and comparison. At the same time, we employ OpenMP to parallelize 11 sequential algorithms, presenting an in-depth analysis of their parallel performance. Furthermore, we develop a distributed parallel algorithm that can asymptotically reduce communication on massive graphs. In our estimate from massive-scale Graph500 graphs, our distributed parallel algorithm can reduce the communication on a scale~36 graph by 1156x and on a scale~42 graph by 2368x. Comprehensive experiments are conducted on the recently launched Intel Xeon 8480+ processor and shed light on how graph attributes, such as topology, diameter, and degree distribution, can affect the performance of these algorithms.


title: Towards Calibrated Deep Clustering Network

abstract: Deep clustering has exhibited remarkable performance; however, the over-confidence problem, i.e., the estimated confidence for a sample belonging to a particular cluster greatly exceeds its actual prediction accuracy, has been overlooked in prior research. To tackle this critical issue, we pioneer the development of a calibrated deep clustering framework. Specifically, we propose a novel dual-head (calibration head and clustering head) deep clustering model that can effectively calibrate the estimated confidence and the actual accuracy. The calibration head adjusts the overconfident predictions of the clustering head, generating prediction confidence that match the model learning status. Then, the clustering head dynamically select reliable high-confidence samples estimated by the calibration head for pseudo-label self-training. Additionally, we introduce an effective network initialization strategy that enhances both training speed and network robustness. The effectiveness of the proposed calibration approach and initialization strategy are both endorsed with solid theoretical guarantees. Extensive experiments demonstrate the proposed calibrated deep clustering model not only surpasses state-of-the-art deep clustering methods by 10 times in terms of expected calibration error but also significantly outperforms them in terms of clustering accuracy.


title: Radio outburst from a massive (proto)star. III. Unveiling the bipolarity of the radio jet from S255IR NIRS3

abstract: We report new Very Large Array high-resolution observations of the radio jet from the outbursting high-mass star S255IR~NIRS3. The images at 6, 10, and 22.2 GHz confirm the existence of a new lobe emerging to the SW and expanding at a mean speed of ~285 km/s, about half as fast as the NE lobe. The new data allow us to reproduce both the morphology and the continuum spectrum of the two lobes with the model already adopted in our previous studies. We conclude that in all likelihood both lobes are powered by the same accretion outburst. We also find that the jet is currently fading down, recollimating, and recombining.


title: Possible and Impossible Inferences From Reconstructed Evolutionary Processes using Phylogenies as an Example

abstract: Our understanding of past evolutionary change is often based on reconstructions based on incomplete data, raising fundamental questions about the degree to which we can make reliable inferences about past evolutionary processes. This was demonstrated by Louca and Pennell (2020), who showed that each pure-birth process can be generated by an infinite number of birth-death processes. Here, I explore what it means to reconstruct past evolutionary change with three approaches from measure theory, group theory, and homotopy theory to better understand structural constraint and origins of (non)identifiability. As an example, the developed framework is applied to the case of birth-death processes.


title: Higgs couplings in SMEFT via Zh production at the HL-LHC

abstract: We study the Higgs couplings present in the $Zh$ associated production mode at the Large Hadron Collider (LHC) in presence of both CP even and CP odd dimension 6 Standard Model Effective Theory (SMEFT) operators. The analysis is performed mainly in context of the HL-LHC (with $\sqrt{s}=$14 TeV and luminosity 3000 $fb^{-1}$) setup using cut based as well as machine learning techniques. The analysis shows significant betterment in the signal significance by using the machine learning technique. We also do a $\chi^2$ analysis, which reveals a significant change in the sensitivity of the coupling modifiers due to the presence of effective operators, in particular due to the four point $qqZh$ interaction. The presence of dimension six CP odd four point operators, which contributes at $\mathcal{O} (\Lambda^{-4})$ order due to lack of interference with the SM contributions, can only have sensitivity with smaller NP scale at the HL-LHC, after addressing the effective limit and constraints.


title: Mem-elements based Neuromorphic Hardware for Neural Network Application

abstract: The thesis investigates the utilization of memristive and memcapacitive crossbar arrays in low-power machine learning accelerators, offering a comprehensive co-design framework for deep neural networks (DNN). The model, implemented through a hybrid Python and PyTorch approach, accounts for various non-idealities, achieving exceptional training accuracies of 90.02% and 91.03% for the CIFAR-10 dataset with memristive and memcapacitive crossbar arrays on an 8-layer VGG network. Additionally, the thesis introduces a novel approach to emulate meminductor devices using Operational Transconductance Amplifiers (OTA) and capacitors, showcasing adjustable behavior. Transistor-level simulations in 180 nm CMOS technology, operating at 60 MHz, demonstrate the proposed meminductor emulator's viability with a power consumption of 0.337 mW. The design is further validated in neuromorphic circuits and CNN accelerators, achieving training and testing accuracies of 91.04% and 88.82%, respectively. Notably, the exclusive use of MOS transistors ensures the feasibility of monolithic IC fabrication. This research significantly contributes to the exploration of advanced hardware solutions for efficient and high-performance machine-learning applications.


title: Feast Your Eyes: Mixture-of-Resolution Adaptation for Multimodal Large Language Models

abstract: Despite remarkable progress, existing multimodal large language models (MLLMs) are still inferior in granular visual recognition. Contrary to previous works, we study this problem from the perspective of image resolution, and reveal that a combination of low- and high-resolution visual features can effectively mitigate this shortcoming. Based on this observation, we propose a novel and efficient method for MLLMs, termed Mixture-of-Resolution Adaptation (MRA). In particular, MRA adopts two visual pathways for images with different resolutions, where high-resolution visual information is embedded into the low-resolution pathway via the novel mixture-of-resolution adapters (MR-Adapters). This design also greatly reduces the input sequence length of MLLMs. To validate MRA, we apply it to a recent MLLM called LLaVA, and term the new model LLaVA-HR. We conduct extensive experiments on 11 vision-language (VL) tasks, which show that LLaVA-HR outperforms existing MLLMs on 8 VL tasks, e.g., +9.4% on TextVQA. More importantly, both training and inference of LLaVA-HR remain efficient with MRA, e.g., 20 training hours and 3$\times$ inference speed than LLaVA-1.5. Source codes are released at: https://github.com/luogen1996/LLaVA-HR.


title: Ultralight vector dark matter search using data from the KAGRA O3GK run

abstract: Among the various candidates for dark matter (DM), ultralight vector DM can be probed by laser interferometric gravitational wave detectors through the measurement of oscillating length changes in the arm cavities. In this context, KAGRA has a unique feature due to differing compositions of its mirrors, enhancing the signal of vector DM in the length change in the auxiliary channels. Here we present the result of a search for $U(1)_{B-L}$ gauge boson DM using the KAGRA data from auxiliary length channels during the first joint observation run together with GEO600. By applying our search pipeline, which takes into account the stochastic nature of ultralight DM, upper bounds on the coupling strength between the $U(1)_{B-L}$ gauge boson and ordinary matter are obtained for a range of DM masses. While our constraints are less stringent than those derived from previous experiments, this study demonstrates the applicability of our method to the lower-mass vector DM search, which is made difficult in this measurement by the short observation time compared to the auto-correlation time scale of DM.


title: Implicit-Explicit simulation of Mass-Spring-Charge Systems

abstract: Point masses connected by springs, or mass-spring systems, are widely used in computer animation to approximate the behavior of deformable objects. One of the restrictions imposed by these models is that points that are not topologically constrained (linked by a spring) are unable to interact with each other explicitly. Such interactions would introduce a new dimension for artistic control and animation within the computer graphics community. Beyond graphics, such a model could be an effective proxy to use for model-based learning of complex physical systems such as molecular biology. We propose to imbue masses in a mass-spring system with electrostatic charge leading a system with internal forces between all pairs of charged points -- regardless of whether they are linked by a spring. We provide a practical and stable algorithm to simulate charged mass-spring systems over long time horizons. We demonstrate how these systems may be controlled via parameters such as guidance electric fields or external charges, thus presenting fresh opportunities for artistic authoring. Our method is especially appropriate for computer graphics applications due to its robustness at larger simulation time steps.


title: Generation of gigahertz frequency surface acoustic waves in YIG/ZnO heterostructures

abstract: We study surface acoustic waves (SAWs) in yttrium iron garnet (YIG)/zinc oxide (ZnO) heterostructures, comparing the results of a computationally lightweight analytical model with time-resolved micro-focused Brillouin light scattering data. Interdigital transducers (IDTs), with operational frequencies in the gigahertz regime, were fabricated on 50 and 100nm thin films of YIG prior to sputter deposition of 830nm and 890nm films of piezoelectric ZnO. We find good agreement between our analytical model and micro-focused Brillouin light scattering data of the IDT frequency response and SAW group velocity, with clear differentiation between the Rayleigh and Sezawa-like modes. This work paves the way for the study of SAW-spin wave (SW) interactions in low SW damping YIG, with the possibility of a method for future energy-efficient SW excitation.


title: Scalable Bayesian inference for the generalized linear mixed model

abstract: The generalized linear mixed model (GLMM) is a popular statistical approach for handling correlated data, and is used extensively in applications areas where big data is common, including biomedical data settings. The focus of this paper is scalable statistical inference for the GLMM, where we define statistical inference as: (i) estimation of population parameters, and (ii) evaluation of scientific hypotheses in the presence of uncertainty. Artificial intelligence (AI) learning algorithms excel at scalable statistical estimation, but rarely include uncertainty quantification. In contrast, Bayesian inference provides full statistical inference, since uncertainty quantification results automatically from the posterior distribution. Unfortunately, Bayesian inference algorithms, including Markov Chain Monte Carlo (MCMC), become computationally intractable in big data settings. In this paper, we introduce a statistical inference algorithm at the intersection of AI and Bayesian inference, that leverages the scalability of modern AI algorithms with guaranteed uncertainty quantification that accompanies Bayesian inference. Our algorithm is an extension of stochastic gradient MCMC with novel contributions that address the treatment of correlated data (i.e., intractable marginal likelihood) and proper posterior variance estimation. Through theoretical and empirical results we establish our algorithm's statistical inference properties, and apply the method in a large electronic health records database.


title: Knowledge Graphs as Context Sources for LLM-Based Explanations of Learning Recommendations

abstract: In the era of personalized education, the provision of comprehensible explanations for learning recommendations is of a great value to enhance the learner's understanding and engagement with the recommended learning content. Large language models (LLMs) and generative AI in general have recently opened new doors for generating human-like explanations, for and along learning recommendations. However, their precision is still far away from acceptable in a sensitive field like education. To harness the abilities of LLMs, while still ensuring a high level of precision towards the intent of the learners, this paper proposes an approach to utilize knowledge graphs (KG) as a source of factual context, for LLM prompts, reducing the risk of model hallucinations, and safeguarding against wrong or imprecise information, while maintaining an application-intended learning context. We utilize the semantic relations in the knowledge graph to offer curated knowledge about learning recommendations. With domain-experts in the loop, we design the explanation as a textual template, which is filled and completed by the LLM. Domain experts were integrated in the prompt engineering phase as part of a study, to ensure that explanations include information that is relevant to the learner. We evaluate our approach quantitatively using Rouge-N and Rouge-L measures, as well as qualitatively with experts and learners. Our results show an enhanced recall and precision of the generated explanations compared to those generated solely by the GPT model, with a greatly reduced risk of generating imprecise information in the final learning explanation.


title: Mesoscale simulations of diffusion and sedimentation in shape-anisotropic nanoparticle suspensions

abstract: We determine the long-time self-diffusion coefficient and sedimentation coefficient for suspensions of nanoparticles with anisotropic shapes (octahedra, cubes, tetrahedra, and spherocylinders) as a function of nanoparticle concentration using mesoscale simulations. We use a discrete particle model for the nanoparticles, and we account for solvent-mediated hydrodynamic interactions between nanoparticles using the multiparticle collision dynamics method. Our simulations are compared to theoretical predictions and experimental data from existing literature, demonstrating good agreement in the majority of cases. Further, we find that the self-diffusion coefficient of the regular polyhedral shapes can be estimated from that of a sphere whose diameter is average of their inscribed and circumscribed sphere diameters.


title: Deterministic preparation of a dual-species two-ion crystal

abstract: The demand for efficient preparation methods for dual-species ion crystals is rapidly expanding across quantum technology and fundamental physics applications with trapped ions. We present a deterministic and efficient technique to produce such crystals, utilizing the segmented structure of a linear Paul trap. By precisely tailoring the trapping potentials, we can split, move, and discard parts of an ion chain. This process is automated in a sequence that converts a larger ion sample into the desired configuration. A critical component of our approach is the accurate identification of crystal constituents. This is achieved by matching the measured positions of fluorescing ions against theoretical expectations for larger crystals, thus facilitating the detection of non-fluorescing ions and enabling accurate ion counting. We demonstrate that our method reliably produces two-ion crystals within minutes. These results represent a significant advance in the production of two-species ion crystals with applications ranging from quantum logic spectroscopy and optical clocks to quantum computing and simulation with trapped ions.


title: Interannual Magneto-Coriolis modes and their sensitivity on the magnetic field within the Earth's core

abstract: Linear modes for which the Coriolis acceleration is almost entirely in balance with the Lorentz force are called Magneto-Coriolis (MC) modes. These MC modes are thought to exist in Earth's liquid outer core and could therefore contribute to the variations observed in Earth's magnetic field. The background state on which these waves ride is assumed here to be static and defined by a prescribed magnetic field and zero flow. We introduce a new computational tool to efficiently compute solutions to the related eigenvalue problem, and study the effect of a range of both axisymmetric and non-axisymmetric background magnetic fields on the MC modes. We focus on a hierarchy of conditions that sequentially partition the numerous computed modes into those which are (i) in principle observable, (ii) those which match a proxy for interannual geomagnetic signal over 1999-2023, and (iii) those which align with core-flows based on recent geomagnetic data. We found that the background field plays a crucial role in determining the structure of the modes. In particular, we found no examples of axisymmetric background fields that support modes consistent with recent geomagnetic changes, but that some non-axisymmetric background fields do support geomagnetically consistent modes.


title: Global N-body Simulation of Gap Edge Structures Created by Perturbations from a Small Satellite Embedded in Saturn's Rings

abstract: Observations by the Voyager and Cassini spacecrafts have revealed various striking features of the gap structure in Saturn's ring, such as the density waves, sharp edge, and vertical wall structure. In order to explain these features in a single simulation, we perform a high-resolution (N~10^6-10^7) global full N-body simulation of gap formation by an embedded satellite considering gravitational interactions and inelastic collisions among all ring particles and the satellite, while these features have been mostly investigated separately with different theoretical approaches: the streamline models, 1D diffusion models, and local N-body simulation. As a first attempt of a series of papers, we here focus on the gap formation by separating satellite migration with fixing the satellite orbit in a Keplerian circular orbit. We reveal how the striking gap features - the density waves, sharp edge, and vertical wall structure - are simultaneously formed by an interplay of the satellite-ring and ring particle-particle interactions. In particular, we propose a new mechanism to quantitatively explain the creation of the vertical wall structure at the gap edge. Inelastic collisions between ring particles damp their eccentricity excited by the satellite's perturbations to enhance the surface density at the gap edge, making its sharp edges more pronounced. We find the eccentricity damping process inevitably raises the vertical wall structures the most effectively in the second epicycle waves. Particle-particle collisions generally convert their lateral epicyclic motion into vertical motion. Because the excited epicyclic motion is the greatest near the ring edge and the epicycle motions are aligned in the first waves, the conversion is the most efficient in the gap edge of the second waves and the wall height is scaled by the satellite Hill radius, which are consistent with the observations.


title: The clique chromatic number of sparse random graphs

abstract: The clique chromatic number of a graph is the smallest number of colors in a vertex coloring so that no maximal clique is monochromatic. In this paper, we determine the order of magnitude of the clique chromatic number of the random graph G_{n,p} for most edge-probabilities p in the range n^{-2/5} \ll p \ll 1. This resolves open problems and questions of Lichev, Mitsche and Warnke as well as Alon and Krievelevich. One major proof difficulty stems from high-degree vertices, which prevent maximal cliques in their neighborhoods: we deal with these vertices by an intricate union bound argument, that combines the probabilistic method with new degree counting arguments in order to enable Janson's inequality. This way we determine the asymptotics of the clique chromatic number of G_{n,p} in some ranges, and discover a surprising new phenomenon that contradicts earlier predictions for edge-probabilities p close to n^{-2/5}.


title: The Case for Evaluating Multimodal Translation Models on Text Datasets

abstract: A good evaluation framework should evaluate multimodal machine translation (MMT) models by measuring 1) their use of visual information to aid in the translation task and 2) their ability to translate complex sentences such as done for text-only machine translation. However, most current work in MMT is evaluated against the Multi30k testing sets, which do not measure these properties. Namely, the use of visual information by the MMT model cannot be shown directly from the Multi30k test set results and the sentences in Multi30k are are image captions, i.e., short, descriptive sentences, as opposed to complex sentences that typical text-only machine translation models are evaluated against. Therefore, we propose that MMT models be evaluated using 1) the CoMMuTE evaluation framework, which measures the use of visual information by MMT models, 2) the text-only WMT news translation task test sets, which evaluates translation performance against complex sentences, and 3) the Multi30k test sets, for measuring MMT model performance against a real MMT dataset. Finally, we evaluate recent MMT models trained solely against the Multi30k dataset against our proposed evaluation framework and demonstrate the dramatic drop performance against text-only testing sets compared to recent text-only MT models.


title: Low Complexity Channel Estimation for RIS-Assisted THz Systems with Beam Split

abstract: To support extremely high data rates, reconfigurable intelligent surface (RIS)-assisted terahertz (THz) communication is considered to be a promising technology for future sixth-generation networks. However, due to the typical employment of hybrid beamforming architecture in THz systems, as well as the passive nature of RIS which lacks the capability to process pilot signals, obtaining channel state information (CSI) is facing significant challenges. To accurately estimate the cascaded channel, we propose a novel low-complexity channel estimation scheme, which includes three steps. Specifically, we first estimate full CSI within a small subset of subcarriers (SCs). Then, we acquire angular information at base station and RIS based on the full CSI. Finally, we derive spatial directions and recover full-CSI for the remaining SCs. Theoretical analysis and simulation results demonstrate that the proposed scheme can achieve superior performance in terms of normalized mean-square-error and exhibit a lower computational complexity compared with the existing algorithms.


title: Wavelet Scattering Networks for Identifying Radio Galaxy Morphologies

abstract: Classifying the morphologies of radio galaxies is important to understand their physical properties and evolutionary histories. A galaxy's morphology is often determined by visual inspection, but as survey size increases robust automated techniques will be needed. Deep neural networks are an attractive method for automated classification, but have many free parameters and therefore require extensive training data and are subject to overfitting and generalization issues. We explore hybrid classification methods using the scattering transform, the recursive wavelet decomposition of an input image. We analyse the performance of the scattering transform for the Fanaroff-Riley classification of radio galaxies with respect to CNNs and other machine learning algorithms. We test the robustness of the different classification methods with training data truncation and noise injection, and find that the scattering transform can offer competitive performance with the most accurate CNNs.


title: OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following

abstract: Embodied Instruction Following (EIF) is a crucial task in embodied learning, requiring agents to interact with their environment through egocentric observations to fulfill natural language instructions. Recent advancements have seen a surge in employing large language models (LLMs) within a framework-centric approach to enhance performance in embodied learning tasks, including EIF. Despite these efforts, there exists a lack of a unified understanding regarding the impact of various components-ranging from visual perception to action execution-on task performance. To address this gap, we introduce OPEx, a comprehensive framework that delineates the core components essential for solving embodied learning tasks: Observer, Planner, and Executor. Through extensive evaluations, we provide a deep analysis of how each component influences EIF task performance. Furthermore, we innovate within this space by deploying a multi-agent dialogue strategy on a TextWorld counterpart, further enhancing task performance. Our findings reveal that LLM-centric design markedly improves EIF outcomes, identify visual perception and low-level action execution as critical bottlenecks, and demonstrate that augmenting LLMs with a multi-agent framework further elevates performance.


title: CRISPR: Ensemble Model

abstract: Clustered Regularly Interspaced Short Palindromic Repeats (CRISPR) is a gene editing technology that has revolutionized the fields of biology and medicine. However, one of the challenges of using CRISPR is predicting the on-target efficacy and off-target sensitivity of single-guide RNAs (sgRNAs). This is because most existing methods are trained on separate datasets with different genes and cells, which limits their generalizability. In this paper, we propose a novel ensemble learning method for sgRNA design that is accurate and generalizable. Our method combines the predictions of multiple machine learning models to produce a single, more robust prediction. This approach allows us to learn from a wider range of data, which improves the generalizability of our model. We evaluated our method on a benchmark dataset of sgRNA designs and found that it outperformed existing methods in terms of both accuracy and generalizability. Our results suggest that our method can be used to design sgRNAs with high sensitivity and specificity, even for new genes or cells. This could have important implications for the clinical use of CRISPR, as it would allow researchers to design more effective and safer treatments for a variety of diseases.


title: Pushing single atoms near an optical cavity

abstract: Optical scattering force is used to reduce the loading time of single atoms to a cavity mode. Releasing a cold atomic ensemble above the resonator, we apply a push beam along the direction of gravity, offering fast atomic transport with narrow velocity distribution. We also observe in real time that, when the push beam is illuminated against gravity, single atoms slow down and even turn around in the mode, through the cavity-transmission measurement. Our method can be employed to make atom-cavity experiments more efficient.


title: SplAgger: Split Aggregation for Meta-Reinforcement Learning

abstract: A core ambition of reinforcement learning (RL) is the creation of agents capable of rapid learning in novel tasks. Meta-RL aims to achieve this by directly learning such agents. Black box methods do so by training off-the-shelf sequence models end-to-end. By contrast, task inference methods explicitly infer a posterior distribution over the unknown task, typically using distinct objectives and sequence models designed to enable task inference. Recent work has shown that task inference methods are not necessary for strong performance. However, it remains unclear whether task inference sequence models are beneficial even when task inference objectives are not. In this paper, we present evidence that task inference sequence models are indeed still beneficial. In particular, we investigate sequence models with permutation invariant aggregation, which exploit the fact that, due to the Markov property, the task posterior does not depend on the order of data. We empirically confirm the advantage of permutation invariant sequence models without the use of task inference objectives. However, we also find, surprisingly, that there are multiple conditions under which permutation variance remains useful. Therefore, we propose SplAgger, which uses both permutation variant and invariant components to achieve the best of both worlds, outperforming all baselines evaluated on continuous control and memory environments. Code is provided at https://github.com/jacooba/hyper.


title: Accelerating the convergence of Newton's method for nonlinear elliptic PDEs using Fourier neural operators

abstract: It is well known that Newton's method, especially when applied to large problems such as the discretization of nonlinear partial differential equations (PDEs), can have trouble converging if the initial guess is too far from the solution. This work focuses on accelerating this convergence, in the context of the discretization of nonlinear elliptic PDEs. We first provide a quick review of existing methods, and justify our choice of learning an initial guess with a Fourier neural operator (FNO). This choice was motivated by the mesh-independence of such operators, whose training and evaluation can be performed on grids with different resolutions. The FNO is trained using a loss minimization over generated data, loss functions based on the PDE discretization. Numerical results, in one and two dimensions, show that the proposed initial guess accelerates the convergence of Newton's method by a large margin compared to a naive initial guess, especially for highly nonlinear or anisotropic problems.


title: Incommensurate broken-helix and broken-fanlike states in axion insulator candidate EuIn$_{2}$As$_{2}$

abstract: Zintl phase EuIn$_{2}$As$_{2}$ has garnered growing attention as an axion insulator candidate, triggered by the identification of a commensurate double-${\mathbf Q}$ broken-helix state in previous studies, however, its periodicity and symmetry remain subjects of debate. Here, we perform resonant x-ray scattering experiments on EuIn$_{2}$As$_{2}$, revealing an incommensurate nature of the broken-helix state, where both the wave number and the amplitude of the helical modulation exhibit systematic sample dependence. Furthermore, the application of an in-plane magnetic field brings about a broken-fanlike state preserving the double-${\mathbf Q}$ nature, which could be attributed to multiple-spin interactions in momentum space. We propose that the itinerant character of EuIn$_{2}$As$_{2}$, possibly induced by Eu deficiency, gives rise to the helical modulation and impedes the realization of a theoretically-predicted axion state with the collinear antiferromagnetic order.


title: On Airy solutions of P$_\mathrm{II}$ and the complex cubic ensemble of random matrices, II

abstract: We describe the pole-free regions of the one-parameter family of special solutions of P$_\mathrm{II}$, the second Painlev\'e equation, constructed from the Airy functions. This is achieved by exploiting the connection between these solutions and the recurrence coefficients of orthogonal polynomials that appear in the analysis of the ensemble of random matrices corresponding to the cubic potential.


title: Toward Improved Deep Learning-based Vulnerability Detection

abstract: Deep learning (DL) has been a common thread across several recent techniques for vulnerability detection. The rise of large, publicly available datasets of vulnerabilities has fueled the learning process underpinning these techniques. While these datasets help the DL-based vulnerability detectors, they also constrain these detectors' predictive abilities. Vulnerabilities in these datasets have to be represented in a certain way, e.g., code lines, functions, or program slices within which the vulnerabilities exist. We refer to this representation as a base unit. The detectors learn how base units can be vulnerable and then predict whether other base units are vulnerable. We have hypothesized that this focus on individual base units harms the ability of the detectors to properly detect those vulnerabilities that span multiple base units (or MBU vulnerabilities). For vulnerabilities such as these, a correct detection occurs when all comprising base units are detected as vulnerable. Verifying how existing techniques perform in detecting all parts of a vulnerability is important to establish their effectiveness for other downstream tasks. To evaluate our hypothesis, we conducted a study focusing on three prominent DL-based detectors: ReVeal, DeepWukong, and LineVul. Our study shows that all three detectors contain MBU vulnerabilities in their respective datasets. Further, we observed significant accuracy drops when detecting these types of vulnerabilities. We present our study and a framework that can be used to help DL-based detectors toward the proper inclusion of MBU vulnerabilities.


title: Predictive power of the Berezinskii-Kosterlitz-Thouless theory based on Renormalization Group throughout the BCS-BEC crossover in 2D superconductors

abstract: Recent experiments on 2D superconductors allow the characterization of the critical temperature and of the phase diagram across the BCS-BEC crossover as a function of density. We obtain from these experiments the microscopic parameters of the superconducting state at low temperatures by the BCS mean-field approach. For Li$_x$ZrNCl, the extracted parameters are used to evaluate the superconducting phase stiffness and the Berezinskii-Kosterlitz-Thouless (BKT) critical temperature throughout the BCS-BEC crossover, by implementing the corresponding Renormalization Group (RG) approach. In this way, we make a quantitative test of the predictive power of the BKT theory for evaluating the critical temperature. The RG flow equations turn out to give a sizable renormalization of the phase stiffness and of the critical temperature, which is crucial to obtain a satisfactory agreement between the BKT theory and the experiments, in particular in the BCS-BEC crossover regime. We predict the temperature range where phase stiffness renormalization can be measured in Li$_x$ZrNCl across the BCS-BEC crossover. Contrary to other microscopic theories of superconductivity, we find that the BKT theory can be exploited to evaluate quantitatively the critical temperature of 2D superconductors in different pairing regimes.


title: Polytropic stellar structure in 5$\mathcal{D}$ Einstein-Gauss-Bonnet gravity

abstract: Polytropic stars are useful tools to learn about stellar structure without the complexity of comprehensive stellar models. These models rely on a certain power-law correlation between the star's pressure and density. This paper proposes a polytropic star model to investigate some new features in the context of $5\mathcal{D}$ Einstein-Gauss-Bonnet (EGB) gravity using the Finch-Skea {\em ansatz} [{\em M. R. Finch and J. E. Skea, Classical and Quantum Gravity 6, 467 (1989)}]. Analytical results are better described by graphical representations of the physical parameters for various values of Gauss-Bonnet coupling constant $\alpha$. The solution for a specific compact object, EXO 1785 - 248, with radius $\mathfrak{R} = 8.849_{-0.04}^{+0.04}$ km and mass $\mathcal{M} = 1.3 \pm 0.02~\mathcal{M}_{\odot}$, is shown here. We analyze the essential physical attributes of the star, which reveal the influence of the coupling parameter $\alpha$ on the values of the parameters. Ultimately, we have concluded that our current model is realistic because it satisfies all the physical criteria for an acceptable model.


title: Assessing the similarity of continuous gravitational-wave signals to narrow instrumental artifacts

abstract: Continuous gravitational-wave signals (CWs) are long-lasting quasi-monochromatic gravitational-wave signals expected to be emitted by rapidly-rotating non-axisymmetric neutron stars. Depending on the rotational frequency and sky location of the source, certain CW signals may behave in a similar manner to narrow-band artifacts present in ground-based interferometric detectors. Part of the detector-characterisation tasks in the current generation of interferometric detectors (Advanced LIGO, Advanced Virgo, and KAGRA) aim at understanding the origin of these narrow artifacts, commonly known as ``spectral lines''. It is expected that similar tasks will continue after the arrival of next-generation detectors (e.g. Einstein Telescope and Cosmic Explorer). Typically, a fraction of the observed lines in a given detector can be associated to one or more instrumental causes; others, however, have an unknown origin. In this work, we assess the similarity of CW signals to spectral lines in order to understand whether a CW may be mistaken for a noise artifact. Albeit astrophysically unlikely, our results do not rule out the possibility of a CW signal being visible in the detector's power spectrum.


title: Word Importance Explains How Prompts Affect Language Model Outputs

abstract: The emergence of large language models (LLMs) has revolutionized numerous applications across industries. However, their "black box" nature often hinders the understanding of how they make specific decisions, raising concerns about their transparency, reliability, and ethical use. This study presents a method to improve the explainability of LLMs by varying individual words in prompts to uncover their statistical impact on the model outputs. This approach, inspired by permutation importance for tabular data, masks each word in the system prompt and evaluates its effect on the outputs based on the available text scores aggregated over multiple user inputs. Unlike classical attention, word importance measures the impact of prompt words on arbitrarily-defined text scores, which enables decomposing the importance of words into the specific measures of interest--including bias, reading level, verbosity, etc. This procedure also enables measuring impact when attention weights are not available. To test the fidelity of this approach, we explore the effect of adding different suffixes to multiple different system prompts and comparing subsequent generations with different large language models. Results show that word importance scores are closely related to the expected suffix importances for multiple scoring functions.


title: Socratic Reasoning Improves Positive Text Rewriting

abstract: Reframing a negative into a positive thought is at the crux of several cognitive approaches to mental health and psychotherapy that could be made more accessible by large language model-based solutions. Such reframing is typically non-trivial and requires multiple rationalization steps to uncover the underlying issue of a negative thought and transform it to be more positive. However, this rationalization process is currently neglected by both datasets and models which reframe thoughts in one step. In this work, we address this gap by augmenting open-source datasets for positive text rewriting with synthetically-generated Socratic rationales using a novel framework called \textsc{SocraticReframe}. \textsc{SocraticReframe} uses a sequence of question-answer pairs to rationalize the thought rewriting process. We show that such Socratic rationales significantly improve positive text rewriting for different open-source LLMs according to both automatic and human evaluations guided by criteria from psychotherapy research.


title: Unifying Controller Design for Stabilizing Nonlinear Systems with Norm-Bounded Control Inputs

abstract: This paper revisits a classical challenge in the design of stabilizing controllers for nonlinear systems with a norm-bounded input constraint. By extending Lin-Sontag's universal formula and introducing a generic (state-dependent) scaling term, a unifying controller design method is proposed. The incorporation of this generic scaling term gives a unified controller and enables the derivation of alternative universal formulas with various favorable properties, which makes it suitable for tailored control designs to meet specific requirements and provides versatility across different control scenarios. Additionally, we present a constructive approach to determine the optimal scaling term, leading to an explicit solution to an optimization problem, named optimization-based universal formula. The resulting controller ensures asymptotic stability, satisfies a norm-bounded input constraint, and optimizes a predefined cost function. Finally, the essential properties of the unified controllers are analyzed, including smoothness, continuity at the origin, stability margin, and inverse optimality. Simulations validate the approach, showcasing its effectiveness in addressing a challenging stabilizing control problem of a nonlinear system.


title: Learning to Use Tools via Cooperative and Interactive Agents

abstract: Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution results into the next action prediction. Despite their progress, these methods suffer from performance degradation when addressing practical tasks due to: (1) the pre-defined pipeline with restricted flexibility to calibrate incorrect actions, and (2) the struggle to adapt a general LLM-based agent to perform a variety of specialized actions. To mitigate these problems, we propose ConAgents, a Cooperative and interactive Agents framework, which coordinates three specialized agents for tool selection, tool execution, and action calibration separately. ConAgents introduces two communication protocols to enable the flexible cooperation of agents. To effectively generalize the ConAgents into open-source models, we also propose specialized action distillation, enhancing their ability to perform specialized actions in our framework. Our extensive experiments on three datasets show that the LLMs, when equipped with the ConAgents, outperform baselines with substantial improvement (i.e., up to 14% higher success rate).


title: Logic Programming with Multiplicative Structures

abstract: In the logic programming paradigm, a program is defined by a set of methods, each of which can be executed when specific conditions are met during the current state of an execution. The semantics of these programs can be elegantly represented using sequent calculi, in which each method is linked to an inference rule. In this context, proof search mirrors the program's execution. Previous works introduced a framework in which the process of constructing proof nets is employed to model executions, as opposed to the traditional approach of proof search in sequent calculus. This paper further extends this investigation by focussing on the pure multiplicative fragment of this framework. We demonstrate, providing practical examples, the capability to define logic programming methods with context-sensitive behaviors solely through specific resource-preserving and context-free operations, corresponding to certain generalized multiplicative connectives explored in existing literature. We show how some of these methods, although still multiplicative, escape the purely multiplicative fragment of Linear Logic (MLL).


title: Three central limit theorems for the unbounded excursion component of a Gaussian field

abstract: For a smooth, stationary Gaussian field $f$ on Euclidean space with fast correlation decay, there is a critical level $\ell_c$ such that the excursion set $\{f\geq\ell\}$ contains a (unique) unbounded component if and only if $\ell<\ell_c$. We prove central limit theorems for the volume, surface area and Euler characteristic of this unbounded component restricted to a growing box. For planar fields, the results hold at all supercritical levels (i.e. all $\ell<\ell_c$). In higher dimensions the results hold at all sufficiently low levels (all $\ell<-\ell_c<\ell_c$) but could be extended to all supercritical levels by proving the decay of truncated connection probabilities. Our proof is based on the martingale central limit theorem.


title: Global dissipative martingale solutions to the variational wave equation with stochastic forcing

abstract: We consider the variational wave equation in one-dimensional space with stochastic forcing by an additive noise. Blow-up of local smooth solutions is established, and global existence is proved in the class of weak martingale solutions.


title: Mars 2.0: A Toolchain for Modeling, Analysis, Verification and Code Generation of Cyber-Physical Systems

abstract: We introduce Mars 2.0 for modeling, analysis, verification and code generation of Cyber-Physical Systems. Mars 2.0 integrates Mars 1.0 with several important extensions and improvements, allowing the design of cyber-physical systems using the combination of AADL and Simulink/Stateflow, which provide a unified graphical framework for modeling the functionality, physicality and architecture of the system to be developed. For a safety-critical system, formal analysis and verification of its combined AADL and Simulink/Stateflow model can be conducted via the following steps. First, the toolchain automatically translates AADL and Simulink/Stateflow models into Hybrid CSP (HCSP), an extension of CSP for formally modeling hybrid systems. Second, the HCSP processes can be simulated using the HCSP simulator, and to complement incomplete simulation, they can be verified using the Hybrid Hoare Logic prover in Isabelle/HOL, as well as the more automated HHLPy prover. Finally, implementations in SystemC or C can be automatically generated from the verified HCSP processes. The transformation from AADL and Simulink/Stateflow to HCSP, and the one from HCSP to SystemC or C, are both guaranteed to be correct with formal proofs. This approach allows model-driven design of safety-critical cyber-physical systems based on graphical and formal models and proven-correct translation procedures. We demonstrate the use of the toolchain on several benchmarks of varying complexity, including several industrial-sized examples.


title: Superconductivity in Ca-intercalated bilayer silicene

abstract: Within first-principles calculations, we explore superconductivity in Ca-intercalated bilayer silicene compound, Si2CaSi2. This arises from the coupling of interlayer flower-like \Gamma-centered Fermi surface formed by the hybridization of Ca-3d and Si-3pz orbitals with low-energy out-of-plane vibrations enabled by silicene's buckling. The consequent large electron-phonon coupling, as evident from the Eliashberg spectral function leads to superconductivity below 5.4 K in this two-dimensional covalent system. Our results reveal the key control parameters to achieve superconductivity in experimentally synthesizable silicon-based thin materials that can find diverse applications.


title: A Backpack Full of Skills: Egocentric Video Understanding with Diverse Task Perspectives

abstract: Human comprehension of a video stream is naturally broad: in a few instants, we are able to understand what is happening, the relevance and relationship of objects, and forecast what will follow in the near future, everything all at once. We believe that - to effectively transfer such an holistic perception to intelligent machines - an important role is played by learning to correlate concepts and to abstract knowledge coming from different tasks, to synergistically exploit them when learning novel skills. To accomplish this, we seek for a unified approach to video understanding which combines shared temporal modelling of human actions with minimal overhead, to support multiple downstream tasks and enable cooperation when learning novel skills. We then propose EgoPack, a solution that creates a collection of task perspectives that can be carried across downstream tasks and used as a potential source of additional insights, as a backpack of skills that a robot can carry around and use when needed. We demonstrate the effectiveness and efficiency of our approach on four Ego4D benchmarks, outperforming current state-of-the-art methods.


title: Transition from topological to chaos in the nonlinear Su-Schrieffer-Heeger model

abstract: Recent studies on topological materials are expanding into the nonlinear regime, while the central principle, namely the bulk-edge correspondence, is yet to be elucidated in the strongly nonlinear regime. Here, we reveal that nonlinear topological edge modes can exhibit the transition to spatial chaos by increasing nonlinearity, which can be a universal mechanism of the breakdown of the bulk-edge correspondence. Specifically, we unveil the underlying dynamical system describing the spatial distribution of zero modes and show the emergence of chaos. We also propose the correspondence between the absolute value of the topological invariant and the dimension of the stable manifold under sufficiently weak nonlinearity. Our results provide a general guiding principle to investigate the nonlinear bulk-edge correspondence that can potentially be extended to arbitrary dimensions.


title: A hybrid optimization framework for the General Continuous Energy-Constrained Scheduling Problem

abstract: We present a hybrid optimization framework for a class of problems, formalized as a generalization of the Continuous Energy-Con\-strained Scheduling Problem (CECSP), introduced by Nattaf et al. (2014). This class is obtained from challenges concerning demand response in energy networks. Our framework extends a previously developed approach. A set of jobs has to be processed on a continuous, shared resource. Consequently, a schedule for a job does not only contain a start and completion time, but also a resource consumption profile, where we have to respect lower and upper bounds on resource consumption during processing. In this work, we develop a hybrid approach for the case where the objective is a step-wise increasing function of completion time, using local search, linear programming and O(n) lower bounds. We exploit that the costs are known in the local search and use bounds to assess feasibility more efficiently than by LP. We compare its performance to a mixed-integer linear program. After that, we extend this to a hybrid optimization framework for the General CECSP. This uses an event-based model, and applies a decomposition in two parts: 1) determining the order of events and 2) finding the event times, and hence the start and completion times of jobs, together with the resource consumption profiles. We argue the broad applicability of this framework.


title: The height gap of planar Brownian motion is $\frac{5}{\pi}$

abstract: We show that the occupation measure of planar Brownian motion exhibits a constant height gap of $5/\pi$ across its outer boundary. This property bears similarities with the celebrated results of Schramm--Sheffield [18] and Miller--Sheffield [12] concerning the height gap of the Gaussian free field across SLE$_4$/CLE$_4$ curves. Heuristically, our result can also be thought of as the $\theta \to 0^+$ limit of the height gap property of a field built out of a Brownian loop soup with subcritical intensity $\theta>0$, proved in our recent paper [3]. To obtain the explicit value of the height gap, we rely on the computation by Garban and Trujillo Ferreras [1] of the expected area of the domain delimited by the outer boundary of a Brownian bridge.


title: Proof-of-concept for a nonadditive stochastic model of supercooled liquids

abstract: The recently proposed non-additive stochastic model (NSM) offers a coherent physical interpretation for diffusive phenomena in glass-forming systems. This model presents non-exponential relationships between viscosity, activation energy, and temperature, characterizing the non-Arrhenius behavior observed in supercooled liquids. In this work, we fit the NSM viscosity equation to experimental temperature-dependent viscosity data corresponding to twenty-five glass-forming liquids and compare the fit parameters with those obtained using the Vogel-Fulcher-Tammann (VFT), Avramov-Milchev (AM), and Mauro-Yue-Ellison-Gupta-Allan (MYEGA) models. The results demonstrate that the NSM provides an effective fitting equation for modeling viscosity experimental data in comparison with other established models (VFT, AM and MYEGA), characterizing the activation energy in fragile liquids, presenting a reliable indicator of the degree of fragility of the glass-forming liquids.


title: Generalization of composite dynamics for the lattice Boltzmann method

abstract: A generalized composite dynamics (GCD) framework is presented for the lattice Boltzmann method (LBM). It leverages synergies of various simple collision operators to model complex physical processes. The framework is validated by recovering semi-permeable fluid flow methods. It provides mathematical justification for the incorporation of forces, addressing a gap in the literature. The versatility of this framework is demonstrated by analyzing a flux boundary condition. The GCD framework opens innovative possibilities for simulating complex physical processes using LBM.


title: Orbital torque switching in perpendicularly magnetized materials

abstract: The orbital Hall effect in light materials has attracted considerable attention for developing novel orbitronic devices. Here we investigate the orbital torque efficiency and demonstrate the switching of the perpendicularly magnetized materials through the orbital Hall material (OHM), i.e., Zirconium (Zr). The orbital torque efficiency of approximately 0.78 is achieved in the Zr OHM with the perpendicularly magnetized [Co/Pt]3 sample, which significantly surpasses that of the perpendicularly magnetized CoFeB/Gd/CoFeB sample (approximately 0.04). Such notable difference is attributed to the different spin-orbit correlation strength between the [Co/Pt]3 sample and the CoFeB/Gd/CoFeB sample, which has been confirmed through the theoretical calculations. Furthermore, the full magnetization switching of the [Co/Pt]3 sample with a switching current density of approximately 2.6x106 A/cm2 has been realized through Zr, which even outperforms that of the W spin Hall material. Our finding provides a guideline to understand orbital torque efficiency and paves the way to develop energy-efficient orbitronic devices.


title: Internal consistency of multi-tier $GW$+EDMFT

abstract: The multi-tier $GW$+EDMFT scheme is an ab-initio method for calculating the electronic structure of correlated materials. While the approach is free from ad-hoc parameters, it requires a selection of appropriate energy windows for describing low-energy and strongly correlated physics. In this study, we test the consistency of the multi-tier description by considering different low-energy windows for a series of cubic SrXO$_3$ (X=V,Cr,Mn) perovskites. Specifically, we compare the 3-orbital $t_{2g}$ model, the 5-orbital $t_{2g}+e_g$ model, the 12-orbital $t_{2g}+O_p$ model, and (in the case of SrVO$_3$) the 14-orbital $t_{2g}+e_g+O_p$ model and compare the results to available photoemission and X-ray absorption measurements. The multi-tier method yields consistent results for the $t_{2g}$ and $t_{2g}+e_g$ low-energy windows, while the models with $O_p$ states produce stronger correlation effects and mostly agree well with experiment, especially in the unoccupied part of the spectrum. We also discuss the consistency between the fermionic and bosonic spectral functions and the physical origin of satellite features, and present momentum-resolved charge susceptibilities.


title: Adding Multimodal Capabilities to a Text-only Translation Model

abstract: While most current work in multimodal machine translation (MMT) uses the Multi30k dataset for training and evaluation, we find that the resulting models overfit to the Multi30k dataset to an extreme degree. Consequently, these models perform very badly when evaluated against typical text-only testing sets such as the WMT newstest datasets. In order to perform well on both Multi30k and typical text-only datasets, we use a performant text-only machine translation (MT) model as the starting point of our MMT model. We add vision-text adapter layers connected via gating mechanisms to the MT model, and incrementally transform the MT model into an MMT model by 1) pre-training using vision-based masking of the source text and 2) fine-tuning on Multi30k.


title: The Exchange Problem

abstract: Auctions are widely used in exchanges to match buy and sell requests. Once the buyers and sellers place their requests, the exchange determines how these requests are to be matched. The two most popular objectives used while determining the matching are maximizing volume at a uniform price and maximizing volume with dynamic pricing. In this work, we study the algorithmic complexity of the problems arising from these matching tasks. We present a linear time algorithm for uniform price matching which is an improvement over the previous algorithms that take $O(n\log n)$ time to match $n$ requests. For dynamic price matching, we establish a lower bound of $\Omega(n \log n)$ on the running time, thereby proving that the currently known best algorithm is time-optimal.


title: Critical magnetic flux for Weyl points in the three-dimensional Hofstadter model

abstract: We investigate the band structure of the three-dimensional Hofstadter model on cubic lattices, with an isotropic magnetic field oriented along the diagonal of the cube with flux $\Phi=2 \pi \cdot m /n$, where $m,n$ are co-prime integers. Using reduced exact diagonalization in momentum space, we show that, at fixed $m$, there exists an integer $n(m)$ associated with a specific value of the magnetic flux, that we denote by $\Phi_c(m) \equiv 2 \pi \cdot m/n(m)$, separating two different regimes. The first one, for fluxes $\Phi<\Phi_c(m)$, is characterized by complete band overlaps, while the second one, for $\Phi>\Phi_c(m)$, features isolated band touching points in the density of states and Weyl points between the $m$- and the $(m+1)$-th bands. In the Hasegawa gauge, the minimum of the $(m+1)$-th band abruptly moves at the critical flux $\Phi_c(m)$ from $k_z=0$ to $k_z=\pi$. We then argue that the limit for large $m$ of $\Phi_c(m)$ exists and it is finite: $\lim_{m\to \infty} \Phi_c(m) \equiv \Phi_c$. Our estimate is $\Phi_c/2\pi=0.1296(1)$. Based on the values of $n(m)$ determined for integers $m\leq60$, we propose a mathematical conjecture for the form of $\Phi_c(m)$ to be used in the large-$m$ limit. The asymptotic critical flux obtained using this conjecture is $\Phi_c^{{\rm (conj)}}/2\pi=7/54$.

categories: cond-mat.mes-hall cond-mat.quant-gas math-ph math.MP


title: Design of Stochastic Quantizers for Privacy Preservation

abstract: In this paper, we examine the role of stochastic quantizers for privacy preservation. We first employ a static stochastic quantizer and investigate its corresponding privacy-preserving properties. Specifically, we demonstrate that a sufficiently large quantization step guarantees $(0, \delta)$ differential privacy. Additionally, the degradation of control performance caused by quantization is evaluated as the tracking error of output regulation. These two analyses characterize the trade-off between privacy and control performance, determined by the quantization step. This insight enables us to use quantization intentionally as a means to achieve the seemingly conflicting two goals of maintaining control performance and preserving privacy at the same time; towards this end, we further investigate a dynamic stochastic quantizer. Under a stability assumption, the dynamic stochastic quantizer can enhance privacy, more than the static one, while achieving the same control performance. We further handle the unstable case by additionally applying input Gaussian noise.


title: Some solutions to the eigenstate equation of the free scalar quantum field theory in the Schr\"odinger representation

abstract: We study the action of the free quantum Hamiltonian in the Schr\"odinger representation on functional spaces generated by Gaussian states with boundary conditions set by localized external sources. It turns out that inspite of very general initial assumptions the proposed scheme requires at least two sources at a distance limited by non-zero constant of the model. In this way we provide example of quntum field evolved by the action of the free Hamiltonian confining external sources which set boundary conditions.


title: Microscopic origin of abrupt transition in interdependent superconducting networks

abstract: The paradigm of interdependent networks has recently been manifested in experimentally testable lab setup of interdependent superconducting networks. This system experiences an abrupt transition due to the thermal dissipation between the networks but its underlying mechanism remains elusive. Here we study the critical behavior and the underlying mechanism of the transition, unveiling its unique microscopic nature. The microscopic characteristics of the transition result in a macroscopic long-living plateau that lasts for thousands of seconds and increases with the size of the system. We characterize the critical behavior of the transition and find that the critical exponents are consistent with those predicted theoretically for percolation of abstract interdependent networks and interdependent ferromagnetic networks, supporting a common universal origin of interdependent systems.


title: Prediction of turbulent channel flow using Fourier neural operator-based machine-learning strategy

abstract: Fast and accurate predictions of turbulent flows are of great importance in the science and engineering field. In this paper, we investigate the implicit U-Net enhanced Fourier neural operator (IUFNO) in the stable prediction of long-time dynamics of three-dimensional (3D) turbulent channel flows. The trained IUFNO models are tested in the large-eddy simulations (LES) at coarse grids for three friction Reynolds numbers: $Re_{\tau}\approx180$, $395$ and $590$. The adopted near-wall mesh grids are tangibly coarser than the general requirements for wall-resolved LES. The numerical experiments show that the IUFNO framework outperforms the traditional dynamic Smagorinsky model (DSM) and the wall-adapted local eddy-viscosity (WALE) model in the predictions of a variety of flow statistics and structures, including the mean and fluctuating velocities, the probability density functions (PDFs) and joint PDF of velocity fluctuations, the Reynolds stress profile, the kinetic energy spectrum, and the Q-criterion (vortex structures). Meanwhile, the trained IUFNO models are computationally much faster than the traditional LES models. Thus, the IUFNO is a promising approach for the fast prediction of wall-bounded turbulent flow.


title: Simulation of Chemical Reactions on a Quantum Computer

abstract: Studying chemical reactions, particularly in the gas phase, relies heavily on computing scattering matrix elements. These elements are essential for characterizing molecular reactions and accurately determining reaction probabilities. However, the intricate nature of quantum interactions poses challenges, necessitating the use of advanced mathematical models and computational approaches to tackle the inherent complexities. In this study, we develop and apply a quantum algorithm for the calculation of scattering matrix elements. In our approach, we employ the time-dependent method based on the M\"oller operator formulation where the S-matrix element between the respective reactant and product channels is determined through the time correlation function of the reactant and product M\"oller wavepackets. We successfully apply our quantum algorithm to calculate scattering matrix elements for 1D semi-infinite square well potential and on the co-linear hydrogen exchange reaction. As we navigate the complexities of quantum interactions, this quantum algorithm is general and emerges as a promising avenue, shedding light on new possibilities for simulating chemical reactions on quantum computers.


title: Neural Codebook Design for Network Beam Management

abstract: Obtaining accurate and timely channel state information (CSI) is a fundamental challenge for large antenna systems. Mobile systems like 5G use a beam management framework that joins the initial access, beamforming, CSI acquisition, and data transmission. The design of codebooks for these stages, however, is challenging due to their interrelationships, varying array sizes, and site-specific channel and user distributions. Furthermore, beam management is often focused on single-sector operations while ignoring the overarching network- and system-level optimization. In this paper, we proposed an end-to-end learned codebook design algorithm, network beamspace learning (NBL), that captures and optimizes codebooks to mitigate interference while maximizing the achievable performance with extremely large hybrid arrays. The proposed algorithm requires limited shared information yet designs codebooks that outperform traditional codebooks by over 10dB in beam alignment and achieve more than 25% improvements in network spectral efficiency.

categories: eess.SP cs.AI cs.IT cs.NI cs.SY eess.SY math.IT


title: Bounds for the independence and chromatic numbers of locally sparse graphs

abstract: In this note we consider a more general version of local sparsity introduced recently by Anderson, Kuchukova, and the author. In particular, we say a graph $G = (V, E)$ is $(k, r)$-locally-sparse if for each vertex $v \in V(G)$, the subgraph induced by its neighborhood contains at most $k$ cliques of size $r$. For $r \geq 3$ and $\epsilon \in [0, 1]$, we show that a $(\Delta^{\epsilon r}, r)$-locally-sparse graph $G$ of maximum degree $\Delta$ satisfies $\alpha(G) = \Omega\left(\dfrac{n}{\gamma\Delta}\right)$ and $\chi(G) = O\left(\gamma\Delta\right)$, where $\gamma :=\max\left\{\epsilon,\,\dfrac{r\log\log \Delta}{\log \Delta}\right\}$. As $K_{r+1}$-free graphs are $(k, r)$-locally-sparse for any $k$, we asymptotically recover classical results of Shearer and Johansson by setting $\epsilon = 0$. We prove a stronger bound on the independence number in terms of the average degree, and establish a local version of the coloring result in the more general setting of correspondence coloring.


title: Distributed Policy Gradient for Linear Quadratic Networked Control with Limited Communication Range

abstract: This paper proposes a scalable distributed policy gradient method and proves its convergence to near-optimal solution in multi-agent linear quadratic networked systems. The agents engage within a specified network under local communication constraints, implying that each agent can only exchange information with a limited number of neighboring agents. On the underlying graph of the network, each agent implements its control input depending on its nearby neighbors' states in the linear quadratic control setting. We show that it is possible to approximate the exact gradient only using local information. Compared with the centralized optimal controller, the performance gap decreases to zero exponentially as the communication and control ranges increase. We also demonstrate how increasing the communication range enhances system stability in the gradient descent process, thereby elucidating a critical trade-off. The simulation results verify our theoretical findings.


title: On the logarithmic slice filtration

abstract: We consider slice filtrations in logarithmic motivic homotopy theory. Our main results establish conjectured compatibilities with the Beilinson, BMS, and HKR filtrations on (topological, log) Hochschild homology and related invariants. In the case of perfect fields admitting resolution of singularities, we show that the slice filtration realizes the BMS filtration on the $p$-completed topological cyclic homology. Furthermore, the motivic trace map is compatible with the slice and BMS filtrations, yielding a natural morphism from the motivic slice spectral sequence to the BMS spectral sequence. Finally, we consider the Kummer \'etale hypersheafification of logarithmic $K$-theory and show that its very effective slices compute Lichtenbaum \'etale motivic cohomology.


title: Efficient Interaction-Based Offline Runtime Verification of Distributed Systems with Lifeline Removal

abstract: Runtime Verification (RV) refers to a family of techniques in which system executions are observed and confronted to formal specifications, with the aim of identifying faults. In Offline RV, observation is done in a first step and verification in a second, on a static artifact collected during observation. In this paper, we define an approach to offline RV of Distributed Systems (DS) against interactions. Interactions are formal models describing communications within a DS. DS are composed of subsystems deployed on different machines and interacting via message passing. Therefore, observing executions of a DS entails logging a collection of local execution traces, one for each subsystem, that we call a multi-trace. A major challenge in analyzing multi-traces is that there are no practical means to synchronize the ends of observations of all local traces. We address this via an operation, called lifeline removal, which we apply on-the-fly on the specification during verification once a local trace has been entirely analyzed. This operation removes from the interaction the specification of actions occurring on the subsystem that is no-longer observed. This may allow further execution of the specification via removing deadlocks due to the partial orders of actions. We prove the correctness of the resulting RV algorithm and introduce two optimization techniques which we also prove correct. We implement a Partial Order Reduction (POR) technique via the selection of a one-unambiguous action (as a unique first step to a linearization) which existence is determined via another use of the lifeline removal operator. Additionally, Local Analyses (LOC) i.e., the verification of local traces, can be leveraged during the global multi-trace analysis to prove failure more quickly. Experiments illustrate the application of our RV approach and the benefits of our optimizations.


title: Machine Learning Assisted Adjustment Boosts Inferential Efficiency of Randomized Controlled Trials

abstract: In this work, we proposed a novel inferential procedure assisted by machine learning based adjustment for randomized control trials. The method was developed under the Rosenbaum's framework of exact tests in randomized experiments with covariate adjustments. Through extensive simulation experiments, we showed the proposed method can robustly control the type I error and can boost the inference efficiency for a randomized controlled trial (RCT). This advantage was further demonstrated in a real world example. The simplicity and robustness of the proposed method makes it a competitive candidate as a routine inference procedure for RCTs, especially when the number of baseline covariates is large, and when nonlinear association or interaction among covariates is expected. Its application may remarkably reduce the required sample size and cost of RCTs, such as phase III clinical trials.


title: New theoretical study of potassium perturbed by He and a comparison to laboratory spectra

abstract: We report on our new calculations of unified line profiles of K perturbed by He using ab initio potential data for the conditions prevailing in cool substellar brown dwarfs and hot dense planetary atmospheres with temperatures from $T_\mathrm{eff}$=500~$\ \mathrm{K}$ to 3000~$\ \mathrm{K}$. For such objects with atmospheres of H$_2$ and He, conventional laboratory absorption spectroscopy can be used to examine the line wings and test the line shape theories and molecular potentials. We find that an analytical Lorentzian profile is useful for a few cm$^{-1}$ from the line center, but not in the line wings, where the radiative transfer is a consequence of the K-He radiative collisions that are sensitive to the interaction potentials. Tables of the K--He absorption coefficients of the resonance lines allow accurate model atmospheres and synthetic spectra. For this purpose, we present new opacities from comprehensive line shape theory incorporating accurate ab initio potentials. Use of these new tables for the modeling of emergent spectra will be an improvement over previous line shape approximations based on incomplete or inaccurate potentials. We also present Lorentzian impact parameters obtained in the semi-classical and quantum theory for the K $4s-4p$ resonance line centered at 0.77~$\mu$m specifically for the line core regime.


title: Exploring Time Delay Interferometry Ranging as a Practical Ranging Approach in the Bayesian Framework

abstract: Time Delay Interferometry (TDI) is an indispensable step in the whole data processing procedure of space-based gravitational wave detection, as it mitigates the overwhelming laser frequency noise, which would otherwise completely bury the gravitational wave signals. Knowledge on the inter-spacecraft optical paths (i.e. delays) is one of the key elements of TDI. Conventional method for inter-spacecraft ranging mainly relies on the pseudo-random noise (PRN) code signal modulated onto the lasers. To ensure the reliability and robustness of this ranging information, it would be highly beneficial to develop other methods which could serve as cross-validations or backups. This paper explores the practical implementation of an alternative data-driven approach - time delay interferometry ranging (TDIR) - as a ranging technique independent of the PRN signal. Distinguished from previous research, our TDIR algorithm significantly relaxes the stringent requirement for clock synchronization imposed by traditional TDI procedure. By framing TDIR as a Bayesian parameter estimation problem and employing a general polynomial parametrization, we demonstrate our algorithm with simulated data based on the numerical orbit of Taiji. In the presence of laser frequency noise and secondary noises, the estimated median values of delays are only 5.28 ns away from the ground truths, capable of suppressing laser frequency noise to the desired level. Additionally, we have also analysed the requirements of mitigating optical bench noise and clock noise on TDIR, and presented an illustrative example for the impact of laser locking.


title: When Industry meets Trustworthy AI: A Systematic Review of AI for Industry 5.0

abstract: Industry is at the forefront of adopting new technologies, and the process followed by the adoption has a significant impact on the economy and society. In this work, we focus on analysing the current paradigm in which industry evolves, making it more sustainable and Trustworthy. In Industry 5.0, Artificial Intelligence (AI), among other technology enablers, is used to build services from a sustainable, human-centric and resilient perspective. It is crucial to understand those aspects that can bring AI to industry, respecting Trustworthy principles by collecting information to define how it is incorporated in the early stages, its impact, and the trends observed in the field. In addition, to understand the challenges and gaps in the transition from Industry 4.0 to Industry 5.0, a general perspective on the industry's readiness for new technologies is described. This provides practitioners with novel opportunities to be explored in pursuit of the adoption of Trustworthy AI in the sector.


title: Equi-dimensionalization via subdivision of simplices

abstract: We give an alternative proof of Suslin's equi-dimensionalization moving lemma, using a different geometric construction. The new construction provides better control of the degrees of the polynomials used to define endomorphisms of schemes along which algebraic cycles are pulled back. When applied to algebraic cycles with modulus, the new degree bound improves an earlier result of Hiroyasu Miyazaki and the present author so that we do not need to take the limit over the thickenings of the given divisor anymore.


title: CrackNex: a Few-shot Low-light Crack Segmentation Model Based on Retinex Theory for UAV Inspections

abstract: Routine visual inspections of concrete structures are imperative for upholding the safety and integrity of critical infrastructure. Such visual inspections sometimes happen under low-light conditions, e.g., checking for bridge health. Crack segmentation under such conditions is challenging due to the poor contrast between cracks and their surroundings. However, most deep learning methods are designed for well-illuminated crack images and hence their performance drops dramatically in low-light scenes. In addition, conventional approaches require many annotated low-light crack images which is time-consuming. In this paper, we address these challenges by proposing CrackNex, a framework that utilizes reflectance information based on Retinex Theory to help the model learn a unified illumination-invariant representation. Furthermore, we utilize few-shot segmentation to solve the inefficient training data problem. In CrackNex, both a support prototype and a reflectance prototype are extracted from the support set. Then, a prototype fusion module is designed to integrate the features from both prototypes. CrackNex outperforms the SOTA methods on multiple datasets. Additionally, we present the first benchmark dataset, LCSD, for low-light crack segmentation. LCSD consists of 102 well-illuminated crack images and 41 low-light crack images. The dataset and code are available at https://github.com/zy1296/CrackNex.


title: CHEX-MATE : turbulence in the ICM from X-ray surface brightness fluctuations

abstract: The intra-cluster medium is prone to turbulent motion that will contribute to the non-thermal heating of the gas, complicating the use of galaxy clusters as cosmological probes. Indirect approaches can estimate the intensity and structure of turbulent motions by studying the associated fluctuations in gas density and X-ray surface brightness. In this work, we want to constrain the gas density fluctuations at work in the CHEX-MATE sample to obtain a detailed view of their properties in a large population of clusters. We use a simulation-based approach to constrain the parameters of the power spectrum of density fluctuations, assuming a Kolmogorov-like spectrum and including the sample variance, further providing an approximate likelihood for each cluster. This method requires clusters to be not too disturbed, as fluctuations can originate from dynamic processes such as merging. Accordingly, we remove the less relaxed clusters (centroid shift $w>0.02$) from our sample, resulting in a sample of 64 clusters. We define different subsets of CHEX-MATE to determine properties of density fluctuations as a function of dynamical state, mass and redshift, and investigate the correlation with the presence or not of a radio halo. We found a positive correlation between the dynamical state and density fluctuation variance, a non-trivial behaviour with mass and no specific trend with redshift or the presence/absence of a radio halo. The injection scale is mostly constrained by the core region. The slope in the inertial range is consistent with Kolmogorov theory. When interpreted as originating from turbulent motion, the density fluctuations in $R_{500}$ yield an average Mach number of $M_{3D}\simeq 0.4\pm 0.2$, an associated non-thermal pressure support of $ P_{turb}/P_{tot}\simeq (9\pm 6) \%$ or a hydrostatic mass bias $b_{turb}\simeq 0.09\pm 0.06$, in line with what is expected from the literature.


title: Tight stellar binaries favour active longitudes at sub- and anti-stellar points

abstract: Stellar binaries are ubiquitous in the galaxy and a laboratory for astrophysical effects. We use TESS to study photometric modulations in the lightcurves of 162 unequal mass eclipsing binaries from the EBLM (Eclipsing Binary Low Mass) survey, comprising F/G/K primaries and M-dwarf secondaries. We detect modulations on 81 eclipsing binaries. We catalog the rotation rates of the primary star in 69 binaries and discover 17 ellipsoidal variables. In a large portion (at least $\sim 51\%$) of our sample, we detect photometric modulations consistent with two over-densities of spots on the primary star that are roughly $180^{\circ}$ apart. We show that these so-called active longitudes are preferentially at the sub- and anti-stellar points on the primary star. Physically, this means that the spots on the primary star preferentially face directly towards and away from the secondary star.


title: Tracking-in-range Formulations for Numerical Optimal Control

abstract: In contrast to set-point tracking which aims to reduce the tracking error between the tracker and the reference, tracking-in-range problems only focus on whether the tracker is within a given range around the reference, making it more suitable for the mission specifications of many practical applications. In this work, we present novel optimal control formulations to solve tracking-in-range problems, for both problems requiring the tracker to be always in range, and problems allowing the tracker to go out of range to yield overall better outcomes. As the problem naturally involves discontinuous functions, we present alternative formulations and regularisation strategies to improve the performance of numerical solvers. The extension to in-range tracking with multiple trackers and in-range tracking in high dimensional space are also discussed and illustrated with numerical examples, demonstrating substantial increases in mission duration in comparison to traditional set-point tracking.


title: Enumeration for MSO-Queries on Compressed Trees

abstract: We present a linear preprocessing and output-linear delay enumeration algorithm for MSO-queries over trees that are compressed in the well-established grammar-based framework. Time bounds are measured with respect to the size of the compressed representation of the tree. Our result extends previous work on the enumeration of MSO-queries over uncompressed trees and on the enumeration of document spanners over compressed text documents.


title: Enhancing single-atom loading in tightly confined dipole traps with ancillary dipole beam

abstract: Single atoms trapped in tightly focused optical dipole traps provide an excellent experimental platform for quantum computing, precision measurement, and fundamental physics research. In this work, we propose and demonstrate a novel approach to enhancing the loading of single atoms by introducing a weak ancillary dipole beam. The loading rate of single atoms in a dipole trap can be significantly improved by only a few tens of microwatts of counter-propagating beam. It was also demonstrated that multiple atoms could be loaded with the assistance of a counter-propagating beam. By reducing the power requirements for trapping single atoms and enabling the trapping of multiple atoms, our method facilitates the extension of single-atom arrays and the investigation of collective light-atom interactions.


title: Improving Variational Autoencoder Estimation from Incomplete Data with Mixture Variational Families

abstract: We consider the task of estimating variational autoencoders (VAEs) when the training data is incomplete. We show that missing data increases the complexity of the model's posterior distribution over the latent variables compared to the fully-observed case. The increased complexity may adversely affect the fit of the model due to a mismatch between the variational and model posterior distributions. We introduce two strategies based on (i) finite variational-mixture and (ii) imputation-based variational-mixture distributions to address the increased posterior complexity. Through a comprehensive evaluation of the proposed approaches, we show that variational mixtures are effective at improving the accuracy of VAE estimation from incomplete data.


title: Impact of $\alpha$ enhancement on the asteroseismic age determination of field stars. Application to the APO-K2 catalogue

abstract: We investigated the theoretical biases affecting the asteroseismic grid-based estimates of stellar parameters in the presence of a mismatch between the heavy element mixture of observed stars and stellar models. We performed a controlled simulation adopting effective temperature, [Fe/H], average large frequency spacing, and frequency of maximum oscillation power as observational constraints. Synthetic stars were sampled from grids of stellar models computed with different [alpha/Fe] values from 0.0 to 0.4. The mass, radius, and age of these objects were then estimated by adopting a grid of models with a fixed [alpha/Fe] value of 0.0. The experiment was repeated assuming different sets of observational uncertainties. In the reference scenario, we adopted an uncertainty of 1.5% in seismic parameters, 50 K in effective temperature, and 0.05 dex in [Fe/H]. A higher uncertainty in the atmospheric constraints was also adopted in order to explore the impact on the precision of the observations of the estimated stellar parameters. Our simulations showed that estimated parameters are biased up to 3% in mass, 1.5% in radius, and 4% in age when the reference uncertainty scenario was adopted. These values correspond to 45%, 48%, and 16% of the estimated uncertainty in the stellar parameters. These biases in mass and radius disappear when adopting larger observational uncertainties because of the possibility of the fitting algorithm exploring a wider range of possible solutions. However, in this scenario, the age is significantly biased by -8%. Finally, we verified that the stellar mass, radius, and age can be estimated with a high accuracy by adopting a grid with the incorrect value of [alpha/Fe] if the metallicity [Fe/H] of the target is adjusted to match the Z in the fitting grid. In this scenario, the maximum bias in the age was reduced to 1.5%.


title: On a Neural Implementation of Brenier's Polar Factorization

abstract: In 1991, Brenier proved a theorem that generalizes the polar decomposition for square matrices -- factored as PSD $\times$ unitary -- to any vector field $F:\mathbb{R}^d\rightarrow \mathbb{R}^d$. The theorem, known as the polar factorization theorem, states that any field $F$ can be recovered as the composition of the gradient of a convex function $u$ with a measure-preserving map $M$, namely $F=\nabla u \circ M$. We propose a practical implementation of this far-reaching theoretical result, and explore possible uses within machine learning. The theorem is closely related to optimal transport (OT) theory, and we borrow from recent advances in the field of neural optimal transport to parameterize the potential $u$ as an input convex neural network. The map $M$ can be either evaluated pointwise using $u^*$, the convex conjugate of $u$, through the identity $M=\nabla u^* \circ F$, or learned as an auxiliary network. Because $M$ is, in general, not injective, we consider the additional task of estimating the ill-posed inverse map that can approximate the pre-image measure $M^{-1}$ using a stochastic generator. We illustrate possible applications of Brenier's polar factorization to non-convex optimization problems, as well as sampling of densities that are not log-concave.


title: Geometry-dependent matching pursuit: a transition phase for convergence on linear regression and LASSO

abstract: Greedy first-order methods, such as coordinate descent with Gauss-Southwell rule or matching pursuit, have become popular in optimization due to their natural tendency to propose sparse solutions and their refined convergence guarantees. In this work, we propose a principled approach to generating (regularized) matching pursuit algorithms adapted to the geometry of the problem at hand, as well as their convergence guarantees. Building on these results, we derive approximate convergence guarantees and describe a transition phenomenon in the convergence of (regularized) matching pursuit from underparametrized to overparametrized models.


title: Entanglement of elliptic curves upon base extension

abstract: Fix distinct primes $p$ and $q$ and let $E$ be an elliptic curve defined over a number field $K$. The $(p,q)$-entanglement type of $E$ over $K$ is the isomorphism class of the group $\operatorname{Gal}(K(E[p])\cap K(E[q])/K)$. This size of this group measures the extent to which the image of the mod $pq$ Galois representation attached to $E$ fails to be a direct product of the mod $p$ and mod $q$ images. In this article, we study how the $(p,q)$-entanglement group varies over different base fields. We prove that for each prime $\ell$ dividing the greatest common divisor of the size of the mod $p$ and $q$ images, there are infinitely many fields $L/K$ such that the entanglement over $L$ is cyclic of order $\ell$. We also classify all possible $(2,q)$-entanglement types that can occur as the base field $L$ varies.


title: Physical Properties and Kinematics of Dense Cores Associated with Regions of Massive Star Formation from the Southern Sky

abstract: The results of spectral observations in the $\sim 84-92$ GHz frequency range of six objects in the southern sky containing dense cores and associated with regions of massive stars and star clusters formation are presented. The observations were carried out with the MOPRA-22m radio telescope. Within the framework of the local thermodynamic equilibrium (LTE) approximation, the column densities and abundances of the H$^{13}$CN, H$^{13}$CO$^+$, HN$^{13}$C, HC$_3$N, c-C$_3$H$_2$, SiO, CH$_3$C$_2$H and CH$_3$CN molecules are calculated. Estimates of kinetic temperatures ($\sim 30-50$ K), sizes of emission regions ($\sim 0.2-3.1$ pc) and virial masses ($\sim 70-4600~M_{\odot}$) are obtained. The line widths in the three cores decrease with increasing distance from the center. In four cores, asymmetry in the profiles of the optically thick lines HCO$^+$(1-0) and HCN(1-0) is observed, indicating the presence of systematic motions along the line of sight. In two cases, the asymmetry can be caused by contraction of gas. The model spectral maps of HCO$^+$(1-0) and H$^{13}$CO$^+$(1-0), obtained within the framework of the non-LTE spherically symmetric model, are fitted into the observed ones. The radial profiles of density ($\propto r^{-1.6}$), turbulent velocity ($\propto r^{-0.2}$), and contraction velocity ($\propto r^{0.5}$) in the G268.42--0.85 core have been calculated. The contraction velocity profile differs from that expected both in the case of free fall of gas onto a protostar ($\propto r^{-0.5}$), and in the case of global core collapse (contraction velocity does not depend on distance). A discussion of the obtained results is provided.


title: Detecting Concrete Visual Tokens for Multimodal Machine Translation

abstract: The challenge of visual grounding and masking in multimodal machine translation (MMT) systems has encouraged varying approaches to the detection and selection of visually-grounded text tokens for masking. We introduce new methods for detection of visually and contextually relevant (concrete) tokens from source sentences, including detection with natural language processing (NLP), detection with object detection, and a joint detection-verification technique. We also introduce new methods for selection of detected tokens, including shortest $n$ tokens, longest $n$ tokens, and all detected concrete tokens. We utilize the GRAM MMT architecture to train models against synthetically collated multimodal datasets of source images with masked sentences, showing performance improvements and improved usage of visual context during translation tasks over the baseline model.