title: Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

abstract: Transformer-based language models spread FLOPs uniformly across input sequences. In this work we demonstrate that transformers can instead learn to dynamically allocate FLOPs (or compute) to specific positions in a sequence, optimising the allocation along the sequence for different layers across the model depth. Our method enforces a total compute budget by capping the number of tokens ($k$) that can participate in the self-attention and MLP computations at a given layer. The tokens to be processed are determined by the network using a top-$k$ routing mechanism. Since $k$ is defined a priori, this simple procedure uses a static computation graph with known tensor sizes, unlike other conditional computation techniques. Nevertheless, since the identities of the $k$ tokens are fluid, this method can expend FLOPs non-uniformly across the time and model depth dimensions. Thus, compute expenditure is entirely predictable in sum total, but dynamic and context-sensitive at the token-level. Not only do models trained in this way learn to dynamically allocate compute, they do so efficiently. These models match baseline performance for equivalent FLOPS and wall-clock times to train, but require a fraction of the FLOPs per forward pass, and can be upwards of 50\% faster to step during post-training sampling.


title: Transmigration of Edge States with Interaction in Su-Schrieffer-Heeger Chain

abstract: The effect of Hubbard and Kondo interactions on the edge states in the half-filled Su-Schrieffer-Heeger chain of electrons is investigated by studying the behaviour of charge quasiparticles using Kumar representation and density matrix renormalization group method. For any finite dimerization of hopping, by increasing the Hubbard interaction, the edge states are found to transmigrate from the physical charge gap to a high energy gap through an intermediate phase without the edge states. The extent of this phase with no edge states shrinks smoothly upon increasing the dimerization. The transmigration of edge states from the charge gap to the high energy gap is also found to occur with Kondo interaction, but through an intermediate phase which itself changes from having no edge states for weak dimerization to having the edge states in the physical as well as the high energy gaps coexisting from moderate to strong dimerization.


title: On diffusion and transport acting on parameterized moving closed curves in space

abstract: We investigate the motion of closed, smooth non-self-intersecting curves that evolve in space $\mathbb{R}^3$. The geometric evolutionary equation for the evolution of the curve is accompanied by a parabolic equation for the scalar quantity evaluated over the evolving curve. We apply the direct Lagrangian approach to describe the geometric flow of 3D curves resulting in a system of degenerate parabolic equations. We prove the local existence and uniqueness of classical H\"older smooth solutions to the governing system of nonlinear parabolic equations. A numerical discretization scheme has been constructed using the method of flowing finite volumes. We present several numerical examples of the evolution of curves in 3D with a scalar quantity. In this paper, we analyze the flow of curves with no torsion evolving in rotating and parallel planes. Next, we present examples of the evolution of curves with initially knotted and unknotted curves.


title: LLMs in the Loop: Leveraging Large Language Model Annotations for Active Learning in Low-Resource Languages

abstract: Low-resource languages face significant barriers in AI development due to limited linguistic resources and expertise for data labeling, rendering them rare and costly. The scarcity of data and the absence of preexisting tools exacerbate these challenges, especially since these languages may not be adequately represented in various NLP datasets. To address this gap, we propose leveraging the potential of LLMs in the active learning loop for data annotation. Initially, we conduct evaluations to assess inter-annotator agreement and consistency, facilitating the selection of a suitable LLM annotator. The chosen annotator is then integrated into a training loop for a classifier using an active learning paradigm, minimizing the amount of queried data required. Empirical evaluations, notably employing GPT-4-Turbo, demonstrate near-state-of-the-art performance with significantly reduced data requirements, as indicated by estimated potential cost savings of at least 42.45 times compared to human annotation. Our proposed solution shows promising potential to substantially reduce both the monetary and computational costs associated with automation in low-resource settings. By bridging the gap between low-resource languages and AI, this approach fosters broader inclusion and shows the potential to enable automation across diverse linguistic landscapes.


title: Classification and Regression Error Bounds for Inhomogenous Data With Applications to Wireless Networks

abstract: In this paper, we study classification and regression error bounds for inhomogenous data that are independent but not necessarily identically distributed. First, we consider classification of data in the presence of non-stationary noise and establish ergodic type sufficient conditions that guarantee the achievability of the Bayes error bound, using universal rules. We then perform a similar analysis for $k$-nearest neighbour regression and obtain optimal error bounds for the same. Finally, we illustrate applications of our results in the context of wireless networks.


title: OFMPNet: Deep End-to-End Model for Occupancy and Flow Prediction in Urban Environment

abstract: The task of motion prediction is pivotal for autonomous driving systems, providing crucial data to choose a vehicle behavior strategy within its surroundings. Existing motion prediction techniques primarily focus on predicting the future trajectory of each agent in the scene individually, utilizing its past trajectory data. In this paper, we introduce an end-to-end neural network methodology designed to predict the future behaviors of all dynamic objects in the environment. This approach leverages the occupancy map and the scene's motion flow. We are investigatin various alternatives for constructing a deep encoder-decoder model called OFMPNet. This model uses a sequence of bird's-eye-view road images, occupancy grid, and prior motion flow as input data. The encoder of the model can incorporate transformer, attention-based, or convolutional units. The decoder considers the use of both convolutional modules and recurrent blocks. Additionally, we propose a novel time-weighted motion flow loss, whose application has shown a substantial decrease in end-point error. Our approach has achieved state-of-the-art results on the Waymo Occupancy and Flow Prediction benchmark, with a Soft IoU of 52.1% and an AUC of 76.75% on Flow-Grounded Occupancy.


title: The Identity Problem in virtually solvable matrix groups over algebraic numbers

abstract: The Tits alternative states that a finitely generated matrix group either contains a nonabelian free subgroup $F_2$, or it is virtually solvable. This paper considers two decision problems in virtually solvable matrix groups: the Identity Problem (does a given finitely generated subsemigroup contain the identity matrix?), and the Group Problem (is a given finitely generated subsemigroup a group?). We show that both problems are decidable in virtually solvable matrix groups over the field of algebraic numbers $\overline{\mathbb{Q}}$. Our proof also extends the decidability result for nilpotent groups by Bodart, Ciobanu, Metcalfe and Shaffrir, and the decidability result for metabelian groups by Dong (STOC'24). Since the Identity Problem and the Group Problem are known to be undecidable in matrix groups containing $F_2 \times F_2$, our result significantly reduces the decidability gap for both decision problems.


title: Continuous Sculpting: Persistent Swarm Shape Formation Adaptable to Local Environmental Changes

abstract: Despite their growing popularity, swarms of robots remain limited by the operating time of each individual. We present algorithms which allow a human to sculpt a swarm of robots into a shape that persists in space perpetually, independent of onboard energy constraints such as batteries. Robots generate a path through a shape such that robots cycle in and out of the shape. Robots inside the shape react to human initiated changes and adapt the path through the shape accordingly. Robots outside the shape recharge and return to the shape so that the shape can persist indefinitely. The presented algorithms communicate shape changes throughout the swarm using message passing and robot motion. These algorithms enable the swarm to persist through any arbitrary changes to the shape. We describe these algorithms in detail and present their performance in simulation and on a swarm of mobile robots. The result is a swarm behavior more suitable for extended duration, dynamic shape-based tasks in applications such as agriculture and emergency response.


title: Tracking the Mean of a Piecewise Stationary Sequence

abstract: In this paper we study the problem of tracking the mean of a piecewise stationary sequence of independent random variables. First we consider the case where the transition times are known and show that a direct running average performs the tracking in short time and with high accuracy. We then use a single valued weighted running average with a tunable parameter for the case when transition times are unknown and establish deviation bounds for the tracking accuracy. Our result has applications in choosing the optimal rewards for the multiarmed bandit scenario.


title: Dirac-type Theorems for Inhomogenous Random Graphs

abstract: In this paper, we study Dirac-type theorems for an inhomogenous random graph (G) whose edge probabilities are not necessarily all the same. We obtain sufficient conditions for the existence of Hamiltonian paths and perfect matchings, in terms of the \emph{sum} of edge probabilities. For edge probability assignments with two-sided bounds, we use P\'osa rotation and single vertex exclusion techniques to show that (G) is Hamiltonian with high probability. For weaker one-sided bounds, we use bootstrapping techniques to obtain a perfect matching in (G,) with high probability. We also highlight an application of our results in the context of channel assignment problem in wireless networks.


title: Multi-Objective Bayesian Active Learning for MeV-ultrafast electron diffraction

abstract: Ultrafast electron diffraction using MeV energy beams(MeV-UED) has enabled unprecedented scientific opportunities in the study of ultrafast structural dynamics in a variety of gas, liquid and solid state systems. Broad scientific applications usually pose different requirements for electron probe properties. Due to the complex, nonlinear and correlated nature of accelerator systems, electron beam property optimization is a time-taking process and often relies on extensive hand-tuning by experienced human operators. Algorithm based efficient online tuning strategies are highly desired. Here, we demonstrate multi-objective Bayesian active learning for speeding up online beam tuning at the SLAC MeV-UED facility. The multi-objective Bayesian optimization algorithm was used for efficiently searching the parameter space and mapping out the Pareto Fronts which give the trade-offs between key beam properties. Such scheme enables an unprecedented overview of the global behavior of the experimental system and takes a significantly smaller number of measurements compared with traditional methods such as a grid scan. This methodology can be applied in other experimental scenarios that require simultaneously optimizing multiple objectives by explorations in high dimensional, nonlinear and correlated systems.


title: Extracting Norms from Contracts Via ChatGPT: Opportunities and Challenges

abstract: We investigate the effectiveness of ChatGPT in extracting norms from contracts. Norms provide a natural way to engineer multiagent systems by capturing how to govern the interactions between two or more autonomous parties. We extract norms of commitment, prohibition, authorization, and power, along with associated norm elements (the parties involved, antecedents, and consequents) from contracts. Our investigation reveals ChatGPT's effectiveness and limitations in norm extraction from contracts. ChatGPT demonstrates promising performance in norm extraction without requiring training or fine-tuning, thus obviating the need for annotated data, which is not generally available in this domain. However, we found some limitations of ChatGPT in extracting these norms that lead to incorrect norm extractions. The limitations include oversight of crucial details, hallucination, incorrect parsing of conjunctions, and empty norm elements. Enhanced norm extraction from contracts can foster the development of more transparent and trustworthy formal agent interaction specifications, thereby contributing to the improvement of multiagent systems.


title: Postprocessing of point predictions for probabilistic forecasting of electricity prices: Diversity matters

abstract: Operational decisions relying on predictive distributions of electricity prices can result in significantly higher profits compared to those based solely on point forecasts. However, the majority of models developed in both academic and industrial settings provide only point predictions. To address this, we examine three postprocessing methods for converting point forecasts into probabilistic ones: Quantile Regression Averaging, Conformal Prediction, and the recently introduced Isotonic Distributional Regression. We find that while IDR demonstrates the most varied performance, combining its predictive distributions with those of the other two methods results in an improvement of ca. 7.5% compared to a benchmark model with normally distributed errors, over a 4.5-year test period in the German power market spanning the COVID pandemic and the war in Ukraine. Remarkably, the performance of this combination is at par with state-of-the-art Distributional Deep Neural Networks.


title: High temperature series expansions of S = 1/2 Heisenberg spin models: algorithm to include the magnetic field with optimized complexity

abstract: This work presents an algorithm for calculating high temperature series expansions (HTSE) of Heisenberg spin models with spin $S=1/2$ in the thermodynamic limit. This algorithm accounts for the presence of a magnetic field. The paper begins with a comprehensive introduction to HTSE and then focuses on identifying the bottlenecks that limit the computation of higher order coefficients. HTSE calculations involve two key steps: graph enumeration on the lattice and trace calculations for each graph. The introduction of a non-zero magnetic field adds complexity to the expansion because previously irrelevant graphs must now be considered: bridged graphs. We present an efficient method to deduce the contribution of these graphs from the contribution of sub-graphs, that drastically reduces the time of calculation for the last order coefficient (in practice increasing by one the order of the series at almost no cost). Previous articles of the authors have utilized HTSE calculations based on this algorithm, but without providing detailed explanations. The complete algorithm is publicly available, as well as the series on many lattice and for various interactions.


title: Comparing angles in Euclid's Elements

abstract: The exposition in Euclid's Elements contains an obvious gap (seemingly unnoticed by most commentators): he often compares not just angles, but *groups* of angles, and at the same time he avoids summing angles (and considering angles greater than $\pi$), and does not say what such a comparison of groups could mean. We discuss the problem and suggest a possible interpretation that could make Euclid's exposition consistent.


title: Beyond Social Media Analogues

abstract: The steady flow of social-media cases toward the Supreme Court shows a nation reworking its fundamental relationship with technology. The cases raise a host of questions ranging from difficult to impossible: how to nurture a vibrant public square when a few tech giants dominate the flow of information, how social media can be at the same time free from conformist groupthink and also protected against harmful disinformation campaigns, and how government and industry can cooperate on such problems without devolving toward censorship. To such profound questions, this Essay offers a comparatively modest contribution -- what not to do. Always the lawyer's instinct is toward analogy, considering what has come before and how it reveals what should come next. Almost invariably, that is the right choice. The law's cautious evolution protects society from disruptive change. But almost is not always, and, with social media, disruptive change is already upon us. Using social-media laws from Texas and Florida as a case study, this Essay shows how social-media's distinct features render it poorly suited to analysis by analogy and argues that courts should instead shift their attention toward crafting legal doctrines targeted to address social media's unique ills.


title: Higher torsion-free Auslander-Reiten sequences and the dominant dimension of algebras

abstract: We generalise a theorem of Tachikawa about reflexive Auslander-Reiten sequences. We apply this to give a new characterisation of the dominant dimension of gendo-symmetric algebras. We also generalise a formula due to Reiten about the dominant dimension of an algebra $A$ and grades of torsion $A$-modules.


title: The ALMA-QUARKS Survey: II. the ACA 1.3 mm continuum source catalog and the assembly of dense gas in massive star-forming clumps

abstract: Leveraging the high resolution, high sensitivity, and wide frequency coverage of the Atacama Large Millimeter/submillimeter Array (ALMA), the QUARKS survey, standing for "Querying Underlying mechanisms of massive star formation with ALMA-Resolved gas Kinematics and Structures", is observing 139 massive star-forming clumps at ALMA Band 6 ($\lambda\sim$ 1.3 mm). This paper introduces the Atacama Compact Array (ACA) 7-m data. Combining multi-wavelength data, we provide the first edition of QUARKS atlas, offering insights into the multiscale and multiphase interstellar medium in high-mass star formation. The ACA 1.3 mm catalog includes 207 continuum sources that are called ACA sources. Their gas kinetic temperatures are estimated using three formaldehyde (H$_2$CO) transitions with a non-LTE radiation transfer model, and the mass and density are derived from a dust emission model. The ACA sources are massive (16-84 percentile values of 6-160 $M_{\odot}$), gravity-dominated ($M\propto R^{1.1}$) fragments within massive clumps, with supersonic turbulence ($\mathcal{M}>1$) and embedded star-forming protoclusters. We find a linear correlation between the masses of the fragments and the massive clumps, with a ratio of 6% between the two. When considering the fragments as representative of dense gas, the ratio indicates a dense gas fraction (DGF) of 6%, although with a wide scatter ranging from 1% to 10%. If we consider the QUARKS massive clumps to be what is observed at various scales, then the size-independent DGF indicates a self-similar fragmentation or collapsing mode in protocluster formation. With the ACA data over four orders of magnitude of luminosity-to-mass ratio ($L/M$), we find that the DGF increases significantly with $L/M$, which indicates clump evolutionary stage. We observed a limited fragmentation at the subclump scale, which can be explained by dynamic global collapse process.


title: Heterogeneous Data Access Model for Concurrency Control and Methods to Deal with High Data Contention

abstract: OLTP has stringent performance requirements defined by Service Level Agreements. Transaction response time is used to determine the maximum throughout in benchmarks. Capacity planning tools for OLTP performance are based on queueing network models for hardware resources and database lock contention has a secondary effect on performance. With ever increasing levels of e-commerce and surges in OLTP traffic we discuss the need for studies of database workloads to develop more realistic lock/latch contention models. Predictive formulas to model increased load leading to thrashing for txns with identical and nonidentical steps are presented. We review concurrency control methods to reduce the level of lock/data conflicts in high contention environments.


title: A Change of Scenery: Transformative Insights from Retrospective VR Embodied Perspective-Taking of Conflict With a Close Other

abstract: Close relationships are irreplaceable social resources, yet prone to high-risk conflict. Building on findings from the fields of HCI, virtual reality, and behavioral therapy, we evaluate the unexplored potential of retrospective VR-embodied perspective-taking to fundamentally influence conflict resolution in close others. We develop a biographically-accurate Retrospective Embodied Perspective-Taking system (REPT) and conduct a mixed-methods evaluation of its influence on close others' reflection and communication, compared to video-based reflection methods currently used in therapy (treatment as usual, or TAU). Our key findings provide evidence that REPT was able to significantly improve communication skills and positive sentiment of both partners during conflict, over TAU. The qualitative data also indicated that REPT surpassed basic perspective-taking by exclusively stimulating users to embody and reflect on both their own and their partner's experiences at the same level. In light of these findings, we provide implications and an agenda for social embodiment in HCI design: conceptualizing the use of `embodied social cognition,' and envisioning socially-embodied experiences as an interactive context.


title: Neural network reconstruction of density and velocity fields from the 2MASS Redshift Survey

abstract: We reconstruct the 3D matter density and peculiar velocity fields in the local Universe up to a distance of $200\,h^{-1}\,\mathrm{Mpc}$ from the Two-Micron All-Sky Redshift Survey (2MRS), using a neural network (NN). We employ a NN with U-net autoencoder architecture and a weighted mean squared error loss function, trained separately to output either the density or velocity field for a given input grid of galaxy number counts. The NN is trained on mocks derived from the Quijote N-body simulations, incorporating redshift-space distortions (RSD), galaxy bias and selection effects, closely mimicking the characteristics of 2MRS. The trained NN is benchmarked against a standard Wiener filter (WF) on a validation set of mocks, before applying it to 2MRS. The NN reconstructions effectively approximate the mean posterior estimate of the true density and velocity fields conditioned on the observations. They consistently outperform the WF in terms of reconstruction accuracy, and effectively capture the nonlinear relation between velocity and density. The NN-reconstructed bulk flow of the total survey volume exhibits a significant correlation with the true mock bulk flow, demonstrating that the NN is sensitive to information on super-survey scales encoded in the RSD. When applied to 2MRS, the NN successfully recovers the main known clusters, some of which are partially in the Zone of Avoidance. The reconstructed bulk flows in spheres of different radii less than $100\,h^{-1}\,\mathrm{Mpc}$ are in good agreement with a previous 2MRS analysis that required an additional external bulk flow component inferred from directly observed peculiar velocities. The NN-reconstructed peculiar velocity of the Local Group closely matches the observed CMB dipole in amplitude and Galactic latitude, and only deviates by $18^\circ$ in longitude. The NN-reconstructed fields are publicly available.


title: Efficient Implementation of Multi-Controlled Quantum Gates

abstract: We present an implementation of multi-controlled quantum gates which provides significant reductions of cost compared to state-of-the-art methods. The operator applied on the target qubit is a unitary, special unitary, or the Pauli X operator (Multi-Controlled Toffoli). The required number of ancilla qubits is no larger than one, similarly to known linear cost decompositions. We extend our methods for any number of target qubits, and provide further cost reductions if additional ancilla qubits are available. For each type of multi-controlled gate, we provide implementations for unrestricted (all-to-all) connectivity and for linear-nearest-neighbor. All of the methods use a linear cost of gates from the Clifford+T (fault-tolerant) set. In the context of linear-nearest-neighbor architecture, the cost and depth of our circuits scale linearly irrespective of the position of the qubits on which the gate is applied. Our methods directly improve the compilation process of many quantum algorithms, providing optimized circuits, which will result in a large reduction of errors.


title: Demonstration of logical qubits and repeated error correction with better-than-physical error rates

abstract: The promise of quantum computers hinges on the ability to scale to large system sizes, e.g., to run quantum computations consisting of more than 100 million operations fault-tolerantly. This in turn requires suppressing errors to levels inversely proportional to the size of the computation. As a step towards this ambitious goal, we present experiments on a trapped-ion QCCD processor where, through the use of fault-tolerant encoding and error correction, we are able to suppress logical error rates to levels below the physical error rates. In particular, we entangled logical qubits encoded in the [[7,1,3]] code with error rates 9.8 times to 500 times lower than at the physical level, and entangled logical qubits encoded in a [[12,2,4]] code with error rates 4.7 times to 800 times lower than at the physical level, depending on the judicious use of post-selection. Moreover, we demonstrate repeated error correction with the [[12,2,4]] code, with logical error rates below physical circuit baselines corresponding to repeated CNOTs, and show evidence that the error rate per error correction cycle, which consists of over 100 physical CNOTs, approaches the error rate of two physical CNOTs. These results signify an important transition from noisy intermediate scale quantum computing to reliable quantum computing, and demonstrate advanced capabilities toward large-scale fault-tolerant quantum computing.


title: Avenues for a number density interpretation of dihadron fragmentation functions

abstract: In this comment, we reassess the underlying physics of the number sum rule for dihadron fragmentation functions. We will argue that, currently, there are no settled constraints on what constitutes a valid number density interpretation for multihadron fragmentation functions. Imposing overly restrictive criteria might lead to misinterpretating the data. Most importantly, and on the basis of phenomenological analyses, the slightly varying definitions used in previous work are not excluded from possessing legitimate number density interpretations (up to the usual issues with ultraviolet divergences and renormalization), so long as they are paired with appropriate factorization theorems. We advocate for further theoretical analyses to be challenged with experimental data, available at JLab or at the future EIC.


title: Smooth Deep Saliency

abstract: In this work, we investigate methods to reduce the noise in deep saliency maps coming from convolutional downsampling, with the purpose of explaining how a deep learning model detects tumors in scanned histological tissue samples. Those methods make the investigated models more interpretable for gradient-based saliency maps, computed in hidden layers. We test our approach on different models trained for image classification on ImageNet1K, and models trained for tumor detection on Camelyon16 and in-house real-world digital pathology scans of stained tissue samples. Our results show that the checkerboard noise in the gradient gets reduced, resulting in smoother and therefore easier to interpret saliency maps.


title: Integrating representative and non-representative survey data for efficient inference

abstract: Non-representative surveys are commonly used and widely available but suffer from selection bias that generally cannot be entirely eliminated using weighting techniques. Instead, we propose a Bayesian method to synthesize longitudinal representative unbiased surveys with non-representative biased surveys by estimating the degree of selection bias over time. We show using a simulation study that synthesizing biased and unbiased surveys together out-performs using the unbiased surveys alone, even if the selection bias may evolve in a complex manner over time. Using COVID-19 vaccination data, we are able to synthesize two large sample biased surveys with an unbiased survey to reduce uncertainty in now-casting and inference estimates while simultaneously retaining the empirical credible interval coverage. Ultimately, we are able to conceptually obtain the properties of a large sample unbiased survey if the assumed unbiased survey, used to anchor the estimates, is unbiased for all time-points.


title: APEX: Ambidextrous Dual-Arm Robotic Manipulation Using Collision-Free Generative Diffusion Models

abstract: Dexterous manipulation, particularly adept coordinating and grasping, constitutes a fundamental and indispensable capability for robots, facilitating the emulation of human-like behaviors. Integrating this capability into robots empowers them to supplement and even supplant humans in undertaking increasingly intricate tasks in both daily life and industrial settings. Unfortunately, contemporary methodologies encounter serious challenges in devising manipulation trajectories owing to the intricacies of tasks, the expansive robotic manipulation space, and dynamic obstacles. We propose a novel approach, APEX, to address all these difficulties by introducing a collision-free latent diffusion model for both robotic motion planning and manipulation. Firstly, we simplify the complexity of real-life ambidextrous dual-arm robotic manipulation tasks by abstracting them as aligning two vectors. Secondly, we devise latent diffusion models to produce a variety of robotic manipulation trajectories. Furthermore, we integrate obstacle information utilizing a classifier-guidance technique, thereby guaranteeing both the feasibility and safety of the generated manipulation trajectories. Lastly, we validate our proposed algorithm through extensive experiments conducted on the hardware platform of ambidextrous dual-arm robots. Our algorithm consistently generates successful and seamless trajectories across diverse tasks, surpassing conventional robotic motion planning algorithms. These results carry significant implications for the future design of diffusion robots, enhancing their capability to tackle more intricate robotic manipulation tasks with increased efficiency and safety. Complete video demonstrations of our experiments can be found in https://sites.google.com/view/apex-dual-arm/home.


title: LP++: A Surprisingly Strong Linear Probe for Few-Shot CLIP

abstract: In a recent, strongly emergent literature on few-shot CLIP adaptation, Linear Probe (LP) has been often reported as a weak baseline. This has motivated intensive research building convoluted prompt learning or feature adaptation strategies. In this work, we propose and examine from convex-optimization perspectives a generalization of the standard LP baseline, in which the linear classifier weights are learnable functions of the text embedding, with class-wise multipliers blending image and text knowledge. As our objective function depends on two types of variables, i.e., the class visual prototypes and the learnable blending parameters, we propose a computationally efficient block coordinate Majorize-Minimize (MM) descent algorithm. In our full-batch MM optimizer, which we coin LP++, step sizes are implicit, unlike standard gradient descent practices where learning rates are intensively searched over validation sets. By examining the mathematical properties of our loss (e.g., Lipschitz gradient continuity), we build majorizing functions yielding data-driven learning rates and derive approximations of the loss's minima, which provide data-informed initialization of the variables. Our image-language objective function, along with these non-trivial optimization insights and ingredients, yields, surprisingly, highly competitive few-shot CLIP performances. Furthermore, LP++ operates in black-box, relaxes intensive validation searches for the optimization hyper-parameters, and runs orders-of-magnitudes faster than state-of-the-art few-shot CLIP adaptation methods. Our code is available at: \url{https://github.com/FereshteShakeri/FewShot-CLIP-Strong-Baseline.git}.


title: Energy Allocation for Multi-User Cooperative Molecular Communication Systems in the Internet of Bio-Nano Things

abstract: Cooperative molecular communication (MC) is a promising technology for facilitating communication between nanomachines in the Internet of Bio-Nano Things (IoBNT) field. However, the performance of IoBNT is limited by the availability of energy for cooperative MC. This paper presents a novel transmitter design scheme that utilizes molecule movement between reservoirs, creating concentration differences through the consumption of free energy, and encoding information on molecule types. The performance of the transmitter is primarily influenced by energy costs, which directly impact the overall IoBNT system performance. To address this, the paper focuses on optimizing energy allocation in cooperative MC for enhanced transmitter performance. Theoretical analysis is conducted for two transmitters. For scenarios with more than two users, a genetic algorithm is employed in the energy allocation to minimize the total bit error rate (BER). Finally, numerical results show the effectiveness of the proposed energy allocation strategies in the considered cooperative MC system.


title: One Noise to Rule Them All: Multi-View Adversarial Attacks with Universal Perturbation

abstract: This paper presents a novel universal perturbation method for generating robust multi-view adversarial examples in 3D object recognition. Unlike conventional attacks limited to single views, our approach operates on multiple 2D images, offering a practical and scalable solution for enhancing model scalability and robustness. This generalizable method bridges the gap between 2D perturbations and 3D-like attack capabilities, making it suitable for real-world applications. Existing adversarial attacks may become ineffective when images undergo transformations like changes in lighting, camera position, or natural deformations. We address this challenge by crafting a single universal noise perturbation applicable to various object views. Experiments on diverse rendered 3D objects demonstrate the effectiveness of our approach. The universal perturbation successfully identified a single adversarial noise for each given set of 3D object renders from multiple poses and viewpoints. Compared to single-view attacks, our universal attacks lower classification confidence across multiple viewing angles, especially at low noise levels. A sample implementation is made available at https://github.com/memoatwit/UniversalPerturbation.


title: Generalized saturation game

abstract: We study the following game version of the generalized graph Tur\'an problem. For two fixed graphs F and H, two players, Max and Mini, alternately claim unclaimed edges of the complete graph Kn such that the graph G of the claimed edges must remain F-free throughout the game. The game ends when no further edges can be claimed, i.e. when G becomes F-saturated. The H-score of the game is the number of copies of H in G. Max aims to maximize the H-score, while Mini wants to minimize it. The H-score of the game when both players play optimally is denoted by s1(n, #H, F) when Max starts, and by s2(n, #H, F) when Mini starts. We study these values for several natural choices of F and H.


title: Federated Multi-Agent Mapping for Planetary Exploration

abstract: In multi-agent robotic exploration, managing and effectively utilizing the vast, heterogeneous data generated from dynamic environments poses a significant challenge. Federated learning (FL) is a promising approach for distributed mapping, addressing the challenges of decentralized data in collaborative learning. FL enables joint model training across multiple agents without requiring the centralization or sharing of raw data, overcoming bandwidth and storage constraints. Our approach leverages implicit neural mapping, representing maps as continuous functions learned by neural networks, for compact and adaptable representations. We further enhance this approach with meta-initialization on Earth datasets, pre-training the network to quickly learn new map structures. This combination demonstrates strong generalization to diverse domains like Martian terrain and glaciers. We rigorously evaluate this approach, demonstrating its effectiveness for real-world deployment in multi-agent exploration scenarios.


title: Signals for invisible matter from solar-terrestrial observations

abstract: The composition of the dark universe although hypothesised, remains one of the biggest mysteries in modern physics. On smaller scales, there are various solar puzzling phenomena which known physics cannot explain like the coronal heating problem, the origin of sunspots, the trigger mechanism of solar flares, but also the open issue since the 1850's on the planetary impact of the active Sun. At the same time, several terrestrial observations in the dynamic Earth's atmosphere such as the ionospheric ionisation around December are unexpected within conventional physics. Following this work, the suggested common solution of all these conventionally unexplained phenomena is based on an external triggering caused by low-speed streaming constituents from the dark sector, being gravitationally focused or deflected by the Sun and the orbiting planets. Evidence in support of this hypothesis and on the existence of one or more streams or clusters has been provided based on a coincidence analysis of long-term astrophysical and planetary datasets. Of note, the planetary correlation is the novel key signature. Finally, a redefined strategy for direct Dark Matter searches focused on streaming Dark Matter is proposed. This novel procedure has been successfully implemented in the CAST-CAPP detector at CERN searching for Dark Matter axions.


title: Towards a New Configurable and Practical Remote Automotive Security Testing Platform

abstract: In the automotive security sector, the absence of a testing platform that is configurable, practical, and user-friendly presents considerable challenges. These difficulties are compounded by the intricate design of vehicle systems, the rapid evolution of attack vectors, and the absence of standardized testing methodologies. We propose a next-generation testing platform that addresses several challenges in vehicle cybersecurity testing and research domains. In this paper, we detail how the Vehicle Security Engineering Cloud (VSEC) Test platform enables easier access to test beds for efficient vehicle cybersecurity testing and advanced (e.g., penetration, fuzz) testing and how we extend such test beds to benefit automotive security research. We highlight methodology on how to use this platform for a variety of users and use cases with real implemented examples.


title: Elasto-inertial rectification of oscillatory flow in an elastic tube

abstract: The interaction between deformable surfaces and oscillatory driving is known to yield complex secondary time-averaged flows due to inertial and elastic nonlinearities. Here, we revisit the problem of oscillatory flow in a cylindrical tube with a deformable wall, and analyze it under a long-wave }theory for small deformations, but for arbitrary Womersley numbers. We find that the oscillatory pressure does not vary linearly along the length of a deformable channel, but instead decays exponentially with spatial oscillations. We show that this decay occurs over an elasto-visco-inertial length scale that depends on the material properties of the fluid and the elastic walls, the geometry of the system, and the frequency of the oscillatory flow, but is independent of the amplitude of deformation. Inertial and geometric nonlinearities associated with the elastic deformation of the channel drive a time-averaged secondary flow. We quantify this flow using numerical solutions of our perturbation theory, and gain insight into these solutions with analytic approximations. The theory identifies a complex non-monotonic dependence of the time-averaged flux on the elastic compliance and inertia, including a reversal of the flow. Finally, we show that our analytic theory is in excellent quantitative agreement with the three-dimensional direct numerical simulations of \citet{pande2023oscillatory}.


title: Licking the plate: dusty star-forming galaxies buried in the ALMA calibration data

abstract: Deep, unbiased surveys are essential to decipher the cosmic evolution of galaxies. The submillimetre (submm) and millimetre (mm) windows complement the UV/optical waveband and are key to revealing the cold and dusty Universe. Traditional ways of conducting deep surveys resort to either lensed fields or target small areas for ultra-long integrations. These surveys have greatly advanced our understanding of dusty star-forming galaxies (DSFGs), but are susceptible to lensing uncertainties and cosmic variance and will be expensive to expand. Here, we summarise our recent multi-wavelength survey of DSFGs in the vicinity of ALMA's calibrators: the ALMACAL survey. These fields have accumulated many hundreds of hours of on-source time, reaching depths and effective areas that are competitive with bespoke cosmological surveys. We summarise the multi-wavelength number counts from ALMACAL and the resolved fraction of the Cosmic Infrared Background (CIB) from submm to mm wavelengths. Meanwhile, combining all available ALMA observations in each field results in impressive frequency coverage, which often yields the redshifts of these DSFGs. The ALMACAL survey has demonstrated the scientific value of calibration scans for all submm/mm and radio telescopes, existing and planned.


title: Constrained Robotic Navigation on Preferred Terrains Using LLMs and Speech Instruction: Exploiting the Power of Adverbs

abstract: This paper explores leveraging large language models for map-free off-road navigation using generative AI, reducing the need for traditional data collection and annotation. We propose a method where a robot receives verbal instructions, converted to text through Whisper, and a large language model (LLM) model extracts landmarks, preferred terrains, and crucial adverbs translated into speed settings for constrained navigation. A language-driven semantic segmentation model generates text-based masks for identifying landmarks and terrain types in images. By translating 2D image points to the vehicle's motion plane using camera parameters, an MPC controller can guides the vehicle towards the desired terrain. This approach enhances adaptation to diverse environments and facilitates the use of high-level instructions for navigating complex and challenging terrains.


title: Large curvature fluctuations from no-scale supergravity with a spectator field

abstract: We investigate the large curvature perturbations which can lead to the formation of primordial black holes (PBHs) in the context of no-scale supergravity. Our study does not depend on any exotic scenario, such as scalar potentials with inflection points or bulks, and aims to avoid the fine-tuning of model parameters to achieve the formation of PBHs. This formation relies on the quantum fluctuations of a light spectator stochastic field after the inflationary period. Our analysis is based on the SU(2,1)/SU(2)$\times$U(1) symmetry, considering both the inflaton and the spectator field. Specifically, we examine existing no-scale models with Starobinsky-like scalar potentials that are consistent with observable constraints on inflation from measurements of the cosmic microwave background (CMB). These models involve two chiral fields: the inflaton and the modulus field. We propose a novel role for the modulus field as a spectator field, responsible for generating PBHs. Our hypothesis suggests that while the inflaton field satisfies the CMB constraints of inflation, it is the modulus field acting as the spectator that leads to large curvature perturbations, capable to explain the production of PBHs. Additionally, we prioritize retaining the inflationary constraints from the CMB through the consideration of spectator fluctuations. Therefore, by exploring the relationship between these fields within the framework of the SU(2,1)/SU(2)$\times$U(1) symmetry, our aim is to unveil their implications for the formation of PBHs.


title: Quantum Flux and Quantum Ergodicity for Cross Sections

abstract: For sequences of quantum ergodic eigenfunctions, we define the quantum flux norm associated to a codimension $1$ submanifold $\Sigma$ of a non-degenerate energy surface. We prove restrictions of eigenfunctions to $\Sigma$, realized using the quantum flux norm, are quantum ergodic. We compare this result to known results from \cite{CTZ} in the case of Euclidean domains and hyperfurfaces. As a further application, we consider complexified analytic eigenfunctions and prove a second microlocal analogue of \cite{CTZ} in that context.


title: Kaon mixing beyond the standard model with physical masses

abstract: We present non-perturbative results for beyond the standard model kaon mixing matrix elements in the isospin symmetric limit ($m_u=m_d$) of QCD, including a complete estimate of all dominant sources of systematic error. Our results are obtained from numerical simulations of lattice QCD with $N_f = 2+1$ flavours of dynamical domain wall fermions. For the first time, these quantities are simulated directly at the physical pion mass $m_\pi$~$\sim$~$139\,\mathrm{MeV}$ for two different lattice spacings. We include data at three lattice spacings in the range $a = 0.11 $ - $ 0.07\,\mathrm{fm}$ and with pion masses ranging from the physical value up to 450$\,\mathrm{MeV}$. Compared to our earlier work, we have added both direct calculations at physical quark masses and a third lattice spacing making the removal of discretisation effects significantly more precise and eliminating the need for any significant mass extrapolation beyond the range of simulated data. We renormalise the lattice operators non-perturbatively using RI-SMOM off-shell schemes. These schemes eliminate the need to model and subtract non-perturbative pion poles that arises in the RI-MOM scheme and, since the calculations are performed with domain wall fermions, the unphysical mixing between chirality sectors is suppressed. Our results for the bag parameters in the $\overline{\mathrm{MS}}$ scheme at $3\,\mathrm{GeV}$ are $B_K~\equiv~\mathcal{B}_1 = 0.5240(17)(54)$, $\mathcal{B}_2 = 0.4794(25)(35)$, $\mathcal{B}_3 = 0.746(13)(17)$, $\mathcal{B}_4 = 0.897(02)(10)$ and $\mathcal{B}_5 = 0.6882(78)(94)$, where the first error is from lattice uncertainties and the second is the uncertainty due to the perturbative matching to $\overline{\mathrm{MS}}$.


title: Output Feedback Periodic Event-triggered Control of Coupled $2\times 2$ Linear Hyperbolic PDEs

abstract: This article introduces an observer-based periodic event-triggered control (PETC) strategy for boundary control of a system characterized by $2\times2$ linear hyperbolic partial differential equations (PDEs). An anti-collocated actuation and sensing configuration is considered, and an exponentially convergent observer for state estimation from boundary data is designed. Initially, a continuous-time dynamic event-triggering mechanism requiring constant monitoring of the triggering function is developed. This mechanism is subsequently adapted into a periodic event-triggering scheme, which necessitates only periodic monitoring to identify when the control input needs updating. The underlying control approach is the PDE backstepping boundary control, implemented in a zero-order hold manner between events. This result marks a substantial improvement over conventional observer-based continuous-time event-triggered control for linear coupled hyperbolic PDEs by removing the requirement for constant monitoring of the triggering function. With the triggering function evaluated periodically, the closed-loop system is inherently free from Zeno behavior. It is demonstrated that under the proposed PETC, the closed-loop system globally exponentially converges to zero in the spatial $L^2$ norm. A simulation study illustrating the theoretical results is presented.


title: "Beam `a la carte": laser heater shaping for attosecond pulses in a multiplexed x-ray free-electron laser

abstract: Electron beam shaping allows the control of the temporal properties of x-ray free-electron laser pulses from femtosecond to attosecond timescales. Here we demonstrate the use of a laser heater to shape electron bunches and enable the generation of attosecond x-ray pulses. We demonstrate that this method can be applied in a selective way, shaping a targeted subset of bunches while leaving the remaining bunches unchanged. This experiment enables the delivery of shaped x-ray pulses to multiple undulator beamlines, with pulse properties tailored to specialized scientific applications.


title: CATGNN: Cost-Efficient and Scalable Distributed Training for Graph Neural Networks

abstract: Graph neural networks have been shown successful in recent years. While different GNN architectures and training systems have been developed, GNN training on large-scale real-world graphs still remains challenging. Existing distributed systems load the entire graph in memory for graph partitioning, requiring a huge memory space to process large graphs and thus hindering GNN training on such large graphs using commodity workstations. In this paper, we propose CATGNN, a cost-efficient and scalable distributed GNN training system which focuses on scaling GNN training to billion-scale or larger graphs under limited computational resources. Among other features, it takes a stream of edges as input, instead of loading the entire graph in memory, for partitioning. We also propose a novel streaming partitioning algorithm named SPRING for distributed GNN training. We verify the correctness and effectiveness of CATGNN with SPRING on 16 open datasets. In particular, we demonstrate that CATGNN can handle the largest publicly available dataset with limited memory, which would have been infeasible without increasing the memory space. SPRING also outperforms state-of-the-art partitioning algorithms significantly, with a 50% reduction in replication factor on average.


title: The edge code of hypergraphs

abstract: Given a hypergraph $\mathcal{H}$, we introduce a new class of evaluation toric codes called edge codes derived from $\mathcal{H}$. We analyze these codes, focusing on determining their basic parameters. We provide estimations for the minimum distance, particularly in scenarios involving $d$-uniform clutters. Additionally, we demonstrate that these codes exhibit self-orthogonality. Furthermore, we compute the minimum distances of edge codes for all graphs with five vertices.


title: Curvature homogeneous hypersurfaces in space forms

abstract: We classify curvature homogeneous hypersurfaces in S^4 and H^4. In higher dimesnsion one only has the FKM examples and an isolate one by Tsukada of a hypersurface in H^5. Besides some simple examples, we show that there exists an isolated hypersurface with a circle of symmetries and and a one parameter family admitting no continuous symmetries. Outside the set of minimal points, which only exists in the case of S^4, every example is locally and up to covers of this form.


title: Physical properties of circumnuclear ionising clusters. III. Kinematics of gas and stars in NGC 7742

abstract: In this third paper of a series, we study the kinematics of the ionised gas and stars, calculating the dynamical masses of the circumnuclear star-forming regions in the ring of of the face-on spiral NGC 7742. We have used high spectral resolution data from the MEGARA instrument attached to the Gran Telescopio Canarias (GTC) to measure the kinematical components of the nebular emission lines of selected HII regions and the stellar velocity dispersions from the CaT absorption lines that allow the derivation of the associated cluster virialized masses. The emission line profiles show two different kinematical components: a narrow one with velocity dispersion $\sim$ 10 km/s and a broad one with velocity dispersion similar to those found for the stellar absorption lines. The derived star cluster dynamical masses range from 2.5 $\times$ 10$^6$ to 10.0 $\times$ 10$^7$ M$_\odot$. The comparison of gas and stellar velocity dispersions suggests a scenario where the clusters have formed simultaneously in a first star formation episode with a fraction of the stellar evolution feedback remaining trapped in the cluster, subject to the same gravitational potential as the cluster stars. Between 0.15 and 7.07 % of the total dynamical mass of the cluster would have cooled down and formed a new, younger, population of stars, responsible for the ionisation of the gas currently observed.


title: Virtual Sensor for Real-Time Bearing Load Prediction Using Heterogeneous Temporal Graph Neural Networks

abstract: Accurate bearing load monitoring is essential for their Prognostics and Health Management (PHM), enabling damage assessment, wear prediction, and proactive maintenance. While bearing sensors are typically placed on the bearing housing, direct load monitoring requires sensors inside the bearing itself. Recently introduced sensor rollers enable direct bearing load monitoring but are constrained by their battery life. Data-driven virtual sensors can learn from sensor roller data collected during a batterys lifetime to map operating conditions to bearing loads. Although spatially distributed bearing sensors offer insights into load distribution (e.g., correlating temperature with load), traditional machine learning algorithms struggle to fully exploit these spatial-temporal dependencies. To address this gap, we introduce a graph-based virtual sensor that leverages Graph Neural Networks (GNNs) to analyze spatial-temporal dependencies among sensor signals, mapping existing measurements (temperature, vibration) to bearing loads. Since temperature and vibration signals exhibit vastly different dynamics, we propose Heterogeneous Temporal Graph Neural Networks (HTGNN), which explicitly models these signal types and their interactions for effective load prediction. Our results demonstrate that HTGNN outperforms Convolutional Neural Networks (CNNs), which struggle to capture both spatial and heterogeneous signal characteristics. These findings highlight the importance of capturing the complex spatial interactions between temperature, vibration, and load.


title: Collapse of Self-trained Language Models

abstract: In various fields of knowledge creation, including science, new ideas often build on pre-existing information. In this work, we explore this concept within the context of language models. Specifically, we explore the potential of self-training models on their own outputs, akin to how humans learn and build on their previous thoughts and actions. While this approach is intuitively appealing, our research reveals its practical limitations. We find that extended self-training of the GPT-2 model leads to a significant degradation in performance, resulting in repetitive and collapsed token output.


title: Derivation and analysis of a nonlocal Hele-Shaw-Cahn-Hilliard system for flow in thin heterogeneous layers

abstract: We derive, through the deterministic homogenization theory in thin domains, a new model consisting of Hele-Shaw equation with memory coupled with the convective Cahn-Hilliard equation. The obtained system, which models in particular tumor growth, is then analyzed and we prove its well-posedness in dimension 2. To achieve our goal, we develop and use the new concept of sigma-convergence in thin heterogeneous media, and we prove some regularity results for the upscaled model.


title: Thermoelectric Properties of Graphene through BN-ring Doping: A Theoretical Investigation

abstract: Graphene has been widely studied for various applications due to its outstanding electrical and mechanical properties. However, its potential in thermoelectric applications has been limited by a low Seebeck coefficient and high thermal conductivity. Efforts to enhance its thermoelectric properties have involved the usage of carbon-based nanoribbons, strain engineering, and heteroatom co-doping, particularly with Nitrogen and/or Boron atoms. In this work, multiscale simulation approaches combining DFT calculations and semi-empirical models are used to explore the potential improvement of the thermoelectric properties via borazine (B$_3$N$_3$)-ring doping. As bandgap engineering can be obtained with this doping, the thermoelectric properties of graphene are significantly enlarged, albeit at the cost of reduced conductance. The effects observed are not only dependent on the concentration of BN within the graphene lattice but are also notably influenced by the relative rotational alignment of the BN rings. Furthermore, the effect of the distribution and rotational disorder are considered, showing reduced electronic conductance compared to the periodic case highlighting the importance of precise control over the doping parameters of BN-ring. Lastly, the thermal lattice conductance is estimated revealing a substantial reduction of up to 40$\%$ compared to pristine graphene opening up the possibility of enhancing the thermoelectric efficiency of BNC materials. The present theoretical approach highlights how BN-ring doping can refine the thermoelectric properties of 2D graphene, offering a pathway for enhancing its suitability in practical thermoelectric applications.


title: The $2$-torsion of determinantal hypertrees is not Cohen-Lenstra

abstract: Let $T_n$ be a $2$-dimensional determinantal hypertree on $n$ vertices. Kahle and Newman conjectured that the $p$-torsion of $H_1(T_n,\mathbb{Z})$ asymptotically follows the Cohen-Lenstra distribution. For $p=2$, we disprove this conjecture by showing that given a positive integer $h$, for all large enough $n$, we have \[\mathbb{P}(\dim H_1(T_n,\mathbb{F}_2)\ge h)\ge \frac{e^{-200h}}{(100h)^{5h}}.\] We also show that $T_n$ is a bad cosystolic expander with positive probability.


title: A Survey of Web Content Control for Generative AI

abstract: The groundbreaking advancements around generative AI have recently caused a wave of concern culminating in a row of lawsuits, including high-profile actions against Stability AI and OpenAI. This situation of legal uncertainty has sparked a broad discussion on the rights of content creators and publishers to protect their intellectual property on the web. European as well as US law already provides rough guidelines, setting a direction for technical solutions to regulate web data use. In this course, researchers and practitioners have worked on numerous web standards and opt-out formats that empower publishers to keep their data out of the development of generative AI models. The emerging AI/ML opt-out protocols are valuable in regards to data sovereignty, but again, it creates an adverse situation for a site owners who are overwhelmed by the multitude of recent ad hoc standards to consider. In our work, we want to survey the different proposals, ideas and initiatives, and provide a comprehensive legal and technical background in the context of the current discussion on web publishers control.


title: Perspicacious $l_p$ norm parameters

abstract: Fix $t\in [1,\infty]$. Let $S$ be an atomic commutative semigroup and, for all $x\in S$, let $\mathscr{L}_t(S):=\{\|f\|_t:f\in Z(x)\}$ be the "$t$-length set" of $x$ (using the standard $l_p$-space definition of $\|\cdot\|_t$). The $t$-Delta set of $x$ (denoted $\Delta_t(S)$) is the set of gaps between consecutive elements of $\mathscr{L}_t(S)$; the Delta set of $S$ is then defined by $\bigcup\limits_{x\in S} \Delta_t(S)$. Though all existing literature on this topic considers the $1$-Delta set, recent results on the $t$-elasticity of Numerical Semigroups (Behera et. al.) for $t\neq 1$ have brought attention to other invariants, such as the $t$-Delta set for $t\neq 1$, as well. Here we characterize $\Delta_t(S)$ for all numerical semigroups $\langle a_1,a_2\rangle$ and all $t\in(1,\infty)$ outside a small family of extremal examples. We also determine the cardinality and describe the distribution of that aberrant family.


title: A Classification of the flag-transitive $2$-$(v,k,2)$ designs

abstract: In this paper, we provide a complete classification of $2$-$(v,k,2)$ design admitting a flag-transitive automorphism group of affine type with the only exception of the semilinear $1$-dimensional group. Alongside this analysis we provide a construction of seven new families of such flag-transitive $2$-designs, two of them infinite, and some of them involve remarkable objects such as $t$-spreads, translation planes, quadrics and Segre varieties. Our result together with those Alavi et al. [1,2], Praeger et al. [15], Zhou and the first author [37,38] provides a complete classification of $2$-$(v,k,2)$ design admitting a flag-transitive automorphism group with the only exception of the semilinear $1$-dimensional case.


title: Resource-consumer dynamics in drylands: modeling the role of plant-plant facilitation-competition shifts with a piecewise system

abstract: In drylands, water availability determines plant population densities and whether they cooperate via facilitation or compete. When water scarcity intensifies, plant densities decrease and competition for water surpasses the benefits of soil improvement by facilitator plants, involving an abrupt shift from facilitation to competition. Here, we model this facilitation-competition shift using a piecewise system in a resource species such as grasses studying its impact on a resource-consumer dynamical system. First, the dynamics of each system are introduced separately. The competitive system, by setting conditions to have a monodromic equilibrium in the first quadrant, has no limit cycles. With a monodromy condition in the same quadrant, the cooperative system only has a hyperbolic, small amplitude limit cycle, allowing for an oscillating coexistence. The dynamic properties of the piecewise system become richer. We here prove the extension of the center-focus problem in this particular case, and from a weak focus of order three, we find 3 limit cycles arising from it. We also study the case assuming continuity in the piecewise system. Finally, we present a special and restricted way of obtaining a limit cycle of small amplitude in a pseudo-Hopf bifurcation type. Our results suggest that abrupt density-dependent functional shifts, such as those described in drylands, could introduce novel dynamical phenomena. Our work also provides a theoretical framework to model and investigate sharp density-dependent processes in Ecology.


title: Optimal combination of composite likelihoods using approximate Bayesian computation with application to state-space models

abstract: Composite likelihood provides approximate inference when the full likelihood is intractable and sub-likelihood functions of marginal events can be evaluated relatively easily. It has been successfully applied for many complex models. However, its wider application is limited by two issues. First, weight selection of marginal likelihood can have a significant impact on the information efficiency and is currently an open question. Second, calibrated Bayesian inference with composite likelihood requires curvature adjustment which is difficult for dependent data. This work shows that approximate Bayesian computation (ABC) can properly address these two issues by using multiple composite score functions as summary statistics. First, the summary-based posterior distribution gives the optimal Godambe information among a wide class of estimators defined by linear combinations of estimating functions. Second, to make ABC computationally feasible for models where marginal likelihoods have no closed form, a novel approach is proposed to estimate all simulated marginal scores using a Monte Carlo sample with size N. Sufficient conditions are given for the additional noise to be negligible with N fixed as the data size n goes to infinity, and the computational cost is O(n). Third, asymptotic properties of ABC with summary statistics having heterogeneous convergence rates is derived, and an adaptive scheme to choose the component composite scores is proposed. Numerical studies show that the new method significantly outperforms the existing Bayesian composite likelihood methods, and the efficiency of adaptively combined composite scores well approximates the efficiency of particle MCMC using the full likelihood.


title: Is Meta-training Really Necessary for Molecular Few-Shot Learning ?

abstract: Few-shot learning has recently attracted significant interest in drug discovery, with a recent, fast-growing literature mostly involving convoluted meta-learning strategies. We revisit the more straightforward fine-tuning approach for molecular data, and propose a regularized quadratic-probe loss based on the the Mahalanobis distance. We design a dedicated block-coordinate descent optimizer, which avoid the degenerate solutions of our loss. Interestingly, our simple fine-tuning approach achieves highly competitive performances in comparison to state-of-the-art methods, while being applicable to black-box settings and removing the need for specific episodic pre-training strategies. Furthermore, we introduce a new benchmark to assess the robustness of the competing methods to domain shifts. In this setting, our fine-tuning baseline obtains consistently better results than meta-learning methods.


title: Evolution of Berry Phase and Half-Metallicity in Cr$_2$Te$_3$ in Response to Strain, Filling, Thickness, and Surface Termination

abstract: Cr$_2$Te$_3$ is a ferromagnetic, quasi-two-dimensional layered material with perpendicular magnetic anisotropy, strong spin-orbit coupling, and non-trivial band topology. The non-trivial topology results in an intrinsic anomalous Hall conductivity (AHC) that switches sign under filling and biaxial strain. Thin films can exhibit half metallicity. Using density functional theory combined with maximally localized Wannier functions, we reveal the physical origins of the sensitivity of the sign of the AHC to strain and filling, and we determine the effect of surface termination on the half metallicity. We find that thin films terminated on the Te layers are the most energetically stable, but only the thin films terminated on both sides with the partially occupied Cr layers are half metals. In bulk Cr$_2$Te$_3$, the sensitivity of the sign of the AHC to strain and filling results from the complex Fermi surface comprised of three bands. Filling of local minima and bands near anti-crossings alters the local Berry curvature consistent with the negative to positive switching of the AHC. Similarly, strain depopulates a local minimum, shifts a degenerate point closer to the Fermi energy, and causes two spin-orbit split bands to reverse their order. These findings provide a physical understanding of the evolution of the Berry phase, AHC, and half-metallicity in Cr$_2$Te$_3$.


title: Circle radius distributions determine random close packing density

abstract: Circles of a single size can pack together densely in a hexagonal lattice, but adding in size variety disrupts the order of those packings. We conduct simulations which generate dense random packings of circles with specified size distributions, and measure the area fraction in each case. While the size distributions can be arbitrary, we find that for a wide range of size distributions the random close packing area fraction $\phi_{rcp}$ is determined to high accuracy by the polydispersity and skewness of the size distribution. At low skewness, all packings tend to a minimum packing fraction $\phi_0 \approx 0.840$ independent of polydispersity. In the limit of high skewness, $\phi_{rcp}$ becomes independent of skewness, asymptoting to a polydispersity-dependent limit. We show how these results can be predicted from the behavior of simple, bidisperse or bi-Gaussian circle size distributions.


title: From Delays to Densities: Exploring Data Uncertainty through Speech, Text, and Visualization

abstract: Understanding and communicating data uncertainty is crucial for making informed decisions in sectors like finance and healthcare. Previous work has explored how to express uncertainty in various modes. For example, uncertainty can be expressed visually with quantile dot plots or linguistically with hedge words and prosody. Our research aims to systematically explore how variations within each mode contribute to communicating uncertainty to the user; this allows us to better understand each mode's affordances and limitations. We completed an exploration of the uncertainty design space based on pilot studies and ran two crowdsourced experiments examining how speech, text, and visualization modes and variants within them impact decision-making with uncertain data. Visualization and text were most effective for rational decision-making, though text resulted in lower confidence. Speech garnered the highest trust despite sometimes leading to risky decisions. Results from these studies indicate meaningful trade-offs among modes of information and encourage exploration of multimodal data representations.


title: ZeroCAP: Zero-Shot Multi-Robot Context Aware Pattern Formation via Large Language Models

abstract: Incorporating language comprehension into robotic operations unlocks significant advancements in robotics, but also presents distinct challenges, particularly in executing spatially oriented tasks like pattern formation. This paper introduces ZeroCAP, a novel system that integrates large language models with multi-robot systems for zero-shot context aware pattern formation. Grounded in the principles of language-conditioned robotics, ZeroCAP leverages the interpretative power of language models to translate natural language instructions into actionable robotic configurations. This approach combines the synergy of vision-language models, cutting-edge segmentation techniques and shape descriptors, enabling the realization of complex, context-driven pattern formations in the realm of multi robot coordination. Through extensive experiments, we demonstrate the systems proficiency in executing complex context aware pattern formations across a spectrum of tasks, from surrounding and caging objects to infilling regions. This not only validates the system's capability to interpret and implement intricate context-driven tasks but also underscores its adaptability and effectiveness across varied environments and scenarios. More details about this work are available at: https://sites.google.com/view/zerocap/home


title: Prompts As Programs: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization

abstract: Large language models (LLMs) can now handle longer and more complex inputs, which facilitate the use of more elaborate prompts. However, prompts often require some tuning to improve performance for deployment. Recent work has proposed automatic prompt optimization methods, but as prompt complexity and LLM strength increase, many prompt optimization techniques are no longer sufficient and a new approach is needed to optimize {\em meta prompt programs}. To address this, we introduce SAMMO, a framework for {\em compile-time} optimizations of metaprompt programs, which represent prompts as structured objects that allows for a rich set of transformations that can be searched over during optimization. We show that SAMMO generalizes previous methods and improves the performance of complex prompts on (1) instruction tuning, (2) RAG pipeline tuning, and (3) prompt compression, across several different LLMs. We make all code available open-source at https://github.com/microsoft/sammo .


title: On Properties of Adjoint Systems for Evolutionary PDEs

abstract: We investigate the geometric structure of adjoint systems associated with evolutionary partial differential equations at the fully continuous, semi-discrete, and fully discrete levels and the relations between these levels. We show that the adjoint system associated with an evolutionary partial differential equation has an infinite-dimensional Hamiltonian structure, which is useful for connecting the fully continuous, semi-discrete, and fully discrete levels. We subsequently address the question of discretize-then-optimize versus optimize-then-discrete for both semi-discretization and time integration, by characterizing the commutativity of discretize-then-optimize methods versus optimize-then-discretize methods uniquely in terms of an adjoint-variational quadratic conservation law. For Galerkin semi-discretizations and one-step time integration methods in particular, we explicitly construct these commuting methods by using structure-preserving discretization techniques.


title: Exploring Substructure of the Near-Surface Shear Layer of the Sun

abstract: The gradient of rotation in the near-surface shear layer (NSSL) of the Sun provides valuable insights into the dynamics associated with the solar activity cycle and the dynamo. Results obtained with global oscillation mode-splittings lack resolution near the surface, prompting the use of the local helioseismic ring-diagram method. While the Helioseismic and Magnetic Imager ring-analysis pipeline has been used previously for analyzing this layer, default pipeline parameters limit the accuracy of the near-surface gradients. To address these challenges, we fitted the flow parameters to power spectra averaged over one-year periods at each location, followed by additional averaging over 12 years. We find that the NSSL can be divided into three fairly distinct regions: a deeper, larger region with small shear, steepening towards the surface; a narrow middle layer with a strong shear, with a gradient approximately three times larger; and a layer very close to the surface, where the logarithmic gradient is close to zero but becomes steeper again towards the surface. The middle layer appears to be centered at 3 Mm, but the poor resolution in these layers implies that it is potentially located closer to the surface, around 1.5 Mm deep. While our analysis primarily focused on regions along the central meridian, we also investigated systematic errors at longitudes off the center. The east-west antisymmetric component of the gradient reveals a layer of substantial differences between east and west longitude around at 1.7 Mm, and the amplitude of the differences increases with longitude.


title: Bounds and Limiting Minimizers for a Family of Interaction Energies

abstract: We study a two parameter family of energy minimization problems for interaction energies $\mathcal{E}_{\alpha,\beta}$ with attractive-repulsive potential $W_{\alpha,\beta}$. We develop a concavity principle, which allows us to provide a lower bound on $\mathcal{E}_{\alpha,\beta}$ if there exist $\beta_0<\beta<\beta_1$ with minimizers of $\mathcal{E}_{\alpha,\beta_0}$ and $\mathcal{E}_{\alpha,\beta_1}$ known. In addition to this, we also derive new conclusions about the limiting behaviour of $\mathcal{E}_{\alpha,\beta}$ for $\beta\approx 2.$ Finally, we describe a method to show that, for certain values of $(\alpha,\beta),$ $\mathcal{E}_{\alpha,\beta}$ cannot be minimized by the uniform distribution over a top-dimensional regular unit simplex. Our results are made possible by two key factors -- recent progress in identifying minimizers of $\mathcal{E}_{\alpha,\beta}$ for a range of $\alpha$ and $\beta$, and an analysis of $\inf\mathcal{E}_{\alpha,\beta}$ as a function on parameter space.


title: Toward Informal Language Processing: Knowledge of Slang in Large Language Models

abstract: Recent advancement in large language models (LLMs) has offered a strong potential for natural language systems to process informal language. A representative form of informal language is slang, used commonly in daily conversations and online social media. To date, slang has not been comprehensively evaluated in LLMs due partly to the absence of a carefully designed and publicly accessible benchmark. Using movie subtitles, we construct a dataset that supports evaluation on a diverse set of tasks pertaining to automatic processing of slang. For both evaluation and finetuning, we show the effectiveness of our dataset on two core applications: 1) slang detection, and 2) identification of regional and historical sources of slang from natural sentences. We also show how our dataset can be used to probe the output distributions of LLMs for interpretive insights. We find that while LLMs such as GPT-4 achieve good performance in a zero-shot setting, smaller BERT-like models finetuned on our dataset achieve comparable performance. Furthermore, we show that our dataset enables finetuning of LLMs such as GPT-3.5 that achieve substantially better performance than strong zero-shot baselines. Our work offers a comprehensive evaluation and a high-quality benchmark on English slang based on the OpenSubtitles corpus, serving both as a publicly accessible resource and a platform for applying tools for informal language processing.


title: Learning from Demonstration Framework for Multi-Robot Systems Using Interaction Keypoints and Soft Actor-Critic Methods

abstract: Learning from Demonstration (LfD) is a promising approach to enable Multi-Robot Systems (MRS) to acquire complex skills and behaviors. However, the intricate interactions and coordination challenges in MRS pose significant hurdles for effective LfD. In this paper, we present a novel LfD framework specifically designed for MRS, which leverages visual demonstrations to capture and learn from robot-robot and robot-object interactions. Our framework introduces the concept of Interaction Keypoints (IKs) to transform the visual demonstrations into a representation that facilitates the inference of various skills necessary for the task. The robots then execute the task using sensorimotor actions and reinforcement learning (RL) policies when required. A key feature of our approach is the ability to handle unseen contact-based skills that emerge during the demonstration. In such cases, RL is employed to learn the skill using a classifier-based reward function, eliminating the need for manual reward engineering and ensuring adaptability to environmental changes. We evaluate our framework across a range of mobile robot tasks, covering both behavior-based and contact-based domains. The results demonstrate the effectiveness of our approach in enabling robots to learn complex multi-robot tasks and behaviors from visual demonstrations.


title: Heat Death of Generative Models in Closed-Loop Learning

abstract: Improvement and adoption of generative machine learning models is rapidly accelerating, as exemplified by the popularity of LLMs (Large Language Models) for text, and diffusion models for image generation.As generative models become widespread, data they generate is incorporated into shared content through the public web. This opens the question of what happens when data generated by a model is fed back to the model in subsequent training campaigns. This is a question about the stability of the training process, whether the distribution of publicly accessible content, which we refer to as "knowledge", remains stable or collapses. Small scale empirical experiments reported in the literature show that this closed-loop training process is prone to degenerating. Models may start producing gibberish data, or sample from only a small subset of the desired data distribution (a phenomenon referred to as mode collapse). So far there has been only limited theoretical understanding of this process, in part due to the complexity of the deep networks underlying these generative models. The aim of this paper is to provide insights into this process (that we refer to as "generative closed-loop learning") by studying the learning dynamics of generative models that are fed back their own produced content in addition to their original training dataset. The sampling of many of these models can be controlled via a "temperature" parameter. Using dynamical systems tools, we show that, unless a sufficient amount of external data is introduced at each iteration, any non-trivial temperature leads the model to asymptotically degenerate. In fact, either the generative distribution collapses to a small set of outputs, or becomes uniform over a large set of outputs.


title: Integrability of Nonabelian Differential-Difference Equations: the Symmetry Approach

abstract: We propose a novel approach to tackle integrability problem for evolutionary differential-difference equations (D$\Delta$Es) on free associative algebras, also referred to as nonabelian D$\Delta$Es. This approach enables us to derive necessary integrability conditions, determine the integrability of a given equation, and make progress in the classification of integrable nonabelian D$\Delta$Es. This work involves establishing symbolic representations for the nonabelian difference algebra, difference operators, and formal series, as well as introducing a novel quasi-local extension for the algebra of formal series within the context of symbolic representations. Applying this formalism, we solve the classification problem of integrable skew-symmetric quasi-linear nonabelian equations of orders $(-1,1)$, $(-2,2)$, and $(-3,3)$, consequently revealing some new equations in the process.


title: Robust Constrained Consensus and Inequality-constrained Distributed Optimization with Guaranteed Differential Privacy and Accurate Convergence

abstract: We address differential privacy for fully distributed optimization subject to a shared inequality constraint. By co-designing the distributed optimization mechanism and the differential-privacy noise injection mechanism, we propose the first distributed constrained optimization algorithm that can ensure both provable convergence to a global optimal solution and rigorous $\epsilon$-differential privacy, even when the number of iterations tends to infinity. Our approach does not require the Lagrangian function to be strictly convex/concave, and allows the global objective function to be non-separable. As a byproduct of the co-design, we also propose a new constrained consensus algorithm that can achieve rigorous $\epsilon$-differential privacy while maintaining accurate convergence, which, to our knowledge, has not been achieved before. Numerical simulation results on a demand response control problem in smart grid confirm the effectiveness of the proposed approach.


title: Local spin structure in the layered van der Waals materials MnPS$_{x}$Se$_{3-x}$

abstract: Two-dimensional (2D) layered materials, whether in bulk form or reduced to just a single layer, have potential applications in spintronics and capacity for advanced quantum phenomena. A prerequisite for harnessing these opportunities lies in gaining a comprehensive understanding of the spin behavior in 2D materials. The low dimensionality motivates an understanding of the spin correlations over a wide length scale, from local to long range order. In this context, we focus on the magnetism in bulk \MPSe ~and \MPS, 2D layered van der Waals antiferromagnetic semiconductors. These materials have similar honeycomb Mn layers and magnetic ordering temperatures, but distinct spin orientations and exchange interactions. We utilize neutron scattering to gain deeper insights into the local magnetic structures and spin correlations in the paramagnetic and ordered phases by systematically investigating a MnPS$_{x}$Se$_{3-x}$ ($x$ = 0, 1, 1.5, 2, 3) series of powder samples using total neutron scattering measurements. By employing magnetic pair distribution function (mPDF) analysis, we unraveled the short-range magnetic correlations in these materials and explored how the non-magnetic anion S/Se mixing impacts the magnetic correlations. The results reveal that the magnetism can be gradually tuned through alteration of the non-magnetic S/Se content, which tunes the atomic structure. The change in magnetic structure is also accompanied by a control of the magnetic correlation length within the 2D honeycomb layers. Complimentary inelastic neutron scattering measurements allowed a quantification of the change in the magnetic exchange interactions for the series and further highlighted the gradual evolution of spin interactions in the series MnPS$_{x}$Se$_{3-x}$.


title: The Least Prime in Arithmetic an Progression

abstract: In his 1979 paper Samuel Wagstaff studied the problem of bounding the first prime in an arithmetic progression. In this paper we update a number of his computations using advances in hardware. Based on this we refine his conjecture on Primes in Arithmetic Progression and provide further numerical evidence in support of it. For instance we conjecture that for $n>3$ we have a bound of $3\phi(n)\log(n)\log(\phi(n))$ and verified this bound to $10^8$.


title: Comparative Study of Domain Driven Terms Extraction Using Large Language Models

abstract: Keywords play a crucial role in bridging the gap between human understanding and machine processing of textual data. They are essential to data enrichment because they form the basis for detailed annotations that provide a more insightful and in-depth view of the underlying data. Keyword/domain driven term extraction is a pivotal task in natural language processing, facilitating information retrieval, document summarization, and content categorization. This review focuses on keyword extraction methods, emphasizing the use of three major Large Language Models(LLMs): Llama2-7B, GPT-3.5, and Falcon-7B. We employed a custom Python package to interface with these LLMs, simplifying keyword extraction. Our study, utilizing the Inspec and PubMed datasets, evaluates the performance of these models. The Jaccard similarity index was used for assessment, yielding scores of 0.64 (Inspec) and 0.21 (PubMed) for GPT-3.5, 0.40 and 0.17 for Llama2-7B, and 0.23 and 0.12 for Falcon-7B. This paper underlines the role of prompt engineering in LLMs for better keyword extraction and discusses the impact of hallucination in LLMs on result evaluation. It also sheds light on the challenges in using LLMs for keyword extraction, including model complexity, resource demands, and optimization techniques.


title: Replica Wormholes and Quantum Hair

abstract: We discuss recent applications of Euclidean path integrals to the black hole information problem. In calculations with replica wormholes as the next-to-leading order correction to the Gibbons-Hawking saddlepoint, the radiation density matrix approaches a pure state at late times, following the Page curve. We compare unitary evaporation of black holes (in real time), mediated by calculable quantum hair effects, with the replica wormhole results. Both replica wormhole and quantum hair approaches imply that radiation states are macroscopic superpositions of spacetime backgrounds, invalidating firewall and monogamy of entanglement constructions. Importantly, identification of modes inside the horizon with radiation modes (i.e., large scale nonlocality across the horizon) is not required to provide a physical picture of unitary evaporation. Radiation modes can encode the interior information while still remaining independent degrees of freedom.


title: Unmasking Correlations in Nuclear Cross Sections with Graph Neural Networks

abstract: In this work, we explore the use of deep learning techniques to learn the relationships between nuclear cross-sections across the chart of isotopes. As a proof of principle, we focus on the neutron-induced reactions in the fast energy regime that are the most important in nuclear science and engineering. We use variational autoencoders (VAEs) and implicit neural representations (INRs) to build a learned feature representation space of nuclear cross sections and reduce the dimensionality of the problem. We then train graph neural networks (GNNs) on the resulting latent space to leverage the topological information encoded in the chart of isotopes and to capture the relationships between cross sections in different nuclei. We find that hypernetworks based on INRs significantly outperforms VAEs in encoding nuclear cross-sections. This superiority is attributed to INR's ability to model complex, varying frequency details, which enables lower prediction errors when combined with GNNs. We also observe that GNN optimization is much more successful when performed in the latent space, whether using INRs or VAEs. However VAEs' continuous representation also allows for direct GNN training in the original input space. We leverage these representational learning techniques and successfully predict cross sections for a 17x17 block of nuclei with high accuracy and precision. These findings suggest that both representation encoding of cross-sections and the prediction task hold significant potential in augmenting nuclear theory models, e.g., providing reliable estimates of covariances of cross sections, including cross-material covariances.


title: No top-heavy stellar initial mass function needed: the ionizing radiation of GS9422 can be powered by a mixture of AGN and stars

abstract: JWST is producing high-quality rest-frame optical and UV spectra of faint galaxies at $z>4$ for the first time, challenging models of galaxy and stellar populations. One galaxy recently observed at $z=5.943$, GS9422, has nebular line and UV continuum emission that appears to require a high ionizing photon production efficiency. This has been explained with an exotic stellar initial mass function (IMF), 10-30x more top-heavy than a Salpeter IMF (Cameron et al. 2023). Here we suggest an alternate explanation to this exotic IMF. We use a new flexible neural net emulator for CLOUDY, Cue, to infer the shape of the ionizing spectrum directly from the observed emission line fluxes. By describing the ionizing spectrum with a piece-wise power-law, Cue is agnostic to the source of the ionizing photons. Cue finds that the ionizing radiation from GS9422 can be approximated by a double power law characterized by $\frac{Q_\mathrm{HeII}}{Q_\mathrm{H}} = -1.5$, which can be interpreted as a combination of young, metal-poor stars and a low-luminosity active galactic nucleus (AGN) with $F_{\nu} \propto \lambda ^ {2}$ in a 65%/35% ratio. This suggests a significantly lower nebular continuum contribution to the observed UV flux (24%) than a top-heavy IMF ($\gtrsim80$%), and hence, necessitates a damped Lyman-$\alpha$ absorber (DLA) to explain the continuum turnover bluewards of $\sim1400$ Angstrom. While current data cannot rule out either scenario, given the immense impact the proposed top-heavy IMF would have on models of galaxy formation, it is important to propose viable alternative explanations and to further investigate the nature of peculiar high-z nebular emitters.


title: cppdlr: Imaginary time calculations using the discrete Lehmann representation

abstract: We introduce cppdlr, a C++ library implementing the discrete Lehmann representation (DLR) of functions in imaginary time and Matsubara frequency, such as Green's functions and self-energies. The DLR is based on a low-rank approximation of the analytic continuation kernel, and yields a compact and explicit basis consisting of exponentials in imaginary time and simple poles in Matsubara frequency. cppdlr constructs the DLR basis and associated interpolation grids, and implements standard operations. It provides a flexible yet high-level interface, facilitating the incorporation of the DLR into both small-scale applications and existing large-scale software projects.

categories: physics.comp-ph cond-mat.str-el cs.NA math.NA


title: Multi-BERT: Leveraging Adapters and Prompt Tuning for Low-Resource Multi-Domain Adaptation

abstract: The rapid expansion of texts' volume and diversity presents formidable challenges in multi-domain settings. These challenges are also visible in the Persian name entity recognition (NER) settings. Traditional approaches, either employing a unified model for multiple domains or individual models for each domain, frequently pose significant limitations. Single models often struggle to capture the nuances of diverse domains, while utilizing multiple large models can lead to resource constraints, rendering the training of a model for each domain virtually impractical. Therefore, this paper introduces a novel approach composed of one core model with multiple sets of domain-specific parameters. We utilize techniques such as prompt tuning and adapters, combined with the incorporation of additional layers, to add parameters that we can train for the specific domains. This enables the model to perform comparably to individual models for each domain. Experimental results on different formal and informal datasets show that by employing these added parameters, the proposed model significantly surpasses existing practical models in performance. Remarkably, the proposed model requires only one instance for training and storage, yet achieves outstanding results across all domains, even surpassing the state-of-the-art in some. Moreover, we analyze each adaptation strategy, delineating its strengths, weaknesses, and optimal hyper-parameters for the Persian NER settings. Finally, we introduce a document-based domain detection pipeline tailored for scenarios with unknown text domains, enhancing the adaptability and practicality of this paper in real-world applications.


title: Observability of Nonlinear Dynamical Systems over Finite Fields

abstract: This paper discusses the observability of nonlinear Dynamical Systems over Finite Fields (DSFF) through the Koopman operator framework. In this work, given a nonlinear DSFF, we construct a linear system of the smallest dimension, called the Linear Output Realization (LOR), which can generate all the output sequences of the original nonlinear system through proper choices of initial conditions (of the associated LOR). We provide necessary and sufficient conditions for the observability of a nonlinear system and establish that the maximum number of outputs sufficient for computing the initial condition is precisely equal to the dimension of the LOR. Further, when the system is not known to be observable, we provide necessary and sufficient conditions for the unique reconstruction of initial conditions for specific output sequences.


title: Muon g-2 and lepton flavor violation in supersymmetric GUTs

abstract: We present a class of supersymmetric (SUSY) GUT models that can explain the apparent discrepancy between the SM predictions and experimental values of muon g-2 while providing testable signals for lepton flavor violation in charged lepton decays. Moreover, these models predict LSP neutralino abundance that is compatible with the Planck dark matter bounds. We find that scenarios in the framework of $SU(4)_c\times SU(2)_L\times SU(2)_R$ unification, with additional symmetries to explain fermion masses and neutrino oscillations, provide interesting benchmarks for the search of SUSY by correlating a possible manifestation of it in dark matter, rare lepton decays and LHC signals.


title: Why do people think liberals drink lattes? How social media afforded self-presentation can shape subjective social sorting

abstract: Social sorting, the alignment of social identities, affiliations, and/or preferences with partisan groups, can increase in-party attachment and decrease out-party tolerance. We propose that self-presentation afforded by social media profiles fosters subjective social sorting by shaping perceptions of alignments between non-political and political identifiers. Unlike previous work, we evaluate social sorting of naturally occurring, public-facing identifiers in social media profiles selected using a bottom-up approach. Using a sample of 50 million X users collected five times between 2016 and 2018, we identify users who define themselves politically and generate networks representing simultaneous co-occurrence of identifiers in profiles. We then systematically measure the alignment of non-political identifiers along political dimensions, revealing alignments that reinforce existing associations, reveal unexpected relationships, and reflect online and offline events. We find that while most identifiers bridge political divides, social sorting of identifiers along political lines is occurring to some degree in X profiles. Our results have implications for understanding the role of social media in facilitating (the perception of) polarization and polarization mitigation strategies such as bridging interventions and algorithms.


title: The Baryonic Tully-Fisher Relation I: WISE/Spitzer Photometry

abstract: We present WISE W1 photometry of the SPARC (Spitzer Photometry and Accurate Rotation Curves) sample. The baseline of near-IR fluxes is established for use by stellar mass models, a key component to the baryonic Tully-Fisher relation and other kinematic galaxies scaling relations. We focus this paper on determination of the characteristics of the W1 fluxes compared to IRAC 3.6 fluxes, internal accuracy limitations from photometric techniques, external accuracy by comparison to other work in the literature and the range of W1 to IRAC 3.6 colors. We outline the behavior of SDSS g, W1 and IRAC 3.6 colors with respect to underlying SED features. We also note a previously unknown correlation between WISE colors and the central surface brightness, probably related to the low metallicity of low surface brightness dwarfs.