title: Harnessing Orbital Hall Effect in Spin-Orbit Torque MRAM

abstract: Spin-Orbit Torque (SOT) Magnetic Random-Access Memory (MRAM) devices offer improved power efficiency, nonvolatility, and performance compared to static RAM, making them ideal, for instance, for cache memory applications. Efficient magnetization switching, long data retention, and high-density integration in SOT MRAM require ferromagnets (FM) with perpendicular magnetic anisotropy (PMA) combined with large torques enhanced by Orbital Hall Effect (OHE). We have engineered PMA [Co/Ni]$_3$ FM on selected OHE layers (Ru, Nb, Cr) and investigated the potential of theoretically predicted larger orbital Hall conductivity (OHC) to quantify the torque and switching current in OHE/[Co/Ni]$_3$ stacks. Our results demonstrate a $\sim$30\% enhancement in damping-like torque efficiency with a positive sign for the Ru OHE layer compared to a pure Pt, accompanied by a $\sim$20\% reduction in switching current for Ru compared to pure Pt across more than 250 devices, leading to more than a 60\% reduction in switching power. These findings validate the application of Ru in devices relevant to industrial contexts, supporting theoretical predictions regarding its superior OHC. This investigation highlights the potential of enhanced orbital torques to improve the performance of orbital-assisted SOT-MRAM, paving the way for next-generation memory technology.

categories: physics.app-ph cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.other


title: Identifying Climate Targets in National Laws and Policies using Machine Learning

abstract: Quantified policy targets are a fundamental element of climate policy, typically characterised by domain-specific and technical language. Current methods for curating comprehensive views of global climate policy targets entail significant manual effort. At present there are few scalable methods for extracting climate targets from national laws or policies, which limits policymakers' and researchers' ability to (1) assess private and public sector alignment with global goals and (2) inform policy decisions. In this paper we present an approach for extracting mentions of climate targets from national laws and policies. We create an expert-annotated dataset identifying three categories of target ('Net Zero', 'Reduction' and 'Other' (e.g. renewable energy targets)) and train a classifier to reliably identify them in text. We investigate bias and equity impacts related to our model and identify specific years and country names as problematic features. Finally, we investigate the characteristics of the dataset produced by running this classifier on the Climate Policy Radar (CPR) dataset of global national climate laws and policies and UNFCCC submissions, highlighting the potential of automated and scalable data collection for existing climate policy databases and supporting further research. Our work represents a significant upgrade in the accessibility of these key climate policy elements for policymakers and researchers. We publish our model at https://huggingface.co/ClimatePolicyRadar/national-climate-targets and related dataset at https://huggingface.co/datasets/ClimatePolicyRadar/national-climate-targets.


title: Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models

abstract: The ability of large language models (LLMs) to follow instructions is crucial to real-world applications. Despite recent advances, several studies have highlighted that LLMs struggle when faced with challenging instructions, especially those that include complex constraints, hindering their effectiveness in various tasks. To address this challenge, we introduce Conifer, a novel instruction tuning dataset, designed to enhance LLMs to follow multi-level instructions with complex constraints. Utilizing GPT-4, we curate the dataset by a series of LLM-driven refinement processes to ensure high quality. We also propose a progressive learning scheme that emphasizes an easy-to-hard progression, and learning from process feedback. Models trained with Conifer exhibit remarkable improvements in instruction-following abilities, especially for instructions with complex constraints. On several instruction-following benchmarks, our 7B model outperforms the state-of-the-art open-source 7B models, even exceeds the performance of models 10 times larger on certain metrics. All the code and Conifer dataset are available at https://www.github.com/ConiferLM/Conifer.


title: Anti-Coulomb ion-ion interactions: a theoretical and computational study

abstract: The free energy of ion solvation can be decomposed into enthalpic and entropic contributions. This helps to understand the connection between the dielectric properties and the underlying forces. We present a simple linear-response model of screened charge interactions that provides an alternative understanding of solvation barriers. Moreover, it explains the "anti-Coulomb" interactions (attraction between like-charged ions and repulsion between opposite-charged ions) observed in both simulations and experiments. We show that this is a universal behavior associated to the non-local response function of any dielectric or metallic system.


title: Control of high-dimensional collective dynamics by deep neural feedback laws and kinetic modelling

abstract: Modeling and control of agent-based models is twice cursed by the dimensionality of the problem, as both the number of agents and their state space dimension can be large. Even though the computational barrier posed by a large ensemble of agents can be overcome through a mean field formulation of the control problem, the feasibility of its solution is generally guaranteed only for agents operating in low-dimensional spaces. To circumvent the difficulty posed by the high dimensionality of the state space a kinetic model is proposed, requiring the sampling of high-dimensional, two-agent sub-problems, to evolve the agents' density using a Boltzmann type equation. Such density evolution requires a high-frequency sampling of two-agent optimal control problems, which is efficiently approximated by means of deep neural networks and supervised learning, enabling the fast simulation of high-dimensional, large-scale ensembles of controlled particles. Numerical experiments demonstrate the effectiveness of the proposed approach in the control of consensus and attraction-repulsion dynamics.


title: An Error-Bounded Lossy Compression Method with Bit-Adaptive Quantization for Particle Data

abstract: This paper presents error-bounded lossy compression tailored for particle datasets from diverse scientific applications in cosmology, fluid dynamics, and fusion energy sciences. As today's high-performance computing capabilities advance, these datasets often reach trillions of points, posing significant visualization, analysis, and storage challenges. While error-bounded lossy compression makes it possible to represent floating-point values with strict pointwise accuracy guarantees, the lack of correlations in particle data's storage ordering often limits the compression ratio. Inspired by quantization-encoding schemes in SZ lossy compressors, we dynamically determine the number of bits to encode particles of the dataset to increase the compression ratio. Specifically, we utilize a k-d tree to partition particles into subregions and generate ``bit boxes'' centered at particles for each subregion to encode their positions. These bit boxes ensure error control while reducing the bit count used for compression. We comprehensively evaluate our method against state-of-the-art compressors on cosmology, fluid dynamics, and fusion plasma datasets.


title: BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

abstract: This work presents BAdam, an optimization method that leverages the block coordinate descent framework with Adam as the inner solver. BAdam offers a memory efficient approach to the full parameter finetuning of large language models. We conduct theoretical convergence analysis for BAdam in the deterministic case. Experimentally, we apply BAdam to instruction-tune the Llama 2-7B and Llama 3-8B models using a single RTX3090-24GB GPU. The results confirm BAdam's efficiency in terms of memory and running time. Additionally, the convergence verification indicates that BAdam exhibits superior convergence behavior compared to LoRA. Furthermore, the downstream performance evaluation using the MT-bench shows that BAdam modestly surpasses LoRA and more substantially outperforms LOMO. Finally, we compare BAdam with Adam on a medium-sized task, i.e., finetuning RoBERTa-large on the SuperGLUE benchmark. The results demonstrate that BAdam is capable of narrowing the performance gap with Adam more effectively than LoRA. Our code is available at https://github.com/Ledzy/BAdam.


title: A camel with a less strict diet

abstract: A camel can carry $B$ bananas on its back. It can have $2$ bananas at a time in its stomach. For each mile the camel walks, the amount of bananas in its stomach decreases $1$. As soon as the amount of bananas in the camel's stomach is at most $1$, it can eat a new banana. When the camel's stomach is empty, the camel must eat a new banana (in order to be able to continue its itinerary). Let there be a stock of $N$ bananas at the border of the desert. How far can the camel penetrate into the desert, starting at this point? (Of course it can form new stocks with transported bananas.) The case $B=1$ is solved completely. The round trip variant is solved for $B=1$ as well. For $B=2$, the round trip variant is solved for $N$ which are a power of $2$ and $N \le 8$, and estimated up to $1/(N-1)$ miles for general $N$.


title: Legendre Transformation under Micro Canonical Ensemble

abstract: The Legendre transformation is a crucial tool in theoretical physics, known for its symmetry, especially when applied to multivariate functions. In statistical mechanics, ensembles represent the central focus. Leveraging the dimensionless aspect of Legendre transformation, this paper explores the transformation process from the entropy characteristic function of microcanonical ensembles to the analogous definition of partition function transformation. Additionally, it derives characteristic functions, partition functions, and establishes their interrelations, along with deriving corresponding thermodynamic formulas for various ensembles. This streamlined approach sheds light on the fundamental principles of statistical mechanics and underscores the symmetry inherent in Legendre transformation.


title: Enhancing Interpretability of Vertebrae Fracture Grading using Human-interpretable Prototypes

abstract: Vertebral fracture grading classifies the severity of vertebral fractures, which is a challenging task in medical imaging and has recently attracted Deep Learning (DL) models. Only a few works attempted to make such models human-interpretable despite the need for transparency and trustworthiness in critical use cases like DL-assisted medical diagnosis. Moreover, such models either rely on post-hoc methods or additional annotations. In this work, we propose a novel interpretable-by-design method, ProtoVerse, to find relevant sub-parts of vertebral fractures (prototypes) that reliably explain the model's decision in a human-understandable way. Specifically, we introduce a novel diversity-promoting loss to mitigate prototype repetitions in small datasets with intricate semantics. We have experimented with the VerSe'19 dataset and outperformed the existing prototype-based method. Further, our model provides superior interpretability against the post-hoc method. Importantly, expert radiologists validated the visual interpretability of our results, showing clinical applicability.


title: Empowering Biomedical Discovery with AI Agents

abstract: We envision 'AI scientists' as systems capable of skeptical learning and reasoning that empower biomedical research through collaborative agents that integrate machine learning tools with experimental platforms. Rather than taking humans out of the discovery process, biomedical AI agents combine human creativity and expertise with AI's ability to analyze large datasets, navigate hypothesis spaces, and execute repetitive tasks. AI agents are proficient in a variety of tasks, including self-assessment and planning of discovery workflows. These agents use large language models and generative models to feature structured memory for continual learning and use machine learning tools to incorporate scientific knowledge, biological principles, and theories. AI agents can impact areas ranging from hybrid cell simulation, programmable control of phenotypes, and the design of cellular circuits to the development of new therapies.


title: "Are Adversarial Phishing Webpages a Threat in Reality?" Understanding the Users' Perception of Adversarial Webpages

abstract: Machine learning based phishing website detectors (ML-PWD) are a critical part of today's anti-phishing solutions in operation. Unfortunately, ML-PWD are prone to adversarial evasions, evidenced by both academic studies and analyses of real-world adversarial phishing webpages. However, existing works mostly focused on assessing adversarial phishing webpages against ML-PWD, while neglecting a crucial aspect: investigating whether they can deceive the actual target of phishing -- the end users. In this paper, we fill this gap by conducting two user studies (n=470) to examine how human users perceive adversarial phishing webpages, spanning both synthetically crafted ones (which we create by evading a state-of-the-art ML-PWD) as well as real adversarial webpages (taken from the wild Web) that bypassed a production-grade ML-PWD. Our findings confirm that adversarial phishing is a threat to both users and ML-PWD, since most adversarial phishing webpages have comparable effectiveness on users w.r.t. unperturbed ones. However, not all adversarial perturbations are equally effective. For example, those with added typos are significantly more noticeable to users, who tend to overlook perturbations of higher visual magnitude (such as replacing the background). We also show that users' self-reported frequency of visiting a brand's website has a statistically negative correlation with their phishing detection accuracy, which is likely caused by overconfidence. We release our resources.


title: More on doubled Hilbert space in double-scaled SYK

abstract: We continue our study of the doubled Hilbert space formalism of double-scaled SYK model initiated in [arXiv:2401.07403]. We show that the 1-particle Hilbert space introduced by Lin and Stanford in [arXiv:2307.15725] is related to the doubled Hilbert space $\mathcal{H}_0\otimes \mathcal{H}_0$ of the 0-particle Hilbert space $\mathcal{H}_0$ by some linear isomorphism $\mathcal{C}$. It turns out that the entangler and disentangler appeared in our previous study are given by the dual (or adjoint) of $\mathcal{C}^{-1}$ and $\mathcal{C}$.


title: Hodge numbers of hypergeometric data

abstract: In this paper, based on the toric hypergeometric model given in a paper by Beukers--Cohen--Mellit, we provide two other ways to explain why the zig-zag diagram method can be used to compute Hodge numbers for hypergeometric data defined over $\mathbb Q$.


title: Retrieving Examples from Memory for Retrieval Augmented Neural Machine Translation: A Systematic Comparison

abstract: Retrieval-Augmented Neural Machine Translation (RAMT) architectures retrieve examples from memory to guide the generation process. While most works in this trend explore new ways to exploit the retrieved examples, the upstream retrieval step is mostly unexplored. In this paper, we study the effect of varying retrieval methods for several translation architectures, to better understand the interplay between these two processes. We conduct experiments in two language pairs in a multi-domain setting and consider several downstream architectures based on a standard autoregressive model, an edit-based model, and a large language model with in-context learning. Our experiments show that the choice of the retrieval technique impacts the translation scores, with variance across architectures. We also discuss the effects of increasing the number and diversity of examples, which are mostly positive across the board.


title: Sensitivity of Polarization to Grain Shape: II. Aggregates

abstract: A previous study (Paper I) investigated the polarization properties of a variety of simple convex grain shapes, some of which were found to be consistent with the observed polarization properties of interstellar dust from far-ultraviolet to far-infrared. Here we study the optical properties of 45 non-convex shapes, all aggregates of $N$ equal-sized spheres. We consider $N=2$, $N=3$, and $N=256$ random aggregates obtained from 3 different aggregation schemes. We also consider "trimmed" $N=256$ aggregates obtained by systematically trimming initially random aggregates to increase either flattening or elongation. The "macroporosities" of the studied aggregates range from ${\cal P}_{\rm macro}=0.18$ (for the $N=2$ bisphere) to ${\cal P}_{\rm macro}\approx 0.85$ (for the $N=256$ "BA" aggregates). The only aggregates consistent with observations of starlight polarization and polarized thermal emission are shapes that have been trimmed to increase their asymmetry. If interstellar grains are high-porosity aggregates, there must be processes causing extreme elongation or flattening; if not, interstellar grains must be dominated by fairly compact structures, with at most moderate porosities. The ratio of polarization in the 10$\mu$m silicate feature to starlight polarization in the optical is shown to be insensitive to porosity and shape. X-ray scattering may be the best tool to determine the porosity of interstellar grains. We propose that modest porosities of interstellar grains could be the result of "photolytic densification". High polarization fractions observed in some Class-0 cores require processes to reduce porosities and/or increase asymmetries of aggregates in dense regions.


title: Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models

abstract: This paper reveals the phenomenon of parameter heterogeneity in large language models (LLMs). We find that a small subset of ``cherry'' parameters exhibit a disproportionately large influence on model performance, while the vast majority of parameters have minimal impact. This heterogeneity is found to be prevalent across different model families, scales, and types. Motivated by this observation, we propose CherryQ, a novel quantization method that unifies the optimization of mixed-precision parameters. CherryQ identifies and preserves the critical cherry parameters in high precision while aggressively quantizing the remaining parameters to low precision. Extensive experiments demonstrate the effectiveness of CherryQ. CherryQ outperforms existing quantization approaches in terms of perplexity and downstream task performance. Notably, our 3-bit quantized Vicuna-1.5 exhibits competitive performance compared to their 16-bit counterparts. These findings highlight the potential of CherryQ for enabling efficient deployment of LLMs by taking advantage of parameter heterogeneity.


title: I-Design: Personalized LLM Interior Designer

abstract: Interior design allows us to be who we are and live how we want - each design is as unique as our distinct personality. However, it is not trivial for non-professionals to express and materialize this since it requires aligning functional and visual expectations with the constraints of physical space; this renders interior design a luxury. To make it more accessible, we present I-Design, a personalized interior designer that allows users to generate and visualize their design goals through natural language communication. I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another, transforming textual user input into feasible scene graph designs with relative object relationships. Subsequently, an effective placement algorithm determines optimal locations for each object within the scene. The final design is then constructed in 3D by retrieving and integrating assets from an existing object database. Additionally, we propose a new evaluation protocol that utilizes a vision-language model and complements the design pipeline. Extensive quantitative and qualitative experiments show that I-Design outperforms existing methods in delivering high-quality 3D design solutions and aligning with abstract concepts that match user input, showcasing its advantages across detailed 3D arrangement and conceptual fidelity.


title: Topics in group schemes and surfaces in positive characteristic

abstract: This is a survey paper on algebraic surfaces in positive characteristic based on a series of lectures that the author gave at the University of Edinburgh in March 2023. It is focused on certain positive characteristic phenomena like infinitesimal group schemes and their actions on algebraic surfaces as well as the failure in positive characteristic of certain fundamental characteristic zero results like the Kodaira vanishing theorem. Many explicit examples are presented.


title: A Survey on Error-Bounded Lossy Compression for Scientific Datasets

abstract: Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide range of parallel and distributed use cases for years. These lossy compressors are designed with distinct compression models and design principles, such that each of them features particular pros and cons. In this paper we provide a comprehensive survey of emerging error-bounded lossy compression techniques for different use cases each involving big data to process. The key contribution is fourfold. (1) We summarize an insightful taxonomy of lossy compression into 6 classic compression models. (2) We provide a comprehensive survey of 10+ commonly used compression components/modules used in error-bounded lossy compressors. (3) We provide a comprehensive survey of 10+ state-of-the-art error-bounded lossy compressors as well as how they combine the various compression modules in their designs. (4) We provide a comprehensive survey of the lossy compression for 10+ modern scientific applications and use-cases. We believe this survey is useful to multiple communities including scientific applications, high-performance computing, lossy compression, and big data.


title: AI-augmented Automation for Real Driving Prediction: an Industrial Use Case

abstract: The risen complexity of automotive systems requires new development strategies and methods to master the upcoming challenges. Traditional methods need thus to be changed by an increased level of automation, and a faster continuous improvement cycle. In this context, current vehicle performance tests represent a very time-consuming and expensive task due to the need to perform the tests in real driving conditions. As a consequence, agile/iterative processes like DevOps are largely hindered by the necessity of triggering frequent tests. This paper reports on a practical experience of developing an AI-augmented solution based on Machine Learning and Model-based Engineering to support continuous vehicle development and testing. In particular, historical data collected in real driving conditions is leveraged to synthesize a high-fidelity driving simulator and hence enable performance tests in virtual environments. Based on this practical experience, this paper also proposes a conceptual framework to support predictions based on real driving behavior.


title: Mixed volumes of zonoids and the absolute value of the Grassmannian (Extended Abstract)

abstract: Zonoids are Hausdorff limits of zonotopes, while zonotopes are convex polytopes defined as the Minkowski sums of finitely many segments. We present a combinatorial framework that links the study of mixed volumes of zonoids (a topic that has applications in algebraic combinatorics) with the study of the absolute value of the Grassmannian, defined as the image of the Grassmannian under the coordinate-wise absolute value map. We use polyhedral computations to derive new families of inequalities for n zonoids in dimension d, when (n,d)=(6,2) and (6,3). Unlike the classical geometric inequalities, originating from the Brunn-Minkowski and Aleksandrov-Fenchel inequalities, the inequalities we produce have the special feature of being Minkowski linear in each of the n zonoids they involve.


title: Characterization of Matrices Satisfying the Reverse Order Law for the Moore-Penrose Pseudoinverse

abstract: We give a constructive characterization of matrices satisfying the reverse-order law for the Moore--Penrose pseudoinverse. In particular, for a given matrix $A$ we construct another matrix $B$, of arbitrary compatible size and chosen rank, in terms of the right singular vectors of $A$, such that the reverse order law for $AB$ is satisfied. Moreover, we show that any matrix satisfying this law comes from a similar construction. As a consequence, several equivalent conditions to $B^+ A^+$ being a pseudoinverse of $AB$ are given, for example $\mathcal{C}(A^*AB)=\mathcal{C}(BB^*A^*)$ or $B\left(AB\right)^+A$ being an orthogonal projection. In addition, we parameterize all possible SVD decompositions of a fixed matrix and give Greville-like equivalent conditions for $B^+A^+$ being a $\{1,2\}$-,$\{1,2,3\}$- and $\{1,2,4\}$-inverse of $AB$, with a geometric insight in terms of the principal angles between $\mathcal{C}(A^*)$ and $\mathcal{C}(B)$.


title: Scalable quantum detector tomography by high-performance computing

abstract: At large scales, quantum systems may become advantageous over their classical counterparts at performing certain tasks. Developing tools to analyse these systems at the relevant scales, in a manner consistent with quantum mechanics, is therefore critical to benchmarking performance and characterising their operation. While classical computational approaches cannot perform like-for-like computations of quantum systems beyond a certain scale, classical high-performance computing (HPC) may nevertheless be useful for precisely these characterisation and certification tasks. By developing open-source customised algorithms using high-performance computing, we perform quantum tomography on a megascale quantum photonic detector covering a Hilbert space of $10^6$. This requires finding $10^8$ elements of the matrix corresponding to the positive operator valued measure (POVM), the quantum description of the detector, and is achieved in minutes of computation time. Moreover, by exploiting the structure of the problem, we achieve highly efficient parallel scaling, paving the way for quantum objects up to a system size of $10^{12}$ elements to be reconstructed using this method. In general, this shows that a consistent quantum mechanical description of quantum phenomena is applicable at everyday scales. More concretely, this enables the reconstruction of large-scale quantum sources, processes and detectors used in computation and sampling tasks, which may be necessary to prove their nonclassical character or quantum computational advantage.


title: Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentation

abstract: Recent developments underscore the potential of textual information in enhancing learning models for a deeper understanding of medical visual semantics. However, language-guided medical image segmentation still faces a challenging issue. Previous works employ implicit and ambiguous architectures to embed textual information. This leads to segmentation results that are inconsistent with the semantics represented by the language, sometimes even diverging significantly. To this end, we propose a novel cross-modal conditioned Reconstruction for Language-guided Medical Image Segmentation (RecLMIS) to explicitly capture cross-modal interactions, which assumes that well-aligned medical visual features and medical notes can effectively reconstruct each other. We introduce conditioned interaction to adaptively predict patches and words of interest. Subsequently, they are utilized as conditioning factors for mutual reconstruction to align with regions described in the medical notes. Extensive experiments demonstrate the superiority of our RecLMIS, surpassing LViT by 3.74% mIoU on the publicly available MosMedData+ dataset and achieving an average increase of 1.89% mIoU for cross-domain tests on our QATA-CoV19 dataset. Simultaneously, we achieve a relative reduction of 20.2% in parameter count and a 55.5% decrease in computational load. The code will be available at https://github.com/ShashankHuang/RecLMIS.


title: On the Springer correspondence for wreath products

abstract: We first show that the wreath product $\Sigma_m\wr \Sigma_d$ between two symmetric groups appears as the generalized Weyl group of an Iwahori's generalized Tits system. We then introduce a certain subvariety of the flag variety of type A, and then give a geometric proof of its Bruhat decomposition indexed by $\Sigma_m\wr \Sigma_d$, via the Bialynicki-Birula decomposition. Furthermore, we realize the group algebra $\mathbb{Q}[\Sigma_m\wr \Sigma_d]$ as the top Borel-Moore homology of a Steinberg variety. Such a geometric realization leads to a Springer correspondence for the irreducible representations over $\mathbb{C}[\Sigma_m\wr \Sigma_d]$, which can be regarded as a counterpart of the Clifford theory for wreath products. Consequently, we have obtained a new Springer correspondence of type B/C/D using essentially type A geometry.


title: Semisimple Algebras of Vector Fields on $\mathbb{C}^{3}$

abstract: A local classification of semisimple algebras of vector fields on $\mathbb{C}^{3}$ is given, using the canonical forms of the Heisenberg algebra and of $sl(2,\mathbb{C})\times sl(2,\mathbb{C})$.


title: Statistical Field Theory of Polarizable Polymer Chains with Nonlocal Dipolar Interactions

abstract: The electromechanical response of polymeric soft matter to applied electric fields is of fundamental scientific interest as well as relevant to technologies for sensing and actuation. Several existing theoretical and numerical approaches for polarizable polymers subject to a combined applied electric field and stretch are based on discrete monomer models. In these models, accounting for the interactions between the induced dipoles on monomers is challenging due to the nonlocality of these interactions. On the other hand, the framework of statistical field theory provides a continuous description of polymer chains that potentially enables a tractable way to account for these interactions. However, prior formulations using this framework have been restricted to the case of weak anisotropy of the monomer polarizability. This paper formulates a general approach based in the framework of statistical field theory to account for the nonlocal nature of the dipolar interactions without any restrictions on the anisotropy or nonlinearity of the polarizability of the monomer. The approach is based on 3 key elements: (1) the statistical field theory framework, in which the discrete monomers are regularized to a continuous dipole distribution; (2) a replacement of the nonlocal dipole-dipole interactions by the local electrostatics PDE with the continuous dipole distribution as the forcing; (3) the use of a completely general relation between the polarization and the local electric field. Rather than treat the dipole-dipole interactions directly, the continuous description in the field theory enables the computationally-tractable nonlocal-to-local transformation. Further, it enables the use of a realistic statistical-mechanical ensemble wherein the average far-field applied electric field is prescribed, rather than prescribing the applied field at every point in the polymer domain.


title: Efficient Structure-Informed Featurization and Property Prediction of Ordered, Dilute, and Random Atomic Structures

abstract: Structure-informed materials informatics is a rapidly evolving discipline of materials science relying on the featurization of atomic structures or configurations to construct vector, voxel, graph, graphlet, and other representations useful for machine learning prediction of properties, fingerprinting, and generative design. This work discusses how current featurizers typically perform redundant calculations and how their efficiency could be improved by considering (1) fundamentals of crystallographic (orbits) equivalency to optimize ordered cases and (2) representation-dependent equivalency to optimize cases of dilute, doped, and defect structures with broken symmetry. It also discusses and contrasts ways of (3) approximating random solid solutions occupying arbitrary lattices under such representations. Efficiency improvements discussed in this work were implemented within pySIPFENN or python toolset for Structure-Informed Property and Feature Engineering with Neural Networks developed by authors since 2019 and shown to increase performance from 2 to 10 times for typical inputs. Throughout this work, the authors explicitly discuss how these advances can be applied to different kinds of similar tools in the community.


title: Structural build-up at rest in the induction and acceleration periods of OPC

abstract: Structural build-up in fresh cement paste at rest is characterized by time evolutions of storage modulus and yield stress, which both increase linearly in time during the induction period of hydration, followed by an exponential evolution after entering the acceleration period. While it is understood that C-S-H formation at contact points between cement particles dictates build-up in the acceleration period, the mechanism in the induction period lacks consensus. Here, we provide experimental evidence that, at least in absence of admixtures, structural build-up at rest originates in both periods from the same mechanism. We couple calorimetry and oscillatory shear measurements of OPC at different w/c ratios, capturing how the storage modulus evolves with changes in cumulative heat. We obtain an exponential relation between stiffness and heat, with the same exponent in both the induction and acceleration periods. This suggests that C-S-H formation dictates build-up at rest in both periods.


title: A representation theorem for order continuous Banach lattices with applications

abstract: Suppose $X$ is a topological space and $S(X)$ is the vector lattice of all equivalence classes of real-valued continuous functions on open dense subsets of $X$. Although, $S(X)$ is not a normed lattice, we can have unbounded norm topology ($un$-topology) on it. On the other hand, the recent result, due to Wickstead, presents a representation approach for every Archimedean vector lattice $E$ in terms of $S(X)$-spaces. In this paper, we show that this representation is order continuous and when $E$ is order complete, it coincides with the known Maeda-Ogasawara representation. Moreover, we obtain a similar representation for an order continuous Banach lattice in terms of $S(X)$-spaces that is a $un$-homeomorphism. Furthermore, as an application, we establish a representation approach for the Fremlin projective tensor product between Banach lattices, in terms of $S(X)$-spaces, as well.


title: Toward Inference-optimal Mixture-of-Expert Large Language Models

abstract: Mixture-of-Expert (MoE) based large language models (LLMs), such as the recent Mixtral and DeepSeek-MoE, have shown great promise in scaling model size without suffering from the quadratic growth of training cost of dense transformers. Like dense models, training MoEs requires answering the same question: given a training budget, what is the optimal allocation on the model size and number of tokens? We study the scaling law of MoE-based LLMs regarding the relations between the model performance, model size, dataset size, and the expert degree. Echoing previous research studying MoE in different contexts, we observe the diminishing return of increasing the number of experts, but this seems to suggest we should scale the number of experts until saturation, as the training cost would remain constant, which is problematic during inference time. We propose to amend the scaling law of MoE by introducing inference efficiency as another metric besides the validation loss. We find that MoEs with a few (4/8) experts are the most serving efficient solution under the same performance, but costs 2.5-3.5x more in training. On the other hand, training a (16/32) expert MoE much smaller (70-85%) than the loss-optimal solution, but with a larger training dataset is a promising setup under a training budget.


title: Domination number of modular product graphs

abstract: The modular product $G\diamond H$ of graphs $G$ and $H$ is a graph on vertex set $V(G)\times V(H)$. Two vertices $(g,h)$ and $(g^{\prime},h^{\prime})$ of $G\diamond H$ are adjacent if $g=g^{\prime}$ and $hh^{\prime}\in E(H)$, or $gg^{\prime}\in E(G)$ and $h=h^{\prime}$, or $gg^{\prime}\in E(G)$ and $hh^{\prime}\in E(H)$, or (for $g\neq g^{\prime}$ and $h\neq h^{\prime}$) $gg^{\prime}\notin E(G)$ and $hh^{\prime}\notin E(H)$. A set $D\subseteq V(G)$ is a dominating set of $G$ if every vertex outside of $D$ contains a neighbor in $D$. A set $D\subseteq V(G)$ is a total dominating set of $G$ if every vertex of $G$ contains a neighbor in $D$. The domination number $\gamma(G)$ (resp. total domination number $\gamma_{t}(G)$) of $G$ is the minimum cardinality of a dominating set (resp. total dominating set) of $G$. In this work we give several upper and lower bounds for $\gamma(G\diamond H)$ in terms of $\gamma(G),$ $\gamma(H)$, $\gamma_{t}(\overline{G})$ and $\gamma _{t}(\overline{H})$, where $\overline{G}$ is the complement graph of $G$. Further, we fully describe graphs where $\gamma(G\diamond H)=k$ for $k\in\{1,2,3\}$. Several conditions on $G$ and $H$ under which $\gamma (G\diamond H)$ is at most $4$ and $5$ are also given. A new type of simultaneous domination $\bar{\gamma}(G)$, defined as the smallest number of vertices that dominates $G$ and totally dominates the complement of $G,$ emerged as useful and we believe it could be of independent interest. We conclude the paper by proposing few directions for possible further research.


title: Axisymmetric steady Navier-Stokes flows under suction

abstract: We prove the existence of solutions for the axisymmetric steady Navier-Stokes system around an infinite cylinder under external forces. The solutions are constructed to be decaying at the horizontal infinity, despite an analogue of the Stokes paradox for the linearized system, and having neither periodicity nor decay in the vertical direction. The proof is based on perturbation of the nonlinear system around a suction flow. The class of functions in this paper, which is a subspace of the space of Fourier transformed vector finite Radon measures, is inspired by Giga-Saal (2013) treating rotating boundary layers.


title: Tight stability bounds for entropic Brenier maps

abstract: Entropic Brenier maps are regularized analogues of Brenier maps (optimal transport maps) which converge to Brenier maps as the regularization parameter shrinks. In this work, we prove quantitative stability bounds between entropic Brenier maps under variations of the target measure. In particular, when all measures have bounded support, we establish the optimal Lipschitz constant for the mapping from probability measures to entropic Brenier maps. This provides an exponential improvement to a result of Carlier, Chizat, and Laborde (2024). As an application, we prove near-optimal bounds for the stability of semi-discrete \emph{unregularized} Brenier maps for a family of discrete target measures.


title: An Information Bottleneck Approach for Markov Model Construction

abstract: Markov state models (MSMs) are valuable for studying dynamics of protein conformational changes via statistical analysis of molecular dynamics (MD) simulations. In MSMs, the complex configuration space is coarse-grained into conformational states, with the dynamics modeled by a series of Markovian transitions among these states at discrete lag times. Constructing the Markovian model at a specific lag time requires state defined without significant internal energy barriers, enabling internal dynamics relaxation within the lag time. This process coarse grains time and space, integrating out rapid motions within metastable states. This work introduces a continuous embedding approach for molecular conformations using the state predictive information bottleneck (SPIB), which unifies dimensionality reduction and state space partitioning via a continuous, machine learned basis set. Without explicit optimization of VAMP-based scores, SPIB demonstrates state-of-the-art performance in identifying slow dynamical processes and constructing predictive multi-resolution Markovian models. When applied to mini-proteins trajectories, SPIB showcases unique advantages compared to competing methods. It automatically adjusts the number of metastable states based on a specified minimal time resolution, eliminating the need for manual tuning. While maintaining efficacy in dynamical properties, SPIB excels in accurately distinguishing metastable states and capturing numerous well-populated macrostates. Furthermore, SPIB's ability to learn a low-dimensional continuous embedding of the underlying MSMs enhances the interpretation of dynamic pathways. Accordingly, we propose SPIB as an easy-to-implement methodology for end-to-end MSM construction.


title: Study of Complex Nitrogen and Oxygen-bearing Molecules toward the High-mass Protostar IRAS 18089$-$1732

abstract: The observation of oxygen (O)- and nitrogen (N)-bearing molecules gives an idea about the complex prebiotic chemistry in the interstellar medium (ISM). In this article, we present the identification of the rotational emission lines of N-bearing molecules ethyl cyanide (C$_{2}$H$_{5}$CN), cyanoacetylene (HC$_{3}$N), and O-bearing molecules methyl formate (CH$_{3}$OCHO) towards high-mass protostar IRAS 18089$-$1732 using the Atacama Compact Array (ACA). We also detected the emission lines of both N- and O-bearing molecule formamide (NH$_{2}$CHO) in the envelope of IRAS 18089$-$1732. We have detected the $v$ = 0 and 1 states rotational emission lines of CH$_{3}$OCHO. We also detected the two vibrationally excited states of HC$_{3}$N ($v$7 = 1 and $v$7 = 2). The estimated fractional abundances of C$_{2}$H$_{5}$CN, HC$_{3}$N ($v$7 = 1), HC$_{3}$N ($v$7 = 2), and NH$_{2}$CHO towards the IRAS 18089$-$1732 are (1.40$\pm$0.5)$\times$10$^{-10}$, (7.5$\pm$0.7)$\times$10$^{-11}$, (3.1$\pm$0.4)$\times$10$^{-11}$, and (6.25$\pm$0.82)$\times$10$^{-11}$. Similarly, the estimated fractional abundances of CH$_{3}$OCHO ($v$ = 0) and CH$_{3}$OCHO ($v$ = 1) are (1.90$\pm$0.9)$\times$10$^{-9}$ and (8.90$\pm$0.8)$\times$10$^{-10}$, respectively. We also created the integrated emission maps of the detected molecules, and the observed molecules may have originated from the extended envelope of the protostar. We show that C$_{2}$H$_{5}$CN and HC$_{3}$N are most probably formed via the subsequential hydrogenation of the CH$_{2}$CHCN and the reaction between C$_{2}$H$_{2}$ and CN on the grain surface of IRAS 18089$-$1732. We found that NH$_{2}$CHO is probably produced due to the reaction between NH$_{2}$ and H$_{2}$CO in the gas phase. Similarly, CH$_{3}$OCHO is possibly created via the reaction between radical CH$_{3}$O and radical HCO on the grain surface of IRAS 18089$-$1732.


title: The Life Care Annuity: enhancing product features and refining pricing methods

abstract: The state-of-the-art proposes Life Care Annuities, that have been recently designed as variable annuity contracts with Long-Term Care payouts and Guaranteed Lifelong Withdrawal Benefits. In this paper, we propose more general features for these insurance products and refine their pricing methods. We name our proposed product ``GLWB-LTC''. In particular, as to the product features, we allow dynamic withdrawal strategies, including the surrender option. Furthermore, we consider stochastic interest rates, described by a Cox-Ingersoll-Ross process. As to the numerical methods, we solve the stochastic control problem involved by the selection of the optimal withdrawal strategy through a robust tree method, which outperforms the Monte Carlo approach. We name this method ``Tree-LTC'', and we use it to estimate the fair price of the product, as some relevant parameters vary, such as, for instance, the entry age of the policyholder. Furthermore, our numerical results show how the optimal withdrawal strategy varies over time with the health status of the policyholder. Our findings stress the important advantage of flexible withdrawal strategies in relation to insurance policies offering protection from health risks. Indeed, the policyholder is given more choice about how much to save for protection from the possible disability states at future times.


title: Uniqueness of the blow-down limit for triple junction problem

abstract: We prove the uniqueness of $L^1$ blow-down limit at infinity for an entire minimizing solution $u:\mathbb{R}^2\rightarrow\mathbb{R}^2$ of a planar Allen-Cahn system with a triple-well potential. Consequently, $u$ can be approximated by a triple junction map at infinity. The proof exploits a careful analysis of energy upper and lower bounds, ensuring that the diffuse interface remains within a small neighborhood of the approximated triple junction at all scales.


title: Spin alignment of $K^\ast$ induced by strange-baryon density inhomogeneity

abstract: The difference between the spin alignments of $K^\ast$ and those of $\phi$ at the low collision energies is a puzzle raised by the recent experiments. Unlike $\phi$ meson, $K^\ast$, carrying a unit strange charge, should react to strange chemical potential $\mu_S$. In this paper, we shall first convince you that $\mu_S$ is not small in a brayon-rich medium for keeping strange neutrality, and then derive the spin alignment induced by the gradient of $\mu_S$, and hence of baryon chemical potential $\mu_B$, using linear response theory, with the transport coefficients expressed, without any approximation, in terms of the $K^\ast$'s in-medium spectral properties by employing Ward-Takahashi identity. It turns out that such an effect applies mainly to the particles whose longitudinal and transverse modes diverge, and induces only the local spin alignment in a static medium. The magnitudes of these coefficients will be further estimated under the quasi-particle approximation.


title: Pre-equilibrium Photon and Dilepton Production

abstract: We use QCD kinetic theory to compute photon and dilepton production in the chemically equilibrating out-of-equilibrium quark-gluon plasma created in the early stages of high-energy heavy-ion collisions. We derive universal scaling functions for the pre-equilibrium spectra of photons and dileptons. These scaling functions can be used to make realistic predictions for the pre-equilibrium emission and consequently establish the significance of the pre-equilibrium phase for the production of electromagnetic probes in heavy-ion collisions.


title: The metric removability of interfaces in the directed landscape

abstract: The directed landscape is a prominent model of random geometry which is believed to be the universal scaling limit of all planar random geometries in the Kardar-Parisi-Zhang universality class. It comes equipped with a few different natural simple curves associated to it, such as geodesics and interfaces. Given such a curve, one might wonder whether the geometry off this curve determines the entire landscape, or if in fact, there is non-trivial extra information actually present "on" the curve. In this paper, we show that the former is true for an interface in the directed landscape, while the latter is true for a geodesic instead. Further, as is used in the proof of the first assertion above, we show that the set of times where any geodesic intersects an interface a.s. has dimension zero.


title: Discovery of universal phonon thermal Hall effect in crystals

abstract: Thermal Hall effect (THE) in insulator is a remarkable phenomenon that arises from the motion of chargeless quasi-particles under a magnetic field. While magnons or exotic spin excitations were considered as the origin of THE in some magnetic materials, there are more and more evidences suggesting that phonons play a significant role. However, the mechanism behind phonon THE is still unknown. Here we report the observation of THE, including planar THE, in a broad range of non-magnetic insulators and semiconductors: SrTiO3, SiO2 (quartz), MgO, MgAl2O4, Si and Ge. While the presence of antiferrodistortive domains in SrTiO3 and chiral phonons in SiO2 may complicate the interpretation of THE, the striking observations of THE in trivial insulators MgO and MgAl2O4, as well as in high-purity intrinsic semiconductors Si and Ge, demonstrate that phonon THE is a universal property of crystals. Without other effects on phonons such as from magnons, this universal phonon THE is characterized by a scaling law of |\k{appa}_xy| ~ \k{appa}_xx^2. Our results experimentally discover a fundamental physics of phonons in magnetic field, which should come from the direct coupling between atom vibrations and the field. Starting from this universal phonon THE in crystals, all previous interpretations of THE in magnetic or non-magnetic materials need to be reconsidered.


title: Forecasting the sensitivity of Pulsar Timing Arrays to gravitational wave backgrounds

abstract: Pulsar Timing Array (PTA) observations hinted towards the existence of a stochastic gravitational wave background (SGWB) in the nHz frequency band. Still, the nature of the SGWB signal cannot be confidently inferred from current data, and the leading explanation invokes mergers of supermassive black holes. If confirmed, such discovery would not only represent a turning point in our understanding of astrophysics, but it may severely limit the capability of searching for additional cosmological sources in the nHz frequency range. In this work, we build a simple framework to forecast the sensitivity of future PTA configurations and assess the parameter estimation of SGWB, which could consist of several contributions. We release the python code fastPTA implementing this framework and ready to use.


title: End-To-End Self-tuning Self-supervised Time Series Anomaly Detection

abstract: Time series anomaly detection (TSAD) finds many applications such as monitoring environmental sensors, industry KPIs, patient biomarkers, etc. A two-fold challenge for TSAD is a versatile and unsupervised model that can detect various different types of time series anomalies (spikes, discontinuities, trend shifts, etc.) without any labeled data. Modern neural networks have outstanding ability in modeling complex time series. Self-supervised models in particular tackle unsupervised TSAD by transforming the input via various augmentations to create pseudo anomalies for training. However, their performance is sensitive to the choice of augmentation, which is hard to choose in practice, while there exists no effort in the literature on data augmentation tuning for TSAD without labels. Our work aims to fill this gap. We introduce TSAP for TSA "on autoPilot", which can (self-)tune augmentation hyperparameters end-to-end. It stands on two key components: a differentiable augmentation architecture and an unsupervised validation loss to effectively assess the alignment between augmentation type and anomaly type. Case studies show TSAP's ability to effectively select the (discrete) augmentation type and associated (continuous) hyperparameters. In turn, it outperforms established baselines, including SOTA self-supervised models, on diverse TSAD tasks exhibiting different anomaly types.


title: Guarantees of confidentiality via Hammersley-Chapman-Robbins bounds

abstract: Protecting privacy during inference with deep neural networks is possible by adding noise to the activations in the last layers prior to the final classifiers or other task-specific layers. The activations in such layers are known as "features" (or, less commonly, as "embeddings" or "feature embeddings"). The added noise helps prevent reconstruction of the inputs from the noisy features. Lower bounding the variance of every possible unbiased estimator of the inputs quantifies the confidentiality arising from such added noise. Convenient, computationally tractable bounds are available from classic inequalities of Hammersley and of Chapman and Robbins -- the HCR bounds. Numerical experiments indicate that the HCR bounds are on the precipice of being effectual for small neural nets with the data sets, "MNIST" and "CIFAR-10," which contain 10 classes each for image classification. The HCR bounds appear to be insufficient on their own to guarantee confidentiality of the inputs to inference with standard deep neural nets, "ResNet-18" and "Swin-T," pre-trained on the data set, "ImageNet-1000," which contains 1000 classes. Supplementing the addition of noise to features with other methods for providing confidentiality may be warranted in the case of ImageNet. In all cases, the results reported here limit consideration to amounts of added noise that incur little degradation in the accuracy of classification from the noisy features. Thus, the added noise enhances confidentiality without much reduction in the accuracy on the task of image classification.


title: Dark energy as a geometrical effect in geodetic brane gravity

abstract: Within the framework of the modified geodetic brane gravity, conformed by the Regge-Teitelboim model and enhanced with a linear term in the extrinsic curvature of the brane, the possibility that under an FRW geometry this theory emulates the so-called dark energy is discussed. The cosmological behavior of this model displays a self-(non-self)-accelerated expansion of this universe which is caused by a combination of usual matter and gravitational geometric effects controlled by a $\beta$ parameter that accompanies the correction $K$ term. Indeed, the self-accelerated branch, provided by the trace $K$ model raises the question of whether the extrinsic curvature correction terms might be suitable for dark energy candidates. We discuss the analytical expression obtained for $\rd$ in addition to the main cosmological parameters such as the state parameter $\omega_{\text{\tiny eff}}$ and the deceleration parameter $q$. Moreover, when we call for the contribution of dark radiation-like energy to be switched off, $\Odr \to 0$, we find the same acceleration behavior, as well as the same dark energy content provided by the DGP theory.


title: UDON: A case for offloading to general purpose compute on CXL memory

abstract: Upcoming CXL-based disaggregated memory devices feature special purpose units to offload compute to near-memory. In this paper, we explore opportunities for offloading compute to general purpose cores on CXL memory devices, thereby enabling a greater utility and diversity of offload. We study two classes of popular memory intensive applications: ML inference and vector database as candidates for computational offload. The study uses Arm AArch64-based dual-socket NUMA systems to emulate CXL type-2 devices. Our study shows promising results. With our ML inference model partitioning strategy for compute offload, we can place up to 90% data in remote memory with just 20% performance trade-off. Offloading Hierarchical Navigable Small World (HNSW) kernels in vector databases can provide upto 6.87$\times$ performance improvement with under 10% offload overhead.


title: Human Activity Recognition using Smartphones

abstract: Human Activity Recognition is a subject of great research today and has its applications in remote healthcare, activity tracking of the elderly or the disables, calories burnt tracking etc. In our project, we have created an Android application that recognizes the daily human activities and calculate the calories burnt in real time. We first captured labeled triaxial acceleration readings for different daily human activities from the smartphone's embedded accelerometer. These readings were preprocessed using a median filter. 42 features were extracted using various methods. We then tested various machine learning algorithms along with dimensionality reduction. Finally, in our Android application, we used the machine learning algorithm and a subset of features that provided maximum accuracy and minimum model building time. This is used for real-time activity recognition and calculation of calories burnt using a formula based on Metabolic Equivalent.


title: Random approximation of convex bodies in Hausdorff metric

abstract: While there is extensive literature on approximation, deterministic as well as random, of general convex bodies $K$ in the symmetric difference metric, or other metrics arising from intrinsic volumes, very little is known for corresponding random results in the Hausdorff distance when the approximant $K_n$ is given by the convex hull of $n$ independent random points chosen uniformly on the boundary or in the interior of $K$. When $K$ is a polygon and the points are chosen on its boundary, we determine the exact limiting behavior of the expected Hausdorff distance between a polygon as $n\to\infty$. From this we derive the behavior of the asymptotic constant for a regular polygon in the number of vertices.


title: A mean-field model of optimal investment

abstract: We establish the existence and uniqueness of the equilibrium for a stochastic mean-field game of optimal investment. The analysis covers both finite and infinite time horizons, and the mean-field interaction of the representative company with a mass of identical and indistinguishable firms is modeled through the time-dependent price at which the produced good is sold. At equilibrium, this price is given in terms of a nonlinear function of the expected (optimally controlled) production capacity of the representative company at each time. The proof of the existence and uniqueness of the mean-field equilibrium relies on a priori estimates and the study of nonlinear integral equations, but employs different techniques for the finite and infinite horizon cases. Additionally, we investigate the deterministic counterpart of the mean-field game under study.


title: Integrating Explanations in Learning LTL Specifications from Demonstrations

abstract: This paper investigates whether recent advances in Large Language Models (LLMs) can assist in translating human explanations into a format that can robustly support learning Linear Temporal Logic (LTL) from demonstrations. Both LLMs and optimization-based methods can extract LTL specifications from demonstrations; however, they have distinct limitations. LLMs can quickly generate solutions and incorporate human explanations, but their lack of consistency and reliability hampers their applicability in safety-critical domains. On the other hand, optimization-based methods do provide formal guarantees but cannot process natural language explanations and face scalability challenges. We present a principled approach to combining LLMs and optimization-based methods to faithfully translate human explanations and demonstrations into LTL specifications. We have implemented a tool called Janaka based on our approach. Our experiments demonstrate the effectiveness of combining explanations with demonstrations in learning LTL specifications through several case studies.


title: Gaussian Process Regression with Soft Inequality and Monotonicity Constraints

abstract: Gaussian process (GP) regression is a non-parametric, Bayesian framework to approximate complex models. Standard GP regression can lead to an unbounded model in which some points can take infeasible values. We introduce a new GP method that enforces the physical constraints in a probabilistic manner. This GP model is trained by the quantum-inspired Hamiltonian Monte Carlo (QHMC). QHMC is an efficient way to sample from a broad class of distributions. Unlike the standard Hamiltonian Monte Carlo algorithm in which a particle has a fixed mass, QHMC allows a particle to have a random mass matrix with a probability distribution. Introducing the QHMC method to the inequality and monotonicity constrained GP regression in the probabilistic sense, our approach improves the accuracy and reduces the variance in the resulting GP model. According to our experiments on several datasets, the proposed approach serves as an efficient method as it accelerates the sampling process while maintaining the accuracy, and it is applicable to high dimensional problems.


title: Planck dust polarization power spectra are consistent with strongly supersonic turbulence

abstract: The polarization of the Cosmic Microwave Background (CMB) is rich in information but obscured by foreground emission from the Milky Way's interstellar medium (ISM). To uncover relationships between the underlying turbulent ISM and the foreground power spectra, we simulated a suite of driven, magnetized, turbulent models of the ISM, varying the fluid properties via the sonic Mach number, $\mathcal{M_S}$ and magnetic (Alfv\'en) Mach number,$\mathcal{M_A}$. We measure the power spectra of density ($\rho$), velocity ($v$), magnetic field ($H$), total projected intensity ($T$), parity-even polarization ($E$), and parity-odd polarization ($B$). We find that the slopes of all six quantities increase with $\mathcal{M_S}$ Most increase with $\mathcal{M_A}$, while the magnetic field spectrum steepens with $M_A$. By comparing spectral slopes of $E$ and $B$ to those measured by Planck, we infer typical values of $\mathcal{M_S}$ and $\mathcal{M_A}$ for the ISM. As the fluid velocity increases, $\mathcal{M_S}> 4$, the ratio of BB power to EE power increases to approach a constant value near the Planck-observed value of $\sim 0.5$, regardless of the magnetic field strength. We also examine correlation-coefficients between projected quantities, and find that $r^{\rm{TE}}\approx 0.3$, in agreement with Planck, for appropriate combinations of $\mathcal{M_S}$ and $\mathcal{M_A}$. Finally, we consider parity-violating correlations $r^{\rm{TB}}$ and $r^{\rm{EB}}.$


title: Subconductance states in a semimicroscopic model for a tetrameric pore

abstract: A physical model for a structured tetrameric pore is studied. The pore is modeled as a device composed of four subunits, each one exhibiting two possible states (open and closed). The pore is located within a membrane that separates two reservoirs with ionic solutions. All variables of the model follow physical dynamical equations accounting for the internal structure of the pore, derived from a single energy functional and supplemented with thermal noises. An extensive study of the resulting ionic intensity is performed for different values of the control parameters, mainly membrane potential and reservoir ion concentrations. Two possible physical devices are studied: voltage-gated (including a voltage sensor in each subunit) and non-voltage-gated pores. The ionic flux through the pore exhibits several distinct dynamical configurations, in particular subconductance states, which indicate very different dynamical internal states of the subunits. Such subconductance states become much easier to observe in sensorless pores. These results are compared with available experimental data on tetrameric K channels and analytical predictions.


title: Sensing Resource Allocation Against Data-Poisoning Attacks in Traffic Routing

abstract: Data-poisoning attacks can disrupt the efficient operations of transportation systems by misdirecting traffic flows via falsified data. One challenge in countering these attacks is to reduce the uncertainties on the types of attacks, such as the distribution of their targets and intensities. We introduce a resource allocation method in transportation networks to detect and distinguish different types of attacks and facilitate efficient traffic routing. The idea is to first cluster different types of attacks based on the corresponding optimal routing strategies, then allocate sensing resources to a subset of network links to distinguish attacks from different clusters via lexicographical mixed-integer programming. We illustrate the application of the proposed method using the Anaheim network, a benchmark model in traffic routing that contains more than 400 nodes and 900 links.


title: FlightScope: A Deep Comprehensive Assessment of Aircraft Detection Algorithms in Satellite Imagery

abstract: Object detection in remotely sensed satellite pictures is fundamental in many fields such as biophysical, and environmental monitoring. While deep learning algorithms are constantly evolving, they have been mostly implemented and tested on popular ground-based taken photos. This paper critically evaluates and compares a suite of advanced object detection algorithms customized for the task of identifying aircraft within satellite imagery. Using the large HRPlanesV2 dataset, together with a rigorous validation with the GDIT dataset, this research encompasses an array of methodologies including YOLO versions 5 and 8, Faster RCNN, CenterNet, RetinaNet, RTMDet, and DETR, all trained from scratch. This exhaustive training and validation study reveal YOLOv5 as the preeminent model for the specific case of identifying airplanes from remote sensing data, showcasing high precision and adaptability across diverse imaging conditions. This research highlight the nuanced performance landscapes of these algorithms, with YOLOv5 emerging as a robust solution for aerial object detection, underlining its importance through superior mean average precision, Recall, and Intersection over Union scores. The findings described here underscore the fundamental role of algorithm selection aligned with the specific demands of satellite imagery analysis and extend a comprehensive framework to evaluate model efficacy. The benchmark toolkit and codes, available via https://github.com/toelt-llc/FlightScope_Bench, aims to further exploration and innovation in the realm of remote sensing object detection, paving the way for improved analytical methodologies in satellite imagery applications.


title: Pair production in rotating electric fields via quantum kinetic equations: Resolving helicity states

abstract: We investigate the phenomenon of electron-positron pair production from vacuum in the presence of a strong electric field of circular polarization. By means of a nonperturbative approach based on the quantum kinetic equations (QKEs), we numerically calculate helicity-resolved momentum distributions of the particles produced and analyze the corresponding helicity asymmetry. It is demonstrated that the external rotating field tends to generate left-handed and right-handed particles traveling in opposite directions. Generic symmetry properties of the momentum spectra are examined analytically by means of the QKEs and also confirmed and illustrated by direct numerical computations. The helicity signatures revealed in our study are expected to provide a firmer basis for possible experimental investigations of the fundamental phenomenon of vacuum pair production in strong fields.


title: Modelling the star-formation activity and ionizing properties of high-redshift galaxies

abstract: Early results from the JWST observations have reported a surprisingly high number of UV-bright galaxies at $z \geq 10$, which appears to challenge the theoretical predictions from standard galaxy formation models in the $\Lambda$CDM framework at these redshifts. To alleviate this tension, several cosmological and astrophysical interpretations have been advanced. However, all of these proposed scenarios carry noteworthy consequences for other large-scale processes in the early Universe, particularly cosmic reionization, since high-redshift galaxies are believed to be the primary ionizing sources during the Epoch of Reionization (EoR). To investigate this, we introduce a semi-analytical model of galaxy formation and evolution that explains the evolving galaxy UV luminosity function (UVLF) over $6 \lesssim z \lesssim 15$, and also jointly tracks the time evolution of the globally averaged neutral hydrogen fraction in the intergalactic medium. The model self-consistently accounts for the suppression of star formation in low-mass galaxies due to reionization feedback and is constrained by comparing the model predictions with various observational probes like the UVLF data from HST and JWST, recent measurements of the neutral hydrogen fraction, and the CMB scattering optical depth. Our analysis confirms that a rapid enhancement in the star-formation rate efficiency and/or UV luminosity per stellar mass formed is necessary for consistency with the JWST UVLF estimates at $z \geq 10$. We further find that it is possible to jointly satisfy the current reionization constraints when the escape fraction is assumed to be halo-mass dependent, requiring higher Lyman-continuum leakage from low-mass galaxies. We also examine the relative contribution of galaxies with different UV luminosities towards the ionizing photon budget for the EoR and investigate the large-scale bias of high-$z$ galaxies.


title: Fragmented Moments, Balanced Choices: How Do People Make Use of Their Waiting Time?

abstract: Everyone spends some time waiting every day. HCI research has developed tools for boosting productivity while waiting. However, little is known about how people naturally spend their waiting time. We conducted an experience sampling study with 21 working adults who used a mobile app to report their daily waiting time activities over two weeks. The aim of this study is to understand the activities people do while waiting and the effect of situational factors. We found that participants spent about 60% of their waiting time on leisure activities, 20% on productive activities, and 20% on maintenance activities. These choices are sensitive to situational factors, including accessible device, location, and certain routines of the day. Our study complements previous ones by demonstrating that people purpose waiting time for various goals beyond productivity and to maintain work-life balance. Our findings shed light on future empirical research and system design for time management.


title: On computing approximate Lewis weights

abstract: In this note we provide and analyze a simple method that given an $n \times d$ matrix, outputs approximate $\ell_p$-Lewis weights, a natural measure of the importance of the rows with respect to the $\ell_p$ norm, for $p \geq 2$. More precisely, we provide a simple post-processing procedure that turns natural one-sided approximate $\ell_p$-Lewis weights into two-sided approximations. When combined with a simple one-sided approximation algorithm presented by Lee (PhD thesis, `16) this yields an algorithm for computing two-sided approximations of the $\ell_p$-Lewis weights of an $n \times d$-matrix using $\mathrm{poly}(d,p)$ approximate leverage score computations. While efficient high-accuracy algorithms for approximating $\ell_p$-Lewis had been established previously by Fazel, Lee, Padmanabhan and Sidford (SODA `22), the simple structure and approximation tolerance of our algorithm may make it of use for different applications.


title: Linear Attention Sequence Parallelism

abstract: Sequence Parallel (SP) serves as a prevalent strategy to handle long sequences that exceed the memory limit of a single GPU. However, existing SP methods do not take advantage of linear attention features, resulting in sub-optimal parallelism efficiency and usability for linear attention-based language models. In this paper, we introduce Linear Attention Sequence Parallel (LASP), an efficient SP method tailored to linear attention-based language models. Specifically, we design an efficient point-to-point communication mechanism to leverage the right-product kernel trick of linear attention, which sharply decreases the communication overhead of SP. We also enhance the practical efficiency of LASP by performing kernel fusion and intermediate state caching, making the implementation of LASP hardware-friendly on GPU clusters. Furthermore, we meticulously ensure the compatibility of sequence-level LASP with all types of batch-level data parallel methods, which is vital for distributed training on large clusters with long sequences and large batches. We conduct extensive experiments on two linear attention-based models with varying sequence lengths and GPU cluster sizes. LASP scales sequence length up to 4096K using 128 A100 80G GPUs on 1B models, which is 8 times longer than existing SP methods while being significantly faster. The code is available at https://github.com/OpenNLPLab/LASP.


title: On the Scalability of Diffusion-based Text-to-Image Generation

abstract: Scaling up model and data size has been quite successful for the evolution of LLMs. However, the scaling law for the diffusion based text-to-image (T2I) models is not fully explored. It is also unclear how to efficiently scale the model for better performance at reduced cost. The different training settings and expensive training cost make a fair model comparison extremely difficult. In this work, we empirically study the scaling properties of diffusion based T2I models by performing extensive and rigours ablations on scaling both denoising backbones and training set, including training scaled UNet and Transformer variants ranging from 0.4B to 4B parameters on datasets upto 600M images. For model scaling, we find the location and amount of cross attention distinguishes the performance of existing UNet designs. And increasing the transformer blocks is more parameter-efficient for improving text-image alignment than increasing channel numbers. We then identify an efficient UNet variant, which is 45% smaller and 28% faster than SDXL's UNet. On the data scaling side, we show the quality and diversity of the training set matters more than simply dataset size. Increasing caption density and diversity improves text-image alignment performance and the learning efficiency. Finally, we provide scaling functions to predict the text-image alignment performance as functions of the scale of model size, compute and dataset size.


title: Stability of multiphase mean curvature flow beyond circular topology changes

abstract: We prove a weak-strong uniqueness principle for varifold-BV solutions to planar multiphase mean curvature flow beyond a circular topology change: Assuming that there exists a classical solution with an interface that becomes increasingly circular and shrinks to a point, any varifold-BV solution with the same initial interface must coincide with it, and any varifold-BV solution with similar initial data must undergo the same type of topology change. Our result illustrates the robustness of the relative energy method for establishing weak-strong uniqueness principles for interface evolution equations, showing that it may also be applied beyond certain topological changes.


title: PoCo: Point Context Cluster for RGBD Indoor Place Recognition

abstract: We present a novel end-to-end algorithm (PoCo) for the indoor RGB-D place recognition task, aimed at identifying the most likely match for a given query frame within a reference database. The task presents inherent challenges attributed to the constrained field of view and limited range of perception sensors. We propose a new network architecture, which generalizes the recent Context of Clusters (CoCs) to extract global descriptors directly from the noisy point clouds through end-to-end learning. Moreover, we develop the architecture by integrating both color and geometric modalities into the point features to enhance the global descriptor representation. We conducted evaluations on public datasets ScanNet-PR and ARKit with 807 and 5047 scenarios, respectively. PoCo achieves SOTA performance: on ScanNet-PR, we achieve R@1 of 64.63%, a 5.7% improvement from the best-published result CGis (61.12%); on Arkit, we achieve R@1 of 45.12%, a 13.3% improvement from the best-published result CGis (39.82%). In addition, PoCo shows higher efficiency than CGis in inference time (1.75X-faster), and we demonstrate the effectiveness of PoCo in recognizing places within a real-world laboratory environment.


title: Boundary Algebras of Positroids

abstract: A dimer model is a quiver with faces embedded into a disk. A consistent dimer model gives rise to a strand diagram, and hence to a positroid. The Gorenstein-projective module category over the completed boundary algebra of a dimer model was shown by Pressland to categorify a cluster structure on the corresponding positroid variety. Outside of the Grassmannian case, boundary algebras of dimer models are not well understood. We give an explicit description of the boundary algebra of a consistent dimer model as a quiver with relations calculated only from the data of the decorated permutation or, equivalently, Grassmann necklace of its positroid.


title: Learning Quadrupedal Locomotion via Differentiable Simulation

abstract: The emergence of differentiable simulators enabling analytic gradient computation has motivated a new wave of learning algorithms that hold the potential to significantly increase sample efficiency over traditional Reinforcement Learning (RL) methods. While recent research has demonstrated performance gains in scenarios with comparatively smooth dynamics and, thus, smooth optimization landscapes, research on leveraging differentiable simulators for contact-rich scenarios, such as legged locomotion, is scarce. This may be attributed to the discontinuous nature of contact, which introduces several challenges to optimizing with analytic gradients. The purpose of this paper is to determine if analytic gradients can be beneficial even in the face of contact. Our investigation focuses on the effects of different soft and hard contact models on the learning process, examining optimization challenges through the lens of contact simulation. We demonstrate the viability of employing analytic gradients to learn physically plausible locomotion skills with a quadrupedal robot using Short-Horizon Actor-Critic (SHAC), a learning algorithm leveraging analytic gradients, and draw a comparison to a state-of-the-art RL algorithm, Proximal Policy Optimization (PPO), to understand the benefits of analytic gradients.


title: Branching Brownian motion versus Random Energy Model in the supercritical phase: overlap distribution and temperature susceptibility

abstract: In comparison with Derrida's REM, we investigate the influence of the so-called decoration processes arising in the limiting extremal processes of numerous log-correlated Gaussian fields. In particular, we focus on the branching Brownian motion and two specific quantities from statistical physics in the vicinity of the critical temperature. The first one is the two-temperature overlap, whose behavior at criticality is smoothened by the decoration process - unlike the one-temperature overlap which is identical - and the second one is the temperature susceptibility, as introduced by Sales and Bouchaud, which is strictly larger in the presence of decorations and diverges, close to the critical temperature, at the same speed as for the REM but with a different multiplicative constant. We also study some general decorated cases in order to highlight the fact that the BBM has a critical behavior in some sense to be made precise.


title: Steganographic Passport: An Owner and User Verifiable Credential for Deep Model IP Protection Without Retraining

abstract: Ensuring the legal usage of deep models is crucial to promoting trustable, accountable, and responsible artificial intelligence innovation. Current passport-based methods that obfuscate model functionality for license-to-use and ownership verifications suffer from capacity and quality constraints, as they require retraining the owner model for new users. They are also vulnerable to advanced Expanded Residual Block ambiguity attacks. We propose Steganographic Passport, which uses an invertible steganographic network to decouple license-to-use from ownership verification by hiding the user's identity images into the owner-side passport and recovering them from their respective user-side passports. An irreversible and collision-resistant hash function is used to avoid exposing the owner-side passport from the derived user-side passports and increase the uniqueness of the model signature. To safeguard both the passport and model's weights against advanced ambiguity attacks, an activation-level obfuscation is proposed for the verification branch of the owner's model. By jointly training the verification and deployment branches, their weights become tightly coupled. The proposed method supports agile licensing of deep models by providing a strong ownership proof and license accountability without requiring a separate model retraining for the admission of every new user. Experiment results show that our Steganographic Passport outperforms other passport-based deep model protection methods in robustness against various known attacks.


title: Mean-field theory of 1+1D $\mathbb{Z}_2$ lattice gauge theory with matter

abstract: Lattice gauge theories (LGTs) provide valuable insights into problems in strongly correlated many-body systems. Confinement which arises when matter is coupled to gauge fields is just one of the open problems, where LGT formalism can explain the underlying mechanism. However, coupling gauge fields to dynamical charges complicates the theoretical and experimental treatment of the problem. Developing a simplified mean-field theory is thus one of the ways to gain new insights into these complicated systems. Here we develop a mean-field theory of a paradigmatic 1+1D $\mathbb{Z}_2$ lattice gauge theory with superconducting pairing term, the gauged Kitaev chain, by decoupling charge and $\mathbb{Z}_2$ fields while enforcing the Gauss law on the mean-field level. We first determine the phase diagram of the original model in the context of confinement, which allows us to identify the symmetry-protected topological transition in the Kitaev chain as a confinement transition. We then compute the phase diagram of the effective mean-field theory, which correctly captures the main features of the original LGT. This is furthermore confirmed by the Green's function results and a direct comparison of the ground state energy. This simple LGT can be implemented in state-of-the art cold atom experiments. We thus also consider string-length histograms and the electric field polarization, which are easily accessible quantities in experimental setups and show that they reliably capture the various phases.

categories: cond-mat.quant-gas cond-mat.str-el hep-lat quant-ph


title: New Herbig-Haro Objects associated with Embedded Sources

abstract: We continue to present the results of the Byurakan Narrow Band Imaging Survey (BNBIS). The main goal of this survey is to search for Herbig-Haro (HH) objects and jets in Galactic dark clouds. In this work we present the results of the search in the vicinity of infrared sources that are bright in the WISE survey and embedded in the dark clouds. The survey is performed with the 1 m Schmidt telescope of Byurakan Observatory, lately equipped with a new CCD detector, which allows to obtain one square degree images of the sky in various filters. Narrow-band filters were used to obtain Halpha and [S II] images, and a medium-width filter was used for the continuum imaging. New HH flows and knots were found near six embedded IR sources, which constitutes a significant proportion of the objects observed. At least two of the newly found HH flows (HH 1226 and HH 1227) lie in isolated dark clouds, thus pointing to active star formation in these regions. Other flows are also located in detached and dense globules or filaments. The length of the HH 1228 flow is about 1 pc; it has also a molecular hydrogen counterpart of the same extension. Coordinates, charts, detailed descriptions and distance estimates are provided. The lower limits of bolometric luminosities of the source stars are typical for low-mass young stellar objects.


title: MODNO: Multi Operator Learning With Distributed Neural Operators

abstract: The study of operator learning involves the utilization of neural networks to approximate operators. Traditionally, the focus has been on single-operator learning (SOL). However, recent advances have rapidly expanded this to include the approximation of multiple operators using foundation models equipped with millions or billions of trainable parameters, leading to the research of multi-operator learning (MOL). In this paper, we present a novel distributed training approach aimed at enabling a single neural operator with significantly fewer parameters to effectively tackle multi-operator learning challenges, all without incurring additional average costs. Our method is applicable to various neural operators, such as Deep Operator Neural Networks (DON). The core idea is to independently learn the output basis functions for each operator using its dedicated data, while simultaneously centralizing the learning of the input function encoding shared by all operators using the entire dataset. Through a systematic study of five numerical examples, we compare the accuracy and cost of training a single neural operator for each operator independently versus training a MOL model using our proposed method. Our results demonstrate enhanced efficiency and satisfactory accuracy. Moreover, our approach illustrates that some operators with limited data can be more effectively constructed with the aid of data from analogous operators through MOL learning. This highlights another MOL's potential to bolster operator learning.


title: ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline

abstract: Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving. While many strategies and datasets to enhance LLMs' mathematics are developed, it remains a challenge to simultaneously maintain and improve both language and mathematical capabilities in deployed LLM systems.In this work, we tailor the Self-Critique pipeline, which addresses the challenge in the feedback learning stage of LLM alignment. We first train a general Math-Critique model from the LLM itself to provide feedback signals. Then, we sequentially employ rejective fine-tuning and direct preference optimization over the LLM's own generations for data collection. Based on ChatGLM3-32B, we conduct a series of experiments on both academic and our newly created challenging dataset, MathUserEval. Results show that our pipeline significantly enhances the LLM's mathematical problem-solving while still improving its language ability, outperforming LLMs that could be two times larger. Related techniques have been deployed to ChatGLM\footnote{\url{https://chatglm.cn}}, an online serving LLM. Related evaluation dataset and scripts are released at \url{https://github.com/THUDM/ChatGLM-Math}.


title: Automated Transparency: A Legal and Empirical Analysis of the Digital Services Act Transparency Database

abstract: The Digital Services Act (DSA) is a much awaited platforms liability reform in the European Union that was adopted on 1 November 2022 with the ambition to set a global example in terms of accountability and transparency. Among other obligations, the DSA emphasizes the need for online platforms to report on their content moderation decisions (`statements of reasons' - SoRs), which is a novel transparency mechanism we refer to as automated transparency in this study. SoRs are currently made available in the DSA Transparency Database, launched by the European Commission in September 2023. The DSA Transparency Database marks a historical achievement in platform governance, and allows investigations about the actual transparency gains, both at structure level as well as at the level of platform compliance. This study aims to understand whether the Transparency Database helps the DSA to live up to its transparency promises. We use legal and empirical arguments to show that while there are some transparency gains, compliance remains problematic, as the current database structure allows for a lot of discretion from platforms in terms of transparency practices. In our empirical study, we analyze a representative sample of the Transparency Database (131m SoRs) submitted in November 2023, to characterise and evaluate platform content moderation practices.


title: Renormalized energy of proper maps and conformal geodesics

abstract: We introduce a certain renormalized energy of proper maps between conformally compact Einstein manifolds, which is then used to give a holographic description of conformal geodesics on the boundary at infinity, in a way deeply inspired by a work of Fine and Herfray on renormalized area minimization and conformal geodesics.


title: Comment on "Machine learning conservation laws from differential equations"

abstract: In lieu of abstract, first paragraph reads: Six months after the author derived a constant of motion for a 1D damped harmonic oscillator [1], a similar result appeared by Liu, Madhavan, and Tegmark [2, 3], without citing the author. However, their derivation contained six serious errors, causing both their method and result to be incorrect. In this Comment, those errors are reviewed.


title: Deep Image Composition Meets Image Forgery

abstract: Image forgery is a topic that has been studied for many years. Before the breakthrough of deep learning, forged images were detected using handcrafted features that did not require training. These traditional methods failed to perform satisfactorily even on datasets much worse in quality than real-life image manipulations. Advances in deep learning have impacted image forgery detection as much as they have impacted other areas of computer vision and have improved the state of the art. Deep learning models require large amounts of labeled data for training. In the case of image forgery, labeled data at the pixel level is a very important factor for the models to learn. None of the existing datasets have sufficient size, realism and pixel-level labeling at the same time. This is due to the high cost of producing and labeling quality images. It can take hours for an image editing expert to manipulate just one image. To bridge this gap, we automate data generation using image composition techniques that are very related to image forgery. Unlike other automated data generation frameworks, we use state of the art image composition deep learning models to generate spliced images close to the quality of real-life manipulations. Finally, we test the generated dataset on the SOTA image manipulation detection model and show that its prediction performance is lower compared to existing datasets, i.e. we produce realistic images that are more difficult to detect. Dataset will be available at https://github.com/99eren99/DIS25k .


title: A Mean Field Game Model for Timely Computation in Edge Computing Systems

abstract: We consider the problem of task offloading in multi-access edge computing (MEC) systems constituting $N$ devices assisted by an edge server (ES), where the devices can split task execution between a local processor and the ES. Since the local task execution and communication with the ES both consume power, each device must judiciously choose between the two. We model the problem as a large population non-cooperative game among the $N$ devices. Since computation of an equilibrium in this scenario is difficult due to the presence of a large number of devices, we employ the mean-field game framework to reduce the finite-agent game problem to a generic user's multi-objective optimization problem, with a coupled consistency condition. By leveraging the novel age of information (AoI) metric, we invoke techniques from stochastic hybrid systems (SHS) theory and study the tradeoffs between increasing information freshness and reducing power consumption. In numerical simulations, we validate that a higher load at the ES may lead devices to upload their task to the ES less often.


title: MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignment

abstract: We present MatAtlas, a method for consistent text-guided 3D model texturing. Following recent progress we leverage a large scale text-to-image generation model (e.g., Stable Diffusion) as a prior to texture a 3D model. We carefully design an RGB texturing pipeline that leverages a grid pattern diffusion, driven by depth and edges. By proposing a multi-step texture refinement process, we significantly improve the quality and 3D consistency of the texturing output. To further address the problem of baked-in lighting, we move beyond RGB colors and pursue assigning parametric materials to the assets. Given the high-quality initial RGB texture, we propose a novel material retrieval method capitalized on Large Language Models (LLM), enabling editabiliy and relightability. We evaluate our method on a wide variety of geometries and show that our method significantly outperform prior arts. We also analyze the role of each component through a detailed ablation study.


title: DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets

abstract: Vision Transformer (ViT) has emerged as a prominent architecture for various computer vision tasks. In ViT, we divide the input image into patch tokens and process them through a stack of self attention blocks. However, unlike Convolutional Neural Networks (CNN), ViTs simple architecture has no informative inductive bias (e.g., locality,etc. ). Due to this, ViT requires a large amount of data for pre-training. Various data efficient approaches (DeiT) have been proposed to train ViT on balanced datasets effectively. However, limited literature discusses the use of ViT for datasets with long-tailed imbalances. In this work, we introduce DeiT-LT to tackle the problem of training ViTs from scratch on long-tailed datasets. In DeiT-LT, we introduce an efficient and effective way of distillation from CNN via distillation DIST token by using out-of-distribution images and re-weighting the distillation loss to enhance focus on tail classes. This leads to the learning of local CNN-like features in early ViT blocks, improving generalization for tail classes. Further, to mitigate overfitting, we propose distilling from a flat CNN teacher, which leads to learning low-rank generalizable features for DIST tokens across all ViT blocks. With the proposed DeiT-LT scheme, the distillation DIST token becomes an expert on the tail classes, and the classifier CLS token becomes an expert on the head classes. The experts help to effectively learn features corresponding to both the majority and minority classes using a distinct set of tokens within the same ViT architecture. We show the effectiveness of DeiT-LT for training ViT from scratch on datasets ranging from small-scale CIFAR-10 LT to large-scale iNaturalist-2018.


title: The Lavrentiev phenomenon

abstract: The basic problem of the calculus of variations consists of finding a function that minimizes an energy, like finding the fastest trajectory between two points for a point mass in a gravity field moving without friction under the influence of gravity or finding the best shape of a wing. The existence of a solution may be established in quite abstract spaces, much larger than the space of smooth functions. An important practical problem is that of being able to approach the value of the infimum of the energy. However, numerical methods work with very concrete functions and sometimes they are unable to approximate the infimum: this is the surprising Lavrentiev phenomenon. The papers that ensure the non-occurrence of the phenomenon form a recent saga, and the most general result formulated in the early '90s was actually fully proved just recently, more than 30 years later. Our aim here is to introduce the reader to the calculus of variations, to illustrate the Lavrentiev phenomenon with the simplest known example, and to give an elementary proof of the non-occurrence of the phenomenon.


title: Electron-Phonon Coupling using Many-Body Perturbation Theory: Implementation in the Questaal Electronic Structure Suite

abstract: The ability to calculate the electron-phonon coupling (e-ph) from first principles is of tremendous interest in materials science, as it provides a non-empirical approach to understand and predict a wide range of phenomena. While this has largely been accomplished in the Kohn-Sham framework of density functional theory (KS-DFT), it is becoming more apparent that standard approximations in KS-DFT can be inaccurate. These discrepancies are often attributed to a non-local potential where more advanced approaches to DFT or many-body perturbation theory have been used. However, a highly reliable and efficient first-principles approach to compute these quantities is still missing. With the goal of realizing a high-fidelity description of e-ph, we present a new field-theoretical methodology, incorporating the seminal work of Baym and Hedin within the quasiparticle self-consistent GW (QSGW) approximation, and the Questaal electronic structure package.


title: LidarDM: Generative LiDAR Simulation in a Generated World

abstract: We present LidarDM, a novel LiDAR generative model capable of producing realistic, layout-aware, physically plausible, and temporally coherent LiDAR videos. LidarDM stands out with two unprecedented capabilities in LiDAR generative modeling: (i) LiDAR generation guided by driving scenarios, offering significant potential for autonomous driving simulations, and (ii) 4D LiDAR point cloud generation, enabling the creation of realistic and temporally coherent sequences. At the heart of our model is a novel integrated 4D world generation framework. Specifically, we employ latent diffusion models to generate the 3D scene, combine it with dynamic actors to form the underlying 4D world, and subsequently produce realistic sensory observations within this virtual environment. Our experiments indicate that our approach outperforms competing algorithms in realism, temporal coherency, and layout consistency. We additionally show that LidarDM can be used as a generative world model simulator for training and testing perception models.