title: Optimal vintage factor analysis with deflation varimax

abstract: Vintage factor analysis is one important type of factor analysis that aims to first find a low-dimensional representation of the original data, and then to seek a rotation such that the rotated low-dimensional representation is scientifically meaningful. Perhaps the most widely used vintage factor analysis is the Principal Component Analysis (PCA) followed by the varimax rotation. Despite its popularity, little theoretical guarantee can be provided mainly because varimax rotation requires to solve a non-convex optimization over the set of orthogonal matrices. In this paper, we propose a deflation varimax procedure that solves each row of an orthogonal matrix sequentially. In addition to its net computational gain and flexibility, we are able to fully establish theoretical guarantees for the proposed procedure in a broad context. Adopting this new varimax approach as the second step after PCA, we further analyze this two step procedure under a general class of factor models. Our results show that it estimates the factor loading matrix in the optimal rate when the signal-to-noise-ratio (SNR) is moderate or large. In the low SNR regime, we offer possible improvement over using PCA and the deflation procedure when the additive noise under the factor model is structured. The modified procedure is shown to be optimal in all SNR regimes. Our theory is valid for finite sample and allows the number of the latent factors to grow with the sample size as well as the ambient dimension to grow with, or even exceed, the sample size. Extensive simulation and real data analysis further corroborate our theoretical findings.


title: Nonlinear Semimartingales and Markov Processes with Jumps

abstract: In this paper we study a family of nonlinear (conditional) expectations that can be understood as a semimartingale with uncertain local characteristics. Here, the differential characteristics are prescribed by a time and path-dependent set-valued function. We show that the associated control problem coincides with both its weak and relaxed counterparts. Furthermore, we establish regularity properties of the value function and discuss their relation to Feller properties of nonlinear semigroups. In the Markovian case we provide conditions that allow us to identify the corresponding semigroup as the unique viscosity solution to a nonlinear Hamilton-Jacobi-Bellman equation. To illustrate our results we discuss a random $G$-double exponential L\'evy setting.


title: InfoGCN++: Learning Representation by Predicting the Future for Online Human Skeleton-based Action Recognition

abstract: Skeleton-based action recognition has made significant advancements recently, with models like InfoGCN showcasing remarkable accuracy. However, these models exhibit a key limitation: they necessitate complete action observation prior to classification, which constrains their applicability in real-time situations such as surveillance and robotic systems. To overcome this barrier, we introduce InfoGCN++, an innovative extension of InfoGCN, explicitly developed for online skeleton-based action recognition. InfoGCN++ augments the abilities of the original InfoGCN model by allowing real-time categorization of action types, independent of the observation sequence's length. It transcends conventional approaches by learning from current and anticipated future movements, thereby creating a more thorough representation of the entire sequence. Our approach to prediction is managed as an extrapolation issue, grounded on observed actions. To enable this, InfoGCN++ incorporates Neural Ordinary Differential Equations, a concept that lets it effectively model the continuous evolution of hidden states. Following rigorous evaluations on three skeleton-based action recognition benchmarks, InfoGCN++ demonstrates exceptional performance in online action recognition. It consistently equals or exceeds existing techniques, highlighting its significant potential to reshape the landscape of real-time action recognition applications. Consequently, this work represents a major leap forward from InfoGCN, pushing the limits of what's possible in online, skeleton-based action recognition. The code for InfoGCN++ is publicly available at https://github.com/stnoah1/infogcn2 for further exploration and validation.


title: A perching and tilting aerial robot for precise and versatile power tool work on vertical walls

abstract: Drilling, grinding, and setting anchors on vertical walls are fundamental processes in everyday construction work. Manually doing these works is error-prone, potentially dangerous, and elaborate at height. Today, heavy mobile ground robots can perform automatic power tool work. However, aerial vehicles could be deployed in untraversable environments and reach inaccessible places. Existing drone designs do not provide the large forces, payload, and high precision required for using power tools. This work presents the first aerial robot design to perform versatile manipulation tasks on vertical concrete walls with continuous forces of up to 150 N. The platform combines a quadrotor with active suction cups for perching on walls and a lightweight, tiltable linear tool table. This combination minimizes weight using the propulsion system for flying, surface alignment, and feed during manipulation and allows precise positioning of the power tool. We evaluate our design in a concrete drilling application - a challenging construction process that requires high forces, accuracy, and precision. In 30 trials, our design can accurately pinpoint a target position despite perching imprecision. Nine visually guided drilling experiments demonstrate a drilling precision of 6 mm without further automation. Aside from drilling, we also demonstrate the versatility of the design by setting an anchor into concrete.


title: Applications of Distributed Machine Learning for the Internet-of-Things: A Comprehensive Survey

abstract: The emergence of new services and applications in emerging wireless networks (e.g., beyond 5G and 6G) has shown a growing demand for the usage of artificial intelligence (AI) in the Internet of Things (IoT). However, the proliferation of massive IoT connections and the availability of computing resources distributed across future IoT systems have strongly demanded the development of distributed AI for better IoT services and applications. Therefore, existing AI-enabled IoT systems can be enhanced by implementing distributed machine learning (aka distributed learning) approaches. This work aims to provide a comprehensive survey on distributed learning for IoT services and applications in emerging networks. In particular, we first provide a background of machine learning and present a preliminary to typical distributed learning approaches, such as federated learning, multi-agent reinforcement learning, and distributed inference. Then, we provide an extensive review of distributed learning for critical IoT services (e.g., data sharing and computation offloading, localization, mobile crowdsensing, and security and privacy) and IoT applications (e.g., smart healthcare, smart grid, autonomous vehicle, aerial IoT networks, and smart industry). From the reviewed literature, we also present critical challenges of distributed learning for IoT and propose several promising solutions and research directions in this emerging area.


title: Deep learning applied to EEG data with different montages using spatial attention

abstract: The ability of Deep Learning to process and extract relevant information in complex brain dynamics from raw EEG data has been demonstrated in various recent works. Deep learning models, however, have also been shown to perform best on large corpora of data. When processing EEG, a natural approach is to combine EEG datasets from different experiments to train large deep-learning models. However, most EEG experiments use custom channel montages, requiring the data to be transformed into a common space. Previous methods have used the raw EEG signal to extract features of interest and focused on using a common feature space across EEG datasets. While this is a sensible approach, it underexploits the potential richness of EEG raw data. Here, we explore using spatial attention applied to EEG electrode coordinates to perform channel harmonization of raw EEG data, allowing us to train deep learning on EEG data using different montages. We test this model on a gender classification task. We first show that spatial attention increases model performance. Then, we show that a deep learning model trained on data using different channel montages performs significantly better than deep learning models trained on fixed 23- and 128-channel data montages.


title: A geometry-originated universal relation for arbitrary convex hard particles

abstract: We have discovered that two significant quantities within hard particle systems: the probability of successfully inserting an additional particle at random and the scale distribution function, can be connected by a concise relation. We anticipate that this relation holds universal applicability for convex hard particles. Our investigations encompassed a range of particle shapes, including one-dimensional line segments, two-dimensional disks, equilateral and non-equilateral triangles, squares, rectangles, and three-dimensional spheres. Remarkably, we have observed a close alignment between the two sides of the relation in all cases we examined. Furthermore, we show that this relation can be derived from the fundamental thermodynamic relation that connects entropy, pressure, and chemical potential. Our study unveils a geometrically rooted relation that underpins essential thermodynamic relations, shedding light on the intricate interplay of geometry and thermodynamics in hard particle systems.


title: Optimal bounds for POD approximations of infinite horizon control problems based on time derivatives

abstract: In this paper we consider the numerical approximation of infinite horizon problems via the dynamic programming approach. The value function of the problem solves a Hamilton-Jacobi-Bellman (HJB) equation that is approximated by a fully discrete method. It is known that the numerical problem is difficult to handle by the so called curse of dimensionality. To mitigate this issue we apply a reduction of the order by means of a new proper orthogonal decomposition (POD) method based on time derivatives. We carry out the error analysis of the method using recently proved optimal bounds for the fully discrete approximations. Moreover, the use of snapshots based on time derivatives allow us to bound some terms of the error that could not be bounded in a standard POD approach. Some numerical experiments show the good performance of the method in practice.


title: TacticAI: an AI assistant for football tactics

abstract: Identifying key patterns of tactics implemented by rival teams, and developing effective responses, lies at the heart of modern football. However, doing so algorithmically remains an open research challenge. To address this unmet need, we propose TacticAI, an AI football tactics assistant developed and evaluated in close collaboration with domain experts from Liverpool FC. We focus on analysing corner kicks, as they offer coaches the most direct opportunities for interventions and improvements. TacticAI incorporates both a predictive and a generative component, allowing the coaches to effectively sample and explore alternative player setups for each corner kick routine and to select those with the highest predicted likelihood of success. We validate TacticAI on a number of relevant benchmark tasks: predicting receivers and shot attempts and recommending player position adjustments. The utility of TacticAI is validated by a qualitative study conducted with football domain experts at Liverpool FC. We show that TacticAI's model suggestions are not only indistinguishable from real tactics, but also favoured over existing tactics 90% of the time, and that TacticAI offers an effective corner kick retrieval system. TacticAI achieves these results despite the limited availability of gold-standard data, achieving data efficiency through geometric deep learning.


title: Kerr-Taub-NUT spacetime to explain the jet power and the radiative efficiency of astrophysical black holes

abstract: In this work, we investigate the electromagnetic energy released by astrophysical black holes within the Kerr-Taub-NUT solution, which describes rotating black holes with a nonvanishing gravitomagnetic charge. In our study, we consider the black holes in the X-ray binary systems GRS 1915+105, GRO J1655-40, XTE J1550-564, A0620-00, H1743-322, and GRS 1124-683. We show that the Kerr-Taub-NUT spacetime can explain the radiative efficiency of these sources inferred from the continuum fitting method (CFM). We also show that, in the framework of the Blandford-Znajeck mechanism, it is possible to reproduce the observed jet power. We unify the results of the two analyses for the selected objects to get more stringent constraints on the spacetime parameters. We show that, as in the case of the Kerr spacetime, the Kerr-Taub-NUT solution cannot simultaneously explain the observed jet power and radiative efficiency of GRS 1915+105.


title: Population-based wind farm monitoring based on a spatial autoregressive approach

abstract: An important challenge faced by wind farm operators is to reduce operation and maintenance cost. Structural health monitoring provides a means of cost reduction through minimising unnecessary maintenance trips as well as prolonging turbine service life. Population-based structural health monitoring can further reduce the cost of health monitoring systems by implementing one system for multiple structures (i.e.~turbines). At the same time, shared data within a population of structures may improve the predictions of structural behaviour. To monitor turbine performance at a population/farm level, an important initial step is to construct a model that describes the behaviour of all turbines under normal conditions. This paper proposes a population-level model that explicitly captures the spatial and temporal correlations (between turbines) induced by the wake effect. The proposed model is a Gaussian process-based spatial autoregressive model, named here a GP-SPARX model. This approach is developed since (a) it reflects our physical understanding of the wake effect, and (b) it benefits from a stochastic data-based learner. A case study is provided to demonstrate the capability of the GP-SPARX model in capturing spatial and temporal variations as well as its potential applicability in a health monitoring system.


title: Sample Complexity of Preference-Based Nonparametric Off-Policy Evaluation with Deep Networks

abstract: A recently popular approach to solving reinforcement learning is with data from human preferences. In fact, human preference data are now used with classic reinforcement learning algorithms such as actor-critic methods, which involve evaluating an intermediate policy over a reward learned from human preference data with distribution shift, known as off-policy evaluation (OPE). Such algorithm includes (i) learning reward function from human preference dataset, and (ii) learning expected cumulative reward of a target policy. Despite the huge empirical success, existing OPE methods with preference data often lack theoretical understanding and rely heavily on heuristics. In this paper, we study the sample efficiency of OPE with human preference and establish a statistical guarantee for it. Specifically, we approach OPE by learning the value function by fitted-Q-evaluation with a deep neural network. By appropriately selecting the size of a ReLU network, we show that one can leverage any low-dimensional manifold structure in the Markov decision process and obtain a sample-efficient estimator without suffering from the curse of high data ambient dimensionality. Under the assumption of high reward smoothness, our results \textit{almost align with the classical OPE results with observable reward data}. To the best of our knowledge, this is the first result that establishes a \textit{provably efficient} guarantee for off-policy evaluation with RLHF.


title: Computational design of optimal heterostructures for $\beta$-Ga$_2$O$_3$

abstract: Ga$_2$O$_3$ is a wide-bandgap material of interest for a wide variety of devices, many of these requiring heterostructures, for instance to achieve carrier confinement. A common method to create such heterostructures is to alloy with In$_2$O$_3$ or Al$_2$O$_3$. However, the lattice constants of these materials are significantly different from those of Ga$_2$O$_3$, leading to large amounts of strain in the resulting heterostructure. If the thickness of the heterostructure is increased, this can lead to cracking. By considering alloys of In$_2$O$_3$ and Al$_2$O$_3$, the lattice constants can be tailored to those of Ga$_2$O$_3$, while still keeping a sizable conduction-band offset. We use density functional theory with hybrid functionals to investigate the structural and electronic properties of In$_2$O$_3$ and Al$_2$O$_3$ alloys in the bixbyite, corundum, and monoclinic structures. We find that the lattice constants increase with In incorporation. Bandgaps decrease nonlinearly with increasing In concentration. We find the (In$_{\rm 0.25}$Al$_{\rm 0.75}$)$_{\rm 2}$O$_{\rm 3}$ monoclinic structure to be of particular interest, as it closely matches the Ga$_2$O$_3$ lattice constants while providing an indirect/direct bandgap of 5.94/5.70 eV and a conduction-band offset of 1 eV compared to Ga$_2$O$_3$.


title: Stability and bifurcation analysis of a two-patch model with Allee effect and dispersal

abstract: In the current manuscript, a first two-patch model with Allee effect and nonlinear dispersal is presented. We study both the ODE case and the PDE case here. In the ODE model, the stability of the equilibrium points and the existence of saddle-node bifurcation are discussed. The phase diagram and bifurcation curve of our model are also given by numerical simulation. Besides, the corresponding linear dispersal case is also presented. We show that when the Allee effect is large, high intensity of linear dispersal is not favorable to the persistence of the species. We further show when the Allee effect is large, nonlinear diffusion is more favorable to the survival of the population than linear diffusion. Moreover, the results of the PDE model extends our findings from discrete patches to continuous patches.


title: Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Data

abstract: Estimating treatment effects over time is relevant in many real-world applications, such as precision medicine, epidemiology, economy, and marketing. Many state-of-the-art methods either assume the observations of all confounders or seek to infer the unobserved ones. We take a different perspective by assuming unobserved risk factors, i.e., adjustment variables that affect only the sequence of outcomes. Under unconfoundedness, we target the Individual Treatment Effect (ITE) estimation with unobserved heterogeneity in the treatment response due to missing risk factors. We address the challenges posed by time-varying effects and unobserved adjustment variables. Led by theoretical results over the validity of the learned adjustment variables and generalization bounds over the treatment effect, we devise Causal DVAE (CDVAE). This model combines a Dynamic Variational Autoencoder (DVAE) framework with a weighting strategy using propensity scores to estimate counterfactual responses. The CDVAE model allows for accurate estimation of ITE and captures the underlying heterogeneity in longitudinal data. Evaluations of our model show superior performance over state-of-the-art models.


title: Towards the Imagenets of ML4EDA

abstract: Despite the growing interest in ML-guided EDA tools from RTL to GDSII, there are no standard datasets or prototypical learning tasks defined for the EDA problem domain. Experience from the computer vision community suggests that such datasets are crucial to spur further progress in ML for EDA. Here we describe our experience curating two large-scale, high-quality datasets for Verilog code generation and logic synthesis. The first, VeriGen, is a dataset of Verilog code collected from GitHub and Verilog textbooks. The second, OpenABC-D, is a large-scale, labeled dataset designed to aid ML for logic synthesis tasks. The dataset consists of 870,000 And-Inverter-Graphs (AIGs) produced from 1500 synthesis runs on a large number of open-source hardware projects. In this paper we will discuss challenges in curating, maintaining and growing the size and scale of these datasets. We will also touch upon questions of dataset quality and security, and the use of novel data augmentation tools that are tailored for the hardware domain.


title: Symmetry protected topological order as a requirement for measurement-based quantum gate teleportation

abstract: All known resource states for measurement-based quantum teleportation in correlation space possess symmetry protected topological order, but is this a sufficient or even necessary condition? This work considers two families of one-dimensional qubit states to answer this question in the negative. The first is a family of matrix-product states with bond dimension two that includes the cluster state as a special case, protected by a global non-onsite symmetry, which is characterized by a finite correlation length and a degenerate entanglement spectrum in the thermodynamic limit but which is unable to deterministically teleport a universal set of single-qubit gates. The second are states with bond dimension four that are a resource for deterministic universal teleportation of finite single-qubit gates, but which possess no symmetry.


title: Trompe L'oeil Ferromagnetism: magnetic point group analysis

abstract: Ferromagnetism can be characterized by various unique phenomena such as non-zero magnetization (inducing magnetic attraction/repulsion), diagonal piezomagnetism, nonreciprocal circular dichroism (such as Faraday effect), odd-order (including linear) anomalous Hall effect, and magneto-optical Kerr effect. We identify all broken symmetries requiring each of the above phenomena, and also the relevant magnetic point groups (MPGs) with those broken symmetries. All of ferromagnetic point groups, relevant for ferromagnets, ferri-magnets and weak ferromagnets, can certainly exhibit all of these phenomena, including non-zero magnetization. Some of true antiferromagnets, which are defined as magnets with MPGs that do not belong to ferromagnetic point groups, can display these phenomena through magnetization induced by external perturbations such as applied current, electric fields, light illumination, and strain. Such MPGs are identified for each external perturbation. Since high-density and ultrafast spintronic technologies can be enabled by antiferromagnets, our findings will be an essential guidance for the future magnetism-related science as well as technology.


title: RefConv: Re-parameterized Refocusing Convolution for Powerful ConvNets

abstract: We propose Re-parameterized Refocusing Convolution (RefConv) as a replacement for regular convolutional layers, which is a plug-and-play module to improve the performance without any inference costs. Specifically, given a pre-trained model, RefConv applies a trainable Refocusing Transformation to the basis kernels inherited from the pre-trained model to establish connections among the parameters. For example, a depth-wise RefConv can relate the parameters of a specific channel of convolution kernel to the parameters of the other kernel, i.e., make them refocus on the other parts of the model they have never attended to, rather than focus on the input features only. From another perspective, RefConv augments the priors of existing model structures by utilizing the representations encoded in the pre-trained parameters as the priors and refocusing on them to learn novel representations, thus further enhancing the representational capacity of the pre-trained model. Experimental results validated that RefConv can improve multiple CNN-based models by a clear margin on image classification (up to 1.47% higher top-1 accuracy on ImageNet), object detection and semantic segmentation without introducing any extra inference costs or altering the original model structure. Further studies demonstrated that RefConv can reduce the redundancy of channels and smooth the loss landscape, which explains its effectiveness.


title: Corrections to diffusion in interacting quantum systems

abstract: Transport and the approach to equilibrium in interacting classical and quantum systems is a challenging problem of both theoretical and experimental interest. One useful organizing principle characterizing equilibration is the dissipative universality class, the most prevalent one being diffusion. In this paper, we use the effective field theory (EFT) of diffusion to systematically obtain universal power-law corrections to diffusion. We then employ large-scale simulations of classical and quantum systems to explore their validity. In particular, we find universal scaling functions for the corrections to the dynamical structure factor $\langle n(x,t)n\rangle$, in the presence of a single $U(1)$ or $SU(2)$ charge in systems with and without particle-hole symmetry, and present the framework to generalize the calculation to multiple charges. Classical simulations show remarkable agreement with EFT predictions for subleading corrections, pushing precision tests of effective theories for thermalizing systems to an unprecedented level. Moving to quantum systems, we perform large-scale tensor-network simulations in unitary and noisy 1d Floquet systems with conserved magnetization. We find a qualitative agreement with EFT which becomes quantitative in the case of noisy systems. Additionally, we show how the knowledge of EFT corrections allows for fitting methods, which can improve the estimation of transport parameters at the intermediate times accessible by simulations and experiments. Finally, we explore non-linear response in quantum systems and find that EFT provides an accurate prediction for its behavior. Our results provide a basis for a better understanding of the non-linear phenomena present in thermalizing systems.


title: HelmFluid: Learning Helmholtz Dynamics for Interpretable Fluid Prediction

abstract: Fluid prediction is a long-standing challenge due to the intrinsic high-dimensional non-linear dynamics. Previous methods usually utilize the non-linear modeling capability of deep models to directly estimate velocity fields for future prediction. However, skipping over inherent physical properties but directly learning superficial velocity fields will overwhelm the model from generating precise or physics-reliable results. In this paper, we propose the HelmFluid toward an accurate and interpretable predictor for fluid. Inspired by the Helmholtz theorem, we design a HelmDynamics block to learn Helmholtz dynamics, which decomposes fluid dynamics into more solvable curl-free and divergence-free parts, physically corresponding to potential and stream functions of fluid. By embedding the HelmDynamics block into a Multiscale Multihead Integral Architecture, HelmFluid can integrate learned Helmholtz dynamics along temporal dimension in multiple spatial scales to yield future fluid. Compared with previous velocity estimating methods, HelmFluid is faithfully derived from Helmholtz theorem and ravels out complex fluid dynamics with physically interpretable evidence. Experimentally, HelmFluid achieves consistent state-of-the-art in both numerical simulated and real-world observed benchmarks, even for scenarios with complex boundaries.


title: Computation of Grundy dominating sequences in (co-)bipartite graphs

abstract: A sequence $S$ of vertices of a graph $G$ is called a dominating sequence of $G$ if $(i)$ each vertex $v$ of $S$ dominates a vertex of $G$ that was not dominated by any of the vertices preceding vertex $v$ in $S$, and $(ii)$ every vertex of $G$ is dominated by at least one vertex of $S$. The Grundy Domination problem is to find a longest dominating sequence for a given graph $G$. It has been known that the decision version of the Grundy Domination problem is NP-complete even when restricted to chordal graphs. In this paper, we prove that the decision version of the Grundy Domination problem is NP-complete for bipartite graphs and co-bipartite graphs. On the positive side, we present a linear-time algorithm that solves the Grundy Domination problem for chain graphs, which form a subclass of bipartite graphs.


title: RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language Modeling

abstract: Retrieval-augmented language models show promise in addressing issues like outdated information and hallucinations in language models (LMs). However, current research faces two main problems: 1) determining what information to retrieve, and 2) effectively combining retrieved information during generation. We argue that valuable retrieved information should not only be related to the current source text but also consider the future target text, given the nature of LMs that model future tokens. Moreover, we propose that aggregation using latent variables derived from a compact latent space is more efficient than utilizing explicit raw text, which is limited by context length and susceptible to noise. Therefore, we introduce RegaVAE, a retrieval-augmented language model built upon the variational auto-encoder (VAE). It encodes the text corpus into a latent space, capturing current and future information from both source and target text. Additionally, we leverage the VAE to initialize the latent space and adopt the probabilistic form of the retrieval generation paradigm by expanding the Gaussian prior distribution into a Gaussian mixture distribution. Theoretical analysis provides an optimizable upper bound for RegaVAE. Experimental results on various datasets demonstrate significant improvements in text generation quality and hallucination removal.


title: Frobenius sign separation for abelian varieties

abstract: Let A and A' be abelian varieties defined over a number field k such that Hom(A,A') = 0. Under the Generalized Riemann hypothesis for motivic L-functions attached to A and A', we show that there exists a prime p of k of good reduction for A and A' at which the Frobenius traces of A and A' are nonzero and differ by sign, and such that the norm Nm(p) is O(log(2NN')^2), where N and N' respectively denote the absolute conductors of A and A'. Our method extends that of Chen, Park, and Swaminathan who considered the case in which A and A' are elliptic curves.


title: Di-Higgs productions at N$^3$LO+N$^3$LL

abstract: In this talk, we discuss the soft-gluon resummation for a pair of Higgs bosons in the dominant gluon fusion channel to next-to-next-to-next-to-leading logarithmic (N$^3$LL) accuracy. Through the study, we achieve sub-percent level accuracy in the uncertainties from the residual renormalisation and factorisation scales, for both inclusive and differential mass distribution in the infinite top quark mass limit. We also combine these results with the full top mass dependent next-to-leading order calculations.


title: On Context Utilization in Summarization with Large Language Models

abstract: Large language models (LLMs) excel in abstractive summarization tasks, delivering fluent and pertinent summaries. Recent advancements have extended their capabilities to handle long-input contexts, exceeding 100k tokens. However, in question answering, language models exhibit uneven utilization of their input context. They tend to favor the initial and final segments, resulting in a U-shaped performance pattern concerning where the answer is located within the input. This bias raises concerns, particularly in summarization where crucial content may be dispersed throughout the source document(s). Besides, in summarization, mapping facts from the source to the summary is not trivial as salient content is usually re-phrased. In this paper, we conduct the first comprehensive study on context utilization and position bias in summarization. Our analysis encompasses 6 LLMs, 10 datasets, and 5 evaluation metrics. We introduce a new evaluation benchmark called MiddleSum on the which we benchmark two alternative inference methods to alleviate position bias: hierarchical summarization and incremental summarization. Our code and data can be found here: https://github.com/ntunlp/MiddleSum.


title: Emerging Challenges in Personalized Medicine: Assessing Demographic Effects on Biomedical Question Answering Systems

abstract: State-of-the-art question answering (QA) models exhibit a variety of social biases (e.g., with respect to sex or race), generally explained by similar issues in their training data. However, what has been overlooked so far is that in the critical domain of biomedicine, any unjustified change in model output due to patient demographics is problematic: it results in the unfair treatment of patients. Selecting only questions on biomedical topics whose answers do not depend on ethnicity, sex, or sexual orientation, we ask the following research questions: (RQ1) Do the answers of QA models change when being provided with irrelevant demographic information? (RQ2) Does the answer of RQ1 differ between knowledge graph (KG)-grounded and text-based QA systems? We find that irrelevant demographic information change up to 15% of the answers of a KG-grounded system and up to 23% of the answers of a text-based system, including changes that affect accuracy. We conclude that unjustified answer changes caused by patient demographics are a frequent phenomenon, which raises fairness concerns and should be paid more attention to.


title: Factorization in Haar system Hardy spaces

abstract: A Haar system Hardy space is the completion of the linear span of the Haar system $(h_I)_I$, either under a rearrangement-invariant norm $\|\cdot \|$ or under the associated square function norm \begin{equation*} \Bigl\| \sum_Ia_Ih_I \Bigr\|_{*} = \Bigl\| \Bigl( \sum_I a_I^2 h_I^2 \Bigr)^{1/2} \Bigr\|. \end{equation*} Apart from $L^p$, $1\le p<\infty$, the class of these spaces includes all separable rearrangement-invariant function spaces on $[0,1]$ and also the dyadic Hardy space $H^1$. Using a unified and systematic approach, we prove that a Haar system Hardy space $Y$ with $Y\ne C(\Delta)$ ($C(\Delta)$ denotes the continuous functions on the Cantor set) has the following properties, which are closely related to the primariness of $Y$: For every bounded linear operator $T$ on $Y$, the identity $I_Y$ factors either through $T$ or through $I_Y - T$, and if $T$ has large diagonal with respect to the Haar system, then the identity factors through $T$. In particular, we obtain that \begin{equation*} \mathcal{M}_Y = \{ T\in \mathcal{B}(Y) : I_Y \ne ATB\text{ for all } A, B\in \mathcal{B}(Y) \} \end{equation*} is the unique maximal ideal of the algebra $\mathcal{B}(Y)$ of bounded linear operators on $Y$. Moreover, we prove similar factorization results for the spaces $\ell^p(Y)$, $1\le p \leq \infty$, and use them to show that they are primary.


title: Content Moderation and the Formation of Online Communities: A Theoretical Framework

abstract: We study the impact of content moderation policies in online communities. In our theoretical model, a platform chooses a content moderation policy and individuals choose whether or not to participate in the community according to the fraction of user content that aligns with their preferences. The effects of content moderation, at first blush, might seem obvious: it restricts speech on a platform. However, when user participation decisions are taken into account, its effects can be more subtle $\unicode{x2013}$ and counter-intuitive. For example, our model can straightforwardly demonstrate how moderation policies may increase participation and diversify content available on the platform. In our analysis, we explore a rich set of interconnected phenomena related to content moderation in online communities. We first characterize the effectiveness of a natural class of moderation policies for creating and sustaining stable communities. Building on this, we explore how resource-limited or ideological platforms might set policies, how communities are affected by differing levels of personalization, and competition between platforms. Our model provides a vocabulary and mathematically tractable framework for analyzing platform decisions about content moderation.


title: Near-Field Aeroacoustic Shape Optimization at Low Reynolds Numbers

abstract: In this paper, we investigated the feasibility of gradient-free aeroacoustic shape optimization. The sound pressure level at a near-field observer is computed directly from the flow field, and the shape is optimized with the objective of minimizing the sound pressure level at this observer. The Flux Reconstruction (FR) approach, is used to study the flow over two-dimensional objects at low Reynolds numbers. The Sound Pressure Level (SPL) is computed using a direct acoustic approach at an observer in the near field. Aeroacoustic shape optimization is performed using the gradient-free Mesh Adaptive Direct Search (MADS) technique. A $7\%$ noise reduction is achieved for flow over an open deep cavity with a length-to-depth ratio of $L/D=4$ at Reynolds number of $Re=1500$ based on the cavity depth and free-stream Mach number of $M_\infty = 0.15$. The second case considers tandem cylinders at $Re=200$ and $M_\infty = 0.2$. Over $12\%$ noise reduction is achieved by optimizing the distance between the cylinders and their diameter ratio. Finally, a baseline NACA0012 airfoil is optimized at $Re=10000$ and $M_\infty = 0.2$ to reduce trailing edge noise. The airfoil's shape is optimized to generate a new 4-digit NACA airfoil at an appropriate angle of attack to reduce the SPL while ensuring the baseline time-averaged lift coefficient is maintained and prevent any increase in the baseline time-averaged drag coefficient. The optimized airfoil is silent with $0~dB$ noise and the drag coefficient is decreased by $24.95\%$. These results demonstrate the feasibility of shape optimization using MADS and FR for aeroacoustic design.


title: Matching the Neuronal Representations of V1 is Necessary to Improve Robustness in CNNs with V1-like Front-ends

abstract: While some convolutional neural networks (CNNs) have achieved great success in object recognition, they struggle to identify objects in images corrupted with different types of common noise patterns. Recently, it was shown that simulating computations in early visual areas at the front of CNNs leads to improvements in robustness to image corruptions. Here, we further explore this result and show that the neuronal representations that emerge from precisely matching the distribution of RF properties found in primate V1 is key for this improvement in robustness. We built two variants of a model with a front-end modeling the primate primary visual cortex (V1): one sampling RF properties uniformly and the other sampling from empirical biological distributions. The model with the biological sampling has a considerably higher robustness to image corruptions that the uniform variant (relative difference of 8.72%). While similar neuronal sub-populations across the two variants have similar response properties and learn similar downstream weights, the impact on downstream processing is strikingly different. This result sheds light on the origin of the improvements in robustness observed in some biologically-inspired models, pointing to the need of precisely mimicking the neuronal representations found in the primate brain.


title: Implicative models of set theory

abstract: In this paper we show that using implicative algebras one can produce models of set theory generalizing Heyting/Boolean-valued models and realizability models of (I)ZF, both in intuitionistic and classical logic. This has as consequence that any topos which is obtained from a Set-based tripos as the result of the tripos-to-topos construction hosts a model of intuitionistic or classical set theory, provided a large enough strongly inaccessible cardinal exists.


title: Nonradial nondegeneracy and uniqueness of positive solutions to a class of fractional semilinear equations

abstract: We prove that positive solutions $u\in H^s(\mathbb{R}^N)$ to the equation $(-\Delta )^s u+ u=u^p$ in $\mathbb{R}^N$ are nonradially nondegenerate, for all $s\in (0,1)$, $N\geq 1$ and $p>1$ strictly smaller than the critical Sobolev exponent. By this we mean that the linearized equation $(-\Delta )^s w+ w-pu^{p-1}w = 0$ does not admit nonradial solutions beside the directional derivatives of $u$. Letting $B$ be the unit centered ball and $\lambda_1(B)$ the first Dirichlet eigenvalue of the fractional Laplacian $(-\Delta )^s$, we also prove that positive solutions to $(-\Delta )^s u+\lambda u=u^p$ in ${B}$ with $u=0$ on $\mathbb{R}^N\setminus B$, are nonradially nondegenerate for any $\lambda> -\lambda_1(B)$ in the sense that the linearized equation does not admit nonradial solutions. From the latter result, we then deduce uniqueness and full nondegeneracy of positive solutions in the special case $N=1$ and $\lambda = 0$. Moreover, we deduce uniqueness of positive ground state solutions in the case $N=1$, $\lambda \ge 0$.


title: Indoor Wireless Signal Modeling with Smooth Surface Diffraction Effects

abstract: We present a novel algorithm that enhances the accuracy of electromagnetic field simulations in indoor environments by incorporating the Uniform Geometrical Theory of Diffraction (UTD) for surface diffraction. This additional diffraction phenomenology is important for the design of modern wireless systems and allows us to capture the effects of more complex scene geometries. Central to our methodology is the Dynamic Coherence-Based EM Ray Tracing Simulator (DCEM), and we augment that formulation with smooth surface UTD and present techniques to efficiently compute the ray paths. We validate our additions by comparing them to analytical solutions of a sphere, method of moments solutions from FEKO, and ray-traced indoor scenes from WinProp. Our algorithm improves shadow region predicted powers by about 5dB compared to our previous work, and captures nuanced field effects beyond shadow boundaries. We highlight the performance on different indoor scenes and observe 60% faster computation time over WinProp.


title: Pion Valence-Quark Generalized Parton Distribution at Physical Pion Mass

abstract: We present the first lattice-QCD $x$-dependent pion valence-quark generalized parton distribution (GPD) calculated directly at physical pion mass using the Large-Momentum Effective Theory (LaMET) with next-to-next-to-leading order perturbative matching correction. We use clover fermions for the valence action on $2+1+1$ flavors of highly improved staggered quarks (HISQ), generated by MILC Collaboration, with lattice spacing $a \approx 0.09$fm and box size $L \approx 5.5$fm; the pion two-point measurements number up to $O(10^6)$ with boost momentum 1.73GeV. The pion valence distribution is renormalized in hybrid scheme with Wilson-line mass subtraction at large distances in coordinate space, followed by a procedure to match it to the $\overline{\text{MS}}$ scheme. We focus on the zero-skewness limit, where the GPD has a probability-density interpretation in the longitudinal Bjorken $x$ and the transverse impact-parameter distributions. We take the integral of our GPD functions to generate leading moment so that we can make comparisons with past lattice-QCD and experimental determinations of the pion form factors and found consistent agreement among them. We predict the higher GPD moments and reveal $x$-dependent tomography of the pion for the first time using lattice QCD.


title: Algebraic characterisations of path algebras

abstract: The theory of path algebras is usually circunscripted to the study of representations, usually linked to finite graphs. In our work, we focus on studying the structure of path algebras over a field associated to arbitrary graphs. We characterise perfection (simplicity, primitivity, primeness and semiprimeness) and finitness conditions (artinianity, semiartinianity and noetherianity) in terms of geometric conditions in the associated graph. In order to do so, we also compute the socle and the Jacobson radical of a path algebra. In addition, we study the centroid of any path algebra and the extended centroid and central closure of the path algebra of a cycle. We obtain two structure theorems, one for semiprime path algebras, and another for noetherian ones. Semiprime path algebras are direct sum of simple, prime and primitive algebras, and noetherian path algebras modulo its radical will be isomorphic to upper triangular formal matrix algebras, they can also be seen as direct sums of path algebras of cycles and copies of the ground field itself.


title: On Weil-Stark elements, II: refined Stark conjectures

abstract: The theory of Weil-Stark elements is used to develop an axiomatic approach to the formulation of refined versions of Stark's Conjecture. This gives concrete new results concerning leading terms of Artin $L$-series and arithmetic properties of Stark elements.


title: A note on two-times measurement entropy production and modular theory

abstract: Recent theoretical investigations of the two-times measurement entropy production (2TMEP) in quantum statistical mechanics have shed a new light on the mathematics and physics of the quantum-mechanical probabilistic rules. Among notable developments are the extensions of entropic fluctuation relations to quantum domain and discovery of a deep link between 2TMEP and modular theory of operator algebras. All these developments concerned the setting where the state of the system at the instant of the first measurement is the same as the state whose entropy production is measured. In this work we consider the case where these two states are different and link this more general 2TEMP to modular theory. The established connection allows us to show that under general ergodicity assumptions the 2TEMP is essentially independent of the choice of the system state at the instant of the first measurement due to a decoherence effect induced by the first measurement. This stability sheds a new light on the concept of quantum entropy production, and, in particular, on possible quantum formulations of the celebrated classical Gallavotti--Cohen Fluctuation Theorem which will be studied in the continuation of this work.

categories: math-ph cond-mat.stat-mech math.MP quant-ph


title: Who Are All The Stochastic Parrots Imitating? They Should Tell Us!

abstract: Both standalone language models (LMs) as well as LMs within downstream-task systems have been shown to generate statements which are factually untrue. This problem is especially severe for low-resource languages, where training data is scarce and of worse quality than for high-resource languages. In this opinion piece, we argue that LMs in their current state will never be fully trustworthy in critical settings and suggest a possible novel strategy to handle this issue: by building LMs such that can cite their sources - i.e., point a user to the parts of their training data that back up their outputs. We first discuss which current NLP tasks would or would not benefit from such models. We then highlight the expected benefits such models would bring, e.g., quick verifiability of statements. We end by outlining the individual tasks that would need to be solved on the way to developing LMs with the ability to cite. We hope to start a discussion about the field's current approach to building LMs, especially for low-resource languages, and the role of the training data in explaining model generations.


title: Universal Bounds on Information-Processing Capabilities of Markov Processes

abstract: We consider a finite-state, continuous-time Markov process, represented in the "linear framework" by a directed graph with labelled edges which specifies the infinitesimal generator of the process. If the graph is strongly connected, the process has a unique steady-state probability distribution, $p$, which may not be one of thermodynamic equilibrium. If the label (rate) of any edge (transition) is perturbed, to reach the new steady-state probability distribution $p'$, we find that the Kullback-Leibler (KL) divergence between these distributions is bounded by the change in the thermodynamic affinity, $\Delta A(C)$, of any cycle, $C$, that includes the altered transition, D$_{KL}$$(p'||p) \leq |\Delta A(C)|$, irrespective of the structure of the graph. It follows that, if an equilibrium distribution is shifted away from equilibrium by perturbing a single rate, then the free energy difference between these distributions is similarly bounded $F^{neq}-F^{eq}\leq |\Delta A(C)|$. Our analysis reveals universal, energy-induced bounds on the information-processing capabilities of Markov systems operating arbitrarily far from thermodynamic equilibrium.


title: Temporally Robust Multi-Agent STL Motion Planning in Continuous Time

abstract: Signal Temporal Logic (STL) is a formal language over continuous-time signals (such as trajectories of a multi-agent system) that allows for the specification of complex spatial and temporal system requirements (such as staying sufficiently close to each other within certain time intervals). To promote robustness in multi-agent motion planning with such complex requirements, we consider motion planning with the goal of maximizing the temporal robustness of their joint STL specification, i.e. maximizing the permissible time shifts of each agent's trajectory while still satisfying the STL specification. Previous methods presented temporally robust motion planning and control in a discrete-time Mixed Integer Linear Programming (MILP) optimization scheme. In contrast, we parameterize the trajectory by continuous B\'ezier curves, where the curvature and the time-traversal of the trajectory are parameterized individually. We show an algorithm generating continuous-time temporally robust trajectories and prove soundness of our approach. Moreover, we empirically show that our parametrization realizes this with a considerable speed-up compared to state-of-the-art methods based on constant interval time discretization.


title: VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools

abstract: Building models that comprehends videos and responds specific user instructions is a practical and challenging topic, as it requires mastery of both vision understanding and knowledge reasoning. Compared to language and image modalities, training efficiency remains a serious problem as existing studies train models on massive sparse videos paired with brief descriptions. In this paper, we introduce \textbf{VidCoM}, a fast adaptive framework that leverages Large Language Models (LLMs) to reason about videos using lightweight visual tools. Specifically, we reveal that the key to responding to specific instructions is focusing on relevant video events, and utilize two visual tools, structured scene graph generation and descriptive image caption generation, to gather and represent the event information. Thus, a LLM enriched with world knowledge is adopted as the reasoning agent to achieve the responses by performing multiple reasoning steps on specific video events. To address the difficulty of LLMs identifying video events, we further propose an Instruction-oriented Video Events Recognition (InsOVER) algorithm. This algorithm locates the corresponding video events based on an efficient Hungarian matching between decompositions of linguistic instructions and video events, thereby enabling LLMs to interact effectively with extended videos. Extensive experiments on two typical video comprehension tasks show that the proposed tuning-free framework outperforms the pre-trained models including Flamingo-80B, to achieve the state-of-the-art performance. Our source code and system will be publicly available.


title: A Tri-Level Optimization Model for Interdependent Infrastructure Network Resilience Against Compound Hazard Events

abstract: Resilient operation of interdependent infrastructures against compound hazard events is essential for maintaining societal well-being. To address consequence assessment challenges in this problem space, we propose a novel tri-level optimization model applied to a proof-of-concept case study with fuel distribution and transportation networks -- encompassing one realistic network; one fictitious, yet realistic network; as well as networks drawn from three synthetic distributions. Mathematically, our approach takes the form of a defender-attacker-defender (DAD) model -- a multi-agent tri-level optimization, comprised of a defender, attacker, and an operator acting in sequence. Here, our notional operator may choose proxy actions to operate an interdependent system comprised of fuel terminals and gas stations (functioning as supplies) and a transportation network with traffic flow (functioning as demand) to minimize unmet demand at gas stations. A notional attacker aims to hypothetically disrupt normal operations by reducing supply at the supply terminals, and the notional defender aims to identify best proxy defense policy options which include hardening supply terminals or allowing alternative distribution methods such as trucking reserve supplies. We solve our DAD formulation at a metropolitan scale and present practical defense policy insights against hypothetical compound hazards. We demonstrate the generalizability of our framework by presenting results for a realistic network; a fictitious, yet realistic network; as well as for three networks drawn from synthetic distributions. Additionally, we demonstrate the scalability of the framework by investigating runtime performance as a function of the network size. Steps for future research are also discussed.


title: Max-convolution processes with random shape indicator kernels

abstract: In this paper, we introduce a new class of models for spatial data obtained from max-convolution processes based on indicator kernels with random shape. We show that this class of models have appealing dependence properties including tail dependence at short distances and independence at long distances. We further consider max-convolutions between such processes and processes with tail independence, in order to separately control the bulk and tail dependence behaviors, and to increase flexibility of the model at longer distances, in particular, to capture intermediate tail dependence. We show how parameters can be estimated using a weighted pairwise likelihood approach, and we conduct an extensive simulation study to show that the proposed inference approach is feasible in high dimensions and it yields accurate parameter estimates in most cases. We apply the proposed methodology to analyse daily temperature maxima measured at 100 monitoring stations in the state of Oklahoma, US. Our results indicate that our proposed model provides a good fit to the data, and that it captures both the bulk and the tail dependence structures accurately.


title: Delayed Massive-Star Mechanical Feedback at Low Metallicity

abstract: The classical model of massive-star mechanical feedback is based on effects at solar metallicity (Zsun), yet feedback parameters are very different at low metallicity. Metal-poor stellar winds are much weaker, and more massive supernova progenitors likely collapse directly to black holes without exploding. Thus, for ~0.4 Zsun we find reductions in the total integrated mechanical energy and momentum of ~40% and 75%, respectively, compared to values classically expected at solar metallicity. But in particular, these changes effectively delay the onset of mechanical feedback until ages of ~10 Myr. Feedback from high-mass X-ray binaries could slightly increase mechanical luminosity between ages 5-10 Myr, but it is stochastic and unlikely to be significant on this timescale. Stellar dynamical mechanisms remove most massive stars from clusters well before 10 Myr, which would further promote this effect; this process is exacerbated by gas retention implied by weak feedback. Delayed mechanical feedback implies that radiation feedback therefore dominates at early ages, which is consistent with the observed absence of superwinds in some extreme starbursts. This scenario may lead to higher star-formation efficiencies, multiple stellar populations in clusters, and higher Lyman continuum escape. This could explain the giant star-forming complexes in metal-poor galaxies and the small sizes of OB superbubble shells relative to their inferred ages. It could also drive modest effects on galactic chemical evolution, including on oxygen abundances. Thus, delayed low-metallicity mechanical feedback may have broad implications, including for early cosmic epochs.


title: Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environment

abstract: Open Information Extraction (OIE) aims to extract objective structured knowledge from natural texts, which has attracted growing attention to build dedicated models with human experience. As the large language models (LLMs) have exhibited remarkable in-context learning capabilities, a question arises as to whether the task of OIE can be effectively tackled with this paradigm? In this paper, we explore solving the OIE problem by constructing an appropriate reasoning environment for LLMs. Specifically, we first propose a method to effectively estimate the discrepancy of syntactic distribution between a LLM and test samples, which can serve as correlation evidence for preparing positive demonstrations. Upon the evidence, we introduce a simple yet effective mechanism to establish the reasoning environment for LLMs on specific tasks. Without bells and whistles, experimental results on the standard CaRB benchmark demonstrate that our $6$-shot approach outperforms state-of-the-art supervised method, achieving an $55.3$ $F_1$ score. Further experiments on TACRED and ACE05 show that our method can naturally generalize to other information extraction tasks, resulting in improvements of $5.7$ and $6.8$ $F_1$ scores, respectively.


title: Interpreting and Controlling Vision Foundation Models via Text Explanations

abstract: Large-scale pre-trained vision foundation models, such as CLIP, have become de facto backbones for various vision tasks. However, due to their black-box nature, understanding the underlying rules behind these models' predictions and controlling model behaviors have remained open challenges. We present a framework for interpreting vision transformer's latent tokens with natural language. Given a latent token, our framework retains its semantic information to the final layer using transformer's local operations and retrieves the closest text for explanation. Our approach enables understanding of model visual reasoning procedure without needing additional model training or data collection. Based on the obtained interpretations, our framework allows for model editing that controls model reasoning behaviors and improves model robustness against biases and spurious correlations.


title: Directional atomic layer etching of MgO-doped lithium niobate using sequential exposures of H$_2$ and SF$_6$ plasma

abstract: Lithium niobate (LiNbO$_3$, LN) is a ferroelectric crystal of interest for integrated photonics owing to its large second-order optical nonlinearity and the ability to impart periodic poling via an external electric field. However, on-chip device performance based on thin-film lithium niobate (TFLN) is presently limited by optical loss arising from corrugations between poled regions and sidewall surface roughness. Atomic layer etching (ALE) could potentially smooth these features and thereby increase photonic performance, but no ALE process has been reported for LN. Here, we report a directional ALE process for $x$-cut MgO-doped LN using sequential exposures of H$_2$ and SF$_6$/Ar plasmas. We observe etch rates up to $1.01 \pm 0.05$ nm/cycle with a synergy of $94$%. We also demonstrate ALE can be achieved with SF$_6$/O$_2$ or Cl$_2$/BCl$_3$ plasma exposures in place of the SF$_6$/Ar plasma step with synergies above $90$%. When combined with a wet post-process to remove redeposited compounds, the process yields a 50% decrease in surface roughness. With additional optimization to reduce the quantity of redeposited compounds, these processes could be used to smoothen surfaces of TFLN waveguides etched by physical Ar$^+$ milling, thereby increasing the performance of TFLN nanophotonic devices or enabling new integrated photonic capabilities.


title: Doping-Induced Electronic and Structural Phase Transition in the Bulk Weyl Semimetal Mo1-xWxTe2

abstract: A comprehensive study of the electronic and structural phase transition from 1T` to Td in the bulk Weyl semimetal Mo1-xWxTe2 at different doping concentrations has been carried out using time-of-flight momentum microscopy (including circular and linear dichroism), X-ray photoelectron spectroscopy (XPS), X-ray photoelectron diffraction (XPD), X-ray diffraction (XRD), angle-resolved Raman spectroscopy, transport measurements, density functional theory (DFT) and Kikuchi pattern calculations. High-resolution angle-resolved photoemission spectroscopy (ARPES) at 20 K reveals surface electronic states, which are indicative of topological Fermi arcs. Their dispersion agrees with the position of Weyl points predicted by DFT calculations based on the experimental crystal structure of our samples determined by XRD. Raman spectroscopy confirms the inversion symmetry breaking for the Td -phase, which is a necessary condition for the emergence of topological states. Transport measurements show that increasing the doping concentration from 2 to 9% leads to an increase in the temperature of the phase transition from 1T` to Td from 230 K to 270 K. Magnetoresistance and longitudinal elastoresistance show significantly increased values in the Td -phase due to stimulated inter-pocket electron backscattering. The results demonstrate the close relationship between electronic properties and elastic deformations in MoTe2.


title: Motion2Language, unsupervised learning of synchronized semantic motion segmentation

abstract: In this paper, we investigate building a sequence to sequence architecture for motion to language translation and synchronization. The aim is to translate motion capture inputs into English natural-language descriptions, such that the descriptions are generated synchronously with the actions performed, enabling semantic segmentation as a byproduct, but without requiring synchronized training data. We propose a new recurrent formulation of local attention that is suited for synchronous/live text generation, as well as an improved motion encoder architecture better suited to smaller data and for synchronous generation. We evaluate both contributions in individual experiments, using the standard BLEU4 metric, as well as a simple semantic equivalence measure, on the KIT motion language dataset. In a follow-up experiment, we assess the quality of the synchronization of generated text in our proposed approaches through multiple evaluation metrics. We find that both contributions to the attention mechanism and the encoder architecture additively improve the quality of generated text (BLEU and semantic equivalence), but also of synchronization. Our code is available at https://github.com/rd20karim/M2T-Segmentation/tree/main


title: Rigidity phenomena and the statistical properties of group actions on $\text{CAT}(0)$ cube complexes

abstract: We compare the marked length spectra of some pairs of proper and cocompact cubical actions of a non-virtually cyclic group on $\text{CAT}(0)$ cube complexes. The cubulations are required to be virtually co-special, have the same sets of convex-cocompact subgroups, and admit a contracting element. There are many groups for which these conditions are always fulfilled for any pair of cubulations, including non-elementary cubulable hyperbolic groups, many cubulable relatively hyperbolic groups, and many right-angled Artin and Coxeter groups. For these pairs of cubulations, we study the Manhattan curve associated to their combinatorial metrics. We prove that this curve is analytic and convex, and a straight line if and only if the marked length spectra are homothetic. The same result holds if we consider invariant combinatorial metrics in which the lengths of the edges are not necessarily one. In addition, for their standard combinatorial metrics, we prove a large deviation theorem with shrinking intervals for their marked length spectra. We deduce the same result for pairs of word metrics on hyperbolic groups. The main tool is the construction of a finite-state automaton that simultaneously encodes the marked length spectra of both cubulations in a coherent way, in analogy with results about (bi)combable functions on hyperbolic groups by Calegari and Fujiwara. The existence of this automaton allows us to apply the machinery of thermodynamic formalism for suspension flows over subshifts of finite type, from which we deduce our results.


title: Full Euler equations for waves generated by vertical seabed displacements

abstract: We present a novel numerical method for simulating the generation and propagation of surface gravity waves by vertical seabed displacements. The cornerstone of our method is the computation of a time dependent conformal map which incorporates the time dependent geometry of the seabed and the wave profile along the free surface. This enables us to handle general geometric configurations of the seabed and the wave. As benchmark we reproduce the results of Hammack on tsunami generation and propagation. Our results show that Hammack's linear theory accurately predicts wave generation. However, as the velocity of the sea bed displacement increases, nonlinear effects become increasingly noticeable. Notably, when the seabed uplift occurs rapidly, the following nonlinear dynamics of the wave differ significantly from the linear dynamics usually associated with tsunami propagation.


title: Revisiting multi-GNSS Navigation for UAVs -- An Equivariant Filtering Approach

abstract: In this work, we explore the recent advances in equivariant filtering for inertial navigation systems to improve state estimation for uncrewed aerial vehicles (UAVs). Traditional state-of-the-art estimation methods, e.g., the multiplicative Kalman filter (MEKF), have some limitations concerning their consistency, errors in the initial state estimate, and convergence performance. Symmetry-based methods, such as the equivariant filter (EqF), offer significant advantages for these points by exploiting the mathematical properties of the system - its symmetry. These filters yield faster convergence rates and robustness to wrong initial state estimates through their error definition. To demonstrate the usability of EqFs, we focus on the sensor-fusion problem with the most common sensors in outdoor robotics: global navigation satellite system (GNSS) sensors and an inertial measurement unit (IMU). We provide an implementation of such an EqF leveraging the semi-direct product of the symmetry group to derive the filter equations. To validate the practical usability of EqFs in real-world scenarios, we evaluate our method using data from all outdoor runs of the INSANE Dataset. Our results demonstrate the performance improvements of the EqF in real-world environments, highlighting its potential for enhancing state estimation for UAVs.


title: Pareto Optimization to Accelerate Multi-Objective Virtual Screening

abstract: The discovery of therapeutic molecules is fundamentally a multi-objective optimization problem. One formulation of the problem is to identify molecules that simultaneously exhibit strong binding affinity for a target protein, minimal off-target interactions, and suitable pharmacokinetic properties. Inspired by prior work that uses active learning to accelerate the identification of strong binders, we implement multi-objective Bayesian optimization to reduce the computational cost of multi-property virtual screening and apply it to the identification of ligands predicted to be selective based on docking scores to on- and off-targets. We demonstrate the superiority of Pareto optimization over scalarization across three case studies. Further, we use the developed optimization tool to search a virtual library of over 4M molecules for those predicted to be selective dual inhibitors of EGFR and IGF1R, acquiring 100% of the molecules that form the library's Pareto front after exploring only 8% of the library. This workflow and associated open source software can reduce the screening burden of molecular design projects and is complementary to research aiming to improve the accuracy of binding predictions and other molecular properties.


title: A Multitor Formula for a Non-lci Intersection

abstract: In this paper we produce the first known formula for cohomologies of the derived tensor products of structure sheaves of subschemes in the case where the intersection of the subschemes is not a local complete intersection. The case covered here is where the intersection instead consists of two local complete intersection components, one of codimension 1 and the other of arbitrary codimension.


title: Impossibility of bipartite full nonlocality, all-versus-nothing proofs, and pseudo-telepathy in small Bell scenarios

abstract: We show that the following statements are equivalent: (i) A quantum correlation p is in a face of the nonsignaling polytope that does not contain local points. (ii) p has local fraction zero; i.e., p has full nonlocality (FN). (iii) p provides an all-versus-nothing (AVN) or Greenberger-Horne-Zeilinger-like proof of nonlocality. (iv) p is a pseudo telepathy (PT) strategy. These connections imply that a long-standing question posed by Gisin, M\'ethot, and Scarani of whether quantum PT is possible with minimal requirements is fundamental for quantum information, quantum computation, and foundations of quantum mechanics, and can be addressed by a variety of strategies. Here, by combining different methods, we show that the answer is negative: according to quantum mechanics, nature does not allow for FN/AVN/PT in the (3,3;3,2) Bell scenario. Moreover, we show that FN/AVN/PT is also impossible in (3,2;3,4). We also study (3,3;3,3) and found no example of FN/AVN/PT. We discuss the implications of these results and further applications of the methods presented.


title: Nonequilibrium dynamics in Dirac quantum criticality

abstract: Quantum criticality within Dirac fermions harbors a plethora of exotic phenomena, attracting sustained attention in the past decades. Nevertheless, the nonequilibrium dynamics therein has rarely been studied. To fill in the gap, we explore the imaginary-time relaxation dynamics in a typical Dirac quantum criticality belonging to chiral Heisenberg universality class. Performing large-scale quantum Monte Carlo simulation, we unveil rich nonequilibrium critical phenomena from different initial states. Particularly, a new dynamic exponent characterizing the non-stationary evolution in the short-time state is determined as $\theta=-0.84(4)$, in sharp contrast with the prevalent belief that $\theta$ is positive as demonstrated in classical cases. Furthermore, we propose a universal dynamic scaling theory governing the fruitful nonequilibrium properties in Dirac quantum criticality. Armed with the scaling theory, we develop a new framework to investigate fermionic quantum criticality based on short-time dynamics, paving a promising avenue to fathoming quantum criticality in diverse fermionic systems with high efficiency.


title: Physics-informed neural wavefields with Gabor basis functions

abstract: Recently, Physics-Informed Neural Networks (PINNs) have gained significant attention for their versatile interpolation capabilities in solving partial differential equations (PDEs). Despite their potential, the training can be computationally demanding, especially for intricate functions like wavefields. This is primarily due to the neural-based (learned) basis functions, biased toward low frequencies, as they are dominated by polynomial calculations, which are not inherently wavefield-friendly. In response, we propose an approach to enhance the efficiency and accuracy of neural network wavefield solutions by modeling them as linear combinations of Gabor basis functions that satisfy the wave equation. Specifically, for the Helmholtz equation, we augment the fully connected neural network model with an adaptable Gabor layer constituting the final hidden layer, employing a weighted summation of these Gabor neurons to compute the predictions (output). These weights/coefficients of the Gabor functions are learned from the previous hidden layers that include nonlinear activation functions. To ensure the Gabor layer's utilization across the model space, we incorporate a smaller auxiliary network to forecast the center of each Gabor function based on input coordinates. Realistic assessments showcase the efficacy of this novel implementation compared to the vanilla PINN, particularly in scenarios involving high-frequencies and realistic models that are often challenging for PINNs.


title: Exploring the Power of Graph Neural Networks in Solving Linear Optimization Problems

abstract: Recently, machine learning, particularly message-passing graph neural networks (MPNNs), has gained traction in enhancing exact optimization algorithms. For example, MPNNs speed up solving mixed-integer optimization problems by imitating computational intensive heuristics like strong branching, which entails solving multiple linear optimization problems (LPs). Despite the empirical success, the reasons behind MPNNs' effectiveness in emulating linear optimization remain largely unclear. Here, we show that MPNNs can simulate standard interior-point methods for LPs, explaining their practical success. Furthermore, we highlight how MPNNs can serve as a lightweight proxy for solving LPs, adapting to a given problem instance distribution. Empirically, we show that MPNNs solve LP relaxations of standard combinatorial optimization problems close to optimality, often surpassing conventional solvers and competing approaches in solving time.


title: Generation or Replication: Auscultating Audio Latent Diffusion Models

abstract: The introduction of audio latent diffusion models possessing the ability to generate realistic sound clips on demand from a text description has the potential to revolutionize how we work with audio. In this work, we make an initial attempt at understanding the inner workings of audio latent diffusion models by investigating how their audio outputs compare with the training data, similar to how a doctor auscultates a patient by listening to the sounds of their organs. Using text-to-audio latent diffusion models trained on the AudioCaps dataset, we systematically analyze memorization behavior as a function of training set size. We also evaluate different retrieval metrics for evidence of training data memorization, finding the similarity between mel spectrograms to be more robust in detecting matches than learned embedding vectors. In the process of analyzing memorization in audio latent diffusion models, we also discover a large amount of duplicated audio clips within the AudioCaps database.


title: ForceGen: End-to-end de novo protein generation based on nonlinear mechanical unfolding responses using a protein language diffusion model

abstract: Through evolution, nature has presented a set of remarkable protein materials, including elastins, silks, keratins and collagens with superior mechanical performances that play crucial roles in mechanobiology. However, going beyond natural designs to discover proteins that meet specified mechanical properties remains challenging. Here we report a generative model that predicts protein designs to meet complex nonlinear mechanical property-design objectives. Our model leverages deep knowledge on protein sequences from a pre-trained protein language model and maps mechanical unfolding responses to create novel proteins. Via full-atom molecular simulations for direct validation, we demonstrate that the designed proteins are novel, and fulfill the targeted mechanical properties, including unfolding energy and mechanical strength, as well as the detailed unfolding force-separation curves. Our model offers rapid pathways to explore the enormous mechanobiological protein sequence space unconstrained by biological synthesis, using mechanical features as target to enable the discovery of protein materials with superior mechanical properties.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cs.CL cs.LG q-bio.BM


title: BayRnTune: Adaptive Bayesian Domain Randomization via Strategic Fine-tuning

abstract: Domain randomization (DR), which entails training a policy with randomized dynamics, has proven to be a simple yet effective algorithm for reducing the gap between simulation and the real world. However, DR often requires careful tuning of randomization parameters. Methods like Bayesian Domain Randomization (Bayesian DR) and Active Domain Randomization (Adaptive DR) address this issue by automating parameter range selection using real-world experience. While effective, these algorithms often require long computation time, as a new policy is trained from scratch every iteration. In this work, we propose Adaptive Bayesian Domain Randomization via Strategic Fine-tuning (BayRnTune), which inherits the spirit of BayRn but aims to significantly accelerate the learning processes by fine-tuning from previously learned policy. This idea leads to a critical question: which previous policy should we use as a prior during fine-tuning? We investigated four different fine-tuning strategies and compared them against baseline algorithms in five simulated environments, ranging from simple benchmark tasks to more complex legged robot environments. Our analysis demonstrates that our method yields better rewards in the same amount of timesteps compared to vanilla domain randomization or Bayesian DR.


title: Finite homological dimension of Hom and vanishing of Ext

abstract: For finitely generated modules $M$ and $N $ over a commutative Noetherian local ring $R$, we give various sufficient criteria for detecting freeness of $M$ or $N$ via vanishing of some finitely many Ext modules $\textrm{Ext}^i_R(M,N)$ and finiteness of certain homological dimension of $\textrm{Hom}_R(M,N)$. Some of our results provide partial progress towards answering a question of Ghosh-Takahashi and also generalize their main results in many ways, for instance, by reducing the number of vanishing. Certain special cases of our results allow us to address the Auslander-Reiten conjecture for modules whose (self) dual has finite projective dimension. Among other things, the notion of residually faithful modules and certain variations of it play a crucial role in our study. As some applications, we provide affirmative answers to two questions raised by Tony Se on $n$-semidualizing modules. Namely, we show that over a local ring of depth $t$, every $(t-1)$-semidualizing module of finite G-dimension is free. Moreover, we establish that for normal domains which satisfy Serre's condition $(S_3)$ and are locally Gorenstein in co-dimension two, the class of $1$-semidualizing modules form a subgroup of the divisor class group. These two groups coincide when, in addition, the ring is locally regular in co-dimension two.


title: Quality control using convolutional neural networks applied to samples of very small size

abstract: Although there is extensive literature on the application of artificial neural networks (NNs) in quality control (QC), to monitor the conformity of a process to quality specifications, at least five QC measurements are required, increasing the related cost. To explore the application of neural networks to samples of QC measurements of very small size, four one-dimensional (1-D) convolutional neural networks (CNNs) were designed, trained, and tested with datasets of $ n $-tuples of simulated standardized normally distributed QC measurements, for $ 1 \leq n \leq 4$. The designed neural networks were compared to statistical QC functions with equal probabilities for false rejection, applied to samples of the same size. When the $ n $-tuples included at least two QC measurements distributed as $ \mathcal{N}(\mu, \sigma^2) $, where $ 0.2 < |\mu| \leq 6.0 $, and $ 1.0 < \sigma \leq 7.0 $, the designed neural networks outperformed the respective statistical QC functions. Therefore, 1-D CNNs applied to samples of 2-4 quality control measurements can be used to increase the probability of detection of the nonconformity of a process to the quality specifications, with lower cost.


title: Bounds on the M\"obius-signed partition numbers

abstract: For $n \in \mathbb{N}$ let $\Pi[n]$ denote the set of partitions of $n$, i.e., the set of positive integer tuples $(x_1,x_2,\ldots,x_k)$ such that $x_1 \geq x_2 \geq \cdots \geq x_k$ and $x_1 + x_2 + \cdots + x_k = n$. Fixing $f:\mathbb{N}\to\{0,\pm 1\}$, for $\pi = (x_1,x_2,\ldots,x_k) \in \Pi[n]$ let $f(\pi) := f(x_1)f(x_2)\cdots f(x_k)$. In this way we define the {signed partition numbers} \[ p(n,f) = \sum_{\pi\in\Pi[n]} f(\pi). \] Following work of Vaughan and Gafni on partitions into primes and prime powers, we derive asymptotic formulae for quantities $p(n,\mu)$ and $p(n,\lambda)$, where $\mu$ and $\lambda$ denote the M\"obius and Liouville functions from prime number theory, respectively. In addition we discuss how quantities $p(n,f)$ generalize the classical notion of restricted partitions.


title: Quantifying Assistive Robustness Via the Natural-Adversarial Frontier

abstract: Our ultimate goal is to build robust policies for robots that assist people. What makes this hard is that people can behave unexpectedly at test time, potentially interacting with the robot outside its training distribution and leading to failures. Even just measuring robustness is a challenge. Adversarial perturbations are the default, but they can paint the wrong picture: they can correspond to human motions that are unlikely to occur during natural interactions with people. A robot policy might fail under small adversarial perturbations but work under large natural perturbations. We propose that capturing robustness in these interactive settings requires constructing and analyzing the entire natural-adversarial frontier: the Pareto-frontier of human policies that are the best trade-offs between naturalness and low robot performance. We introduce RIGID, a method for constructing this frontier by training adversarial human policies that trade off between minimizing robot reward and acting human-like (as measured by a discriminator). On an Assistive Gym task, we use RIGID to analyze the performance of standard collaborative Reinforcement Learning, as well as the performance of existing methods meant to increase robustness. We also compare the frontier RIGID identifies with the failures identified in expert adversarial interaction, and with naturally-occurring failures during user interaction. Overall, we find evidence that RIGID can provide a meaningful measure of robustness predictive of deployment performance, and uncover failure cases in human-robot interaction that are difficult to find manually. https://ood-human.github.io.


title: IW-GAE: Importance weighted group accuracy estimation for improved calibration and model selection in unsupervised domain adaptation

abstract: Reasoning about a model's accuracy on a test sample from its confidence is a central problem in machine learning, being connected to important applications such as uncertainty representation, model selection, and exploration. While these connections have been well-studied in the i.i.d. settings, distribution shifts pose significant challenges to the traditional methods. Therefore, model calibration and model selection remain challenging in the unsupervised domain adaptation problem--a scenario where the goal is to perform well in a distribution shifted domain without labels. In this work, we tackle difficulties coming from distribution shifts by developing a novel importance weighted group accuracy estimator. Specifically, we formulate an optimization problem for finding an importance weight that leads to an accurate group accuracy estimation in the distribution shifted domain with theoretical analyses. Extensive experiments show the effectiveness of group accuracy estimation on model calibration and model selection. Our results emphasize the significance of group accuracy estimation for addressing challenges in unsupervised domain adaptation, as an orthogonal improvement direction with improving transferability of accuracy.


title: Bayesian Filtering for Homography Estimation

abstract: This paper considers homography estimation in a Bayesian filtering framework using rate gyro and camera measurements. The use of rate gyro measurements facilitates a more reliable estimate of homography in the presence of occlusions, while a Bayesian filtering approach generates both a homography estimate along with an uncertainty. Uncertainty information opens the door to adaptive filtering approaches, post-processing procedures, and safety protocols. In particular, herein an iterative extended Kalman filter and an interacting multiple model (IMM) filter are tested using both simulated and experimental datasets. The IMM is shown to have good consistency properties and better overall performance when compared to the state-of-the-art homography nonlinear deterministic observer in both simulations and experiments.


title: Stabilization of uncertain linear distributed delay systems with dissipativity constraints

abstract: This paper examines the problem of stabilizing linear distributed delay systems with nonlinear distributed delay kernels and dissipativity constraints. Specifically, the nonlinear distributed kernel includes functions such as polynomials, trigonometric and exponential functions. By constructing a Liapunov-Krasovski\v{i} functional related to the distributed kernels, sufficient conditions for the existence of a state feedback controller which stabilizes the uncertain distributed delay systems with dissipativity constraints are given in terms of linear matrix inequalities (LMIs). In contrast to existing methods, the proposed scenario is less conservative or requires a smaller number of decision variables based on the application of a newly derived integral inequality. Finally, numerical examples are presented to demonstrate the validity and effectiveness of the proposed methodology.


title: Understanding an Acquisition Function Family for Bayesian Optimization

abstract: Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated and possibly real examples to show its efficacy. Yet on a different example, this new algorithm might not be as effective as the alternatives. This paper looks at a broader family of approaches to explain the strengths and weaknesses of algorithms in the family, with guidance on what choices might work best on different classes of problems.


title: Rydberg Raman-Ramsey (R${}^3$) resonances in atomic vapor

abstract: The sensitivity of electric field sensors based on two-photon electromagnetically induced transparency (EIT) involving highly excited Rydberg states in thermal atoms is often limited by the residual Doppler effect and optical power broadening. Here, we propose a method to reduce the EIT spectral linewidth using a Ramsey interrogation approach, allowing multiple interrogations of atomic coherence, using either temporally or spatially separated laser beams. Our theoretical calculations predict that the linewidth of such Raman-Ramsey spectral features can be substantially reduced compare to a standard Doppler-broadened EIT, opening a possibility to improved sensitivity of Rydberg atomic vapor-based sensors. We also discuss some preliminary experimental efforts toward observing Raman-Ramsey resonances for both spatially and temporally separated interrogation approaches and associated technical challenges.


title: How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations

abstract: While large language models based on the transformer architecture have demonstrated remarkable in-context learning (ICL) capabilities, understandings of such capabilities are still in an early stage, where existing theory and mechanistic understanding focus mostly on simple scenarios such as learning simple function classes. This paper takes initial steps on understanding ICL in more complex scenarios, by studying learning with representations. Concretely, we construct synthetic in-context learning problems with a compositional structure, where the label depends on the input through a possibly complex but fixed representation function, composed with a linear function that differs in each instance. By construction, the optimal ICL algorithm first transforms the inputs by the representation function, and then performs linear ICL on top of the transformed dataset. We show theoretically the existence of transformers that approximately implement such algorithms with mild depth and size. Empirically, we find trained transformers consistently achieve near-optimal ICL performance in this setting, and exhibit the desired dissection where lower layers transforms the dataset and upper layers perform linear ICL. Through extensive probing and a new pasting experiment, we further reveal several mechanisms within the trained transformers, such as concrete copying behaviors on both the inputs and the representations, linear ICL capability of the upper layers alone, and a post-ICL representation selection mechanism in a harder mixture setting. These observed mechanisms align well with our theory and may shed light on how transformers perform ICL in more realistic scenarios.


title: Biasymptotics of the M\"obius- and Liouville-signed partition numbers

abstract: For $n \in \mathbb{N}$ let $\Pi[n]$ denote the set of partitions of $n$, i.e., the set of positive integer tuples $(x_1,x_2,\ldots,x_k)$ such that $x_1 \geq x_2 \geq \cdots \geq x_k$ and $x_1 + x_2 + \cdots + x_k = n$. Fixing $f:\mathbb{N}\to\{0,\pm 1\}$, for $\pi = (x_1,x_2,\ldots,x_k) \in \Pi[n]$ let $f(\pi) := f(x_1)f(x_2)\cdots f(x_k)$. In this way we define the {signed partition numbers} \[ p(n,f) = \sum_{\pi\in\Pi[n]} f(\pi). \] Building on the author's previous work on the quantities $p(n,\mu)$ and $p(n,\lambda)$, where $\mu$ and $\lambda$ are the M\"obius and Liouville functions of prime number theory, respectively, on assumptions about the zeros of the Riemann zeta function we establish an alternation of the terms $p(n,\mu)$ between two asymptotic behaviors as $n\to\infty$. Similar results for the quantities $p(n,\lambda)$ are established. However, it is also demonstrated that if the Riemann Hypothesis (RH) holds, then it is possible that the quantities $p(n,\lambda)$ maintain a single asymptotic behavior as $n\to\infty$. In particular, this stable asymptotic behavior occurs if, in addition to RH, it holds that all zeros of $\zeta(s)$ in the critical strip $\{0 < \Re(s) < 1\}$ are simple and the residues of $1/\zeta(s)$ at these zeros are not too large. To formally describe these stable and alternating behaviors, the notions of asymptotic and biasymptotic sequences are introduced using a modification of the real logarithm.


title: Interpolatory $\mathcal{H}_2$-optimality Conditions for Structured Linear Time-invariant Systems

abstract: Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured LTI systems, in particular, for second-order, port-Hamiltonian, and time-delay systems. Under certain diagonalizability assumptions, we show that across all these different structured settings, bitangential Hermite interpolation is the common form for optimality, thus proving a unifying optimality framework for structured reduced-order modeling.


title: Shortest-path recovery from signature with an optimal control approach

abstract: In this paper, we consider the signature-to-path reconstruction problem from the control theoretic perspective. Namely, we design an optimal control problem whose solution leads to the minimal-length path that generates a given signature. In order to do that, we minimize a cost functional consisting of two competing terms, i.e., a weighted final-time cost combined with the $L^2$-norm squared of the controls. Moreover, we can show that, by taking the limit to infinity of the parameter that tunes the final-time cost, the problem $\Gamma$-converges to the problem of finding a sub-Riemannian geodesic connecting two signatures. Finally, we provide an alternative reformulation of the latter problem, which is particularly suitable for the numerical implementation.


title: Evolutionarity of MHD shock waves in collisionless plasma with heat fluxes

abstract: The evolutionarity conditions for the MHD shock waves are considered within the framework of the 8-moment approximation for collisionless plasma with heat fluxes. In the general case, evolutionarity diagrams are obtained depending on the relative magnitude of the Alfven wave velocity in front of or behind the shock wave front. The evolutionarity conditions for parallel shock waves are analyzed using previously obtained solutions for parallel MHD shock waves in collisionless plasma with heat fluxes. On the plane of dimensionless parameters characterizing plasma velocity and heat flux in front of the shock wave, the regions of evolutionarity are determined for the fast and slow shock waves propagating along the magnetic field.


title: Electronic Transport and Fermi Surface Topology of Zintl phase Dirac Semimetal SrZn2Ge2

abstract: We report a comprehensive study on the electronic transport properties of SrZn$_2$Ge$_2$ single crystals. The in-plane electrical resistivity of the compound exhibits linear temperature dependence for 80 K < T < 300 K, and T^2 dependence below 40 K, consistent with the Fermi liquid behavior. Both the transverse and longitudinal magnetoresistance exhibit a crossover at critical field B* from weak-field quadratic-like to high-field unsaturated linear field dependence at low temperatures (T \leq 50 K). Possible sources of linear magnetoresistance are discussed based on the Fermi surface topology, classical and quantum transport models. The Hall resistivity data establish SrZn$_2$Ge$_2$ as a multiband system with contributions from both the electrons and holes. The Hall coefficient is observed to decrease with increasing temperature and magnetic field, changing its sign from positive to negative. The negative Hall coefficient observed at low temperatures in high fields and at high temperatures over the entire field range suggests that the highly mobile electron charge carriers dominate the electronic transport. Our first-principles calculations show that nontrivial topological surface states exist in SrZn$_2$Ge$_2$ within the bulk gap along the {\Gamma}-M path. Notably, these surface states extend from the valence to conduction band with their number varying based on the Sr and Ge termination plane. The Fermi surface of the compound exhibits a distinct tetragonal petal-like structure, with one open and several closed surfaces. Overall, these findings offer crucial insights into the mechanisms underlying the electronic transport of the compound.


title: Radiation Transfer in Cloud Layers

abstract: For 2n-stream radiation transfer theory, a stack of m clouds can be represented as an equivalent cloud. Individual clouds, indexed by c = 1, 2, 3, ..., m are characterized by 2n x 2n scattering matrices S^{c}, that describe how the cloud interacts with 2n streams of axially symmetric incoming radiation, propagating in upward and downward Gauss-Legendre sample directions. Some of the radiation is transmitted, some is absorbed and converted to heat and some is scattered into 2n outgoing streams along the directions of the incoming streams. The clouds are also characterized by 2n x 1 thermal source vectors |J^dot^{c}} that describe the thermal emission of radiation along the stream directions by cloud particulates and gas molecules. The 2n x 2n scattering matrix of the equivalent cloud, S^{ev} = S^{m}*S^{m-1} *...*S^{2}*S^{1}, is the Redheffer star product of the scattering matrices S^{c} of the individual clouds. The 2n x 1 thermal source vector for the equivalent cloud |J^dot^{ev}}=G^[m,m}|J^dot^{m}} + G^[m,m-1}|J^dot^{m,m-1}} + ... + G^[m,1}|J^dot^{1}} is a linear combination of the thermal source vectors of the individual clouds. The 2n x 2n discrete Green's matrices G^[m,c} can be constructed from the scattering matrices S^{c} of individual clouds. The equivalent scattering matrix S^{ev} and the equivalent thermal source vector |J^dot}^{ev}} are analogous to the equivalent resistance and the equivalent electromotive force of Thevenin's theorem for a network of electrical circuits. Illustrative numerical examples are given for single clouds, 3-cloud stacks and 10-cloud stacks. These methods are useful for modeling radiation transfer in Earth's atmosphere, which can be represented by layers of invisible clouds, consisting of clear air and greenhouse gases, or visible clouds which also include condensed water, smog, etc.