title: Physics Informed Piecewise Linear Neural Networks for Process Optimization

abstract: Constructing first-principles models is usually a challenging and time-consuming task due to the complexity of the real-life processes. On the other hand, data-driven modeling, and in particular neural network models often suffer from issues such as overfitting and lack of useful and highquality data. At the same time, embedding trained machine learning models directly into the optimization problems has become an effective and state-of-the-art approach for surrogate optimization, whose performance can be improved by physics-informed training. In this study, it is proposed to upgrade piece-wise linear neural network models with physics informed knowledge for optimization problems with neural network models embedded. In addition to using widely accepted and naturally piece-wise linear rectified linear unit (ReLU) activation functions, this study also suggests piece-wise linear approximations for the hyperbolic tangent activation function to widen the domain. Optimization of three case studies, a blending process, an industrial distillation column and a crude oil column are investigated. For all cases, physics-informed trained neural network based optimal results are closer to global optimality. Finally, associated CPU times for the optimization problems are much shorter than the standard optimization results.


title: On strongly $\phi$-$w$-Flat modules and Their Homological Dimensions

abstract: In this paper, we introduce and study the notion of strongly $\phi$-$w$-flat modules. The $\phi$-$w$-weak global dimension $\phi$-$w$-w.gl.dim$(R)$ of an NP-ring $R$ is also introduced and studied. We characterize $\phi$-\Prufer\ $v$-multiplication strongly $\phi$-rings in terms of strongly $\phi$-$w$-flat modules.


title: Exposing the CSI: A Systematic Investigation of CSI-based Wi-Fi Sensing Capabilities and Limitations

abstract: Thanks to the ubiquitous deployment of Wi-Fi hotspots, channel state information (CSI)-based Wi-Fi sensing can unleash game-changing applications in many fields, such as healthcare, security, and entertainment. However, despite one decade of active research on Wi-Fi sensing, most existing work only considers legacy IEEE 802.11n devices, often in particular and strictly-controlled environments. Worse yet, there is a fundamental lack of understanding of the impact on CSI-based sensing of modern Wi-Fi features, such as 160-MHz bandwidth, multiple-input multiple-output (MIMO) transmissions, and increased spectral resolution in IEEE 802.11ax (Wi-Fi 6). This work aims to shed light on the impact of Wi-Fi 6 features on the sensing performance and to create a benchmark for future research on Wi-Fi sensing. To this end, we perform an extensive CSI data collection campaign involving 3 individuals, 3 environments, and 12 activities, using Wi-Fi 6 signals. An anonymized ground truth obtained through video recording accompanies our 80-GB dataset, which contains almost two hours of CSI data from three collectors. We leverage our dataset to dissect the performance of a state-of-the-art sensing framework across different environments and individuals. Our key findings suggest that (i) MIMO transmissions and higher spectral resolution might be more beneficial than larger bandwidth for sensing applications; (ii) there is a pressing need to standardize research on Wi-Fi sensing because the path towards a truly environment-independent framework is still uncertain. To ease the experiments' replicability and address the current lack of Wi-Fi 6 CSI datasets, we release our 80-GB dataset to the community.


title: Unpaired Multi-Domain Causal Representation Learning

abstract: The goal of causal representation learning is to find a representation of data that consists of causally related latent variables. We consider a setup where one has access to data from multiple domains that potentially share a causal representation. Crucially, observations in different domains are assumed to be unpaired, that is, we only observe the marginal distribution in each domain but not their joint distribution. In this paper, we give sufficient conditions for identifiability of the joint distribution and the shared causal graph in a linear setup. Identifiability holds if we can uniquely recover the joint distribution and the shared causal representation from the marginal distributions in each domain. We transform our identifiability results into a practical method to recover the shared latent causal graph.


title: Symmetries of the Woolly Hat graphs

abstract: A graph is edge-transitive if the natural action of its automorphism group on its edge set is transitive. An automorphism of a graph is semiregular if all of the orbits of the subgroup generated by this automorphism have the same length. While the tetravalent edge-transitive graphs admitting a semiregular automorphism with only one orbit are easy to determine, those that admit a semiregular automorphism with two orbits took a considerable effort and were finally classified in 2012. Of the several possible different ``types'' of potential tetravalent edge-transitive graphs admitting a semiregular automorphism with three orbits, only one ``type'' has thus far received no attention. In this paper we focus on this class of graphs, which we call the Woolly Hat graphs. We prove that there are in fact no edge-transitive Woolly Hat graphs and classify the vertex-transitive ones.


abstract: Single-Source Single-Target Domain Adaptation (1S1T) aims to bridge the gap between a labelled source domain and an unlabelled target domain. Despite 1S1T being a well-researched topic, they are typically not deployed to the real world. Methods like Multi-Source Domain Adaptation and Multi-Target Domain Adaptation have evolved to model real-world problems but still do not generalise well. The fact that most of these methods assume a common label-set between source and target is very restrictive. Recent Open-Set Domain Adaptation methods handle unknown target labels but fail to generalise in multiple domains. To overcome these difficulties, first, we propose a novel generic domain adaptation (DA) setting named Open-Set Multi-Source Multi-Target Domain Adaptation (OS-nSmT), with n and m being number of source and target domains respectively. Next, we propose a graph attention based framework named DEGAA which can capture information from multiple source and target domains without knowing the exact label-set of the target. We argue that our method, though offered for multiple sources and multiple targets, can also be agnostic to various other DA settings. To check the robustness and versatility of DEGAA, we put forward ample experiments and ablation studies.


title: Critical mass phenomena in higher dimensional quasilinear Keller-Segel systems with indirect signal production

abstract: In this paper, we deal with quasilinear Keller--Segel systems with indirect signal production, $$\begin{cases} u_t = \nabla \cdot ((u+1)^{m-1}\nabla u) - \nabla \cdot (u \nabla v), &x \in \Omega,\ t> 0,\\ 0 = \Delta v - \mu(t) + w, &x \in \Omega,\ t> 0,\\ w_t + w = u, &x \in \Omega,\ t> 0, \end{cases}$$ complemented with homogeneous Neumann boundary conditions and suitable initial conditions, where $\Omega\subset\mathbb R^n$ $(n\ge3)$ is a bounded smooth domain, $m\ge1$ and $$\mu(t) := \frac{1}{|\Omega|} w(\cdot, t) \qquad\mbox{for}\ t>0.$$ We show that in the case $m\ge2-\frac{2}{n}$, there exists $M_c>0$ such that if either $m>2-\frac{2}{n}$ or $\int_\Omega u_0 <M_c$, then the solution exists globally and remains bounded, and that in the case $m\le2-\frac{2}{n}$, if either $m<2-\frac{2}{n}$ or $M>2^\frac{n}{2}n^{n-1}\omega_n$, then there exist radially symmetric initial data such that $\int_\Omega u_0 = M$ and the solution blows up in finite or infinite time, where the blow-up time is infinite if $m=2-\frac2n$. In particular, if $m=2-\frac{2}{n}$ there is a critical mass phenomenon in the sense that $\inf\left\{M > 0 : \exists u_0 \text{ with } \int_\Omega u_0 = M \text{ such that the corresponding solution blows up in infinite time}\right\}$ is a finite positive number.


title: Constrained Online Two-stage Stochastic Optimization: Near Optimal Algorithms via Adversarial Learning

abstract: We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage action from a feasible set that depends both on the first-stage decision and the model parameter. We aim to minimize the cumulative objective value while guaranteeing that the long-term average second-stage decision belongs to a set. We develop online algorithms for the online two-stage problem from adversarial learning algorithms. Also, the regret bound of our algorithm cam be reduced to the regret bound of embedded adversarial learning algorithms. Based on our framework, we obtain new results under various settings. When the model parameter at each period is drawn from identical distributions, we derive \textit{state-of-art} $O(\sqrt{T})$ regret that improves previous bounds under special cases. Our algorithm is also robust to adversarial corruptions of model parameter realizations. When the model parameters are drawn from unknown non-stationary distributions and we are given machine-learned predictions of the distributions, we develop a new algorithm from our framework with a regret $O(W_T+\sqrt{T})$, where $W_T$ measures the total inaccuracy of the machine-learned predictions.


title: Convergence condition of simulated quantum annealing with a non-stoquastic catalyst

abstract: The Ising model with a transverse field and an antiferromagnetic transverse interaction is represented as a matrix in the computational basis with non-zero off-diagonal elements with both positive and negative signs and thus may be regarded to be non-stoquastic. We show that the local Boltzmann factors of such a system under an appropriate Suzuki-Trotter representation can be chosen non-negative and thus may potentially be simulated classically without a sign problem if the parameter values are limited to a subspace of the whole parameter space. We then derive conditions for parameters to satisfy asymptotically in order that simulated quantum annealing of this system converges to thermal equilibrium in the long-time limit.


title: High-Probability Bounds for Stochastic Optimization and Variational Inequalities: the Case of Unbounded Variance

abstract: During recent years the interest of optimization and machine learning communities in high-probability convergence of stochastic optimization methods has been growing. One of the main reasons for this is that high-probability complexity bounds are more accurate and less studied than in-expectation ones. However, SOTA high-probability non-asymptotic convergence results are derived under strong assumptions such as the boundedness of the gradient noise variance or of the objective's gradient itself. In this paper, we propose several algorithms with high-probability convergence results under less restrictive assumptions. In particular, we derive new high-probability convergence results under the assumption that the gradient/operator noise has bounded central $\alpha$-th moment for $\alpha \in (1,2]$ in the following setups: (i) smooth non-convex / Polyak-Lojasiewicz / convex / strongly convex / quasi-strongly convex minimization problems, (ii) Lipschitz / star-cocoercive and monotone / quasi-strongly monotone variational inequalities. These results justify the usage of the considered methods for solving problems that do not fit standard functional classes studied in stochastic optimization.


title: Series expansions in closed and open quantum many-body systems with multiple quasiparticle types

abstract: The established approach of perturbative continuous unitary transformations (pCUTs) constructs effective quantum many-body Hamiltonians as perturbative series that conserve the number of one quasiparticle type. We extend the pCUT method to similarity transformations - dubbed $\mathrm{pcst}^{\texttt{++}}$ - allowing for multiple quasiparticle types with complex-valued energies. This enlarges the field of application to closed and open quantum many-body systems with unperturbed operators corresponding to arbitrary superimposed ladder spectra. To this end, a generalized counting operator is combined with the quasiparticle generator for open quantum systems recently introduced by Schmiedinghoff and Uhrig (arXiv:2203.15532). The $\mathrm{pcst}^{\texttt{++}}$ then yields model-independent block-diagonal effective Hamiltonians and Lindbladians allowing a linked-cluster expansion in the thermodynamic limit similar to the conventional pCUT method. We illustrate the application of the $\mathrm{pcst}^{\texttt{++}}$ method by discussing representative closed, open, and non-Hermitian quantum systems.


title: QMC strength for some random configurations on the sphere

abstract: A sequence $(X_N ) \subset \mathbb S^d$ of N-point sets from the d-dimensional sphere has QMC strength $s^*>d/2$ if it has worst-case error of optimal order, $N^{s/d}$, for Sobolev spaces of order $s$ for all $d/2 < s < s^*$ , and the order is not optimal for $s > s^*$ . In arXiv:1208.3267 conjectured values of the strength are given for some well known point families in $\mathbb S^2$ based on numerical results. We study the average QMC strength for some related random configurations.


title: Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning

abstract: We consider the optimisation of large and shallow neural networks via gradient flow, where the output of each hidden node is scaled by some positive parameter. We focus on the case where the node scalings are non-identical, differing from the classical Neural Tangent Kernel (NTK) parameterisation. We prove that, for large neural networks, with high probability, gradient flow converges to a global minimum AND can learn features, unlike in the NTK regime. We also provide experiments on synthetic and real-world datasets illustrating our theoretical results and showing the benefit of such scaling in terms of pruning and transfer learning.


title: Termination of linear loops under commutative updates

abstract: We consider the following problem: given $d \times d$ rational matrices $A_1, \ldots, A_k$ and a polyhedral cone $\mathcal{C} \subset \mathbb{R}^d$, decide whether there exists a non-zero vector whose orbit under multiplication by $A_1, \ldots, A_k$ is contained in $\mathcal{C}$. This problem can be interpreted as verifying the termination of multi-path while loops with linear updates and linear guard conditions. We show that this problem is decidable for commuting invertible matrices $A_1, \ldots, A_k$. The key to our decision procedure is to reinterpret this problem in a purely algebraic manner. Namely, we discover its connection with modules over the polynomial ring $\mathbb{R}[X_1, \ldots, X_k]$ as well as the polynomial semiring $\mathbb{R}_{\geq 0}[X_1, \ldots, X_k]$. The loop termination problem is then reduced to deciding whether a submodule of $\left(\mathbb{R}[X_1, \ldots, X_k]\right)^n$ contains a ``positive'' element.


title: On the equivalence of the hybrid particle-field and Gaussian core models

abstract: Hybrid particle-field molecular dynamics is a molecular simulation strategy wherein particles couple to a density field instead of through ordinary pair potentials. Traditionally considered a mean-field theory, a momentum and energy-conserving hybrid particle-field formalism has recently been introduced, which was demonstrated to approach the Gaussian Core model potential in the grid-converged limit. Here, we expand on and generalize the correspondence between the Hamiltonian hybrid particle-field method and particle-particle pair potentials. Using the spectral procedure suggested by Bore and Cascella, we establish compatibility to any local soft pair potential in the limit of infinitesimal grid spacing. Furthermore, we document how the mean-field regime often observed in hybrid particle-field simulations is due to the systems under consideration, and not an inherent property of the model. Considering the Gaussian filter form in particular, we demonstrate the ability of the Hamiltonian hybrid particle-field model of recovering all structural and dynamical properties of the Gaussian Core model, including solid phases, a first-order phase transition, and anomalous transport properties. We quantify the impact of the grid spacing on the correspondence, as well as the effect of the particle-field filtering length scale on the emergent particle-particle correlations.


title: Predefined domain specific embeddings of food concepts and recipes: A case study on heterogeneous recipe datasets

abstract: Although recipe data are very easy to come by nowadays, it is really hard to find a complete recipe dataset - with a list of ingredients, nutrient values per ingredient, and per recipe, allergens, etc. Recipe datasets are usually collected from social media websites where users post and publish recipes. Usually written with little to no structure, using both standardized and non-standardized units of measurement. We collect six different recipe datasets, publicly available, in different formats, and some including data in different languages. Bringing all of these datasets to the needed format for applying a machine learning (ML) pipeline for nutrient prediction [1], [2], includes data normalization using dictionary-based named entity recognition (NER), rule-based NER, as well as conversions using external domain-specific resources. From the list of ingredients, domain-specific embeddings are created using the same embedding space for all recipes - one ingredient dataset is generated. The result from this normalization process is two corpora - one with predefined ingredient embeddings and one with predefined recipe embeddings. On all six recipe datasets, the ML pipeline is evaluated. The results from this use case also confirm that the embeddings merged using the domain heuristic yield better results than the baselines.


title: Continuous images of closed sets in generalized Baire spaces

abstract: Let $\kappa$ be an uncountable cardinal with $\kappa=\kappa^{{<}\kappa}$. Given a cardinal $\mu$, we equip the set ${}^\kappa\mu$ consisting of all functions from $\kappa$ to $\mu$ with the topology whose basic open sets consist of all extensions of partial functions of cardinality less than $\kappa$. We prove results that allow us to separate several classes of subsets of ${}^\kappa\kappa$ that consist of continuous images of closed subsets of spaces of the form ${}^\kappa\mu$. Important examples of such results are the following: (i) there is a closed subset of ${}^\kappa\kappa$ that is not a continuous image of ${}^\kappa\kappa$; (ii) there is an injective continuous image of ${}^\kappa\kappa$ that is not $\kappa$-Borel (i.e. that is not contained in the smallest algebra of sets on ${}^\kappa\kappa$ that contains all open subsets and is closed under $\kappa$-unions); (iii) the statement "every continuous image of ${}^\kappa\kappa$ is an injective continuous image of a closed subset of ${}^\kappa\kappa$" is independent of the axioms of $\mathrm{ZFC}$; and (iv) the axioms of $\mathrm{ZFC}$ do not prove that the assumption "$2^\kappa>\kappa^+$'' implies the statement "every closed subset of ${}^\kappa\kappa$ is a continuous image of ${}^\kappa(\kappa^+)$'' or its negation.


title: Content Adaptive Wavelet Lifting for Scalable Lossless Video Coding

abstract: Scalable lossless video coding is an important aspect for many professional applications. Wavelet-based video coding decomposes an input sequence into a lowpass and a highpass subband by filtering along the temporal axis. The lowpass subband can be used for previewing purposes, while the highpass subband provides the residual content for lossless reconstruction of the original sequence. The recursive application of the wavelet transform to the lowpass subband of the previous stage yields coarser temporal resolutions of the input sequence. This allows for lower bit rates, but also affects the visual quality of the lowpass subband. So far, the number of total decomposition levels is determined for the entire input sequence in advance. However, if the motion in the video sequence is strong or if abrupt scene changes occur, a further decomposition leads to a low-quality lowpass subband. Therefore, we propose a content adaptive wavelet transform, which locally adapts the depth of the decomposition to the content of the input sequence. Thereby, the visual quality of the low-pass subband is increased by up to 10.28 dB compared to a uniform wavelet transform with the same number of total decomposition levels, while the required rate is reduced by 1.06% additionally.


title: Uniformly distributed floor sources of buoyancy can give rise to significant spatial inhomogeneities within rooms

abstract: Displacement ventilation, where cool external air enters a room through low-level vents and warmer air leaves through high-level vents, is characterised by vertical gradients in pressure arising from the warmer indoor temperatures. Models usually assume that horizontal variations of temperature difference are small in comparison and are, therefore, unimportant. Small-scale laboratory experiments and computational fluid dynamics were used to examine these flows, driven by a uniformly heated floor. These experiments and simulations show that the horizontal variations of temperature difference can be neglected for predictions of the bulk ventilation rate; however, they also evidence that these horizontal variations can be significant and play a critical role in establishing the pattern of flow within the room -- this renders the horizontal position of the low- and high-level vents (relative to one another) important. We consider two cases: single-ended (where inlet and outlet are at the same end of the room) and opposite-ended. In both cases the ventilation flow rate is the same. However, in the opposite-ended case a dead zone is established in the upper part of the room which results in significant horizontal variations. We consider the formation of this dead zone by examining the streamline patterns and the age of air within the room. We discuss the implications for occupant exposure to pollutants and airborne disease.


title: String Compression in FA-Presentable Structures

abstract: We construct a FA-presentation $\psi: L \rightarrow \mathbb{N}$ of the structure $(\mathbb{N};\mathrm{S})$ for which a numerical characteristic $r(n)$ defined as the maximum number $\psi(w)$ for all strings $w \in L$ of length less than or equal to $n$ grows faster than any tower of exponents of a fixed height. This result leads us to a more general notion of a compressibility rate defined for FA-presentations of any FA-presentable structure. We show the existence of FA-presentations for the configuration space of a Turing machine and Cayley graphs of some groups for which it grows faster than any tower of exponents of a fixed height. For FA-presentations of the Presburger arithmetic $(\mathbb{N};+)$ we show that it is bounded from above by a linear function.


title: Performance attribution with respect to interest rates, FX, carry, and residual market risks

abstract: We develop a method to decompose the PnL of a portfolio of assets into four parts: (a) PnL due to FX rate changes, (b) PnL due to interest rate changes, (c) carry gain due to time passing, (d) PnL due to residual market risk changes (credit risk, liquidity risk, volatility risk etc.). We demonstrate the usefulness of our approach by decomposing the performance of an FX- and interest rate-hedged negative basis position in our fund XAIA Credit Basis II, and we apply the methodology to decompose the performance of our fund XAIA Credit Debt Capital in the first quarter of 2022 into PnL contributions of the single positions.


title: Optimizing Rate-Distortion Performance of Motion Compensated Wavelet Lifting with Denoised Prediction and Update

abstract: Efficient lossless coding of medical volume data with temporal axis can be achieved by motion compensated wavelet lifting. As side benefit, a scalable bit stream is generated, which allows for displaying the data at different resolution layers, highly demanded for telemedicine applications. Additionally, the similarity of the temporal base layer to the input sequence is preserved by the use of motion compensated temporal filtering. However, for medical sequences the overall rate is increased due to the specific noise characteristics of the data. The use of denoising filters inside the lifting structure can improve the compression efficiency significantly without endangering the property of perfect reconstruction. However, the design of an optimum filter is a crucial task. In this paper, we present a new method for selecting the optimal filter strength for a certain denoising filter in a rate-distortion sense. This allows to minimize the required rate based on a single input parameter for the encoder to control the requested distortion of the temporal base layer.


title: A Near-Field Focused Phased-Array Antenna Design Using the Time-Reversal Concept for Weed Control Purpose

abstract: Near-field focus (NFF) antennas have been recently used in several applications for different purposes. In this work, the time-reversal (TR) concept is used to shape the phase distribution of the phased array elements for the NFF of the electromagnetic field strength. It is shown that the TR concept is equivalent to the known ray optic method for the NFF. A slotted waveguide phased array antenna operating at 5.8 GHz is designed to provide the maximum electric field strength at the near-field region of the phased array. It is shown that the application of the full-wave simulation allows for an antenna design that provide high strength of the electromagnetic field and sufficient steerability even at near-field conditions close to the phased array antenna.


title: On Stability and Instability of Gravity Driven Navier-Stokes-Korteweg Model in Two Dimensions

abstract: Bresch-Desjardins-Gisclon-Sart have derived that the capillarity can slow {down} the growth rate of Rayleigh-Taylor (RT) instability in the capillary fluids based on the linearized two-dimensional (2D) Navier-Stokes-Korteweg equations in 2008. Motivated by their linear theory, we further investigate the nonlinear RT problem for the 2D incompressible case in a horizontally periodic slab domain with Navier boundary condition, and rigorously verify that the RT instability can be inhibited by capillarity under our 2D setting. More precisely, if the RT density profile $\bar{\rho}$ satisfies an additional stabilizing condition, then there is a threshold $\kappa_{C}$ of capillarity coefficient, such that if the capillarity coefficient $\kappa$ is bigger than $\kappa_{C}$, then the small perturbation solution around the RT equilibrium state is \emph{algebraically} stable in time. In particular, if the RT density profile is linear, then the threshold $\kappa_{C}$ can be given by the formula $\kappa_{C}=g /(\pi^2h^{-2}+L^{-2})\bar{\rho}'$, where $2\pi L$ denotes the length of a periodic cell of the slab domain in the horizontal direction, and $h$ the height of the slab domain. In addition, we also provide a nonlinear instability result for $\kappa\in[0,\kappa_{C})$. The instability result presents that the capillarity can not inhibit the RT instability, if its strength is too small.


title: Compression of Dynamic Medical CT Data Using Motion Compensated Wavelet Lifting with Denoised Update

abstract: For the lossless compression of dynamic 3-D+t volumes as produced by medical devices like Computed Tomography, various coding schemes can be applied. This paper shows that 3-D subband coding outperforms lossless HEVC coding and additionally provides a scalable representation, which is often required in telemedicine applications. However, the resulting lowpass subband, which shall be used as a downscaled representative of the whole original sequence, contains a lot of ghosting artifacts. This can be alleviated by incorporating motion compensation methods into the subband coder. This results in a high quality lowpass subband but also leads to a lower compression ratio. In order to cope with this, we introduce a new approach for improving the compression efficiency of compensated 3-D wavelet lifting by performing denoising in the update step. We are able to reduce the file size of the lowpass subband by up to 1.64\%, while the lowpass subband is still applicable for being used as a downscaled representative of the whole original sequence.


title: OpenSpike: An OpenRAM SNN Accelerator

abstract: This paper presents a spiking neural network (SNN) accelerator made using fully open-source EDA tools, process design kit (PDK), and memory macros synthesized using OpenRAM. The chip is taped out in the 130 nm SkyWater process and integrates over 1 million synaptic weights, and offers a reprogrammable architecture. It operates at a clock speed of 40 MHz, a supply of 1.8 V, uses a PicoRV32 core for control, and occupies an area of 33.3 mm^2. The throughput of the accelerator is 48,262 images per second with a wallclock time of 20.72 us, at 56.8 GOPS/W. The spiking neurons use hysteresis to provide an adaptive threshold (i.e., a Schmitt trigger) which can reduce state instability. This results in high performing SNNs across a range of benchmarks that remain competitive with state-of-the-art, full precision SNNs. The design is open sourced and available online: https://github.com/sfmth/OpenSpike


title: On the polytypism of layered $\textit{MX}_2$ materials

abstract: We revisit the problem of polytypism in layered $\textit{MX}_2$ materials, with a view to reinterpreting the phase space accessible to this family. Our starting point is to develop a simple, constructive and compact label for the most commonly observed stacking arrangements that is similar to the Glazer notation used to label tilt systems in perovskites. The key advantage of this label in the context of $\textit{MX}_2$ systems is that it contains sufficient information to generate the corresponding stacking sequences uniquely. Using a related approach, we generate a Cartesian representation of the phase space containing all possible $\textit{MX}_2$ polytypes, with the most common structures appearing as limiting cases. We argue that variation in (e.g. composition, or temperature, or pressure) may allow navigation of this phase space along continuous paths. This interpretation is shown to be consistent with the structural evolution of stacking-faulted $\textit{MX}_2$ systems as a function of temperature and composition. Our study highlights the potential for controlling composition/structure/property relationships amongst layered $\textit{MX}_2$ materials in ways that might not previously have been obvious.


title: The space of commuting elements in a Lie group and maps between classifying spaces

abstract: Let $\pi$ be a discrete group, and let $G$ be a compact connected Lie group. Then there is a map $\Theta\colon\mathrm{Hom}(\pi,G)_0\to\mathrm{map}_*(B\pi,BG)_0$ between the null-components of the spaces of homomorphism and based maps, which sends a homomorphism to the induced map between classifying spaces. Atiyah and Bott studied this map for $\pi$ a surface group, and showed that it is surjective in rational cohomology. In this paper, we prove that the map $\Theta$ is surjective in rational cohomology for $\pi=\mathbb{Z}^m$ and the classical group $G$ except for $SO(2n)$, and that it is not surjective for $\pi=\mathbb{Z}^m$ with $m\ge 3$ and $G=SO(2n)$ with $n\ge 4$. As an application, we consider the surjectivity of the map $\Theta$ in rational cohomology for $\pi$ a finitely generated nilpotent group. We also consider the dimension of the cokernel of the map $\Theta$ in rational homotopy groups for $\pi=\mathbb{Z}^m$ and the classical groups $G$ except for $SO(2n)$.


title: Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunities

abstract: Graph Neural Networks (GNNs) have become the leading paradigm for learning on (static) graph-structured data. However, many real-world systems are dynamic in nature, since the graph and node/edge attributes change over time. In recent years, GNN-based models for temporal graphs have emerged as a promising area of research to extend the capabilities of GNNs. In this work, we provide the first comprehensive overview of the current state-of-the-art of temporal GNN, introducing a rigorous formalization of learning settings and tasks and a novel taxonomy categorizing existing approaches in terms of how the temporal aspect is represented and processed. We conclude the survey with a discussion of the most relevant open challenges for the field, from both research and application perspectives.


title: Biophysical aspects of neurocognitive modeling with long-term sustained temperature variations

abstract: Long-term focused attention with visualization and breathing exercises is at the core of various Eastern traditions. Neurocognitive and psychosomatic phenomena demonstrated during such exercises were instrumentally explored with EEG and other sensors. Neurocognitive modeling in the form of meditative visualization produced persistent temperature effects in the body long after the exercise finished; this raises the question about their psychosomatic or biophysical origin. The work explores this question by comparing experiments with focusing attention inside and outside the body. EEG, temperature, heart and breathing sensors monitor internal body conditions, high resolution differential calorimetric sensors are used to detect thermal effects outside the body. Experiments with 159 attempts (2427 operator-sensor sessions) were carried over five months, control measurements run in the same conditions in parallel to experimental series. Increase of body temperature up to moderate fever zone 38.5 C and intentional control of up and down trend of core temperature by 1.6 C are demonstrated. Persistent temperature variations last >60 min. Experiments also demonstrated induced thermal fluctuations at 10^-3 C level in external calorimetric systems with 15 ml of water for 60-90 min. Repeatability of these attempts is over 90%, statistical Chi-square and Mann-Whitney tests reject the null hypotheses about random character of outcomes. Thus, the obtained data confirm the persistent thermal effects reported in previous publications and indicate their biophysical dimension. To explain these results we refer to a new model in neuroscience that involves spin phenomena in biochemical and physical systems. These experiments demonstrate complex biophysical mechanisms of altered states of consciousness; their function in the body's neurohumoral regulation and non-classical brain functions is discussed.


title: Meta Learning in Decentralized Neural Networks: Towards More General AI

abstract: Meta-learning usually refers to a learning algorithm that learns from other learning algorithms. The problem of uncertainty in the predictions of neural networks shows that the world is only partially predictable and a learned neural network cannot generalize to its ever-changing surrounding environments. Therefore, the question is how a predictive model can represent multiple predictions simultaneously. We aim to provide a fundamental understanding of learning to learn in the contents of Decentralized Neural Networks (Decentralized NNs) and we believe this is one of the most important questions and prerequisites to building an autonomous intelligence machine. To this end, we shall demonstrate several pieces of evidence for tackling the problems above with Meta Learning in Decentralized NNs. In particular, we will present three different approaches to building such a decentralized learning system: (1) learning from many replica neural networks, (2) building the hierarchy of neural networks for different functions, and (3) leveraging different modality experts to learn cross-modal representations.


title: Faster Consensus via a Sparser Controller

abstract: In this paper, we investigate the architecture of an optimal controller that maximizes the convergence speed of a consensus protocol with single-integrator dynamics. Under the assumption that communication delays increase with the number of hops from which information is allowed to reach each agent, we address the optimal control design under delayed feedback and show that the optimal controller features, in general, a sparsely connected architecture.


title: Finite-range bias in fitting three-body loss to the zero-range model

abstract: We study the impact of finite-range physics on the zero-range-model analysis of three-body recombination in ultracold atoms. We find that temperature dependence of the zero-range parameters can vary from one set of measurements to another as it may be driven by the distribution of error bars in the experiment, and not by the underlying three-body physics. To study finite-temperature effects in three-body recombination beyond the zero-range physics, we introduce and examine a finite-range model based upon a hyperspherical formalism. The systematic error discussed in the paper may provide a significant contribution to the error bars of measured three-body parameters.


title: Intermixing-driven surface and bulk ferromagnetism in the quantum anomalous Hall candidate MnBi$_6$Te$_{10}$

abstract: The recent realizations of the quantum anomalous Hall effect (QAHE) in MnBi$_2$Te$_4$ and MnBi$_4$Te$_7$ benchmark the (MnBi$_2$Te$_4$)(Bi$_2$Te$_3$)$_n$ family as a promising hotbed for further QAHE improvements. The family owes its potential to its ferromagnetically (FM) ordered MnBi$_2$Te$_4$ septuple layers (SL). However, the QAHE realization is complicated in MnBi$_2$Te$_4$ and MnBi$_4$Te$_7$ due to the substantial antiferromagnetic (AFM) coupling between the SL. An FM state, advantageous for the QAHE, can be stabilized by interlacing the SL with an increasing number $n$ of Bi$_2$Te$_3$ layers. However, the mechanisms driving the FM state and the number of necessary QLs are not understood, and the surface magnetism remains obscure. Here, we demonstrate robust FM properties in MnBi$_6$Te$_{10}$ ($n = 2$) with $T_C \approx 12$ K and establish their origin in the Mn/Bi intermixing phenomenon by a combined experimental and theoretical study. Our measurements reveal a magnetically intact surface with a large magnetic moment, and with FM properties similar to the bulk. Our investigation thus consolidates the MnBi$_6$Te$_{10}$ system as perspective for the QAHE at elevated temperatures.


title: SSO-Monitor: Fully-Automatic Large-Scale Landscape, Security, and Privacy Analyses of Single Sign-On in the Wild

abstract: Single Sign-On (SSO) shifts the crucial authentication process on a website to to the underlying SSO protocols and their correct implementation. To strengthen SSO security, organizations, such as IETF and W3C, maintain advisories to address known threats. One could assume that these security best practices are widely deployed on websites. We show that this assumption is a fallacy. We present SSO-MONITOR, an open-source fully-automatic large-scale SSO landscape, security, and privacy analysis tool. In contrast to all previous work, SSO-MONITOR uses a highly extensible, fully automated workflow with novel visual-based SSO detection techniques, enhanced security and privacy analyses, and continuously updated monitoring results. It receives a list of domains as input to discover the login pages, recognize the supported Identity Providers (IdPs), and execute the SSO. It further reveals the current security level of SSO in the wild compared to the security best practices on paper. With SSO-MONITOR, we automatically identified 1,632 websites with 3,020 Apple, Facebook, or Google logins within the Tranco 10k. Our continuous monitoring also revealed how quickly these numbers change over time. SSO-MONITOR can automatically login to each SSO website. It records the logins by tracing HTTP and in-browser communication to detect widespread security and privacy issues automatically. We introduce a novel deep-level inspection of HTTP parameters that we call SMARTPARMS. Using SMARTPARMS for security analyses, we uncovered URL parameters in 5 Client Application (Client) secret leakages and 337 cases with weak CSRF protection. We additionally identified 447 cases with no CSRF protection, 342 insecure SSO flows and 9 cases with nested URL parameters, leading to an open redirect in one case. SSO-MONITOR reveals privacy leakages that deanonymize users in 200 cases.


title: Semantic Coherence Markers for the Early Diagnosis of the Alzheimer Disease

abstract: In this work we explore how language models can be employed to analyze language and discriminate between mentally impaired and healthy subjects through the perplexity metric. Perplexity was originally conceived as an information-theoretic measure to assess how much a given language model is suited to predict a text sequence or, equivalently, how much a word sequence fits into a specific language model. We carried out an extensive experimentation with the publicly available data, and employed language models as diverse as N-grams, from 2-grams to 5-grams, and GPT-2, a transformer-based language model. We investigated whether perplexity scores may be used to discriminate between the transcripts of healthy subjects and subjects suffering from Alzheimer Disease (AD). Our best performing models achieved full accuracy and F-score (1.00 in both precision/specificity and recall/sensitivity) in categorizing subjects from both the AD class and control subjects. These results suggest that perplexity can be a valuable analytical metrics with potential application to supporting early diagnosis of symptoms of mental disorders.


title: Generalized Uncertainty Principles for Quantum Cryptography

abstract: We know the classical public cryptographic algorithms are based on certain NP-hard problems such as the integer factoring in RSA and the discrete logarithm in Diffie-Hellman. They are going to be vulnerable with fault-tolerant quantum computers. We also know that the uncertainty principle for quantum bits or qubits such as quantum key distribution or QKD based on the quantum uncertainty principle offers the information theoretical security. The interesting implication with the paradigm shifts from classical computing to quantum computing is that the NP-hardness used for classical cryptography may shift to the uncertainty principles for quantum cryptography including quantum symmetric encryption, post-quantum cryptography, as well as quantum encryption in phase space for coherent optical communications. This paper would like to explore those so-called generalized uncertainty principles and explain what their implications are for quantum security. We identified three generalized uncertainty principles offering quantum security: non-commutability between permutation gates, non-commutability between the displacement and phase shift operators for coherent states, and the modular Diophantine Equation Problem in general linear algebra for post-quantum cryptography.


title: FCB-SwinV2 Transformer for Polyp Segmentation

abstract: Polyp segmentation within colonoscopy video frames using deep learning models has the potential to automate the workflow of clinicians. This could help improve the early detection rate and characterization of polyps which could progress to colorectal cancer. Recent state-of-the-art deep learning polyp segmentation models have combined the outputs of Fully Convolutional Network architectures and Transformer Network architectures which work in parallel. In this paper we propose modifications to the current state-of-the-art polyp segmentation model FCBFormer. The transformer architecture of the FCBFormer is replaced with a SwinV2 Transformer-UNET and minor changes to the Fully Convolutional Network architecture are made to create the FCB-SwinV2 Transformer. The performance of the FCB-SwinV2 Transformer is evaluated on the popular colonoscopy segmentation bench-marking datasets Kvasir-SEG and CVC-ClinicDB. Generalizability tests are also conducted. The FCB-SwinV2 Transformer is able to consistently achieve higher mDice scores across all tests conducted and therefore represents new state-of-the-art performance. Issues found with how colonoscopy segmentation model performance is evaluated within literature are also re-ported and discussed. One of the most important issues identified is that when evaluating performance on the CVC-ClinicDB dataset it would be preferable to ensure no data leakage from video sequences occurs during the training/validation/test data partition.


title: Modeling opinion polarization on social media: application to Covid-19 vaccination hesitancy in Italy

abstract: The SARS-CoV-2 pandemic reminded us how vaccination can be a divisive topic on which the public conversation is permeated by misleading claims, and thoughts tend to polarize, especially on online social networks. In this work, motivated by recent natural language processing techniques to systematically extract and quantify opinions from text messages, we present a differential framework for bivariate opinion formation dynamics that is coupled with a compartmental model for fake news dissemination. Thanks to a mean-field analysis we demonstrate that the resulting Fokker-Planck system permits to reproduce bimodal distributions of opinions as observed in polarization dynamics. The model is then applied to sentiment analysis data from social media platforms in Italy, in order to analyze the evolution of opinions about Covid-19 vaccination. We show through numerical simulations that the model is capable to describe correctly the formation of the bimodal opinion structure observed in the vaccine-hesitant dataset, which is witness of the known polarization effects that happen within closed online communities.


title: On Suppressing Range of Adaptive Stepsizes of Adam to Improve Generalisation Performance

abstract: A number of recent adaptive optimizers improve the generalisation performance of Adam by essentially reducing the variance of adaptive stepsizes to get closer to SGD with momentum. Following the above motivation, we suppress the range of the adaptive stepsizes of Adam by exploiting the layerwise gradient statistics. In particular, at each iteration, we propose to perform three consecutive operations on the second momentum v_t before using it to update a DNN model: (1): down-scaling, (2): epsilon-embedding, and (3): down-translating. The resulting algorithm is referred to as SET-Adam, where SET is a brief notation of the three operations. The down-scaling operation on v_t is performed layerwise by making use of the angles between the layerwise subvectors of v_t and the corresponding all-one subvectors. Extensive experimental results show that SET-Adam outperforms eight adaptive optimizers when training transformers and LSTMs for NLP, and VGG and ResNet for image classification over CIAF10 and CIFAR100 while matching the best performance of the eight adaptive methods when training WGAN-GP models for image generation tasks. Furthermore, SET-Adam produces higher validation accuracies than Adam and AdaBelief for training ResNet18 over ImageNet.


title: Vortices in a rotating holographic superfluid with Lifshitz scaling

abstract: We have extended our previous work [1] on rotating holographic superfluids to include Lifshitz scaling. Presence of this scaling breaks relativistic invariance of the boundary superfluid system and indicates the existence of a Lifshitz fixed point [2]. We have analytically shown that we still get same vortex solutions as discovered earlier in [1]. We have recovered previous results for the case of z = 1, which restores the relativistic invariance in the holographic superfluid system. However, for z $\neq$ 1 this study indicate surprising results regarding dissipation in such a holographic superfluid. We found that higher winding number vortices increase with higher values of imaginary chemical potential for values of z in the open interval (1, 2). This result is remarkable because it asserts that dissipation in the rotating holographic superfluid increases in the presence of Lifshitz scaling.


title: Local Implicit Neural Representations for Multi-Sequence MRI Translation

abstract: In radiological practice, multi-sequence MRI is routinely acquired to characterize anatomy and tissue. However, due to the heterogeneity of imaging protocols and contra-indications to contrast agents, some MRI sequences, e.g. contrast-enhanced T1-weighted image (T1ce), may not be acquired. This creates difficulties for large-scale clinical studies for which heterogeneous datasets are aggregated. Modern deep learning techniques have demonstrated the capability of synthesizing missing sequences from existing sequences, through learning from an extensive multi-sequence MRI dataset. In this paper, we propose a novel MR image translation solution based on local implicit neural representations. We split the available MRI sequences into local patches and assign to each patch a local multi-layer perceptron (MLP) that represents a patch in the T1ce. The parameters of these local MLPs are generated by a hypernetwork based on image features. Experimental results and ablation studies on the BraTS challenge dataset showed that the local MLPs are critical for recovering fine image and tumor details, as they allow for local specialization that is highly important for accurate image translation. Compared to a classical pix2pix model, the proposed method demonstrated visual improvement and significantly improved quantitative scores (MSE 0.86 x 10^-3 vs. 1.02 x 10^-3 and SSIM 94.9 vs 94.3)


title: A novel failure indexing approach with run-time values of program variables

abstract: Failures with different root causes can disturb multi-fault localization significantly, therefore, dividing failures into distinct groups according to the responsible faults is highly important. In such a failure indexing task, the crux lies in the failure proximity, which involves two points, i.e., how to effectively represent failures (e.g., extract the signature of failures) and how to properly measure the distance between the proxies for those failures. Existing studies have proposed a variety of failure proximities. The prevalent of them extract signatures of failures from execution coverage or suspiciousness ranking lists, and accordingly employ the Euclid or the Kendall tau distances. However, such strategies may not properly reflect the essential characteristics of failures, thus resulting in unsatisfactory effectiveness. In this paper, we propose a new failure proximity, namely, program variable-based failure proximity, and based on which present a novel failure indexing approach. Specifically, the proposed approach utilizes the run-time values of program variables to represent failures, and designs a set of rules to measure the similarity between them. Experimental results demonstrate the competitiveness of the proposed approach: it can achieve 44.12% and 27.59% improvements in faults number estimation, as well as 47.30% and 26.93% improvements in clustering effectiveness, compared with the state-of-the-art technique in this field, in simulated and real-world environments, respectively.


title: An Operator Theory for Analyzing the Resolution of Multi-illumination Imaging Modalities

abstract: By introducing a new operator theory, we provide a unified mathematical theory for general source resolution in the multi-illumination imaging problem. Our main idea is to transform multi-illumination imaging into single-snapshot imaging with a new imaging kernel that depends on both the illumination patterns and the point spread function of the imaging system. We thus prove that the resolution of multi-illumination imaging is approximately determined by the essential cutoff frequency of the new imaging kernel, which is roughly limited by the sum of the cutoff frequency of the point spread function and the maximum essential frequency in the illumination patterns. Our theory provides a unified way to estimate the resolution of various existing super-resolution modalities and results in the same estimates as those obtained in experiments. In addition, based on the reformulation of the multi-illumination imaging problem, we also estimate the resolution limits for resolving both complex and positive sources by sparsity-based approaches. We show that the resolution of multi-illumination imaging is approximately determined by the new imaging kernel from our operator theory and better resolution can be realized by sparsity-promoting techniques in practice but only for resolving very sparse sources. This explains experimentally observed phenomena in some sparsity-based super-resolution modalities.


title: An Efficient Convex Hull-based Vehicle Pose Estimation Method for 3D LiDAR

abstract: Vehicle pose estimation with LiDAR is essential in the perception technology of autonomous driving. However, due to incomplete observation measurements and sparsity of the LiDAR point cloud, it is challenging to achieve satisfactory pose extraction based on 3D LiDAR with the existing pose estimation methods. In addition, the demand for real-time performance further increases the difficulty of the pose estimation task. In this paper, we propose a novel vehicle pose estimation method based on the convex hull. The extracted 3D cluster is reduced to the convex hull, reducing the subsequent computation burden while preserving essential contour information. Subsequently, a novel criterion based on the minimum occlusion area is developed for the search-based algorithm, enabling accurate pose estimation. Additionally, this criterion renders the proposed algorithm particularly well-suited for obstacle avoidance. The proposed algorithm is validated on the KITTI dataset and a manually labeled dataset acquired at an industrial park. The results demonstrate that our proposed method can achieve better accuracy than the classical pose estimation method while maintaining real-time speed.


title: Deep Learning Based Predictive Beamforming Design

abstract: This paper investigates deep learning techniques to predict transmit beamforming based on only historical channel data without current channel information in the multiuser multiple-input-single-output downlink. This will significantly reduce the channel estimation overhead and improve the spectrum efficiency especially in high-mobility vehicular communications. Specifically, we propose a joint learning framework that incorporates channel prediction and power optimization, and produces prediction for transmit beamforming directly. In addition, we propose to use the attention mechanism in the Long Short-Term Memory Recurrent Neural Networks to improve the accuracy of channel prediction. Simulation results using both a simple autoregressive process model and the more realistic 3GPP spatial channel model verify that our proposed predictive beamforming scheme can significantly improve the effective spectrum efficiency compared to traditional channel estimation and the method that separately predicts channel and then optimizes beamforming.


title: CREPES: Cooperative RElative Pose Estimation System

abstract: Mutual localization plays a crucial role in multi-robot cooperation. CREPES, a novel system that focuses on six degrees of freedom (DOF) relative pose estimation for multi-robot systems, is proposed in this paper. CREPES has a compact hardware design using active infrared (IR) LEDs, an IR fish-eye camera, an ultra-wideband (UWB) module and an inertial measurement unit (IMU). By leveraging IR light communication, the system solves data association between visual detection and UWB ranging. Ranging measurements from the UWB and directional information from the camera offer relative 3-DOF position estimation. Combining the mutual relative position with neighbors and the gravity constraints provided by IMUs, we can estimate the 6-DOF relative pose from a single frame of sensor measurements. In addition, we design an estimator based on the error-state Kalman filter (ESKF) to enhance system accuracy and robustness. When multiple neighbors are available, a Pose Graph Optimization (PGO) algorithm is applied to further improve system accuracy. We conduct enormous experiments to demonstrate CREPES' accuracy between robot pairs and a team of robots, as well as performance under challenging conditions.


title: Sentiment Overflow in the Testing Stack: Analysing Software Testing Posts on Stack Overflow

abstract: Software testing is an integral part of modern software engineering practice. Past research has not only underlined its significance, but also revealed its multi-faceted nature. The practice of software testing and its adoption is influenced by many factors that go beyond tools or technology. This paper sets out to investigate the context of software testing from the practitioners' point of view by mining and analyzing sentimental posts on the widely used question and answer website Stack Overflow. By qualitatively analyzing sentimental expressions of practitioners, which we extract from the Stack Overflow dataset using sentiment analysis tools, we discern factors that help us to better understand the lived experience of software engineers with regards to software testing. Grounded in the data that we have analyzed, we argue that sentiments like insecurity, despair and aspiration, have an impact on practitioners' attitude towards testing. We suggest that they are connected to concrete factors like the level of complexity of projects in which software testing is practiced.


title: Stable bubble formations in a Hele-Shaw channel

abstract: Deformable bubbles propagated by the flow of a viscous liquid in a planar Hele-Shaw channel of uniform depth tend to travel steadily along the channel's streamwise axis and pairs of neighbouring bubbles will either separate or coalesce because an individual bubble's propagation speed increases monotonically with its size. Thus, any group of bubbles will eventually rearrange itself in order of decreasing size and all of the bubbles will separate. We show that, by introducing a small geometric perturbation to the channel in the form of an axially-uniform depth reduction along its centreline, the system supports a multitude of stable bubble formations and this can disrupt the usual reordering by bubble size. The constituent bubbles of a stable formation lie in alternation on opposite sides of the depth-perturbation, retain fixed shapes and propagate steadily at the same speed. A stable formation is always led by the smallest of its constituent bubbles, which would be the slowest bubble in isolation. The leading bubble propagates as if it were isolated and the trailing bubbles reduce their speeds by adjusting their shapes and overlaps of the depth-perturbation in the perturbation fields of their preceding nearest-neighbours in order to match that of the leading bubble. The trailing bubbles can be arranged in any order and, hence, the number of stable formations increases factorially as the number of bubbles is increased.


title: Explainable Human-Robot Training and Cooperation with Augmented Reality

abstract: The current spread of social and assistive robotics applications is increasingly highlighting the need for robots that can be easily taught and interacted with, even by users with no technical background. Still, it is often difficult to grasp what such robots know or to assess if a correct representation of the task is being formed. Augmented Reality (AR) has the potential to bridge this gap. We demonstrate three use cases where AR design elements enhance the explainability and efficiency of human-robot interaction: 1) a human teaching a robot some simple kitchen tasks by demonstration, 2) the robot showing its plan for solving novel tasks in AR to a human for validation, and 3) a robot communicating its intentions via AR while assisting people with limited mobility during daily activities.


title: Engineering chaos in a four-mirror cavity-optomechanics with mechanical drives

abstract: We study occurrence of chaos in a four-mirror optomechanical cavity with mechanical drives externally interacting with two transversely located moving-end mirrors of the cavity. The strong cavity mode, driven by the pump laser, excites mechanical oscillations in both moving-end mirrors with its radiation pressure. These radiation-pressure-induced mechanical effects then lead to the indirect coupling between two transverse mirrors, where intra-cavity field mimics as a spring between two mechanical objects. By computing Poincar\'e surface of sections for both mirrors over a wide interval of initial conditions, we illustrate the transition from stable to mixed -- containing stable islands and chaotic seas -- Poincar\'e surface of sections with external mechanical drives. To further explore the occurrence of chaos with mechanical drives, we measure the spatio-temporal responses of moving-end mirrors initially located in mixed Poincar\'e sections. We find that both of the mirrors follow chaotic temporal evolution with external mechanical drives, even in the absence of any one of the mechanical drives. To quantitatively measure the occurrence of chaos, we computed the possible Lyapunov exponents and collective Kolmogorov-Sinai Entropy of the system. We find that the largest Lyapunov exponent, and corresponding Kolmogorov-Sinai Entropy, not only gains positive values with increase in external drives but also crucially depends on the initial conditions chosen from the Poincar\'e surface of sections. Furthermore, we show the enhancement in chaotic dynamics of mirrors in the presence of mechanical damping rates associated with the oscillatory motion of the mirrors.

categories: quant-ph nlin.CD physics.comp-ph physics.optics


title: TAPS Responsibility Matrix: A tool for responsible data science by design

abstract: Data science is an interdisciplinary research area where scientists are typically working with data coming from different fields. When using and analyzing data, the scientists implicitly agree to follow standards, procedures, and rules set in these fields. However, guidance on the responsibilities of the data scientists and the other involved actors in a data science project is typically missing. While literature shows that novel frameworks and tools are being proposed in support of open-science, data reuse, and research data management, there are currently no frameworks that can fully express responsibilities of a data science project. In this paper, we describe the Transparency, Accountability, Privacy, and Societal Responsibility Matrix (TAPS-RM) as framework to explore social, legal, and ethical aspects of data science projects. TAPS-RM acts as a tool to provide users with a holistic view of their project beyond key outcomes and clarifies the responsibilities of actors. We map the developed model of TAPS-RM with well-known initiatives for open data (such as FACT, FAIR and Datasheets for datasets). We conclude that TAPS-RM is a tool to reflect on responsibilities at a data science project level and can be used to advance responsible data science by design.


title: Implementation of chiral two-nucleon forces to nuclear many-body methods with Gaussian-wave packets

abstract: Many-body methods that use Gaussian-wave packets to describe nucleon-spatial distribution have been widely employed for depicting various phenomena in nuclear systems, in particular clustering. So far, however, the chiral effective field theory, a state-of-the-art theory of nuclear force, has not been applied to such methods. In this paper, we give the formalism to calculate the two-body matrix elements of the chiral two-nucleon forces using the Gaussian-wave packets. We also visualize the matrix elements and investigate the contributions of the central and tensor forces. This work is a foothold towards an \textit{ab initio} description of various cluster phenomena in view of nucleons, pions, and many-nucleon forces.


title: The topology of stable electromagnetic structures and Legendrian fields on the 3-sphere

abstract: Null solutions to Maxwell's equations in free space have the property that the topology of the electric and magnetic lines is preserved for all time. In this article we connect the study of a particularly relevant class of null solutions (related to the Hopf fibration) with the existence of pairs of volume preserving Legendrian fields with respect to the standard contact structure on the 3-sphere. Exploiting this connection, we prove that a Legendrian link can be realized as a set of closed orbits of a non-vanishing Legendrian field corresponding to the electric or magnetic part of a null solution if and only if each of its components has vanishing rotation number. Moreover, we prove that any foliation by circles (a Seifert foliation) of $S^3$ is isotopic to the foliation defined by a volume preserving Legendrian field with respect to the standard contact structure. We also construct a new null solution to the Maxwell's equations with the property that every positive torus knot is a closed electric line of its electric field. Finally, we prove that any (possibly knotted) toroidal surface in $\mathbb{R}^3$ can be realized as a magnetic surface of a null solution to Maxwell's equations, thus implying its stability for all times. In particular, the associated volume preserving Legendrian field on $S^3$ exhibits a positive volume set of invariant tori of the same topological type.


title: Kondo QED: The Kondo effect and photon trapping in a two-impurity Anderson model ultra-strongly coupled to light

abstract: The Kondo effect is one of the most studied examples of strongly correlated quantum many-body physics. Another type of strongly correlated physics that has only recently been explored in detail (and become experimentally accessible) is that of ultrastrong coupling between light and matter. Here, we study a system which we denote as "Kondo QED") that combines both phenomena, consisting of a two-impurity Anderson model ultra-strongly coupled to a single-mode cavity. While presented as an abstract model, it is relevant for a range of future hybrid cavity-QED systems. Using the hierarchical equations of motion approach we show that the ultrastrong coupling of cavity photons to the electronic states (impurity) noticeably suppresses the electronic Kondo resonance due to the destruction of many-body correlations of the Kondo cloud. We observe this transfer of correlations from the Kondo cloud to the cavity by computing the entropy and mutual information of the impurity-cavity subsystems. In addition, in the weak lead-coupling limit and at zero-bias, the model exhibits a ground-state photon accumulation effect originating entirely from counter-rotating terms in the impurity-cavity interaction. Interestingly, in the strong lead-coupling limit, this accumulation is ``Kondo-enhanced'' by new transition paths opening when increasing the hybridization to the leads. This suggests a new mechanism for the generation of real photons from virtual states. We further show that the suppression of the Kondo effect is stable under broadening of the cavity resonance as a consequence of the interaction to an external bosonic continuum. Our findings pave the way for the simultaneous control of both the Kondo QED effect and a photon accumulation effect using the ultrastrong coupling of light and matter.


title: Effect of rigid body motion in phase-field models of solid-state sintering

abstract: In the last two decades, many phase-field models for solid-state sintering have been published. Two groups of models have emerged, with and without the contribution of rigid body motion. This paper first describes the previously published phase-field model with an advection term driven by rigid body motion. The model is then used to investigate the differences between models with and without rigid body motion in new benchmark geometries exhibiting markedly different behavior. Sensitivity studies concerning the parameters of the rigid-body motion model are conducted and their effects on equilibrium and kinetic properties explored. In particular, it is shown by simulations that a shrinkage rate independent of system size requires the inclusion of an advection term. Finally, the reason behind this behavior is explored and implications for diffusion-only models are drawn.


title: Study of the $DK$ interaction with femtoscopic correlation functions

abstract: The $DK$ interaction in isospin zero is known to be attractive to such an extent that a bound state can be generated, which can be associated with the mysterious $D_{s0}^*(2317)$. In this work, we calculate the $DK$ femtoscopic correlation function in the coupled-channel framework for different source sizes that can directly probe the strongly attractive $DK$ interaction, which is otherwise inaccessible due to the unstable nature of $D$ and $K$ mesons, and therefore can help elucidate the nature of $D_{s0}^*(2317)$. We further generalize the study of source size dependence to various interactions, ranging from repulsive, weakly attractive, moderately attractive, and strongly attractive, in a square-well model. We hope that our study can motivate future experimental measurements of the $DK$ correlation function and other interactions relevant to the understanding of the nature of the many exotic hadrons discovered so far.


title: Real-Time Evaluation in Online Continual Learning: A New Hope

abstract: Current evaluations of Continual Learning (CL) methods typically assume that there is no constraint on training time and computation. This is an unrealistic assumption for any real-world setting, which motivates us to propose: a practical real-time evaluation of continual learning, in which the stream does not wait for the model to complete training before revealing the next data for predictions. To do this, we evaluate current CL methods with respect to their computational costs. We conduct extensive experiments on CLOC, a large-scale dataset containing 39 million time-stamped images with geolocation labels. We show that a simple baseline outperforms state-of-the-art CL methods under this evaluation, questioning the applicability of existing methods in realistic settings. In addition, we explore various CL components commonly used in the literature, including memory sampling strategies and regularization approaches. We find that all considered methods fail to be competitive against our simple baseline. This surprisingly suggests that the majority of existing CL literature is tailored to a specific class of streams that is not practical. We hope that the evaluation we provide will be the first step towards a paradigm shift to consider the computational cost in the development of online continual learning methods.


title: Teaching MLOps in Higher Education through Project-Based Learning

abstract: Building and maintaining production-grade ML-enabled components is a complex endeavor that goes beyond the current approach of academic education, focused on the optimization of ML model performance in the lab. In this paper, we present a project-based learning approach to teaching MLOps, focused on the demonstration and experience with emerging practices and tools to automatize the construction of ML-enabled components. We examine the design of a course based on this approach, including laboratory sessions that cover the end-to-end ML component life cycle, from model building to production deployment. Moreover, we report on preliminary results from the first edition of the course. During the present year, an updated version of the same course is being delivered in two independent universities; the related learning outcomes will be evaluated to analyze the effectiveness of project-based learning for this specific subject.


title: Paced-Curriculum Distillation with Prediction and Label Uncertainty for Image Segmentation

abstract: Purpose: In curriculum learning, the idea is to train on easier samples first and gradually increase the difficulty, while in self-paced learning, a pacing function defines the speed to adapt the training progress. While both methods heavily rely on the ability to score the difficulty of data samples, an optimal scoring function is still under exploration. Methodology: Distillation is a knowledge transfer approach where a teacher network guides a student network by feeding a sequence of random samples. We argue that guiding student networks with an efficient curriculum strategy can improve model generalization and robustness. For this purpose, we design an uncertainty-based paced curriculum learning in self distillation for medical image segmentation. We fuse the prediction uncertainty and annotation boundary uncertainty to develop a novel paced-curriculum distillation (PCD). We utilize the teacher model to obtain prediction uncertainty and spatially varying label smoothing with Gaussian kernel to generate segmentation boundary uncertainty from the annotation. We also investigate the robustness of our method by applying various types and severity of image perturbation and corruption. Results: The proposed technique is validated on two medical datasets of breast ultrasound image segmentation and robotassisted surgical scene segmentation and achieved significantly better performance in terms of segmentation and robustness. Conclusion: P-CD improves the performance and obtains better generalization and robustness over the dataset shift. While curriculum learning requires extensive tuning of hyper-parameters for pacing function, the level of performance improvement suppresses this limitation.


title: Groupoid and algebra of the infinite quantum spin chain

abstract: It is well known that certain features of a quantum theory cannot be described in the standard picture on a Hilbert space. In particular, this happens when we try to formally frame a quantum field theory, or a thermodynamic system with finite density. This forces us to introduce different types of algebras, more general than the ones we usually encounter in a standard course of quantum mechanics. We show how these algebras naturally arise in the Schwinger description of the quantum mechanics of an infinite spin chain. In particular, we use the machinery of Dirac-Feynman-Schwinger (DFS) states developed in recent works to introduce a dynamics based on the modular theory by Tomita-Takesaki, and consequently we apply this approach to describe the Ising model.


title: Randomized prior wavelet neural operator for uncertainty quantification

abstract: In this paper, we propose a novel data-driven operator learning framework referred to as the \textit{Randomized Prior Wavelet Neural Operator} (RP-WNO). The proposed RP-WNO is an extension of the recently proposed wavelet neural operator, which boasts excellent generalizing capabilities but cannot estimate the uncertainty associated with its predictions. RP-WNO, unlike the vanilla WNO, comes with inherent uncertainty quantification module and hence, is expected to be extremely useful for scientists and engineers alike. RP-WNO utilizes randomized prior networks, which can account for prior information and is easier to implement for large, complex deep-learning architectures than its Bayesian counterpart. Four examples have been solved to test the proposed framework, and the results produced advocate favorably for the efficacy of the proposed framework.


title: Site-specific Deep Learning Path Loss Models based on the Method of Moments

abstract: This paper describes deep learning models based on convolutional neural networks applied to the problem of predicting EM wave propagation over rural terrain. A surface integral equation formulation, solved with the method of moments and accelerated using the Fast Far Field approximation, is used to generate synthetic training data which comprises path loss computed over randomly generated 1D terrain profiles. These are used to train two networks, one based on fractal profiles and one based on profiles generated using a Gaussian process. The models show excellent agreement when applied to test profiles generated using the same statistical process used to create the training data and very good accuracy when applied to real life problems.


title: Foundational DevOps Patterns

abstract: Adopting DevOps practices is nowadays a recurring task in the industry. DevOps is a set of practices intended to reduce the friction between the software development (Dev) and the IT operations (Ops), resulting in higher quality software and a shorter development lifecycle. Even though many resources are talking about DevOps practices, they are often inconsistent with each other on the best DevOps practices. Furthermore, they lack the needed detail and structure for beginners to the DevOps field to quickly understand them. In order to tackle this issue, this paper proposes four foundational DevOps patterns: Version Control Everything, Continuous Integration, Deployment Automation, and Monitoring. The patterns are both detailed enough and structured to be easily reused by practitioners and flexible enough to accommodate different needs and quirks that might arise from their actual usage context. Furthermore, the patterns are tuned to the DevOps principle of Continuous Improvement by containing metrics so that practitioners can improve their pattern implementations.


title: Accurate recipe for predicting valley Linear Weyl phonons in two dimensions

abstract: The discovery of topological quantum states in two-dimensional (2D) systems is one of the most promising advancements in condensed matter physics. Linear Weyl point (LWP) phonons have been theoretically investigated in some 2D materials. Especially, Jin, Wang, and Xu [Nano Lett. 2018, 18, 12, 7755-7760] proposed in 2018 that the candidates with threefold rotational symmetry at the corners of the hexagonal Brillouin zone can host LWP phonons with a quantized valley Berry phase. However, all the candidates with hexagonal lattices may not host LWP phonons at $K$ ($K'$) high-symmetry points (HSPs). Hence, a more accurate recipe for LWP phonons in 2D is highly required. This work provides an exhaustive list of valley LWP phonons at HSPs in 2D by searching the entire 80 layer groups (LGs). We found that the valley LWP phonons can be obtained at HSPs in 11 of the 80 LGs. Guided by the symmetry analysis, we also contributed to realizing the ideal 2D material with valley LWP phonons. We identified the existence of the valley LWP phonons in eleven 2D material candidates with 11 LGs. This work offers a method to search for valley LWPs in 2D phononic systems and proposes 2D material candidates to obtain the valley LWP phonons.


title: Approximation and homotopy in regulous geometry

abstract: Let X, Y be nonsingular real algebraic sets. A map fi:X-->Y is said to be k-regulous, where k is a nonnegative integer, if it is of class C^k and the restriction of fi to some Zariski open dense subset of X is a regular map. Assuming that Y is uniformly rational, and k>0, we prove that a C^inf map f:X-->Y can be approximated by k-regulous maps in the C^k topology if and only if f is homotopic to a k-regulous map. The class of uniformly rational real algebraic varieties includes spheres, Grassmannians and real rational surfaces, and is stable under blowing up nonsingular centers. Furthermore, Taking Y=S^p (the unit p-dimensional sphere), we obtain several new results on approximation of C^inf maps from X into S^p by k-regulous maps in the C^k topology, for k nonnegative.


title: Beyond Pretrained Features: Noisy Image Modeling Provides Adversarial Defense

abstract: Recent advancements in masked image modeling (MIM) have made it a prevailing framework for self-supervised visual representation learning. The MIM pretrained models, like most deep neural network methods, remain vulnerable to adversarial attacks, limiting their practical application, and this issue has received little research attention. In this paper, we investigate how this powerful self-supervised learning paradigm can provide adversarial robustness to downstream classifiers. During the exploration, we find that noisy image modeling (NIM), a simple variant of MIM that adopts denoising as the pre-text task, reconstructs noisy images surprisingly well despite severe corruption. Motivated by this observation, we propose an adversarial defense method, referred to as De^3, by exploiting the pretrained decoder for denoising. Through De^3, NIM is able to enhance adversarial robustness beyond providing pretrained features. Furthermore, we incorporate a simple modification, sampling the noise scale hyperparameter from random distributions, and enable the defense to achieve a better and tunable trade-off between accuracy and robustness. Experimental results demonstrate that, in terms of adversarial robustness, NIM is superior to MIM thanks to its effective denoising capability. Moreover, the defense provided by NIM achieves performance on par with adversarial training while offering the extra tunability advantage. Source code and models are available at https://github.com/youzunzhi/NIM-AdvDef.


title: Nonlinear Schrodinger equation for a two-dimensional plasma: the analysis of solitons, breathers, and plane wave stability

abstract: We analytically study nonlinear quasi-monochromatic plasma waves in a two-dimensional electron system set between the two metal electrodes (gates). We derive a nonlinear Schrodinger equation for a slow-varying envelope to describe the waves. We find it to be of either focusing or defocusing type depending on the parameter qd, where q is the carrier wave vector and d is the distance between the 2DES and the gates. When qd<1.61, we have the defocusing-type equation with the solutions in the form of dark plasma solitons appearing against the background of the stable plane waves. Conversely, for qd>1.61, the focusing-type equation has the solutions in the form of bright solitons, and the plane waves are unstable. We also address the appearance of the simplest type of breathers in the latter case. A detailed description of the resultant nonlinear waves is given based on the parameters of the two-dimensional electron system.


title: IKOL: Inverse kinematics optimization layer for 3D human pose and shape estimation via Gauss-Newton differentiation

abstract: This paper presents an inverse kinematic optimization layer (IKOL) for 3D human pose and shape estimation that leverages the strength of both optimization- and regression-based methods within an end-to-end framework. IKOL involves a nonconvex optimization that establishes an implicit mapping from an image's 3D keypoints and body shapes to the relative body-part rotations. The 3D keypoints and the body shapes are the inputs and the relative body-part rotations are the solutions. However, this procedure is implicit and hard to make differentiable. So, to overcome this issue, we designed a Gauss-Newton differentiation (GN-Diff) procedure to differentiate IKOL. GN-Diff iteratively linearizes the nonconvex objective function to obtain Gauss-Newton directions with closed form solutions. Then, an automatic differentiation procedure is directly applied to generate a Jacobian matrix for end-to-end training. Notably, the GN-Diff procedure works fast because it does not rely on a time-consuming implicit differentiation procedure. The twist rotation and shape parameters are learned from the neural networks and, as a result, IKOL has a much lower computational overhead than most existing optimization-based methods. Additionally, compared to existing regression-based methods, IKOL provides a more accurate mesh-image correspondence. This is because it iteratively reduces the distance between the keypoints and also enhances the reliability of the pose structures. Extensive experiments demonstrate the superiority of our proposed framework over a wide range of 3D human pose and shape estimation methods.


title: Elliptic Curves with positive rank and no integral points

abstract: We study the family of elliptic curves $E_{D'}: y^{2} = x^{3} + 16D'$, where $D' = -3D$ and $D < -4$ is a negative squarefree integer, with $3 \nmid D$, that satisfies two simple congruence conditions. By assuming finiteness of their Tate-Shafarevich group, we show that these curves must have odd rank. We then focus on the subfamily of those elliptic curves $E_{D'}$ that correspond to the fundamental discriminants $D'$ with the property that the rank $r_{3}(D)$ of the $3$-part of the ideal class group of $\mathbb{Q}(\sqrt{D})$ is not equal to the rank $r_{3}(D')$ of the $3$-part of the ideal class group of $\mathbb{Q}(\sqrt{D'})$, and therefore $r_{3}(D) = r_{3}(D') + 1$ by Scholz's Reflection Theorem. By using the connection between the points of $E_{D'}(\mathbb{Q})$ and the so-called $3$-virtual units of $\mathbb{Q}(\sqrt{D'})$, we show that the elliptic curves of this subfamily, even though they have non-trivial rank, they cannot have any integral points. We also discuss the case of positive squarefree integer $D > 4$ and derive a result for this case as well.


title: Physics Constrained Motion Prediction with Uncertainty Quantification

abstract: Predicting the motion of dynamic agents is a critical task for guaranteeing the safety of autonomous systems. A particular challenge is that motion prediction algorithms should obey dynamics constraints and quantify prediction uncertainty as a measure of confidence. We present a physics-constrained approach for motion prediction which uses a surrogate dynamical model to ensure that predicted trajectories are dynamically feasible. We propose a two-step integration consisting of intent and trajectory prediction subject to dynamics constraints. We also construct prediction regions that quantify uncertainty and are tailored for autonomous driving by using conformal prediction, a popular statistical tool. Physics Constrained Motion Prediction achieves a 41% better ADE, 56% better FDE, and 19% better IoU over a baseline in experiments using an autonomous racing dataset.


title: MLOps with enhanced performance control and observability

abstract: The explosion of data and its ever increasing complexity in the last few years, has made MLOps systems more prone to failure, and new tools need to be embedded in such systems to avoid such failure. In this demo, we will introduce crucial tools in the observability module of a MLOps system that target difficult issues like data drfit and model version control for optimum model selection. We believe integrating these features in our MLOps pipeline would go a long way in building a robust system immune to early stage ML system failures.


title: Two-dimensional extended Hubbard model at half-filling

abstract: We consider the extended Hubbard model on a two-dimensional square lattice at half-filling. The model is investigated using the strong coupling diagram technique. We sum infinite series of ladder diagrams allowing for full-scale charge and spin fluctuations and the actual short-range antiferromagnetic order for nonzero temperatures. In agreement with earlier results, we find the first-order phase transition in the charge subsystem occurring at $v=v_c\gtrsim U/4$ with $v$ and $U$ the intersite and on-site Coulomb repulsion constants. The transition reveals itself in an abrupt sign change of a sharp maximum in the zero-frequency charge susceptibility at the corner of the Brillouin. States arising at the transition have alternating deviations of electron occupations from the mean value on neighboring sites. Due to fluctuations, these alternating occupation deviations have short-range order. For the considered parameters, such behavior is found for $U\lesssim5t$ with $t$ the hopping constant. For the insulating case $U\gtrsim 6t$, in which the transition is not observed, we find a continuous growth of the Mott gap with $v$. The evolution of the electron density of states with increasing $v$ is also considered.


title: Towards Modelling and Verification of Social Explainable AI

abstract: Social Explainable AI (SAI) is a new direction in artificial intelligence that emphasises decentralisation, transparency, social context, and focus on the human users. SAI research is still at an early stage. Consequently, it concentrates on delivering the intended functionalities, but largely ignores the possibility of unwelcome behaviours due to malicious or erroneous activity. We propose that, in order to capture the breadth of relevant aspects, one can use models and logics of strategic ability, that have been developed in multi-agent systems. Using the STV model checker, we take the first step towards the formal modelling and verification of SAI environments, in particular of their resistance to various types of attacks by compromised AI modules.


title: Hidden scale invariance of turbulence in a shell model: from forcing to dissipation scales

abstract: Intermittency is one of central obstacles for understanding small-scale dynamics in the fully developed hydrodynamic turbulence. The modern approach is largely based on the multifractal theory of Parisi and Frisch which is, however, phenomenological. It was shown recently that the intermittency can be related to the hidden scale invariance. The latter is a new statistical scaling symmetry unbroken in a rescaled (projected) formulation of equations of motion. In the present work, we consider a shell model of turbulence and describe how the hidden symmetry manifests itself through all scales, both in the inertial interval and in the transition to forcing and dissipation ranges. In the inertial interval, we derive anomalous scaling laws from the hidden symmetry. Then, we show how a complicated form of the dissipation range is controlled by intermittent rescaled Reynolds numbers within a large range of dissipation scales. This dissipative intermittency can be removed by using a special class of dissipation models. For such models, the hidden scale invariance is restored both in the inertial interval and the dissipation range. Overall, the presented approach deduces the multifractal theory and some of its basic conclusions from the hidden scaling symmetry of equations of motion.


title: Scalable quantum memory nodes using nuclear spins in Silicon Carbide

abstract: A distributed quantum network would require quantum nodes capable of performing arbitrary quantum information protocols with high fidelity. So far the challenge has been in realizing such quantum nodes with features for scalable quantum computing. We show here that using the solid-state spins in 4H-Silicon Carbide (4H-SiC) such a goal could be realized, wherein a controlled generation of highly coherent qubit registers using nuclear spins is possible. Using a controlled isotope concentration and coherent control we perform here atomistic modeling of the central spin system formed by the electron spin of a silicon vacancy color center ($V_{Si}^-$-center) and the non-interacting nuclear spins. From this we lay out conditions for realizing a scalable nuclear-spin ($^{13}C$ or $^{29}Si$) register, wherein independent control of the qubits alongside their mutual controlled operations using the central electron spin associated to the $V_{Si}^-$-center in 4H-SiC are achieved. Further, the decoherence and entanglement analysis provided here could be used to evaluate the quantum volume of these nodes. Our results mark a clear route towards realizing scalable quantum memory nodes for applications in distributed quantum computing networks and further for quantum information protocols.


title: Approximate Reversible Circuits for NISQ-Era Quantum Computers

abstract: The synthesis approaches for quantum circuits typically aim at minimizing the number of lines or gates. Given the tight restrictions on those logical resources in physical implementations, we propose to view the problem fundamentally different: Given noisy gates and a fixed number of lines, how can we use them to perform a computation as precisely as possible? In this paper we show approximate circuits can be deployed for computations with limited resources. Performing experiments on a QC simulator, we show that under the influence of noise, approximate circuits can have lower error-rates than exact circuits.


title: A Survey on Compositional Generalization in Applications

abstract: The field of compositional generalization is currently experiencing a renaissance in AI, as novel problem settings and algorithms motivated by various practical applications are being introduced, building on top of the classical compositional generalization problem. This article aims to provide a comprehensive review of top recent developments in multiple real-life applications of the compositional generalization. Specifically, we introduce a taxonomy of common applications and summarize the state-of-the-art for each of those domains. Furthermore, we identify important current trends and provide new perspectives pertaining to the future of this burgeoning field.


title: FedLAP-DP: Federated Learning by Sharing Differentially Private Loss Approximations

abstract: Conventional gradient-sharing approaches for federated learning (FL), such as FedAvg, rely on aggregation of local models and often face performance degradation under differential privacy (DP) mechanisms or data heterogeneity, which can be attributed to the inconsistency between the local and global objectives. To address this issue, we propose FedLAP-DP, a novel privacy-preserving approach for FL. Our formulation involves clients synthesizing a small set of samples that approximate local loss landscapes by simulating the gradients of real images within a local region. Acting as loss surrogates, these synthetic samples are aggregated on the server side to uncover the global loss landscape and enable global optimization. Building upon these insights, we offer a new perspective to enforce record-level differential privacy in FL. A formal privacy analysis demonstrates that FedLAP-DP incurs the same privacy costs as typical gradient-sharing schemes while achieving an improved trade-off between privacy and utility. Extensive experiments validate the superiority of our approach across various datasets with highly skewed distributions in both DP and non-DP settings. Beyond the promising performance, our approach presents a faster convergence speed compared to typical gradient-sharing methods and opens up the possibility of trading communication costs for better performance by sending a larger set of synthetic images. The source is available at https://github.com/a514514772/FedLAP-DP.


title: Cheeger inequalities on simplicial complexes

abstract: Cheeger-type inequalities in which the decomposability of a graph and the spectral gap of its Laplacian mutually control each other play an important role in graph theory and network analysis, in particular in the context of expander theory. The natural problem, however, to extend such inequalities to simplicial complexes and their higher order Eckmann Laplacians has been open for a long time. The question is not only to prove an inequality, but also to identify the right Cheeger-type constant in the first place. Here, we solve this problem. Our solution involves and combines constructions from simplicial topology, signed graphs, Gromov filling radii and an interpolation between the standard 2-Laplacians and the analytically more difficult 1-Laplacians, for which, however, the inequalities become equalities. It is then natural to develop a general theory for $p$-Laplacians on simplicial complexes and investigate the related Cheeger-type inequalities.


title: Linear stability analysis of Israel-Stewart theory in the case of a nonzero background charge

abstract: Linear stability of Israel-Stewart theory in the presence of net-charge diffusion was investigated in [Phys.~Rev.~D 102 (2020) 116009] for the case of a massless, classical gas of noninteracting particles. However, in that work only a vanishing net-charge background was considered. In this work, we extend that study to the case of a nonvanishing background charge. We find that this effectively results in a change of the numeric value of the charge-diffusion coefficient, in a way that when the background charge goes to infinity, this coefficient can become at most four times its value at zero background charge. We also extend the analysis of [Phys.~Rev.~D 102 (2020) 116009] by performing a systematic parameter study in the plane of charge-diffusion coefficient vs.\ the coupling term between shear-stress and net-charge diffusion. In this plane, we identify regions where the solutions remain stable and causal and where they become acausal and/or unstable.


title: Bayesian optimization of the layout of wind farms with a high-fidelity surrogate model

abstract: We introduce a gradient-free data-driven framework for optimizing the power output of a wind farm based on a Bayesian approach and large-eddy simulations. In contrast with conventional wind farm layout optimization strategies, which make use of simple wake models, the proposed framework accounts for complex flow phenomena such as wake meandering, local speed-ups and the interaction of the wind turbines with the atmospheric flow. The capabilities of the framework are demonstrated for the case of a small wind farm consisting of five wind turbines. It is shown that it can find optimal designs within a few iterations, while leveraging the above phenomena to deliver increased wind farm performance.


title: Some remarks on the ring of arithmetical functions

abstract: The aim of these notes is to study some of the structural aspects of the ring of arithmetical functions. We prove that this ring is neither Noetherian nor Artinian. Furthermore, we construct various types of prime ideals. We show arithmetic ring has infinite Krull dimension and its associated prime ideal set is nonempty.