title: Gated recurrent neural networks discover attention

abstract: Recent architectural developments have enabled recurrent neural networks (RNNs) to reach and even surpass the performance of Transformers on certain sequence modeling tasks. These modern RNNs feature a prominent design pattern: linear recurrent layers interconnected by feedforward paths with multiplicative gating. Here, we show how RNNs equipped with these two design elements can exactly implement (linear) self-attention, the main building block of Transformers. By reverse-engineering a set of trained RNNs, we find that gradient descent in practice discovers our construction. In particular, we examine RNNs trained to solve simple in-context learning tasks on which Transformers are known to excel and find that gradient descent instills in our RNNs the same attention-based in-context learning algorithm used by Transformers. Our findings highlight the importance of multiplicative interactions in neural networks and suggest that certain RNNs might be unexpectedly implementing attention under the hood.


title: Octonion Algebras over Schemes and the Equivalence of Isotopes and Isometric Quadratic Forms

abstract: Octonion algebras are certain algebras with a multiplicative quadratic form. In their 2019 article, Alsaody and Gille show that, for octonion algebras over unital commutative rings, there is an equivalence between isotopes and isometric quadratic forms. The contravariant equivalence from unital commutative rings to affine schemes, sending a ring to its spectrum, leads us to a question: can the equivalence of isotopy and isometry be generalized to octonion algebras over a (not necessarily affine) scheme? We present the basic definitions and properties of octonion algebras, both over rings and over schemes. Then we show that an isotope of an octonion algebra C over a scheme is isomorphic to a twist by an Aut(C)-torsor. We conclude the thesis by giving an affirmative answer to our question.


title: Adsorption Characteristics of Refrigerants for Thermochemical Energy Storage in Metal-Organic Frameworks

abstract: The adsorption of fluorocarbons has gained significant importance as its use as refrigerants in energy storage applications. In this context, the adsorption behavior of two low global warming potential refrigerants, R125 fluorocarbon and its hydrocarbon analog, R170, within four nanoporous materials, namely MIL-101, Cu-BTC, ZIF-8, and UiO-66 has been investigated. By analyzing the validity of our models against experimental observations, we ensure the reliability of our molecular simulations. Our analysis encompasses a range of crucial parameters, including adsorption isotherms, enthalpy of adsorption, and energy storage densities, all under varying operating conditions.We find remarkable agreement between computed and observed adsorption isotherms for R125 within MIL-101. However, to obtain similar success for the rest of the adsorbents, we need to take into account a few considerations, such as the presence of inaccessible cages in Cu-BTC, the flexibility of ZIF-8, or the defects in UiO-66. Transitioning to energy storage properties, we investigated various scenarios, including processes with varying adsorption and desorption conditions. Our findings underscore the dominance of MIL-101 in terms of storage densities, with R125 exhibiting superior affinity over R170. Complex mechanisms governed by changes in pressure, temperature, and desorption behavior make for complicated patterns, demanding a case-specific approach. In summary, this study navigates the complex landscape of refrigerant adsorption in diverse nanoporous materials. It highlights the significance of operating conditions, model selection, and refrigerant and adsorbent choices for energy storage applications.


title: CONFIDERAI: a novel CONFormal Interpretable-by-Design score function for Explainable and Reliable Artificial Intelligence

abstract: Everyday life is increasingly influenced by artificial intelligence, and there is no question that machine learning algorithms must be designed to be reliable and trustworthy for everyone. Specifically, computer scientists consider an artificial intelligence system safe and trustworthy if it fulfills five pillars: explainability, robustness, transparency, fairness, and privacy. In addition to these five, we propose a sixth fundamental aspect: conformity, that is, the probabilistic assurance that the system will behave as the machine learner expects. In this paper, we present a methodology to link conformal prediction with explainable machine learning by defining a new score function for rule-based classifiers that leverages rules predictive ability, the geometrical position of points within rules boundaries and the overlaps among rules as well, thanks to the definition of a geometrical rule similarity term. Furthermore, we address the problem of defining regions in the feature space where conformal guarantees are satisfied, by exploiting the definition of conformal critical set and showing how this set can be used to achieve new rules with improved performance on the target class. The overall methodology is tested with promising results on several datasets of real-world interest, such as domain name server tunneling detection or cardiovascular disease prediction.


title: DRAG: Divergence-based Adaptive Aggregation in Federated learning on Non-IID Data

abstract: Local stochastic gradient descent (SGD) is a fundamental approach in achieving communication efficiency in Federated Learning (FL) by allowing individual workers to perform local updates. However, the presence of heterogeneous data distributions across working nodes causes each worker to update its local model towards a local optimum, leading to the phenomenon known as ``client-drift" and resulting in slowed convergence. To address this issue, previous works have explored methods that either introduce communication overhead or suffer from unsteady performance. In this work, we introduce a novel metric called ``degree of divergence," quantifying the angle between the local gradient and the global reference direction. Leveraging this metric, we propose the divergence-based adaptive aggregation (DRAG) algorithm, which dynamically ``drags" the received local updates toward the reference direction in each round without requiring extra communication overhead. Furthermore, we establish a rigorous convergence analysis for DRAG, proving its ability to achieve a sublinear convergence rate. Compelling experimental results are presented to illustrate DRAG's superior performance compared to state-of-the-art algorithms in effectively managing the client-drift phenomenon. Additionally, DRAG exhibits remarkable resilience against certain Byzantine attacks. By securely sharing a small sample of the client's data with the FL server, DRAG effectively counters these attacks, as demonstrated through comprehensive experiments.


title: Measuring, Interpreting, and Improving Fairness of Algorithms using Causal Inference and Randomized Experiments

abstract: Algorithm fairness has become a central problem for the broad adoption of artificial intelligence. Although the past decade has witnessed an explosion of excellent work studying algorithm biases, achieving fairness in real-world AI production systems has remained a challenging task. Most existing works fail to excel in practical applications since either they have conflicting measurement techniques and/ or heavy assumptions, or require code-access of the production models, whereas real systems demand an easy-to-implement measurement framework and a systematic way to correct the detected sources of bias. In this paper, we leverage recent advances in causal inference and interpretable machine learning to present an algorithm-agnostic framework (MIIF) to Measure, Interpret, and Improve the Fairness of an algorithmic decision. We measure the algorithm bias using randomized experiments, which enables the simultaneous measurement of disparate treatment, disparate impact, and economic value. Furthermore, using modern interpretability techniques, we develop an explainable machine learning model which accurately interprets and distills the beliefs of a blackbox algorithm. Altogether, these techniques create a simple and powerful toolset for studying algorithm fairness, especially for understanding the cost of fairness in practical applications like e-commerce and targeted advertising, where industry A/B testing is already abundant.


title: Self-concordant Smoothing for Large-Scale Convex Composite Optimization

abstract: We introduce a notion of self-concordant smoothing for minimizing the sum of two convex functions, one of which is smooth and the other may be nonsmooth. The key highlight of our approach is in a natural property of the resulting problem's structure which provides us with a variable-metric selection method and a step-length selection rule particularly suitable for proximal Newton-type algorithms. In addition, we efficiently handle specific structures promoted by the nonsmooth function, such as $\ell_1$-regularization and group-lasso penalties. We prove the convergence of two resulting algorithms: Prox-N-SCORE, a proximal Newton algorithm and Prox-GGN-SCORE, a proximal generalized Gauss-Newton algorithm. The Prox-GGN-SCORE algorithm highlights an important approximation procedure which helps to significantly reduce most of the computational overhead associated with the inverse Hessian. This approximation is essentially useful for overparameterized machine learning models and in the mini-batch settings. Numerical examples on both synthetic and real datasets demonstrate the efficiency of our approach and its superiority over existing approaches. A Julia package implementing the proposed algorithms is available at https://github.com/adeyemiadeoye/SelfConcordantSmoothOptimization.jl.


title: 3D View Prediction Models of the Dorsal Visual Stream

abstract: Deep neural network representations align well with brain activity in the ventral visual stream. However, the primate visual system has a distinct dorsal processing stream with different functional properties. To test if a model trained to perceive 3D scene geometry aligns better with neural responses in dorsal visual areas, we trained a self-supervised geometry-aware recurrent neural network (GRNN) to predict novel camera views using a 3D feature memory. We compared GRNN to self-supervised baseline models that have been shown to align well with ventral regions using the large-scale fMRI Natural Scenes Dataset (NSD). We found that while the baseline models accounted better for ventral brain regions, GRNN accounted for a greater proportion of variance in dorsal brain regions. Our findings demonstrate the potential for using task-relevant models to probe representational differences across visual streams.


title: Survival Prediction from Imbalance colorectal cancer dataset using hybrid sampling methods and tree-based classifiers

abstract: Background and Objective: Colorectal cancer is a high mortality cancer. Clinical data analysis plays a crucial role in predicting the survival of colorectal cancer patients, enabling clinicians to make informed treatment decisions. However, utilizing clinical data can be challenging, especially when dealing with imbalanced outcomes. This paper focuses on developing algorithms to predict 1-, 3-, and 5-year survival of colorectal cancer patients using clinical datasets, with particular emphasis on the highly imbalanced 1-year survival prediction task. To address this issue, we propose a method that creates a pipeline of some of standard balancing techniques to increase the true positive rate. Evaluation is conducted on a colorectal cancer dataset from the SEER database. Methods: The pre-processing step consists of removing records with missing values and merging categories. The minority class of 1-year and 3-year survival tasks consists of 10% and 20% of the data, respectively. Edited Nearest Neighbor, Repeated edited nearest neighbor (RENN), Synthetic Minority Over-sampling Techniques (SMOTE), and pipelines of SMOTE and RENN approaches were used and compared for balancing the data with tree-based classifiers. Decision Trees, Random Forest, Extra Tree, eXtreme Gradient Boosting, and Light Gradient Boosting (LGBM) are used in this article. Method. Results: The performance evaluation utilizes a 5-fold cross-validation approach. In the case of highly imbalanced datasets (1-year), our proposed method with LGBM outperforms other sampling methods with the sensitivity of 72.30%. For the task of imbalance (3-year survival), the combination of RENN and LGBM achieves a sensitivity of 80.81%, indicating that our proposed method works best for highly imbalanced datasets. Conclusions: Our proposed method significantly improves mortality prediction for the minority class of colorectal cancer patients.


title: INTAGS: Interactive Agent-Guided Simulation

abstract: In many applications involving multi-agent system (MAS), it is imperative to test an experimental (Exp) autonomous agent in a high-fidelity simulator prior to its deployment to production, to avoid unexpected losses in the real-world. Such a simulator acts as the environmental background (BG) agent(s), called agent-based simulator (ABS), aiming to replicate the complex real MAS. However, developing realistic ABS remains challenging, mainly due to the sequential and dynamic nature of such systems. To fill this gap, we propose a metric to distinguish between real and synthetic multi-agent systems, which is evaluated through the live interaction between the Exp and BG agents to explicitly account for the systems' sequential nature. Specifically, we characterize the system/environment by studying the effect of a sequence of BG agents' responses to the environment state evolution and take such effects' differences as MAS distance metric; The effect estimation is cast as a causal inference problem since the environment evolution is confounded with the previous environment state. Importantly, we propose the Interactive Agent-Guided Simulation (INTAGS) framework to build a realistic ABS by optimizing over this novel metric. To adapt to any environment with interactive sequential decision making agents, INTAGS formulates the simulator as a stochastic policy in reinforcement learning. Moreover, INTAGS utilizes the policy gradient update to bypass differentiating the proposed metric such that it can support non-differentiable operations of multi-agent environments. Through extensive experiments, we demonstrate the effectiveness of INTAGS on an equity stock market simulation example. We show that using INTAGS to calibrate the simulator can generate more realistic market data compared to the state-of-the-art conditional Wasserstein Generative Adversarial Network approach.


title: Products of involutions in symplectic groups over general fields (I)

abstract: Let $s$ be an $n$-dimensional symplectic form over an arbitrary field with characteristic not $2$, with $n>2$. The simplicity of the group $\mathrm{Sp}(s)/\{\pm \mathrm{id}\}$ and the existence of a non-trivial involution in $\mathrm{Sp}(s)$ yield that every element of $\mathrm{Sp}(s)$ is a product of involutions. Extending and improving recent results of Awa, de La Cruz, Ellers and Villa with the help of a completely new method, we prove that if the underlying field is infinite, every element of $\mathrm{Sp}(s)$ is the product of four involutions if $n$ is a multiple of $4$, and of five involutions otherwise. The first part of this result is shown to be optimal for all multiples of $4$ and all fields, and is shown to fail for the fields with three elements and for $n=4$. Whether the second part of the result is optimal remains an open question. Finite fields will be tackled in a subsequent article.


title: Safe and Robust Watermark Injection with a Single OoD Image

abstract: Training a high-performance deep neural network requires large amounts of data and computational resources. Protecting the intellectual property (IP) and commercial ownership of a deep model is challenging yet increasingly crucial. A major stream of watermarking strategies implants verifiable backdoor triggers by poisoning training samples, but these are often unrealistic due to data privacy and safety concerns and are vulnerable to minor model changes such as fine-tuning. To overcome these challenges, we propose a safe and robust backdoor-based watermark injection technique that leverages the diverse knowledge from a single out-of-distribution (OoD) image, which serves as a secret key for IP verification. The independence of training data makes it agnostic to third-party promises of IP security. We induce robustness via random perturbation of model parameters during watermark injection to defend against common watermark removal attacks, including fine-tuning, pruning, and model extraction. Our experimental results demonstrate that the proposed watermarking approach is not only time- and sample-efficient without training data, but also robust against the watermark removal attacks above.


title: Cone beam neutron interferometry: from modeling to applications

abstract: Phase-grating moire interferometers (PGMIs) have emerged as promising candidates for the next generation of neutron interferometry, enabling the use of a polychromatic beam and manifesting interference patterns that can be directly imaged by existing neutron cameras. However, the modeling of the various PGMI configurations is limited to cumbersome numerical calculations and backward propagation models which often do not enable one to explore the setup parameters. Here we generalize the Fresnel scaling theorem to introduce a k-space model for PGMI setups illuminated by a cone beam, thus enabling an intuitive forward propagation model for a wide range of parameters. The interference manifested by a PGMI is shown to be a special case of the Talbot effect, and the optimal fringe visibility is shown to occur at the moire location of the Talbot distances. We derive analytical expressions for the contrast and the propagating intensity profiles in various conditions, and analyze the behaviour of the dark-field imaging signal when considering sample characterization. The model's predictions are compared to experimental measurements and good agreement is found between them. Lastly, we propose and experimentally verify a method to recover contrast at typically inaccessible PGMI autocorrelation lengths. The presented work provides a toolbox for analyzing and understanding existing PGMI setups and their future applications, for example extensions to two-dimensional PGMIs and characterization of samples with non-trivial structures.


title: Hierarchical Grammar-Induced Geometry for Data-Efficient Molecular Property Prediction

abstract: The prediction of molecular properties is a crucial task in the field of material and drug discovery. The potential benefits of using deep learning techniques are reflected in the wealth of recent literature. Still, these techniques are faced with a common challenge in practice: Labeled data are limited by the cost of manual extraction from literature and laborious experimentation. In this work, we propose a data-efficient property predictor by utilizing a learnable hierarchical molecular grammar that can generate molecules from grammar production rules. Such a grammar induces an explicit geometry of the space of molecular graphs, which provides an informative prior on molecular structural similarity. The property prediction is performed using graph neural diffusion over the grammar-induced geometry. On both small and large datasets, our evaluation shows that this approach outperforms a wide spectrum of baselines, including supervised and pre-trained graph neural networks. We include a detailed ablation study and further analysis of our solution, showing its effectiveness in cases with extremely limited data. Code is available at https://github.com/gmh14/Geo-DEG.


title: Non-integer characterizing slopes and knot Floer homology

abstract: Conjecturally, a knot in the 3-sphere has only finitely many non-integer non-characterizing slopes. We verify this conjecture for all knots with knot Floer homology satisfying certain simplicity conditions. The class of knots satisfying our notion of simplicity includes alternating knots, $L$-space knots and the vast majority of knots with at most 12 crossings. For arbitrary knots in the 3-sphere we show that almost all slopes $p/q$ with $|q|\geq 3$ are characterizing. In addition, we show that all $L$-space knots and almost $L$-space knots have infinitely many integer characterizing slopes.


title: Quantum Cosmology

abstract: Invited contribution to the Encyclopedia of Mathematical Physics (2nd edition), providing an overview over some main ideas and results in quantum cosmology. Key points: Canonical quantisation of homogeneous, isotropic cosmology; discussion of ambiguities in this quantisation; Construction of explicit solutions, attempts at physical interpretation; conceptual issues (time evolution, unitarity, probability interpretation); Introduction of scalar fields or perfect fluids; Discussion of whether classical singularities are resolved; Addition of inhomogeneities, possible predictions for primordial cosmology; Connections to string theory and loop quantum gravity.


title: Non-Transitivity of the Win Ratio and the Area Under the Receiver Operating Characteristics Curve (AUC): a case for evaluating the strength of stochastic comparisons

abstract: The win ratio (WR) is a novel statistic used in randomized controlled trials that can account for hierarchies within event outcomes. In this paper we report and study the long-run non-transitive behavior of the win ratio and the closely related Area Under the Receiver Operating Characteristics Curve (AUC) and argue that their transitivity cannot be taken for granted. Crucially, traditional within-group statistics (i.e., comparison of means) are always transitive, while the WR can detect non-transitivity. Non-transitivity provides valuable information on the stochastic relationship between two treatment groups, which should be tested and reported. We specify the necessary conditions for transitivity, the sufficient conditions for non-transitivity, and demonstrate non-transitivity in a real-life large randomized controlled trial for the WR of time-to-death. Our results can be used to rule out or evaluate the possibility of non-transitivity and show the importance of studying the strength of stochastic relationships.

categories: stat.ME cs.PF econ.EM math.ST stat.AP stat.TH


title: Explicit families of congruences for the overpartition function

abstract: In this article we exhibit new explicit families of congruences for the overpartition function, making effective the existence results given previously by Treneer. We give infinite families of congruences modulo $m$ for $m = 5, 7, 11$, and finite families for $m = 13, 17, 19$.


title: Neural-Singular-Hessian: Implicit Neural Representation of Unoriented Point Clouds by Enforcing Singular Hessian

abstract: Neural implicit representation is a promising approach for reconstructing surfaces from point clouds. Existing methods combine various regularization terms, such as the Eikonal and Laplacian energy terms, to enforce the learned neural function to possess the properties of a Signed Distance Function (SDF). However, inferring the actual topology and geometry of the underlying surface from poor-quality unoriented point clouds remains challenging. In accordance with Differential Geometry, the Hessian of the SDF is singular for points within the differential thin-shell space surrounding the surface. Our approach enforces the Hessian of the neural implicit function to have a zero determinant for points near the surface. This technique aligns the gradients for a near-surface point and its on-surface projection point, producing a rough but faithful shape within just a few iterations. By annealing the weight of the singular-Hessian term, our approach ultimately produces a high-fidelity reconstruction result. Extensive experimental results demonstrate that our approach effectively suppresses ghost geometry and recovers details from unoriented point clouds with better expressiveness than existing fitting-based methods.


title: On the stability of spherically symmetric space-times in scalar-tensor gravity

abstract: We study the linear stability of vacuum static, spherically symmetric solutions to the gravitational field equations of the Bergmann-Wagoner-Nordtvedt class of scalar-tensor theories (STT) of gravity, restricting ourselves to nonphantom theories, massless scalar fields and configurations with positive Schwarzschild mass. We consider only small radial (monopole) perturbations as the ones most likely to cause an instability. The problem reduces to the same Schroedinger-like master equation as is known for perturbations of Fisher's solution of general relativity (GR), but the corresponding boundary conditions that affect the final result of the study depend on the choice of the STT and a particular solution within it. The stability or instability conclusions are obtained for the Brans-Dicke, Barker and Schwinger STT as well as for GR nonminimally coupled to a scalar field with an arbitrary parameter $\xi$.


title: Composite federated learning with heterogeneous data

abstract: We propose a novel algorithm for solving the composite Federated Learning (FL) problem. This algorithm manages non-smooth regularization by strategically decoupling the proximal operator and communication, and addresses client drift without any assumptions about data similarity. Moreover, each worker uses local updates to reduce the communication frequency with the server and transmits only a $d$-dimensional vector per communication round. We prove that our algorithm converges linearly to a neighborhood of the optimal solution and demonstrate the superiority of our algorithm over state-of-the-art methods in numerical experiments.


title: Asymmetric matrix sensing by gradient descent with small random initialization

abstract: We study matrix sensing, which is the problem of reconstructing a low-rank matrix from a few linear measurements. It can be formulated as an overparameterized regression problem, which can be solved by factorized gradient descent when starting from a small random initialization. Linear neural networks, and in particular matrix sensing by factorized gradient descent, serve as prototypical models of non-convex problems in modern machine learning, where complex phenomena can be disentangled and studied in detail. Much research has been devoted to studying special cases of asymmetric matrix sensing, such as asymmetric matrix factorization and symmetric positive semi-definite matrix sensing. Our key contribution is introducing a continuous differential equation that we call the $\textit{perturbed gradient flow}$. We prove that the perturbed gradient flow converges quickly to the true target matrix whenever the perturbation is sufficiently bounded. The dynamics of gradient descent for matrix sensing can be reduced to this formulation, yielding a novel proof of asymmetric matrix sensing with factorized gradient descent. Compared to directly analyzing the dynamics of gradient descent, the continuous formulation allows bounding key quantities by considering their derivatives, often simplifying the proofs. We believe the general proof technique may prove useful in other settings as well.


title: Accuracy and Consistency of Space-based Vegetation Height Maps for Forest Dynamics in Alpine Terrain

abstract: Monitoring and understanding forest dynamics is essential for environmental conservation and management. This is why the Swiss National Forest Inventory (NFI) provides countrywide vegetation height maps at a spatial resolution of 0.5 m. Its long update time of 6 years, however, limits the temporal analysis of forest dynamics. This can be improved by using spaceborne remote sensing and deep learning to generate large-scale vegetation height maps in a cost-effective way. In this paper, we present an in-depth analysis of these methods for operational application in Switzerland. We generate annual, countrywide vegetation height maps at a 10-meter ground sampling distance for the years 2017 to 2020 based on Sentinel-2 satellite imagery. In comparison to previous works, we conduct a large-scale and detailed stratified analysis against a precise Airborne Laser Scanning reference dataset. This stratified analysis reveals a close relationship between the model accuracy and the topology, especially slope and aspect. We assess the potential of deep learning-derived height maps for change detection and find that these maps can indicate changes as small as 250 $m^2$. Larger-scale changes caused by a winter storm are detected with an F1-score of 0.77. Our results demonstrate that vegetation height maps computed from satellite imagery with deep learning are a valuable, complementary, cost-effective source of evidence to increase the temporal resolution for national forest assessments.


title: New Qubit Codes from Multidimensional Circulant Graphs

abstract: Two new qubit stabilizer codes with parameters $[77, 0, 19]_2$ and $[90, 0, 22]_2$ are constructed for the first time by employing additive symplectic self-dual $\F_4$ codes from multidimensional circulant (MDC) graphs. We completely classify MDC graph codes for lengths $4\le n \le 40$ and show that many optimal $\dsb{\ell, 0, d}$ qubit codes can be obtained from the MDC construction. Moreover, we prove that adjacency matrices of MDC graphs have nested block circulant structure and determine isomorphism properties of MDC graphs.


title: Quantum Barkhausen Noise Induced by Domain Wall Co-Tunneling

abstract: Most macroscopic magnetic phenomena (including magnetic hysteresis) are typically understood classically. Here, we examine the dynamics of a uniaxial rare-earth ferromagnet deep within the quantum regime, so that domain wall motion, and the associated hysteresis, is dominated by large-scale quantum tunneling of spins, rather than classical thermal activation over a potential barrier. The domain wall motion is found to exhibit avalanche dynamics, observable as an unusual form of Barkhausen noise. We observe non-critical behavior in the avalanche dynamics that only can be explained by going beyond traditional renormalization group methods or classical domain wall models. We find that this ``quantum Barkhausen noise'' exhibits two distinct mechanisms for domain wall movement, each of which is quantum-mechanical, but with very different dependences on an external magnetic field applied transverse to the spin (Ising) axis. These observations can be understood in terms of the correlated motion of pairs of domain walls, nucleated by co-tunneling of plaquettes (sections of domain wall), with plaquette pairs correlated by dipolar interactions; this correlation is suppressed by the transverse field. Similar macroscopic correlations may be expected to appear in the hysteresis of other systems with long-range interactions.


title: Tight Bounds on List-Decodable and List-Recoverable Zero-Rate Codes

abstract: In this work, we consider the list-decodability and list-recoverability of codes in the zero-rate regime. Briefly, a code $\mathcal{C} \subseteq [q]^n$ is $(p,\ell,L)$-list-recoverable if for all tuples of input lists $(Y_1,\dots,Y_n)$ with each $Y_i \subseteq [q]$ and $|Y_i|=\ell$ the number of codewords $c \in \mathcal{C}$ such that $c_i \notin Y_i$ for at most $pn$ choices of $i \in [n]$ is less than $L$; list-decoding is the special case of $\ell=1$. In recent work by Resch, Yuan and Zhang~(ICALP~2023) the zero-rate threshold for list-recovery was determined for all parameters: that is, the work explicitly computes $p_*:=p_*(q,\ell,L)$ with the property that for all $\epsilon>0$ (a) there exist infinite families positive-rate $(p_*-\epsilon,\ell,L)$-list-recoverable codes, and (b) any $(p_*+\epsilon,\ell,L)$-list-recoverable code has rate $0$. In fact, in the latter case the code has constant size, independent on $n$. However, the constant size in their work is quite large in $1/\epsilon$, at least $|\mathcal{C}|\geq (\frac{1}{\epsilon})^{O(q^L)}$. Our contribution in this work is to show that for all choices of $q,\ell$ and $L$ with $q \geq 3$, any $(p_*+\epsilon,\ell,L)$-list-recoverable code must have size $O_{q,\ell,L}(1/\epsilon)$, and furthermore this upper bound is complemented by a matching lower bound $\Omega_{q,\ell,L}(1/\epsilon)$. This greatly generalizes work by Alon, Bukh and Polyanskiy~(IEEE Trans.\ Inf.\ Theory~2018) which focused only on the case of binary alphabet (and thus necessarily only list-decoding). We remark that we can in fact recover the same result for $q=2$ and even $L$, as obtained by Alon, Bukh and Polyanskiy: we thus strictly generalize their work.


title: Phase Transitions for Binomial Sets Under Linear Forms

abstract: We generalize the study of the sum and difference sets of a subset of $\mathbb{N}$ drawn from a binomial model to the following setting. Given $A \subseteq \{0, 1, \dots, N\}$, an integer $h \geq 2$, and a linear form $L: \mathbb{Z}^h \to \mathbb{Z}$ given by $$L(x_1, \dots, x_h) = u_1x_1 + \cdots + u_hx_h, \quad u_i \in \mathbb{Z}_{\neq 0} \text{ for all } i \in [h],$$ we study the size of $$L(A) = \left\{u_1a_1 + \cdots + u_ha_h : a_i \in A \right\}$$ and its complement $L(A)^c$ when each element of $\{0, 1, \dots, N\}$ is independently included in $A$ with probability $p(N)$. We identify two phase transition phenomena. The first ``global" phase transition concerns the relative sizes of $L(A)$ and $L(A)^c$, with $p(N) = N^{-\frac{h-1}{h}}$ as the threshold. Asymptotically almost surely, it holds below the threshold that almost all sums generated in $L(A)$ are distinct and almost all possible sums are in $L(A)^c$, and above the threshold that almost all possible sums are in $L(A)$. Our asymptotic formulae substantially extend work of Hegarty and Miller and completely settle, with appropriate corrections made to its statement, their conjecture from 2009. The second ``local" phase transition concerns the asymptotic behavior of the number of distinct realizations in $L(A)$ of a given value, with $p(N) = N^{-\frac{h-2}{h-1}}$ as the threshold. Specifically, it identifies (in a sharp sense) when the number of such realizations obeys a Poisson limit. Our main tools are recent results concerning the asymptotic enumeration of partitions and weak compositions, classical theorems on Poisson approximation, and the martingale machinery of Kim and Vu.


title: Sensitivity of Simulations of Double Detonation Type Ia Supernova to Integration Methodology

abstract: We study the coupling of hydrodynamics and reactions in simulations of the double detonation model for Type Ia supernovae. When assessing the convergence of simulations, the focus is usually on spatial resolution; however, the method of coupling the physics together as well as the tolerances used in integrating a reaction network also play an important role. In this paper, we explore how the choices made in both coupling and integrating the reaction portion of a simulation (operator / Strang splitting vs.\ the simplified spectral deferred corrections method we introduced previously) influences the accuracy, efficiency, and the nucleosynthesis of simulations of double detonations. We find no need to limit reaction rates or reduce the simulation timestep to the reaction timescale. The entire simulation methodology used here is GPU-accelerated and made freely available as part of the Castro simulation code.


title: Importance of overnight parameters to predict Sea Breeze on Long Island

abstract: The sea breeze is a phenomenon frequently impacting Long Island, New York, especially during the spring and early summer, when land surface temperatures can exceed ocean temperatures considerably. The sea breeze influences daily weather conditions by causing a shift in wind direction and speed, limiting the maximum temperature, and occasionally serving as a trigger for precipitation and thunderstorms. Advance prediction of the presence or absence of the sea breeze for a certain location on a given day would therefore be beneficial to weather forecasters. To forecast sea breeze occurrence based on the previous night's weather conditions, we used a novel algorithm called the $D$-Basis. We analyzed sea breeze data from a recent four year period (2017-2020) at a single weather station several miles inland from the coast. High or constant station pressure, high or constant dew point, and onshore wind from the previous night were found to be strong predictors of sea breeze formation the following day. The accuracy of the prediction was around 74\% for June 2020. Unlike other prediction methods which involve the comparison of sea surface and land surface temperatures in near real time, our prediction method is based on the parameters from the prior night, allowing it to potentially aid in advanced forecasting of the sea breeze.


title: Simultaneous mm/X-ray intraday variability in the radio-quiet AGN MCG+08-11-11

abstract: Most of the Active Galactic Nuclei (AGN) are radio-quiet (RQ) and, differently from radio-loud (RL) AGN, do not show signature of large-scale and powerful jets. The physical origin of their radio emission remains then broadly unclear. The observation of flat/inverted radio spectra at GHz frequencies seems to support however the presence of an unresolved synchrotron self-absorbed region in the close environment of the supermassive black hole. Its size could be as small as that of the X-ray corona. Since synchrotron self absorption decreases strongly with frequency, these sources need to be observed in the millimetric (mm) domain. We report here a 12h simultaneous mm-X-ray observation of the RQ AGN MCG+08-11-11 by NOEMA and NuSTAR. The mm flux shows a weak but clear increase along the pointing with a fractional variability of $2.0\pm0.1$\%. The 3-10 keV flux of NuSTAR also increases and shows a fractional variability of $7.0\pm1.5$\%. A structure function analysis shows a local maximum in the mm light curve corresponding to 2-3\% of variability on timescale of $\sim2\times10^4$ seconds (100-300 $R_g$ light crossing time). Assuming an optically thick mm emitting medium, this translates into an upper limit of its size of $\sim$1300 $R_g$. The observation of fast variability in radio-mm and X-ray wavelengths, as well as a similar variability trend, well support the mm emission to be emitted by a region close, and potentially related to, the X-ray corona like an outflow/weak jet.


title: From Kubernetes to Knactor: A Data-Centric Rethink of Service Composition

abstract: Microservices are increasingly used in modern applications, leading to a growing need for effective service composition solutions. However, we argue that traditional API-centric composition mechanisms (e.g., RPC, REST, and Pub/Sub) hamper the modularity of microservices. These mechanisms introduce rigid code-level coupling, scatter composition logic, and hinder visibility into cross-service data exchanges. Ultimately, these limitations complicate the maintenance and evolution of microservice-based applications. In response, we propose a rethinking of service composition and present Knactor, a new data-centric composition framework to restore the modularity that microservices were intended to offer. Knactor decouples service composition from service development, allowing composition to be implemented as explicit data exchanges among multiple services. Our initial case study suggests that Knactor simplifies service composition and creates new opportunities for optimizations.


title: Focusing and Calibration of Large Scale Network Sensors using GraphBLAS Anonymized Hypersparse Matrices

abstract: Defending community-owned cyber space requires community-based efforts. Large-scale network observations that uphold the highest regard for privacy are key to protecting our shared cyberspace. Deployment of the necessary network sensors requires careful sensor placement, focusing, and calibration with significant volumes of network observations. This paper demonstrates novel focusing and calibration procedures on a multi-billion packet dataset using high-performance GraphBLAS anonymized hypersparse matrices. The run-time performance on a real-world data set confirms previously observed real-time processing rates for high-bandwidth links while achieving significant data compression. The output of the analysis demonstrates the effectiveness of these procedures at focusing the traffic matrix and revealing the underlying stable heavy-tail statistical distributions that are necessary for anomaly detection. A simple model of the corresponding probability of detection ($p_{\rm d}$) and probability of false alarm ($p_{\rm fa}$) for these distributions highlights the criticality of network sensor focusing and calibration. Once a sensor is properly focused and calibrated it is then in a position to carry out two of the central tenets of good cybersecurity: (1) continuous observation of the network and (2) minimizing unbrokered network connections.


title: Marginalized Importance Sampling for Off-Environment Policy Evaluation

abstract: Reinforcement Learning (RL) methods are typically sample-inefficient, making it challenging to train and deploy RL-policies in real world robots. Even a robust policy trained in simulation requires a real-world deployment to assess their performance. This paper proposes a new approach to evaluate the real-world performance of agent policies prior to deploying them in the real world. Our approach incorporates a simulator along with real-world offline data to evaluate the performance of any policy using the framework of Marginalized Importance Sampling (MIS). Existing MIS methods face two challenges: (1) large density ratios that deviate from a reasonable range and (2) indirect supervision, where the ratio needs to be inferred indirectly, thus exacerbating estimation error. Our approach addresses these challenges by introducing the target policy's occupancy in the simulator as an intermediate variable and learning the density ratio as the product of two terms that can be learned separately. The first term is learned with direct supervision and the second term has a small magnitude, thus making it computationally efficient. We analyze the sample complexity as well as error propagation of our two step-procedure. Furthermore, we empirically evaluate our approach on Sim2Sim environments such as Cartpole, Reacher, and Half-Cheetah. Our results show that our method generalizes well across a variety of Sim2Sim gap, target policies and offline data collection policies. We also demonstrate the performance of our algorithm on a Sim2Real task of validating the performance of a 7 DoF robotic arm using offline data along with the Gazebo simulator.


title: DiscoverPath: A Knowledge Refinement and Retrieval System for Interdisciplinarity on Biomedical Research

abstract: The exponential growth in scholarly publications necessitates advanced tools for efficient article retrieval, especially in interdisciplinary fields where diverse terminologies are used to describe similar research. Traditional keyword-based search engines often fall short in assisting users who may not be familiar with specific terminologies. To address this, we present a knowledge graph-based paper search engine for biomedical research to enhance the user experience in discovering relevant queries and articles. The system, dubbed DiscoverPath, employs Named Entity Recognition (NER) and part-of-speech (POS) tagging to extract terminologies and relationships from article abstracts to create a KG. To reduce information overload, DiscoverPath presents users with a focused subgraph containing the queried entity and its neighboring nodes and incorporates a query recommendation system, enabling users to iteratively refine their queries. The system is equipped with an accessible Graphical User Interface that provides an intuitive visualization of the KG, query recommendations, and detailed article information, enabling efficient article retrieval, thus fostering interdisciplinary knowledge exploration. DiscoverPath is open-sourced at https://github.com/ynchuang/DiscoverPath.


title: Are Emergent Abilities in Large Language Models just In-Context Learning?

abstract: Large language models have exhibited emergent abilities, demonstrating exceptional performance across diverse tasks for which they were not explicitly trained, including those that require complex reasoning abilities. The emergence of such abilities carries profound implications for the future direction of research in NLP, especially as the deployment of such models becomes more prevalent. However, one key challenge is that the evaluation of these abilities is often confounded by competencies that arise in models through alternative prompting techniques, such as in-context learning and instruction following, which also emerge as the models are scaled up. In this study, we provide the first comprehensive examination of these emergent abilities while accounting for various potentially biasing factors that can influence the evaluation of models. We conduct rigorous tests on a set of 18 models, encompassing a parameter range from 60 million to 175 billion parameters, across a comprehensive set of 22 tasks. Through an extensive series of over 1,000 experiments, we provide compelling evidence that emergent abilities can primarily be ascribed to in-context learning. We find no evidence for the emergence of reasoning abilities, thus providing valuable insights into the underlying mechanisms driving the observed abilities and thus alleviating safety concerns regarding their use.


title: Infrared structures of scattering on self-dual radiative backgrounds

abstract: The scattering of gluons and gravitons in trivial backgrounds is endowed with many surprising infrared features which have interesting conformal interpretations on the two-dimensional celestial sphere. However, the fate of these structures in more general asymptotically flat backgrounds is far from clear. In this paper, we consider holomorphic infrared structures in the presence of non-perturbative, self-dual background gauge and gravitational fields which are determined by freely specified radiative data. We make use of explicit formulae for tree-level gluon and graviton scattering in these self-dual radiative backgrounds, as well as chiral twistor sigma model descriptions of the classical dynamics. Remarkably, we find that the leading holomorphic part of tree-level collinear splitting functions -- or celestial OPEs -- and infinite-dimensional chiral soft algebras are undeformed by the background. We also compute all-order holomorphic celestial OPEs in the MHV sectors of gauge theory and gravity.


title: Instant Continual Learning of Neural Radiance Fields

abstract: Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption may be prohibitive in continual learning scenarios, where new data is acquired in a sequential manner and a continuous update of the NeRF is desired, as in automotive or remote sensing applications. When naively trained in such a continual setting, traditional scene representation frameworks suffer from catastrophic forgetting, where previously learned knowledge is corrupted after training on new data. Prior works in alleviating forgetting with NeRFs suffer from low reconstruction quality and high latency, making them impractical for real-world application. We propose a continual learning framework for training NeRFs that leverages replay-based methods combined with a hybrid explicit--implicit scene representation. Our method outperforms previous methods in reconstruction quality when trained in a continual setting, while having the additional benefit of being an order of magnitude faster.


title: Into the Single Cell Multiverse: an End-to-End Dataset for Procedural Knowledge Extraction in Biomedical Texts

abstract: Many of the most commonly explored natural language processing (NLP) information extraction tasks can be thought of as evaluations of declarative knowledge, or fact-based information extraction. Procedural knowledge extraction, i.e., breaking down a described process into a series of steps, has received much less attention, perhaps in part due to the lack of structured datasets that capture the knowledge extraction process from end-to-end. To address this unmet need, we present FlaMB\'e (Flow annotations for Multiverse Biological entities), a collection of expert-curated datasets across a series of complementary tasks that capture procedural knowledge in biomedical texts. This dataset is inspired by the observation that one ubiquitous source of procedural knowledge that is described as unstructured text is within academic papers describing their methodology. The workflows annotated in FlaMB\'e are from texts in the burgeoning field of single cell research, a research area that has become notorious for the number of software tools and complexity of workflows used. Additionally, FlaMB\'e provides, to our knowledge, the largest manually curated named entity recognition (NER) and disambiguation (NED) datasets for tissue/cell type, a fundamental biological entity that is critical for knowledge extraction in the biomedical research domain. Beyond providing a valuable dataset to enable further development of NLP models for procedural knowledge extraction, automating the process of workflow mining also has important implications for advancing reproducibility in biomedical research.


title: Inverse Dynamics Trajectory Optimization for Contact-Implicit Model Predictive Control

abstract: Robots must make and break contact with the environment to perform useful tasks, but planning and control through contact remains a formidable challenge. In this work, we achieve real-time contact-implicit model predictive control with a surprisingly simple method: inverse dynamics trajectory optimization. While trajectory optimization with inverse dynamics is not new, we introduce a series of incremental innovations that collectively enable fast model predictive control on a variety of challenging manipulation and locomotion tasks. We implement these innovations in an open-source solver and present simulation examples to support the effectiveness of the proposed approach. Additionally, we demonstrate contact-implicit model predictive control on hardware at over 100 Hz for a 20-degree-of-freedom bi-manual manipulation task. Video and code are available at https://idto.github.io.


title: Data-Driven Computation of Robust Invariant Sets and Gain-Scheduled Controllers for Linear Parameter-Varying Systems

abstract: We present a direct data-driven approach to synthesize robust control invariant (RCI) sets and their associated gain-scheduled feedback control laws for linear parameter-varying (LPV) systems subjected to bounded disturbances. A data-set consisting of a single state-input-scheduling trajectory is gathered from the system, which is directly utilized to compute polytopic RCI set and controllers by solving a semidefinite program. The proposed method does not require an intermediate LPV model identification step. Through a numerical example, we show that the proposed approach can generate RCI sets with a relatively small number of data samples when the data satisfies certain excitation conditions.


title: Effective Hamiltonian approach to the kinetic infinitely long-range Ising (the Husimi-Temperley) model

abstract: The linear master equation (ME) describing the stochastic kinetics of Ising-type models has been transformed into a nonlinear ME (NLME) for a time-dependent effective Hamiltonian (EH). It has been argued that for models with large number of spins ($N$) NLME is easier to deal with numerically than ME. The reason is that the non-equilibrium probability distribution entering ME scales exponentially with the system size which for large $N$ causes numerical under- and overflow problems. NLME, in contrast, contains quantities scaling with $ N $ not faster than linearly. The advantages of NLME in numerical calculations has been illustrated on the problem of decay of metastable states in the kinetic Husimi-Temperley model (HTM) previously studied within ME approach by other authors. It has been shown that the use of NLME makes possible to extend by orders of magnitude the ranges of numerically accessible quantities, such as the system size $ N $ and the lifetimes of metastable states, as well as the accuracy of the calculations. An excellent agreement of numerical results with previous studies has been found. It has been shown that in the thermodynamic limit EH for HTM exactly satisfies a nonlinear first order differential equation. The system of characteristic equations for its solution has been derived and it has been shown that the conventional mean field equation is one of them.


title: Adaptive Model Pruning and Personalization for Federated Learning over Wireless Networks

abstract: Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency increase when updating large-scale learning models on devices with limited computational capability and wireless resources. We consider a FL framework with partial model pruning and personalization to overcome these challenges. This framework splits the learning model into a global part with model pruning shared with all devices to learn data representations and a personalized part to be fine-tuned for a specific device, which adapts the model size during FL to reduce both computation and communication latency and increases the learning accuracy for devices with non-independent and identically distributed data. The computation and communication latency and convergence of the proposed FL framework are mathematically analyzed. To maximize the convergence rate and guarantee learning accuracy, Karush Kuhn Tucker (KKT) conditions are deployed to jointly optimize the pruning ratio and bandwidth allocation. Finally, experimental results demonstrate that the proposed FL framework achieves a remarkable reduction of approximately 50 percent computation and communication latency compared with FL with partial model personalization.


title: Invariants and reversibility in polynomial systems of ODEs

abstract: This paper explores a relationship between invariants of certain group actions and the time-reversibility of two-dimensional polynomial differential systems exhibiting a $1:-1$ resonant singularity at the origin. We focus on the connection of time-reversibility with the Sibirsky subvariety of the center (integrability) variety, which encompasses systems possessing a local analytic first integral near the origin. An algorithm for generating the Sibirsky ideal for these systems is proposed and the algebraic properties of the ideal are examined. Furthermore, using a generalization of the concept of time-reversibility we study $n$-dimensional systems with a $1:\zeta:\zeta^2:\dots:\zeta^{n-1}$ resonant singularity at the origin, where $n$ is prime and $\zeta$ is a primitive $n$-th root of unity. We study the invariants of a Lie group action on the parameter space of the system, leveraging the theory of binomial ideals as a fundamental tool for the analysis. Our study reveals intriguing connections between generalized reversibility, invariants, and binomial ideals, shedding light on their complex interrelations.


title: On the rook polynomial of grid polyominoes

abstract: We investigate the algebraic properties of the coordinate ring of grid polyominoes. This class of non-simple and thin polyominoes was introduced by Mascia, Rinaldo, and Romeo, but not much is known about their polyomino ideals, $I_{\mathcal{P}}$, and their related coordinate ring, $K[\mathcal{P}]$. We give a formula for the Krull dimension of $K[\mathcal{P}]$ in terms of the combinatorics of the polyomino and we prove that $I_{\mathcal{P}}$ is of K\"onig type if and only if the polyomino has exactly one hole. In addition, we study a Conjecture of Rinaldo and Romeo which characterizes the thin polyominoes, and we confirm it for grid polyominoes. Namely, in the main result of this article, we prove that the $h$-polynomial of $K[\mathcal{P}]$ is equal to the rook polynomial of $\mathcal{P}$, and, as a consequence, the Castelnuovo-Mumford regularity of $K[\mathcal{P}]$ is equal to $r(\mathcal{P})$, the maximum number of rooks that can be placed in $\mathcal{P}$ in non-attacking positions. Our method to prove this result is based on the theory of simplicial complexes. We provide a suitable shelling order for $\Delta_{\mathcal{P}}$, the simplicial complex attached to $\mathcal{P}$ in relation to a generalized step of a facet, and we show that there is a one-to-one correspondence between the facets of $\Delta_{\mathcal{P}}$ with $k$ generalized steps and the $k$-rook configurations in $\mathcal{P}$.


title: Decoding the IRX-\beta\ dust attenuation relation in star-forming galaxies at intermediate redshift

abstract: We aim to understand what drives the IRX-\beta dust attenuation relation at intermediate redshift (0.5 < z < 0.8) in star-forming galaxies. We investigate the role of various galaxy properties in shaping this observed relation. We use robust [O ii] {\lambda}3727, [O iii] {\lambda}{\lambda}4959, 5007, and H\beta line detections of our statistical sample of 1049 galaxies to estimate the gas-phase metallicities. We derive key physical properties that are necessary to study galaxy evolution, such as the stellar masses and the star formation rates, using the spectral energy distribution fitting tool CIGALE. Equivalently, we study the effect of galaxy morphology (mainly the S\'ersic index n and galaxy inclination) on the observed IRX-\beta scatter. We also investigate the role of the environment in shaping dust attenuation in our sample. We find a strong correlation of the IRX-\beta relation on gas-phase metallicity in our sample, and also strong correlation with galaxy compactness characterized by the S\'ersic indexes. Correlations are also seen with stellar masses, specific star formation rates and the stellar ages of our sources. Metallicity strongly correlates with the IRX-\beta scatter, this also results from the older stars and higher masses at higher beta values. Galaxies with higher metallicities show higher IRX and higher beta values. The correlation with specific dust mass strongly shifts the galaxies away from the IRX-\beta relation towards lower \b{eta} values. We find that more compact galaxies witness a larger amount of attenuation than less compact galaxies. There is a subtle variation in the dust attenuation scatter between edge-on and face-on galaxies, but the difference is not statistically significant. Galaxy environments do not significantly affect dust attenuation in our sample of star-forming galaxies at intermediate redshift.


title: Fitting the Light Curve of 1I/`Oumuamua with a Nonprincipal Axis Rotational Model and Outgassing Torques

abstract: In this paper, we investigate the nonprincipal axis (NPA) rotational state of 1I/`Oumuamua -- the first interstellar object discovered traversing the inner Solar System -- from its photometric light curve. Building upon Mashchenko (2019), we develop a model which incorporates NPA rotation and {Sun-induced, time-varying} outgassing torques to generate synthetic light curves of the object. The model neglects tidal forces, which are negligible compared to outgassing torques over the distances that `Oumuamua was observed. We implement an optimization scheme that incorporates the NPA rotation model to calculate the initial rotation state of the object. We find that an NPA rotation state with an average period of $\langle P \rangle\simeq7.34$ hr best reproduces the photometric data. The discrepancy between this period and previous estimates is due to continuous period modulation induced by outgassing torques in the rotational model, {as well as different periods being used}. The best fit to the October 2017 data does not reproduce the November 2017 data (although the later measurements are too sparse to fit). The light curve is consistent with no secular evolution of the angular momentum, somewhat in tension with the empirical correlations between nuclear spin-up and cometary outgassing. The complex rotation of `Oumuamua may be {the result of primordial rotation about the smallest principal axis} if (i) the object experienced hypervolatile outgassing and (ii) our idealized outgassing model is accurate.


title: Status of next-generation $\Lambda_b \to p, \Lambda, \Lambda_c$ form-factor calculations

abstract: I present preliminary results of next-generation lattice-QCD calculations of the $\Lambda_b \to p$, $\Lambda_b \to \Lambda$, and $\Lambda_b \to \Lambda_c$ form factors based on RBC/UKQCD gauge-field ensembles with 2+1 flavors of domain-wall fermions. Compared to the work published in 2015 and 2016, the new calculations include three additional ensembles (one with 139 MeV pion mass, one with 0.073 fm lattice spacing, and one with another volume) and were performed with a more accurate tuning of the charm and bottom anisotropic clover action parameters.


title: A Systematic Review on Reproducibility in Child-Robot Interaction

abstract: Research reproducibility - i.e., rerunning analyses on original data to replicate the results - is paramount for guaranteeing scientific validity. However, reproducibility is often very challenging, especially in research fields where multi-disciplinary teams are involved, such as child-robot interaction (CRI). This paper presents a systematic review of the last three years (2020-2022) of research in CRI under the lens of reproducibility, by analysing the field for transparency in reporting. Across a total of 325 studies, we found deficiencies in reporting demographics (e.g. age of participants), study design and implementation (e.g. length of interactions), and open data (e.g. maintaining an active code repository). From this analysis, we distill a set of guidelines and provide a checklist to systematically report CRI studies to help and guide research to improve reproducibility in CRI and beyond.


title: Multi-dimension unified Swin Transformer for 3D Lesion Segmentation in Multiple Anatomical Locations

abstract: In oncology research, accurate 3D segmentation of lesions from CT scans is essential for the modeling of lesion growth kinetics. However, following the RECIST criteria, radiologists routinely only delineate each lesion on the axial slice showing the largest transverse area, and delineate a small number of lesions in 3D for research purposes. As a result, we have plenty of unlabeled 3D volumes and labeled 2D images, and scarce labeled 3D volumes, which makes training a deep-learning 3D segmentation model a challenging task. In this work, we propose a novel model, denoted a multi-dimension unified Swin transformer (MDU-ST), for 3D lesion segmentation. The MDU-ST consists of a Shifted-window transformer (Swin-transformer) encoder and a convolutional neural network (CNN) decoder, allowing it to adapt to 2D and 3D inputs and learn the corresponding semantic information in the same encoder. Based on this model, we introduce a three-stage framework: 1) leveraging large amount of unlabeled 3D lesion volumes through self-supervised pretext tasks to learn the underlying pattern of lesion anatomy in the Swin-transformer encoder; 2) fine-tune the Swin-transformer encoder to perform 2D lesion segmentation with 2D RECIST slices to learn slice-level segmentation information; 3) further fine-tune the Swin-transformer encoder to perform 3D lesion segmentation with labeled 3D volumes. The network's performance is evaluated by the Dice similarity coefficient (DSC) and Hausdorff distance (HD) using an internal 3D lesion dataset with 593 lesions extracted from multiple anatomical locations. The proposed MDU-ST demonstrates significant improvement over the competing models. The proposed method can be used to conduct automated 3D lesion segmentation to assist radiomics and tumor growth modeling studies. This paper has been accepted by the IEEE International Symposium on Biomedical Imaging (ISBI) 2023.


title: On the fly Deep Neural Network Optimization Control for Low-Power Computer Vision

abstract: Processing visual data on mobile devices has many applications, e.g., emergency response and tracking. State-of-the-art computer vision techniques rely on large Deep Neural Networks (DNNs) that are usually too power-hungry to be deployed on resource-constrained edge devices. Many techniques improve the efficiency of DNNs by using sparsity or quantization. However, the accuracy and efficiency of these techniques cannot be adapted for diverse edge applications with different hardware constraints and accuracy requirements. This paper presents a novel technique to allow DNNs to adapt their accuracy and energy consumption during run-time, without the need for any re-training. Our technique called AdaptiveActivation introduces a hyper-parameter that controls the output range of the DNNs' activation function to dynamically adjust the sparsity and precision in the DNN. AdaptiveActivation can be applied to any existing pre-trained DNN to improve their deployability in diverse edge environments. We conduct experiments on popular edge devices and show that the accuracy is within 1.5% of the baseline. We also show that our approach requires 10%--38% less memory than the baseline techniques leading to more accuracy-efficiency tradeoff options


title: LoopTune: Optimizing Tensor Computations with Reinforcement Learning

abstract: Advanced compiler technology is crucial for enabling machine learning applications to run on novel hardware, but traditional compilers fail to deliver performance, popular auto-tuners have long search times and expert-optimized libraries introduce unsustainable costs. To address this, we developed LoopTune, a deep reinforcement learning compiler that optimizes tensor computations in deep learning models for the CPU. LoopTune optimizes tensor traversal order while using the ultra-fast lightweight code generator LoopNest to perform hardware-specific optimizations. With a novel graph-based representation and action space, LoopTune speeds up LoopNest by 3.2x, generating an order of magnitude faster code than TVM, 2.8x faster than MetaSchedule, and 1.08x faster than AutoTVM, consistently performing at the level of the hand-tuned library Numpy. Moreover, LoopTune tunes code in order of seconds.


title: One Wide Feedforward is All You Need

abstract: The Transformer architecture has two main non-embedding components: Attention and the Feed Forward Network (FFN). Attention captures interdependencies between words regardless of their position, while the FFN non-linearly transforms each input token independently. In this work we explore the role of the FFN, and find that despite taking up a significant fraction of the model's parameters, it is highly redundant. Concretely, we are able to substantially reduce the number of parameters with only a modest drop in accuracy by removing the FFN on the decoder layers and sharing a single FFN across the encoder. Finally we scale this architecture back to its original size by increasing the hidden dimension of the shared FFN, achieving substantial gains in both accuracy and latency with respect to the original Transformer Big.


title: Extreme first passage times for populations of identical rare events

abstract: A collection of identical and independent rare event first passage times is considered. The problem of finding the fastest out of $N$ such events to occur is called an extreme first passage time. The rare event times are singular and limit to infinity as a positive parameter scaling the noise magnitude is reduced to zero. In contrast, previous work has shown that the mean of the fastest event time goes to zero in the limit of an infinite number of walkers. The combined limit is studied. In particular, the mean time and the most likely path taken by the fastest random walker are investigated. Using techniques from large deviation theory, it is shown that there is a distinguished limit where the mean time for the fastest walker can take any positive value, depending on a single proportionality constant. Furthermore, it is shown that the mean time and most likely path can be approximated using the solution to a variational problem related to the single-walker rare event.


title: Secure and Efficient Federated Learning in LEO Constellations using Decentralized Key Generation and On-Orbit Model Aggregation

abstract: Satellite technologies have advanced drastically in recent years, leading to a heated interest in launching small satellites into low Earth orbit (LEOs) to collect massive data such as satellite imagery. Downloading these data to a ground station (GS) to perform centralized learning to build an AI model is not practical due to the limited and expensive bandwidth. Federated learning (FL) offers a potential solution but will incur a very large convergence delay due to the highly sporadic and irregular connectivity between LEO satellites and GS. In addition, there are significant security and privacy risks where eavesdroppers or curious servers/satellites may infer raw data from satellites' model parameters transmitted over insecure communication channels. To address these issues, this paper proposes FedSecure, a secure FL approach designed for LEO constellations, which consists of two novel components: (1) decentralized key generation that protects satellite data privacy using a functional encryption scheme, and (2) on-orbit model forwarding and aggregation that generates a partial global model per orbit to minimize the idle waiting time for invisible satellites to enter the visible zone of the GS. Our analysis and results show that FedSecure preserves the privacy of each satellite's data against eavesdroppers, a curious server, or curious satellites. It is lightweight with significantly lower communication and computation overheads than other privacy-preserving FL aggregation approaches. It also reduces convergence delay drastically from days to only a few hours, yet achieving high accuracy of up to 85.35% using realistic satellite images.


title: A Post-Training Approach for Mitigating Overfitting in Quantum Convolutional Neural Networks

abstract: Quantum convolutional neural network (QCNN), an early application for quantum computers in the NISQ era, has been consistently proven successful as a machine learning (ML) algorithm for several tasks with significant accuracy. Derived from its classical counterpart, QCNN is prone to overfitting. Overfitting is a typical shortcoming of ML models that are trained too closely to the availed training dataset and perform relatively poorly on unseen datasets for a similar problem. In this work we study post-training approaches for mitigating overfitting in QCNNs. We find that a straightforward adaptation of a classical post-training method, known as neuron dropout, to the quantum setting leads to a significant and undesirable consequence: a substantial decrease in success probability of the QCNN. We argue that this effect exposes the crucial role of entanglement in QCNNs and the vulnerability of QCNNs to entanglement loss. Hence, we propose a parameter adaptation method as an alternative method. Our method is computationally efficient and is found to successfully handle overfitting in the test cases.


title: Geodesics and $F$-geodesics on tangent bundle with $\varphi$-Sasaki metric over para-K\"{a}hler-Norden manifold

abstract: In this paper, we investigate some geodesics and $F$-geodesics problems on tangent bundle and on $\varphi$-unit tangent bundle $T^{\varphi}_{1}M$ equipped with the $\varphi$-Sasaki metric over para-K\"{a}hler-Norden manifold $(M^{2m}, \varphi, g)$.


title: Axion minima in string theory

abstract: We study the landscape of axion theories in compactifications of type IIB string theory on orientifolds of Calabi-Yau threefolds. In a sample of approximately 400,000 geometries we find that in the regime of perturbative control there are only a handful of distinct axion minima per geometry, despite there being infinitely many instanton contributions to the potential with unbounded charges. The ensemble we consider has numbers of axion fields ranging from 1 to 491, but the median number of distinct minima is 1, the mean number is 1.9 and the largest is 54. These small numbers of minima occur because the leading axion charge matrix is quite sparse, while the subleading corrections are increasingly exponentially suppressed as the charges increase. On their own, such potentials are nowhere near rich enough to be of interest anthropically. This is in stark contrast to potentials for which the charge matrix is less sparse or the hierarchies between the instanton contributions are less steep, where one can find $\mathcal{O}(10^{500})$ minima for $\mathcal{O}(500)$ axions. To generate a sufficiently large landscape from string compactifications our results indicate that one would need to rely on varying flux or topology, or to develop tools that allow one to go beyond the regime we can control with current techniques.


title: High-resolution [OI] line spectral mapping of TW Hya consistent with X-ray driven photoevaporation

abstract: Theoretical models indicate that photoevaporative and magnetothermal winds play a crucial role in the evolution and dispersal of protoplanetary disks and affect the formation of planetary systems. However, it is still unclear what wind-driving mechanism is dominant or if both are at work, perhaps at different stages of disk evolution. Recent spatially resolved observations by Fang et al. (2023) of the [OI] 6300 Angstrom spectral line, a common disk wind tracer, in TW Hya revealed that about 80% of the emission is confined to the inner few au of the disk. In this work, we show that state-of-the-art X-ray driven photoevaporation models can reproduce the compact emission and the line profile of the [OI] 6300 Angstrom line. Furthermore, we show that the models also simultaneously reproduce the observed line luminosities and detailed spectral profiles of both the [OI] 6300 Angstrom and the [NeII] 12.8 micron lines. While MHD wind models can also reproduce the compact radial emission of the [OI] 6300 Angstrom line, they fail to match the observed spectral profile of the [OI] 6300 Angstrom line and underestimate the luminosity of the [NeII] 12.8 micron line by a factor of three. We conclude that, while we cannot exclude the presence of an MHD wind component, the bulk of the wind structure of TW Hya is predominantly shaped by a photoevaporative flow.


title: The eigenvalue spectrum of a large real antisymmetric random matrix with non-zero mean

abstract: We study the eigenvalue spectrum of a large real antisymmetric random matrix $J_{ij}$. Using a fermionic approach and replica trick, we obtain a semicircular spectrum of eigenvalues when the mean value of each matrix element is zero, and in the case of a non-zero mean, we show that there is a set of critical finite mean values above which eigenvalues arise that are split off from the semicircular continuum of eigenvalues. The result converged with numerical simulations.


title: Mitigation of stop-and-go traffic waves with intelligent vehicles at low market penetration rates

abstract: Stop-and-go traffic patterns sometimes manifest on roadways without any discernible congestion triggers. Such a phenomenon has been observed on homogeneous ring roads without lane changes. With the development of vehicle technology and measurement sensors, multiple researchers have focused on studying the influence of automated vehicles on traffic. In particular, there is a focus on the design of string-stable adaptive cruise control (ACC) strategies to dampen stop-and-go waves. However, there is no systematic comparison among different strategies nor a quantitative analysis of the oscillation reduction at low market penetration rates (MPRs). This paper proposes a framework to evaluate the impact of low MPRs across multiple ACC strategies. Then, through Monte Carlo simulations, our findings indicate that multi-vehicle anticipation technology yields nearly equivalent benefits in mitigating stop-and-go patterns compared to full vehicular connectivity, even at a modest MPR of 1\%. In contrast, partial connectivity among vehicles only eliminates stop-and-go waves if the MPR is larger.


title: Starobinsky inflation with a quadratic Weyl tensor

abstract: In Starobinsky inflation with a Weyl squared Lagrangian $-\alpha C^2$, where $\alpha$ is a coupling constant, we study the linear stability of cosmological perturbations on a spatially flat Friedmann-Lema\^{i}tre-Robertson-Walker background. In this theory, there are two dynamical vector modes propagating as ghosts for $\alpha>0$, whose condition is required to avoid tachyonic instabilities of vector perturbations during inflation. The tensor sector has four propagating degrees of freedom, among which two of them correspond to ghost modes. However, the tensor perturbations approach constants after the Hubble radius crossing during inflation, and hence the classical instabilities are absent. In the scalar sector, the Weyl curvature gives rise to a ghost mode coupled to the scalaron arising from the squared Ricci scalar. We show that two gauge-invariant gravitational potentials, which are both dynamical in our theory, are subject to exponential growth after the Hubble radius crossing. There are particular gauge-invariant combinations like the curvature perturbations whose growth is suppressed, but it is not possible to remove the instability of other propagating degrees of freedom present in the perturbed metric. This violent and purely classical instability present in the scalar sector makes the background unviable. Furthermore, the presence of such classical instability makes the quantization of the modes irrelevant, and the homogeneous inflationary background is spoiled by the Weyl curvature term.


title: Distributionally Robust Decentralized Volt-Var Control with Network Reconfiguration

abstract: This paper presents a decentralized volt-var optimization (VVO) and network reconfiguration strategy to address the challenges arising from the growing integration of distributed energy resources, particularly photovoltaic (PV) generation units, in active distribution networks. To reconcile control measures with different time resolutions and empower local control centers to handle intermittency locally, the proposed approach leverages a two-stage distributionally robust optimization; decisions on slow-responding control measures and set points that link neighboring subnetworks are made in advance while considering all plausible distributions of uncertain PV outputs. We present a decomposition algorithm with an acceleration scheme for solving the proposed model. Numerical experiments on the IEEE 123 bus distribution system are given to demonstrate its outstanding out-of-sample performance and computational efficiency, which suggests that the proposed method can effectively localize uncertainty via risk-informed proactive timely decisions.


title: Delegating Data Collection in Decentralized Machine Learning

abstract: Motivated by the emergence of decentralized machine learning (ML) ecosystems, we study the delegation of data collection. Taking the field of contract theory as our starting point, we design optimal and near-optimal contracts that deal with two fundamental information asymmetries that arise in decentralized ML: uncertainty in the assessment of model quality and uncertainty regarding the optimal performance of any model. We show that a principal can cope with such asymmetry via simple linear contracts that achieve 1-1/e fraction of the optimal utility. To address the lack of a priori knowledge regarding the optimal performance, we give a convex program that can adaptively and efficiently compute the optimal contract. We also study linear contracts and derive the optimal utility in the more complex setting of multiple interactions.


title: Efficient Defense Against Model Stealing Attacks on Convolutional Neural Networks

abstract: Model stealing attacks have become a serious concern for deep learning models, where an attacker can steal a trained model by querying its black-box API. This can lead to intellectual property theft and other security and privacy risks. The current state-of-the-art defenses against model stealing attacks suggest adding perturbations to the prediction probabilities. However, they suffer from heavy computations and make impracticable assumptions about the adversary. They often require the training of auxiliary models. This can be time-consuming and resource-intensive which hinders the deployment of these defenses in real-world applications. In this paper, we propose a simple yet effective and efficient defense alternative. We introduce a heuristic approach to perturb the output probabilities. The proposed defense can be easily integrated into models without additional training. We show that our defense is effective in defending against three state-of-the-art stealing attacks. We evaluate our approach on large and quantized (i.e., compressed) Convolutional Neural Networks (CNNs) trained on several vision datasets. Our technique outperforms the state-of-the-art defenses with a $\times37$ faster inference latency without requiring any additional model and with a low impact on the model's performance. We validate that our defense is also effective for quantized CNNs targeting edge devices.


title: Designing a Security System Administration Course for Cybersecurity with a Companion Project

abstract: In the past few years, an incident response-oriented cybersecurity program has been constructed at University of Central Oklahoma. As a core course in the newly-established curricula, Secure System Administration focuses on the essential knowledge and skill set for system administration. To enrich students with hands-on experience, we also develop a companion coursework project, named PowerGrader. In this paper, we present the course structure as well as the companion project design. Additionally, we survey the pertinent criterion and curriculum requirements from the widely recognized accreditation units. By this means, we demonstrate the importance of a secure system administration course within the context of cybersecurity education.


title: Minimum entropy of a log-concave variable for fixed variance

abstract: We show that for log-concave real random variables with fixed variance the Shannon differential entropy is minimized for an exponential random variable. We apply this result to derive upper bounds on capacities of additive noise channels with log-concave noise. We also improve constants in the reverse entropy power inequalities for log-concave random variables.


title: Concentrated solutions to the Schr\"odinger--Bopp--Podolsky system with a positive potential

abstract: Consider the Schr\"odinger--Bopp--Podolsky system \[ \begin{cases} -\epsilon^2\Delta u+(V+K\phi)u=u|u|^{p-1};\newline \Delta^2\phi-\Delta\phi=4\pi K u^2 \end{cases} ~\text{in}~\mathbb{R}^3 \] for sufficiently small $\epsilon>0$, where $V,K\colon\mathbb{R}^3\to [0,\infty[$; $p\in ]1,5[$ are fixed and we want to solve for $u,\phi\colon\mathbb{R}^3\to\mathbb{R}$. Under certain hypotheses, we estimate the multiplicity of solutions in function of a critical manifold of $V$ and we establish the existence of solutions concentrated around critical points of $V$.


title: StereoFlowGAN: Co-training for Stereo and Flow with Unsupervised Domain Adaptation

abstract: We introduce a novel training strategy for stereo matching and optical flow estimation that utilizes image-to-image translation between synthetic and real image domains. Our approach enables the training of models that excel in real image scenarios while relying solely on ground-truth information from synthetic images. To facilitate task-agnostic domain adaptation and the training of task-specific components, we introduce a bidirectional feature warping module that handles both left-right and forward-backward directions. Experimental results show competitive performance over previous domain translation-based methods, which substantiate the efficacy of our proposed framework, effectively leveraging the benefits of unsupervised domain adaptation, stereo matching, and optical flow estimation.


title: Projected sensitivity of the CDEX-50 experiment

abstract: CDEX-50 is a next-generation project of the China Dark Matter Experiment (CDEX) that aims to search for dark matter using a 50-kg germanium detector array. This paper comprises a thorough summary of the CDEX-50 experiment, including an investigation of potential background sources and the development of a background model. Based on the baseline model, the projected sensitivity of weakly interacting massive particle (WIMP) is also presented. The expected background level within the energy region of interest, set to 2--2.5 keVee, is $\sim$0.01 counts keVee$^{-1}$ kg$^{-1}$ day$^{-1}$. At 90\% confidence level, the expected sensitivity to spin-independent WIMP-nucleon couplings is estimated to reach a cross-section of 5.3 $\times$ 10$^{-45}$ cm$^{2}$ for a WIMP mass of 5 GeV/c$^{2}$ with an exposure objective of 150 kg$\cdot$year and an analysis threshold of 160 eVee. This science goal will correspond to the most sensitive results for WIMPs with a mass of 2.2--8 GeV/c$^{2}$.


title: Effectiveness of Walker's Cancellation Theorem

abstract: Walker's Cancellation theorem for abelian groups tells us that if $A$ is finitely generated and $G$ and $H$ are such that $A \oplus G \cong A \oplus H$, then $G \cong H$. Michael Deveau showed that the theorem can be effectivized, but not uniformly. In this paper, we expand on Deveau's initial analysis to show that the complexity of uniformly outputting an index of an isomorphism between $G$ and $H$, given indices for $A$, $G$, $H$, the isomorphism between $A \oplus G$ and $A \oplus H$, and the rank of $A$, is $\mathbf{0'}$.


title: Local scale symmetry in non-riemannian geometry based gravitational theories and the role of the noether current

abstract: In this paper, we delve into the significance of local scale symmetry and the role of the associated noether current, within gravitational theories which are based in non-riemannian background space. Our focus is in Weyl and in Riemann-Cartan geometry based gravitational theories. We show that local scale symmetry is associated with vanishing noether current whenever there are not new propagating gravitational degrees of freedom beyond the two polarizations of the massless graviton. In contrast, in local scale invariant theories where there are more than two propagating gravitational degrees of freedom, local scale symmetry is associated with nonvanishing noether current. The known result that Weyl symmetry has vanishing noether current, is generalized to non-riemannian gravitational theories. An exception are the local scale invariant gravitational theories with vectorial nonmetricity, where the associated noether current is nonvanishing.


title: Equisingularity of families of map germs from the plane to 3-space

abstract: In this work, we consider a finitely determined map germ $f$ from $(\mathbb{C}^2,0)$ to $(\mathbb{C}^3,0)$. We characterize the Whitney equisingularity of an unfolding $F=(f_t,t)$ of $f$ through the constancy of a single invariant in the source. Namely, the Milnor number of the curve $W_t(f)=D(f_t)\cup f_t^{-1}(\gamma)$, where $D(f)$ denotes the double point curve of $f_t$. This gives an answer to a question by Ruas in 1994.


title: A Unified Geometric Model of Repeating and Non-Repeating Fast Radio Bursts

abstract: Fast radio bursts (FRBs) are millisecond-duration extragalactic radio transients. They apparently fall into repeaters and non-repeaters. However, such a classification has lacked a motivation on the physical picture. Here we propose a unified geometric model to distinguish between the repeaters and non-repeaters, in which the quasi-tangential (QT) propagation effect within the magnetospheric polar cap of a neutron star is considered. In this model, the non-repeaters arise from the sources whose emitting region has a smaller impact angle with respect to the magnetic axis, while the repeaters come from the sources whose emitting region has a larger impact angle. The observational discriminant polarization properties between the repeaters and non-repeaters are an important clue to verifying this unified geometric model since the polarization is sensitive to the QT propagation effect. Moreover, our model effectively explains all of the other discriminant properties, including bandwidth, duration, peak luminosity, energy, brightness temperature, time-frequency downward drifting, and repetition rate, providing compelling evidence for the magnetospheric origin of FRBs.


title: A Human-Centric Metaverse Enabled by Brain-Computer Interface: A Survey

abstract: The growing interest in the Metaverse has generated momentum for members of academia and industry to innovate toward realizing the Metaverse world. The Metaverse is a unique, continuous, and shared virtual world where humans embody a digital form within an online platform. Through a digital avatar, Metaverse users should have a perceptual presence within the environment and can interact and control the virtual world around them. Thus, a human-centric design is a crucial element of the Metaverse. The human users are not only the central entity but also the source of multi-sensory data that can be used to enrich the Metaverse ecosystem. In this survey, we study the potential applications of Brain-Computer Interface (BCI) technologies that can enhance the experience of Metaverse users. By directly communicating with the human brain, the most complex organ in the human body, BCI technologies hold the potential for the most intuitive human-machine system operating at the speed of thought. BCI technologies can enable various innovative applications for the Metaverse through this neural pathway, such as user cognitive state monitoring, digital avatar control, virtual interactions, and imagined speech communications. This survey first outlines the fundamental background of the Metaverse and BCI technologies. We then discuss the current challenges of the Metaverse that can potentially be addressed by BCI, such as motion sickness when users experience virtual environments or the negative emotional states of users in immersive virtual applications. After that, we propose and discuss a new research direction called Human Digital Twin, in which digital twins can create an intelligent and interactable avatar from the user's brain signals. We also present the challenges and potential solutions in synchronizing and communicating between virtual and physical entities in the Metaverse.


title: Impact of electrostatic crosstalk on spin qubits in dense CMOS quantum dot arrays

abstract: Quantum processors based on integrated nanoscale silicon spin qubits are a promising platform for highly scalable quantum computation. Current CMOS spin qubit processors consist of dense gate arrays to define the quantum dots, making them susceptible to crosstalk from capacitive coupling between a dot and its neighbouring gates. Small but sizeable spin-orbit interactions can transfer this electrostatic crosstalk to the spin g-factors, creating a dependence of the Larmor frequency on the electric field created by gate electrodes positioned even tens of nanometers apart. By studying the Stark shift from tens of spin qubits measured in nine different CMOS devices, we developed a theoretical frawework that explains how electric fields couple to the spin of the electrons in increasingly complex arrays, including those electric fluctuations that limit qubit dephasing times $T_2^*$. The results will aid in the design of robust strategies to scale CMOS quantum technology.


title: Uncertainty in AI: Evaluating Deep Neural Networks on Out-of-Distribution Images

abstract: As AI models are increasingly deployed in critical applications, ensuring the consistent performance of models when exposed to unusual situations such as out-of-distribution (OOD) or perturbed data, is important. Therefore, this paper investigates the uncertainty of various deep neural networks, including ResNet-50, VGG16, DenseNet121, AlexNet, and GoogleNet, when dealing with such data. Our approach includes three experiments. First, we used the pretrained models to classify OOD images generated via DALL-E to assess their performance. Second, we built an ensemble from the models' predictions using probabilistic averaging for consensus due to its advantages over plurality or majority voting. The ensemble's uncertainty was quantified using average probabilities, variance, and entropy metrics. Our results showed that while ResNet-50 was the most accurate single model for OOD images, the ensemble performed even better, correctly classifying all images. Third, we tested model robustness by adding perturbations (filters, rotations, etc.) to new epistemic images from DALL-E or real-world captures. ResNet-50 was chosen for this being the best performing model. While it classified 4 out of 5 unperturbed images correctly, it misclassified all of them post-perturbation, indicating a significant vulnerability. These misclassifications, which are clear to human observers, highlight AI models' limitations. Using saliency maps, we identified regions of the images that the model considered important for their decisions.


title: Classical stochastic approach to quantum mechanics and quantum thermodynamics

abstract: We derive the equations of quantum mechanics and quantum thermodynamics from the assumption that a quantum system can be described by an underlying classical system of particles. Each component $\phi_j$ of the wave vector is understood as a stochastic complex variable whose real and imaginary parts are proportional to the coordinate and momentum associated to a degree of freedom of the underlying classical system. From the classical stochastic equations of motion, we derive a general equation for the covariance matrix of the wave vector which turns out to be of the Lindblad type. When the noise changes only the phase of $\phi_j$, the Schr\"odinger and the quantum Liouville equation are obtained. The component $\psi_j$ of the wave vector obeying the Schr\"odinger equation is related to stochastic wave vector by $|\psi_j|^2=\langle|\phi_j|^2\rangle$.


title: Local Certification of Majority Dynamics

abstract: In majority voting dynamics, a group of $n$ agents in a social network are asked for their preferred candidate in a future election between two possible choices. At each time step, a new poll is taken, and each agent adjusts their vote according to the majority opinion of their network neighbors. After $T$ time steps, the candidate with the majority of votes is the leading contender in the election. In general, it is very hard to predict who will be the leading candidate after a large number of time-steps. We study, from the perspective of local certification, the problem of predicting the leading candidate after a certain number of time-steps, which we call Election-Prediction. We show that in graphs with sub-exponential growth Election-Prediction admits a proof labeling scheme of size $\mathcal{O}(\log n)$. We also find non-trivial upper bounds for graphs with a bounded degree, in which the size of the certificates are sub-linear in $n$. Furthermore, we explore lower bounds for the unrestricted case, showing that locally checkable proofs for Election-Prediction on arbitrary $n$-node graphs have certificates on $\Omega(n)$ bits. Finally, we show that our upper bounds are tight even for graphs of constant growth.


title: Interactive Design and Optics-Based Visualization of Arbitrary Non-Euclidean Kaleidoscopic Orbifolds

abstract: Orbifolds are a modern mathematical concept that arises in the research of hyperbolic geometry with applications in computer graphics and visualization. In this paper, we make use of rooms with mirrors as the visual metaphor for orbifolds. Given any arbitrary two-dimensional kaleidoscopic orbifold, we provide an algorithm to construct a Euclidean, spherical, or hyperbolic polygon to match the orbifold. This polygon is then used to create a room for which the polygon serves as the floor and the ceiling. With our system that implements M\"obius transformations, the user can interactively edit the scene and see the reflections of the edited objects. To correctly visualize non-Euclidean orbifolds, we adapt the rendering algorithms to account for the geodesics in these spaces, which light rays follow. Our interactive orbifold design system allows the user to create arbitrary two-dimensional kaleidoscopic orbifolds. In addition, our mirror-based orbifold visualization approach has the potential of helping our users gain insight on the orbifold, including its orbifold notation as well as its universal cover, which can also be the spherical space and the hyperbolic space.


title: Dynamical Stability of Threshold Networks over Undirected Signed Graphs

abstract: In this paper, we explore the dynamic behavior of threshold networks on undirected signed graphs. Much attention has been dedicated to understand the convergence and long-term behavior of this model. Yet, an open question persists: How does the underlying graph structure impact network dynamics? Similar studies have been carried out for threshold networks and other types of networks, but these primarily focus on unsigned networks. Here, we address the question on signed threshold networks. We introduce the stability index of a graph, related to the concepts of frustration and balance in signed graphs, to establish a connection between the structure and the dynamics of such networks. We show that graphs which present a negative stability index exhibit stable dynamics, i.e., the dynamics converges to fixed points regardless of its threshold parameters. Conversely, if at least one subgraph has a positive stability index, oscillations in long term behavior may appear. Furthermore, we generalize the analysis to network dynamics under periodic update modes and explore the case of the existence of some subgraph with a positive stability index, for which we find that attractors of super-polynomial period in the size of the network may appear.