title: Kinetic reconstruction of free energies as a function of multiple order parameters

abstract: A vast array of phenomena, ranging from chemical reactions to phase transformations, are analysed in terms of a free energy surface defined with respect to a single or multiple order parameters. Enhanced sampling methods are typically used, especially in the presence of large free energy barriers, to estimate free energies using biasing protocols and sampling of transition paths. Kinetic reconstructions of free energy barriers of intermediate height have been performed, with respect to a single order parameter, employing the steady state properties of unconstrained simulation trajectories when barrier crossing is achievable with reasonable computational effort. Considering such cases, we describe a method to estimate free energy surfaces with respect to multiple order parameters from a steady state ensemble of trajectories. The approach applies to cases where the transition rates between pairs of order parameter values considered is not affected by the presence of an absorbing boundary, whereas the macroscopic fluxes and sampling probabilities are. We demonstrate the applicability of our prescription on different test cases of random walkers executing Brownian motion in order parameter space with an underlying (free) energy landscape and discuss strategies to improve numerical estimates of the fluxes and sampling. We next use this approach to reconstruct the free energy surface for supercooled liquid silicon with respect to the degree of crystallinity and density, from unconstrained molecular dynamics simulations, and obtain results quantitatively consistent with earlier results from umbrella sampling.


title: Kernelized Cumulants: Beyond Kernel Mean Embeddings

abstract: In $\mathbb R^d$, it is well-known that cumulants provide an alternative to moments that can achieve the same goals with numerous benefits such as lower variance estimators. In this paper we extend cumulants to reproducing kernel Hilbert spaces (RKHS) using tools from tensor algebras and show that they are computationally tractable by a kernel trick. These kernelized cumulants provide a new set of all-purpose statistics; the classical maximum mean discrepancy and Hilbert-Schmidt independence criterion arise as the degree one objects in our general construction. We argue both theoretically and empirically (on synthetic, environmental, and traffic data analysis) that going beyond degree one has several advantages and can be achieved with the same computational complexity and minimal overhead in our experiments.


title: Continual Learning for Predictive Maintenance: Overview and Challenges

abstract: Deep learning techniques have become one of the main propellers for solving engineering problems effectively and efficiently. For instance, Predictive Maintenance methods have been used to improve predictions of when maintenance is needed on different machines and operative contexts. However, deep learning methods are not without limitations, as these models are normally trained on a fixed distribution that only reflects the current state of the problem. Due to internal or external factors, the state of the problem can change, and the performance decreases due to the lack of generalization and adaptation. Contrary to this stationary training set, real-world applications change their environments constantly, creating the need to constantly adapt the model to evolving scenarios. To aid in this endeavor, Continual Learning methods propose ways to constantly adapt prediction models and incorporate new knowledge after deployment. Despite the advantages of these techniques, there are still challenges to applying them to real-world problems. In this work, we present a brief introduction to predictive maintenance, non-stationary environments, and continual learning, together with an extensive review of the current state of applying continual learning in real-world applications and specifically in predictive maintenance. We then discuss the current challenges of both predictive maintenance and continual learning, proposing future directions at the intersection of both areas. Finally, we propose a novel way to create benchmarks that favor the application of continuous learning methods in more realistic environments, giving specific examples of predictive maintenance.


title: Towards integrable perturbation of 2d CFT on de Sitter space

abstract: We describe a procedure to deform the dynamics of a two-dimensional conformal net to possibly obtain a Haag-Kastler net on the de Sitter spacetime. The new dynamics is given by adding a primary field smeared on the time-zero circle to the Lorentz generators of the conformal net. As an example, we take an extension of the chiral U(1)-current net by a charged field with conformal dimension d < 1/4. We show that the perturbing operators are defined on a dense domain.


title: Experimental investigation of the thermal emission cross-section of nano-resonators using hierarchical Poisson-disk distributions

abstract: Effective cross-sections of nano-objects are fundamental properties that determine their ability to interact with light. However, measuring them for individual resonators directly and quantitatively remains challenging, particularly because of the very low signals involved. Here, we experimentally measure the thermal emission cross-section of metal-insulator-metal nano-resonators using a stealthy hyperuniform distribution based on a hierarchical Poisson-disk algorithm. In such distributions, there are no long-range interactions between antennas, and we show that the light emitted by the metasurface behaves as the sum of cross-sections of independent nanoantennas, enabling direct retrieval of the single resonator contribution. The emission cross-section at resonance is found to be of the order of $\mathbf{\lambda_0^2/3}$, a value that is nearly three times larger than the theroretical maximal absorption cross-section of a single particle but remains smaller than the maximal extinction cross-section. This measurement technique can be generalized to any single resonator cross-section, and we also apply it here to the extinction cross-section.


title: Gesture Control of Micro-drone: A Lightweight-Net with Domain Randomization and Trajectory Generators

abstract: Micro-drones can be integrated into various industrial applications but are constrained by their computing power and expert pilots, a secondary challenge. This study presents a computationally-efficient deep convolutional neural network that utilizes Gabor filters and spatial separable convolutions with low computational complexities. An attention module is integrated with the model to complement the performance. Further, perception-based action space and trajectory generators are integrated with the model's predictions for intuitive navigation. The computationally-efficient model aids a human operator in controlling a micro-drone via gestures. Nearly 18% of computational resources are conserved using the NVIDIA GPU profiler during training. Using a low-cost DJI Tello drone for experiment verification, the computationally-efficient model shows promising results compared to a state-of-the-art and conventional computer vision-based technique.


title: Maximising Weather Forecasting Accuracy through the Utilisation of Graph Neural Networks and Dynamic GNNs

abstract: Weather forecasting is an essential task to tackle global climate change. Weather forecasting requires the analysis of multivariate data generated by heterogeneous meteorological sensors. These sensors comprise of ground-based sensors, radiosonde, and sensors mounted on satellites, etc., To analyze the data generated by these sensors we use Graph Neural Networks (GNNs) based weather forecasting model. GNNs are graph learning-based models which show strong empirical performance in many machine learning approaches. In this research, we investigate the performance of weather forecasting using GNNs and traditional Machine learning-based models.


title: Comparing entanglement and identity effects in tunnelling

abstract: The probability of simultaneous tunnelling of two particles is modified when the system is in a non-separable state, either entangled or symmetrised. We compare both effects in the rectangular potential barrier by evaluating the transmission rates in superposition states. For large momenta, their simultaneous presence greatly changes the form of the transmission rates. The joint effects are much larger than the superposition ones. Moreover, there are significant differences between bosons and fermions. We present an unified view of the combined effects as a quantum interference phenomenon. The analysis also illustrates a novel aspect of exclusion in entangled systems, the existence of superposition states one of whose terms is forbidden by Pauli's principle.


title: Large Language Models for Biomedical Knowledge Graph Construction: Information extraction from EMR notes

abstract: The automatic construction of knowledge graphs (KGs) is an important research area in medicine, with far-reaching applications spanning drug discovery and clinical trial design. These applications hinge on the accurate identification of interactions among medical and biological entities. In this study, we propose an end-to-end machine learning solution based on large language models (LLMs) that utilize electronic medical record notes to construct KGs. The entities used in the KG construction process are diseases, factors, treatments, as well as manifestations that coexist with the patient while experiencing the disease. Given the critical need for high-quality performance in medical applications, we embark on a comprehensive assessment of 12 LLMs of various architectures, evaluating their performance and safety attributes. To gauge the quantitative efficacy of our approach by assessing both precision and recall, we manually annotate a dataset provided by the Macula and Retina Institute. We also assess the qualitative performance of LLMs, such as the ability to generate structured outputs or the tendency to hallucinate. The results illustrate that in contrast to encoder-only and encoder-decoder, decoder-only LLMs require further investigation. Additionally, we provide guided prompt design to utilize such LLMs. The application of the proposed methodology is demonstrated on age-related macular degeneration.


title: Discrete gradient structure of a second-order variable-step method for nonlinear integro-differential models

abstract: The discrete gradient structure and the positive definiteness of discrete fractional integrals or derivatives are fundamental to the numerical stability in long-time simulation of nonlinear integro-differential models. We build up a discrete gradient structure for a class of second-order variable-step approximations of fractional Riemann-Liouville integral and fractional Caputo derivative. Then certain variational energy dissipation laws at discrete levels of the corresponding variable-step Crank-Nicolson type methods are established for time-fractional Allen-Cahn and time-fractional Klein-Gordon type models. They are shown to be asymptotically compatible with the associated energy laws of the classical Allen-Cahn and Klein-Gordon equations in the associated fractional order limits.Numerical examples together with an adaptive time-stepping procedure are provided to demonstrate the effectiveness of our second-order methods.


title: Profinite lambda-terms and parametricity

abstract: Combining ideas coming from Stone duality and Reynolds parametricity, we formulate in a clean and principled way a notion of profinite lambda-term which, we show, generalizes at every type the traditional notion of profinite word coming from automata theory. We start by defining the Stone space of profinite lambda-terms as a projective limit of finite sets of usual lambda-terms, considered modulo a notion of equivalence based on the finite standard model. One main contribution of the paper is to establish that, somewhat surprisingly, the resulting notion of profinite lambda-term coming from Stone duality lives in perfect harmony with the principles of Reynolds parametricity. In addition, we show that the notion of profinite lambda-term is compositional by constructing a cartesian closed category of profinite lambda-terms, and we establish that the embedding from lambda-terms modulo beta-eta-conversion to profinite lambda-terms is faithful using Statman's finite completeness theorem. Finally, we prove that the traditional Church encoding of finite words into lambda-terms can be extended to profinite words, and leads to a homeomorphism between the space of profinite words and the space of profinite lambda-terms of the corresponding Church type.


title: 6-DoF Robotic Grasping with Transformer

abstract: Robotic grasping aims to detect graspable points and their corresponding gripper configurations in a particular scene, and is fundamental for robot manipulation. Existing research works have demonstrated the potential of using a transformer model for robotic grasping, which can efficiently learn both global and local features. However, such methods are still limited in grasp detection on a 2D plane. In this paper, we extend a transformer model for 6-Degree-of-Freedom (6-DoF) robotic grasping, which makes it more flexible and suitable for tasks that concern safety. The key designs of our method are a serialization module that turns a 3D voxelized space into a sequence of feature tokens that a transformer model can consume and skip-connections that merge multiscale features effectively. In particular, our method takes a Truncated Signed Distance Function (TSDF) as input. After serializing the TSDF, a transformer model is utilized to encode the sequence, which can obtain a set of aggregated hidden feature vectors through multi-head attention. We then decode the hidden features to obtain per-voxel feature vectors through deconvolution and skip-connections. Voxel feature vectors are then used to regress parameters for executing grasping actions. On a recently proposed pile and packed grasping dataset, we showcase that our transformer-based method can surpass existing methods by about 5% in terms of success rates and declutter rates. We further evaluate the running time and generalization ability to demonstrate the superiority of the proposed method.


title: StriderNET: A Graph Reinforcement Learning Approach to Optimize Atomic Structures on Rough Energy Landscapes

abstract: Optimization of atomic structures presents a challenging problem, due to their highly rough and non-convex energy landscape, with wide applications in the fields of drug design, materials discovery, and mechanics. Here, we present a graph reinforcement learning approach, StriderNET, that learns a policy to displace the atoms towards low energy configurations. We evaluate the performance of StriderNET on three complex atomic systems, namely, binary Lennard-Jones particles, calcium silicate hydrates gel, and disordered silicon. We show that StriderNET outperforms all classical optimization algorithms and enables the discovery of a lower energy minimum. In addition, StriderNET exhibits a higher rate of reaching minima with energies, as confirmed by the average over multiple realizations. Finally, we show that StriderNET exhibits inductivity to unseen system sizes that are an order of magnitude different from the training system.


title: Local transformations and functorial maps

abstract: Picture-valued invariants are the main achievement of parity theory by V.O. Manturov. In the paper we give a general description of such invariants which can be assigned to a parity (in general, a trait) on diagram crossings. We distinguish two types of picture-valued invariants: derivations (Turaev bracker, index polynomial etc.) and functorial maps (Kauffman bracket, parity bracket, parity projection etc.). We consider some examples of binary functorial maps. Besides known cases of functorial maps, we present two new examples. The order functorial map is closely connected with (pre)orderings of surface groups and leads to the notion of sibling knots, i.e. knots such that any diagram of one knot can be transformed to a diagram of the other by crossing switching. The other is the lifting map which is inverse to forgetting of under-overcrossings information which turns virtual knots into flat knots. We give some examples of liftable flat knots and flattable virtual knots. An appendix of the paper contains description of some smoothing skein modules. In particular, we show that $\Delta$-equivalence of tangles in a fixed surface is classified by the extended homotopy index polynomial.


title: Magnetic field effect on tunneling through triple barrier in AB bilayer graphene

abstract: We investigate electron tunneling in AB bilayer graphene through a triple electrostatic barrier of heights $U_i (i=2,3,4)$ subjected to a perpendicular magnetic field. By way of the transfer matrix method and using the continuity conditions at the different interfaces, the transmission probability is determined. Additional resonances appear for two-band tunneling at normal incidence, and their number is proportional to the value of $U_4$ in the case of $U_2<U_4$. However, when $U_2>U_4$, anti-Klein tunneling increases with $U_2$. The transmission probability exhibits an interesting oscillatory behavior when $U_3>U_2=U_4$ and $U_3 <U_2=U_4$. For fixed energy $E=0.39\gamma_1$, increasing barrier widths increases the number of oscillations and decreases Klein tunneling. The interlayer bias creates a gap for $U_2<U_3<U_4$ and $U_3>U_2=U_4$. In the four-band tunneling case, the transmission decreases in $T^+_+$, $T^-_+$ and $T^-_-$ channels in comparison with the single barrier case. It does, however, increase for $T^+_-$ when compared to the single barrier case. Transmission is suppressed in the gap region when an interlayer bias is introduced. This is reflected in the total conductance $G_{\text{tot}}$ in the region of zero conductance. Our results are relevant for electron confinement in AB bilayer graphene and for the development of graphene-based transistors.


title: Testing mean and variance by e-processes

abstract: We address the problem of testing conditional mean and conditional variance for non-stationary data. We build e-values and p-values for four types of non-parametric composite hypotheses with specified mean and variance as well as other conditions on the shape of the data-generating distribution. These shape conditions include symmetry, unimodality, and their combination. Using the obtained e-values and p-values, we construct tests via e-processes, also known as testing by betting, as well as some tests based on combining p-values for comparison. Although we mainly focus on one-sided tests, the two-sided test for the mean is also studied. Simulation and empirical studies are conducted under a few settings, and they illustrate features of the methods based on e-processes.


title: Pascal Determinantal Arrays and a Generalization of Rahimpour's Determinantal Identity

abstract: In this paper, we shall first introduce the Pascal determinantal array of order $k$ as a generalization of the standard Pascal array. We also present an algorithm to produce determinantal arrays of any order. Then we investigate geometric properties of these new determinantal arrays. As a by product, we give a proof of the correctness of our proposed algorithm. Then we give a geometric interpretation of the determinant of any $k$ by $k$ subarray of the Pascal array. Finally, we will give a generalization of Rahimpour's determinantal identity, using the above geometric interpretation.


title: Comparable binary relations and the amalgamation property

abstract: The theory of two binary relations has the strong amalgamation property when the first relation is assumed to be coarser than the second relation, and each relation satisfies a chosen set of properties from the following list: transitivity, reflexivity, symmetry, antireflexivity and antisymmetry. The amalgamation property is maintained when we add families of unary operations preserving all the relations. As a consequence, we get the existence of Fra\"\i ss\'e limits for classes of finite structures. The results fail, for general comparability conditions, when three or more binary relations are taken into account, or when we add an operation preserving just one relation.


title: Topological entropy of switched nonlinear and interconnected systems

abstract: A general upper bound for topological entropy of switched nonlinear systems is constructed, using an asymptotic average of upper limits of the matrix measures of Jacobian matrices of strongly persistent individual modes, weighted by their active rates. A general lower bound is constructed as well, using a similar weighted average of lower limits of the traces of these Jacobian matrices. In a case of interconnected structure, the general upper bound is readily applied to derive upper bounds for entropy that depend only on "network-level" information. In a case of block-diagonal structure, less conservative upper and lower bounds for entropy are constructed. In each case, upper bounds for entropy that require less information about the switching signal are also derived. The upper bounds for entropy and their relations are illustrated by numerical examples of a switched Lotka-Volterra ecosystem model.


title: New partition identities for odd w odd

abstract: In this note we conjecture Rogers-Ramanujan type colored partition identities for an array with odd number of rows w such that the first and the last row consist of even positive integers. In a strange way this is different from the partition identities for the array with odd number of rows w such that the first and the last row consist of odd positive integers -- the partition identities conjectured by S. Capparelli, A. Meurman, A. Primc and the author and related to standard representations of the affine Lie algebra of type $C^{(1)}_\ell$ for $w=2\ell+1$. The conjecture is based on numerical evidence.


title: Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Clouds

abstract: Proteins power a vast array of functional processes in living cells. The capability to create new proteins with designed structures and functions would thus enable the engineering of cellular behavior and development of protein-based therapeutics and materials. Structure-based protein design aims to find structures that are designable (can be realized by a protein sequence), novel (have dissimilar geometry from natural proteins), and diverse (span a wide range of geometries). While advances in protein structure prediction have made it possible to predict structures of novel protein sequences, the combinatorially large space of sequences and structures limits the practicality of search-based methods. Generative models provide a compelling alternative, by implicitly learning the low-dimensional structure of complex data distributions. Here, we leverage recent advances in denoising diffusion probabilistic models and equivariant neural networks to develop Genie, a generative model of protein structures that performs discrete-time diffusion using a cloud of oriented reference frames in 3D space. Through in silico evaluations, we demonstrate that Genie generates protein backbones that are more designable, novel, and diverse than existing models. This indicates that Genie is capturing key aspects of the distribution of protein structure space and facilitates protein design with high success rates. Code for generating new proteins and training new versions of Genie is available at https://github.com/aqlaboratory/genie.


title: Design, fabrication and large scale qualification of cosmic muon veto scintillator detectors

abstract: The INO collaboration is designing a cosmic muon veto detector (CMVD) to cover the mini-ICAL detector which is operational at the IICHEP transit campus, Madurai in South India. The aim of the CMVD is to study the feasibility of building an experiment to record rare events at a shallow depth of around 100 m, and use plastic scintillators to veto atmospheric muons from those produced by the rare interactions within the target mass of the detector. The efficiency of such a veto detector should be better than 99.99% and false positive rate of less than $10^{-5}$. The CMVD is being built using extruded plastic scintillator (EPS) strips to detect and tag atmospheric muons. More than 700 EPS strips are required to build the CMVD. Two EPS strips are pasted together to make a di-counter (DC) and wavelength shifting fibres are embedded inside the EPS strips to trap the scintillation light generated by a passing cosmic ray muon and transmit it as secondary photons to the Silicon Photo-Multipliers (SiPMs) mounted at the two ends of the DCs. Since the efficiency requirement of the veto detector is rather high, it is imperative to thoroughly test each and every component used for building the CMVD. A cosmic ray muon telescope has been setup using the DCs to qualify all the DCs that will be fabricated. In this paper we will discuss the details of the design and fabrication of the DCs, and the cosmic muon setup and the electronics used for their testing and the test results.


title: Mitigating Adversarial Effects of False Data Injection Attacks in Power Grid

abstract: Deep Neural Networks have proven to be highly accurate at a variety of tasks in recent years. The benefits of Deep Neural Networks have also been embraced in power grids to detect False Data Injection Attacks (FDIA) while conducting critical tasks like state estimation. However, the vulnerabilities of DNNs along with the distinct infrastructure of cyber-physical-system (CPS) can favor the attackers to bypass the detection mechanism. Moreover, the divergent nature of CPS engenders limitations to the conventional defense mechanisms for False Data Injection Attacks. In this paper, we propose a DNN framework with additional layer which utilizes randomization to mitigate the adversarial effect by padding the inputs. The primary advantage of our method is when deployed to a DNN model it has trivial impact on the models performance even with larger padding sizes. We demonstrate the favorable outcome of the framework through simulation using the IEEE 14-bus, 30-bus, 118-bus and 300-bus systems. Furthermore to justify the framework we select attack techniques that generate subtle adversarial examples that can bypass the detection mechanism effortlessly.


title: Saez-Ballester gravity in Kantowski-Sachs Universe: a new reconstruction paradigm for Barrow Holographic Dark Energy

abstract: We reconstruct Barrow Holographic Dark Energy (BHDE) within the framework of Saez-Ballester Scalar Tensor Theory. As a specific background, we consider a homogeneous and anisotropic Kantowski-Sachs Universe filled up with BHDE and dark matter. By assuming the Hubble radius as an IR cutoff, we investigate both the cases of non-interacting and interacting dark energy scenarios. We analyze the evolutionary behavior of various model parameters, such as skewness parameter, Equation-of-State parameter, deceleration parameter, jerk parameter and squared sound speed. We also draw the trajectories of $\omega_D-\omega'_D$ phase plane and examine statefinder diagnosis. Observational consistency is discussed by inferring the current value of Hubble's parameter through the best fit curve of data points from Differential Age (DA) and Baryon Acoustic Oscillations (BAO) and commenting on cosmological perturbations and growth rate of matter fluctuations in BHDE. We show that our model satisfactorily retraces the history of the Universe, thus providing a potential candidate explanation for dark energy. Comparison with other reconstructions of BHDE is finally analyzed.


title: Autonomous Satellite Docking via Adaptive Optimal Output Regulation: A Reinforcement Learning Approach

abstract: This paper describes an online off-policy data-driven reinforcement learning based-algorithm to regulate and control the relative position of a deputy satellite in an autonomous satellite docking problem. The optimal control policy is learned under the framework of output regulation problem and adaptive dynamic programming (ADP) by considering the continuous-time linearized model of the satellite. The linearized model of relative motion is used to describe the motion between satellites, and the satellite docking problem is formulated as a linear optimal output regulation problem, in which the feedback-forward optimal controller is used to track a class of references and rejecting a class of disturbances while maintaining the overall system's closed-loop stability. The optimal control problem is presented using a data-driven reinforcement learning based method to regulate the relative position and velocity of the deputy to safely dock with the chief. Using the adaptive optimal output regulation framework, the learned optimal feedback-feedforward gains guarantee optimal transient and steady state performances without any prior knowledge of the dynamics of the studied system. {The states/input information of the underlying dynamical system are instead used to compute the approximated optimal feedback-feedforward control gain matrices.} Reference tracking and disturbance rejection are achieved in an optimal sense without using any modelling information of the physics of the satellites. {Simulation results are presented and demonstrate the efficacy of the proposed method.


title: How does HCI Understand Human Autonomy and Agency?

abstract: Human agency and autonomy have always been fundamental concepts in HCI. New developments, including ubiquitous AI and the growing integration of technologies into our lives, make these issues ever pressing, as technologies increase their ability to influence our behaviours and values. However, in HCI understandings of autonomy and agency remain ambiguous. Both concepts are used to describe a wide range of phenomena pertaining to sense-of-control, material independence, and identity. It is unclear to what degree these understandings are compatible, and how they support the development of research programs and practical interventions. We address this by reviewing 30 years of HCI research on autonomy and agency to identify current understandings, open issues, and future directions. From this analysis, we identify ethical issues, and outline key themes to guide future work. We also articulate avenues for advancing clarity and specificity around these concepts, and for coordinating integrative work across different HCI communities.


title: Sustainable Diversity of Phage-Bacteria Systems

abstract: Bacteriophages are central to microbial ecosystems for balancing bacterial populations and promoting evolution by applying strong selection pressure. Here we review some of the known aspects that modulate phage-bacteria interaction in a way that naturally promotes their coexistence. We focus on the modulations that arise from structural, physical, or physiological constraints. We argue they should play roles in many phage-bacteria systems providing sustainable diversity.


title: On constructing informationally complete covariant positive operator-valued measures

abstract: We study positive operator-valued measures generated by orbits of projective unitary representations of locally compact Abelian groups. It is shown that integration over such a measure defines a family of contractions being multiples of unitary operators from the representation. Using this fact it is proved that the measures are informationally complete. The obtained results are illustrated for the measure with density taking values in the set of coherent states.


title: Graph Mixer Networks

abstract: In recent years, the attention mechanism has demonstrated superior performance in various tasks, leading to the emergence of GAT and Graph Transformer models that utilize this mechanism to extract relational information from graph-structured data. However, the high computational cost associated with the Transformer block, as seen in Vision Transformers, has motivated the development of alternative architectures such as MLP-Mixers, which have been shown to improve performance in image tasks while reducing the computational cost. Despite the effectiveness of Transformers in graph-based tasks, their computational efficiency remains a concern. The logic behind MLP-Mixers, which addresses this issue in image tasks, has the potential to be applied to graph-structured data as well. In this paper, we propose the Graph Mixer Network (GMN), also referred to as Graph Nasreddin Nets (GNasNets), a framework that incorporates the principles of MLP-Mixers for graph-structured data. Using a PNA model with multiple aggregators as the foundation, our proposed GMN has demonstrated improved performance compared to Graph Transformers. The source code is available publicly at https://github.com/asarigun/GraphMixerNetworks.


title: Harmonic flow of quaternion-K\"ahler structures

abstract: We formulate the gradient Dirichlet flow of $Sp(2)Sp(1)$-structures on $8$-manifolds, as the first systematic study of a geometric quaternion-K\"ahler (QK) flow. Its critical condition of \emph{harmonicity} is especially relevant in the QK setting, since torsion-free structures are often topologically obstructed. We show that the conformally parallel property implies harmonicity, extending a result of Grigorian in the $G_2$ case. We also draw several comparisons with $Spin(7)$-structures. Analysing the QK harmonic flow, we prove an almost-monotonicity formula, which implies to long-time existence under small initial energy, via $\epsilon$-regularity. We set up a theory of harmonic QK solitons, constructing a non-trivial steady example. We produce explicit long-time solutions: one, converging to a torsion-free limit on the hyperbolic plane; and another, converging to a limit which is harmonic but not torsion-free, on the manifold $SU(3)$. We also study compactness and the formation of singularities.


title: Time-Series Pattern Recognition in Smart Manufacturing Systems: A Literature Review and Ontology

abstract: Since the inception of Industry 4.0 in 2012, emerging technologies have enabled the acquisition of vast amounts of data from diverse sources such as machine tools, robust and affordable sensor systems with advanced information models, and other sources within Smart Manufacturing Systems (SMS). As a result, the amount of data that is available in manufacturing settings has exploded, allowing data-hungry tools such as Artificial Intelligence (AI) and Machine Learning (ML) to be leveraged. Time-series analytics has been successfully applied in a variety of industries, and that success is now being migrated to pattern recognition applications in manufacturing to support higher quality products, zero defect manufacturing, and improved customer satisfaction. However, the diverse landscape of manufacturing presents a challenge for successfully solving problems in industry using time-series pattern recognition. The resulting research gap of understanding and applying the subject matter of time-series pattern recognition in manufacturing is a major limiting factor for adoption in industry. The purpose of this paper is to provide a structured perspective of the current state of time-series pattern recognition in manufacturing with a problem-solving focus. By using an ontology to classify and define concepts, how they are structured, their properties, the relationships between them, and considerations when applying them, this paper aims to provide practical and actionable guidelines for application and recommendations for advancing time-series analytics.


title: Unified Singular Protocol Flow for OAuth (USPFO) Ecosystem

abstract: OAuth 2.0 is a popular authorization framework that allows third-party clients such as websites and mobile apps to request limited access to a user's account on another application. The specification classifies clients into different types based on their ability to keep client credentials confidential. It also describes different grant types for obtaining access to the protected resources, with the authorization code and implicit grants being the most commonly used. Each client type and associated grant type have their unique security and usability considerations. In this paper, we propose a new approach for OAuth ecosystem that combines different client and grant types into a unified singular protocol flow for OAuth (USPFO), which can be used by both confidential and public clients. This approach aims to reduce the vulnerabilities associated with implementing and configuring different client types and grant types. Additionally, it provides built-in protections against known OAuth 2.0 vulnerabilities such as client impersonation, token (or code) thefts and replay attacks through integrity, authenticity, and audience binding. The proposed USPFO is largely compatible with existing Internet Engineering Task Force (IETF) Proposed Standard Request for Comments (RFCs), OAuth 2.0 extensions and active internet drafts.


title: Disproving Sum-Difference Co-Array Property

abstract: The recently published paper by Gupta and Agrawal [1] exploited the sum-difference co-array (SDCA) to enhance the virtual aperture of sparse arrays. We argue that the key SDCA property established in [1] requires a critical necessary and sufficient condition that is valid for a very rare case only.


title: Reconstruction of Gaussian Quantum States from Ideal Position Measurements: Beyond Pauli's Problem, I

abstract: We show that the covariance matrix of a quantum state can be reconstructed from position measurements using the simple notion of polar duality, familiar from convex geometry. In particular, all multidimensional Gaussian states (pure or mixed) can in principle be reconstructed if the quantum system is well localized in configuration space. The main observation which makes this possible is that the John ellipsoid of the Cartesian product of the position localization by its polar dual contains a quantum blob, and can therefore be identified with the covariance ellipsoid of a quantum state.

categories: quant-ph cs.IT math-ph math.IT math.MP physics.optics


title: Multidimensional dynamic factor models

abstract: This paper generalises dynamic factor models for multidimensional dependent data. In doing so, it develops an interpretable technique to study complex information sources ranging from repeated surveys with a varying number of respondents to panels of satellite images. We specialise our results to model microeconomic data on US households jointly with macroeconomic aggregates. This results in a powerful tool able to generate localised predictions, counterfactuals and impulse response functions for individual households, accounting for traditional time-series complexities depicted in the state-space literature. The model is also compatible with the growing focus of policymakers for real-time economic analysis as it is able to process observations online, while handling missing values and asynchronous data releases.


title: BERT-based Authorship Attribution on the Romanian Dataset called ROST

abstract: Being around for decades, the problem of Authorship Attribution is still very much in focus currently. Some of the more recent instruments used are the pre-trained language models, the most prevalent being BERT. Here we used such a model to detect the authorship of texts written in the Romanian language. The dataset used is highly unbalanced, i.e., significant differences in the number of texts per author, the sources from which the texts were collected, the time period in which the authors lived and wrote these texts, the medium intended to be read (i.e., paper or online), and the type of writing (i.e., stories, short stories, fairy tales, novels, literary articles, and sketches). The results are better than expected, sometimes exceeding 87\% macro-accuracy.


title: G-fractional diffusion on bounded domains in $\mathbb{R}^d$

abstract: In this paper we study $g$-fractional diffusion on bounded domains in $\mathbb{R}^d$ with absorbing boundary conditions. We show the explicit representation of the solution and then we study the first passage time distribution, showing the dependence on the particular choice of the function $g$. Then, we specialize the analysis to the interesting case of a rectangular domain. Finally we briefly discuss the connection of this general theory with the physical application to the so-called fractional Dodson diffusion model recently discussed in the literature.


title: First-principles calculation of the frequency-dependent dipole polarizability of argon

abstract: In this work we report state-of-the-art theoretical calculations of the dipole polarizability of the argon atom. Frequency dependence of the polarizability is taken into account by means of the dispersion coefficients (Cauchy coefficients) which is sufficient for experimentally relevant wavelengths below the first resonant frequency. In the proposed theoretical framework, all known physical effects including the relativistic, quantum electrodynamics, finite nuclear mass, and finite nuclear size corrections are accounted for. We obtained $\alpha_0=11.0763(19)$ for the static polarizability and $\alpha_2=27.976(15)$ and $\alpha_4=95.02(11)$ for the second and fourth dispersion coefficients, respectively. The result obtained for the static polarizability agrees (within the estimated uncertainty) with the most recent experimental data [C. Gaiser and B. Fellmuth, Phys. Rev. Lett. 120, 123203 (2018)], but is less accurate. The dispersion coefficients determined in this work appear to be most accurate in the literature, improving by more than an order of magnitude upon previous estimates. By combining the experimentally determined value of the static polarizability with the dispersion coefficients from our calculations, the polarizability of argon can be calculated with accuracy of around $10\,$ppm for wavelengths above roughly $450\,$nm. This result is important from the point of view of quantum metrology, especially for a new pressure standard based on thermophysical properties of gaseous argon. Additionally, in this work we calculate the static magnetic susceptibility of argon which relates the refractive index of dilute argon gas with its pressure. While our results for this quantity are less accurate than in the case of the polarizability, they can provide, via Lorenz-Lorentz formula, the best available theoretical estimate of the refractive index of argon.


title: AudioLDM: Text-to-Audio Generation with Latent Diffusion Models

abstract: Text-to-audio (TTA) system has recently gained attention for its ability to synthesize general audio based on text descriptions. However, previous studies in TTA have limited generation quality with high computational costs. In this study, we propose AudioLDM, a TTA system that is built on a latent space to learn the continuous audio representations from contrastive language-audio pretraining (CLAP) latents. The pretrained CLAP models enable us to train LDMs with audio embedding while providing text embedding as a condition during sampling. By learning the latent representations of audio signals and their compositions without modeling the cross-modal relationship, AudioLDM is advantageous in both generation quality and computational efficiency. Trained on AudioCaps with a single GPU, AudioLDM achieves state-of-the-art TTA performance measured by both objective and subjective metrics (e.g., frechet distance). Moreover, AudioLDM is the first TTA system that enables various text-guided audio manipulations (e.g., style transfer) in a zero-shot fashion. Our implementation and demos are available at https://audioldm.github.io.


title: Diverse legal case search

abstract: In last decades, legal case search has received more and more attention. Legal practitioners need to work or enhance their efficiency by means of class case search. In the process of searching, legal practitioners often need the search results under several different causes of cases as reference. However, existing work tends to focus on the relevance of the judgments themselves, without considering the connection between the causes of action. Several well-established diversity search techniques already exist in open-field search efforts. However, these techniques do not take into account the specificity of legal search scenarios, e.g., the subtopic may not be independent of each other, but somehow connected. Therefore, we construct a diversity legal retrieval model. This model takes into account both diversity and relevance, and is well adapted to this scenario. At the same time, considering the lack of dataset with diversity labels, we constructed a diversity legal retrieval dataset and obtained labels by manual labeling. experiments confirmed that our model is effective.


title: Implementing a Hybrid Quantum-Classical Neural Network by Utilizing a Variational Quantum Circuit for Detection of Dementia

abstract: Magnetic resonance imaging (MRI) is a common technique to scan brains for strokes, tumors, and other abnormalities that cause forms of dementia. However, correctly diagnosing forms of dementia from MRIs is difficult, as nearly 1 in 3 patients with Alzheimer's were misdiagnosed in 2019, an issue neural networks can rectify. Quantum computing applications This proposed novel neural network architecture uses a fully-connected (FC) layer, which reduces the number of features to obtain an expectation value by implementing a variational quantum circuit (VQC). The VQC created in this study utilizes a layer of Hadamard gates, Rotation-Y gates that are parameterized by tanh(intensity) * (pi/2) of a pixel, controlled-not (CNOT) gates, and measurement operators to obtain the expected values. This study found that the proposed hybrid quantum-classical convolutional neural network (QCCNN) provided 97.5% and 95.1% testing and validation accuracies, respectively, which was considerably higher than the classical neural network (CNN) testing and validation accuracies of 91.5% and 89.2%. Additionally, using a testing set of 100 normal and 100 dementia MRI images, the QCCNN detected normal and demented images correctly 95% and 98% of the time, compared to the CNN accuracies of 89% and 91%. With hospitals like Massachusetts General Hospital beginning to adopt machine learning applications for biomedical image detection, this proposed architecture would approve accuracies and potentially save more lives. Furthermore, the proposed architecture is generally flexible, and can be used for transfer-learning tasks, saving time and resources.


title: Commensurability and bi-interpretability of groups

abstract: Commensurable groups are bi-interpretable, under suitable definability conditions.


title: Distilling Internet-Scale Vision-Language Models into Embodied Agents

abstract: Instruction-following agents must ground language into their observation and action spaces. Learning to ground language is challenging, typically requiring domain-specific engineering or large quantities of human interaction data. To address this challenge, we propose using pretrained vision-language models (VLMs) to supervise embodied agents. We combine ideas from model distillation and hindsight experience replay (HER), using a VLM to retroactively generate language describing the agent's behavior. Simple prompting allows us to control the supervision signal, teaching an agent to interact with novel objects based on their names (e.g., planes) or their features (e.g., colors) in a 3D rendered environment. Fewshot prompting lets us teach abstract category membership, including pre-existing categories (food vs toys) and ad-hoc ones (arbitrary preferences over objects). Our work outlines a new and effective way to use internet-scale VLMs, repurposing the generic language grounding acquired by such models to teach task-relevant groundings to embodied agents.


title: Physics-agnostic and Physics-infused machine learning for thin films flows: modeling, and predictions from small data

abstract: Numerical simulations of multiphase flows are crucial in numerous engineering applications, but are often limited by the computationally demanding solution of the Navier-Stokes (NS) equations. Here, we present a data-driven workflow where a handful of detailed NS simulation data are leveraged into a reduced-order model for a prototypical vertically falling liquid film. We develop a physics-agnostic model for the film thickness, achieving a far better agreement with the NS solutions than the asymptotic Kuramoto-Sivashinsky (KS) equation. We also develop two variants of physics-infused models providing a form of calibration of a low-fidelity model (i.e. the KS) against a few high-fidelity NS data. Finally, predictive models for missing data are developed, for either the amplitude, or the full-field velocity and even the flow parameter from partial information. This is achieved with the so-called "Gappy Diffusion Maps", which we compare favorably to its linear counterpart, Gappy POD.


title: Constraining Barrow entropy-based Cosmology with power-law inflation

abstract: We study the inflationary era of the Universe in a modified cosmological scenario based on the gravity-thermodynamics conjecture with Barrow entropy instead of the usual Bekenstein-Hawking one. The former arises from the effort to account for quantum gravitational effects on the horizon surface of black holes and, in a broader sense, of the Universe. First, we extract modified Friedmann equations from the first law of thermodynamics applied to the apparent horizon of a Friedmann- Robertson-Walker Universe in (n + 1)-dimensions. Assuming a power-law behavior for the scalar inflaton field, we then investigate how the inflationary dynamics is affected in Barrow cosmological setup. We find that the inflationary era may phenomenologically consist of the slow-roll phase, while Barrow entropy is incompatible with kinetic inflation. By demanding observationally consistency of the scalar spectral index and tensor-to-scalar ratio with recent Planck data, we finally constrain Barrow exponent to $\Delta\lesssim10^{-4}$.


title: EMP-EVAL: A Framework for Measuring Empathy in Open Domain Dialogues

abstract: Measuring empathy in conversation can be challenging, as empathy is a complex and multifaceted psychological construct that involves both cognitive and emotional components. Human evaluations can be subjective, leading to inconsistent results. Therefore, there is a need for an automatic method for measuring empathy that reduces the need for human evaluations. In this paper, we proposed a novel approach EMP-EVAL, a simple yet effective automatic empathy evaluation method. The proposed technique takes the influence of Emotion, Cognitive and Emotional empathy. To the best knowledge, our work is the first to systematically measure empathy without the human-annotated provided scores. Experimental results demonstrate that our metrics can correlate with human preference, achieving comparable results with human judgments.


title: Fast-BEV: A Fast and Strong Bird's-Eye View Perception Baseline

abstract: Recently, perception task based on Bird's-Eye View (BEV) representation has drawn more and more attention, and BEV representation is promising as the foundation for next-generation Autonomous Vehicle (AV) perception. However, most existing BEV solutions either require considerable resources to execute on-vehicle inference or suffer from modest performance. This paper proposes a simple yet effective framework, termed Fast-BEV , which is capable of performing faster BEV perception on the on-vehicle chips. Towards this goal, we first empirically find that the BEV representation can be sufficiently powerful without expensive transformer based transformation nor depth representation. Our Fast-BEV consists of five parts, We novelly propose (1) a lightweight deployment-friendly view transformation which fast transfers 2D image feature to 3D voxel space, (2) an multi-scale image encoder which leverages multi-scale information for better performance, (3) an efficient BEV encoder which is particularly designed to speed up on-vehicle inference. We further introduce (4) a strong data augmentation strategy for both image and BEV space to avoid over-fitting, (5) a multi-frame feature fusion mechanism to leverage the temporal information. Through experiments, on 2080Ti platform, our R50 model can run 52.6 FPS with 47.3% NDS on the nuScenes validation set, exceeding the 41.3 FPS and 47.5% NDS of the BEVDepth-R50 model and 30.2 FPS and 45.7% NDS of the BEVDet4D-R50 model. Our largest model (R101@900x1600) establishes a competitive 53.5% NDS on the nuScenes validation set. We further develop a benchmark with considerable accuracy and efficiency on current popular on-vehicle chips. The code is released at: https://github.com/Sense-GVT/Fast-BEV.


title: Visual Belief Elicitation Reduces the Incidence of False Discovery

abstract: Visualization supports exploratory data analysis (EDA), but EDA frequently presents spurious charts, which can mislead people into drawing unwarranted conclusions. We investigate interventions to prevent false discovery from visualized data. We evaluate whether eliciting analyst beliefs helps guard against the over-interpretation of noisy visualizations. In two experiments, we exposed participants to both spurious and 'true' scatterplots, and assessed their ability to infer data-generating models that underlie those samples. Participants who underwent prior belief elicitation made 21% more correct inferences along with 12% fewer false discoveries. This benefit was observed across a variety of sample characteristics, suggesting broad utility to the intervention. However, additional interventions to highlight counterevidence and sample uncertainty did not provide significant advantage. Our findings suggest that lightweight, belief-driven interactions can yield a reliable, if moderate, reduction in false discovery. This work also suggests future directions to improve visual inference and reduce bias. The data and materials for this paper are available at https://osf.io/52u6v/


title: State polynomials: positivity, optimization and nonlinear Bell inequalities

abstract: This paper introduces state polynomials, i.e., polynomials in noncommuting variables and formal states of their products. A state analog of Artin's solution to Hilbert's 17th problem is proved showing that state polynomials, positive over all matrices and matricial states, are sums of squares with denominators. Somewhat surprisingly, it is also established that a Krivine-Stengle Positivstellensatz fails to hold in the state polynomial setting. Further, archimedean Positivstellens\"atze in the spirit of Putinar and Helton-McCullough are presented leading to a hierarchy of semidefinite relaxations converging monotonically to the optimum of a state polynomial subject to state constraints. This hierarchy can be seen as a state analog of the Lasserre hierarchy for optimization of polynomials, and the Navascu\'es-Pironio-Ac\'in scheme for optimization of noncommutative polynomials. The motivation behind this theory arises from the study of correlations in quantum networks. Determining the maximal quantum violation of a polynomial Bell inequality for an arbitrary network is reformulated as a state polynomial optimization problem. Several examples of quadratic Bell inequalities in the bipartite and the bilocal tripartite scenario are analyzed. To reduce the size of the constructed SDPs, sparsity, sign symmetry and conditional expectation of the observables' group structure are exploited. To obtain the above-mentioned results, techniques from noncommutative algebra, real algebraic geometry, operator theory, and convex optimization are employed.


title: Softening of Majorana edge states by long-range couplings

abstract: The inclusion of long-range couplings in the Kitaev chain is shown to modify the universal scaling of topological states close to the critical point. By means of the scattering approach, we prove that the Majorana states \textit{soften}, becoming increasingly delocalised at a universal rate which is only determined by the interaction range. This edge mechanism can be related to a change in the value of the bulk topological index at criticality, upon careful redefinition of the latter. The critical point turns out to be topologically akin to the trivial phase rather than interpolating between the two phases. Our treatment moreover showcases how various topological aspects of quantum models can be investigated analytically.


title: LiDAR-CS Dataset: LiDAR Point Cloud Dataset with Cross-Sensors for 3D Object Detection

abstract: Over the past few years, there has been remarkable progress in research on 3D point clouds and their use in autonomous driving scenarios has become widespread. However, deep learning methods heavily rely on annotated data and often face domain generalization issues. Unlike 2D images whose domains usually pertain to the texture information present in them, the features derived from a 3D point cloud are affected by the distribution of the points. The lack of a 3D domain adaptation benchmark leads to the common practice of training a model on one benchmark (e.g. Waymo) and then assessing it on another dataset (e.g. KITTI). This setting results in two distinct domain gaps: scenarios and sensors, making it difficult to analyze and evaluate the method accurately. To tackle this problem, this paper presents LiDAR Dataset with Cross Sensors (LiDAR-CS Dataset), which contains large-scale annotated LiDAR point cloud under six groups of different sensors but with the same corresponding scenarios, captured from hybrid realistic LiDAR simulator. To our knowledge, LiDAR-CS Dataset is the first dataset that addresses the sensor-related gaps in the domain of 3D object detection in real traffic. Furthermore, we evaluate and analyze the performance using various baseline detectors and demonstrated its potential applications. Project page: https://opendriving.github.io/lidar-cs.


title: Corbino magnetoresistance in neutral graphene

abstract: We explore the magnetohydrodynamics of Dirac fermions in neutral graphene in the Corbino geometry. Based on the fully consistent hydrodynamic description derived from a microscopic framework and taking into account all peculiarities of graphene-specific hydrodynamics, we report the results of a comprehensive study of the interplay of viscosity, disorder-induced scattering, recombination, energy relaxation, and interface-induced dissipation. In the clean limit, magnetoresistance of a Corbino sample is determined by viscosity. Hence the Corbino geometry could be used to measure the viscosity coefficient in neutral graphene.

categories: cond-mat.mes-hall cond-mat.other cond-mat.stat-mech cond-mat.str-el physics.flu-dyn


title: Revealing a deep connection between factorization and saturation: New insight into modeling high-energy proton-proton and nucleus-nucleus scattering in the EPOS4 framework

abstract: It is known that multiple partonic scatterings in high-energy proton-proton ($pp$) collisions must happen in parallel. However, a rigorous parallel scattering formalism, taking energy sharing properly into account, fails to reproduce factorization, which on the other hand is the basis of almost all $pp$ event generators. In addition, binary scaling in nuclear scatterings is badly violated. These problems are usually ``solved'' by simply not considering strictly parallel scatterings, which is not a solution. I will report on new ideas (leading to EPOS4), which allow recovering perfectly factorization, and also binary scaling in $AA$ collisions, in a rigorous unbiased parallel scattering formalism. In this new approach, dynamical saturation scales play a crucial role, and this seems to be the missing piece needed to reconcile parallel scattering with factorization. From a practical point of view, one can compute within the EPOS4 framework parton distribution functions (EPOS PDFs) and use them to compute inclusive $pp$ cross sections. So, for the first time, one may compute inclusive jet production (for heavy or light flavors) at very high transverse momentum ($p_{t}$) and at the same time in the same formalism study flow effects at low $p_{t}$ in high-multiplicity $pp$ events, making EPOS4 a full-scale ``general purpose event generator''. I discuss applications, essentially multiplicity dependencies (of particle ratios, mean $p_{t}$, charm production) which are very strongly affected by the saturation issues discussed in this paper.


title: Surfatron acceleration of the high energy protons in the relativistic jets

abstract: This paper describes the acceleration of high energies protons captured by electrostatic waves in the frame of jet arising in the area of instability of relativistic jet, where spiral structures are excited. The wave has a spatially heterogeneous structure of $\exp(i k_\parallel z +i m_\phi \phi)$. Protons can be captured in potential wells created by spiral waves, and thereby experience acceleration with a mechanism known as surfatron acceleration. Expressions of the maximum energy ($ E_p \simeq 10^{19} eV $) and the energy spectrum from jet parameters are obtained.


title: 3D Object Detection in LiDAR Point Clouds using Graph Neural Networks

abstract: LiDAR (Light Detection and Ranging) is an advanced active remote sensing technique working on the principle of time of travel (ToT) for capturing highly accurate 3D information of the surroundings. LiDAR has gained wide attention in research and development with the LiDAR industry expected to reach 2.8 billion $ by 2025. Although the LiDAR dataset is of rich density and high spatial resolution, it is challenging to process LiDAR data due to its inherent 3D geometry and massive volume. But such a high-resolution dataset possesses immense potential in many applications and has great potential in 3D object detection and recognition. In this research we propose Graph Neural Network (GNN) based framework to learn and identify the objects in the 3D LiDAR point clouds. GNNs are class of deep learning which learns the patterns and objects based on the principle of graph learning which have shown success in various 3D computer vision tasks.


title: Producing Usable Taxonomies Cheaply and Rapidly at Pinterest Using Discovered Dynamic $\mu$-Topics

abstract: Creating a taxonomy of interests is expensive and human-effort intensive: not only do we need to identify nodes and interconnect them, in order to use the taxonomy, we must also connect the nodes to relevant entities such as users, pins, and queries. Connecting to entities is challenging because of ambiguities inherent to language but also because individual interests are dynamic and evolve. Here, we offer an alternative approach that begins with bottom-up discovery of $\mu$-topics called pincepts. The discovery process itself connects these $\mu$-topics dynamically with relevant queries, pins, and users at high precision, automatically adapting to shifting interests. Pincepts cover all areas of user interest and automatically adjust to the specificity of user interests and are thus suitable for the creation of various kinds of taxonomies. Human experts associate taxonomy nodes with $\mu$-topics (on average, 3 $\mu$-topics per node), and the $\mu$-topics offer a high-level data layer that allows quick definition, immediate inspection, and easy modification. Even more powerfully, $\mu$-topics allow easy exploration of nearby semantic space, enabling curators to spot and fill gaps. Curators' domain knowledge is heavily leveraged and we thus don't need untrained mechanical Turks, allowing further cost reduction. These $\mu$-topics thus offer a satisfactory "symbolic" stratum over which to define taxonomies. We have successfully applied this technique for very rapidly iterating on and launching the home decor and fashion styles taxonomy for style-based personalization, prominently featured at the top of Pinterest search results, at 94% precision, improving search success rate by 34.8% as well as boosting long clicks and pin saves.


title: Re-orienting the Turbulent flow over an Inclined Cylinder of Finite Aspect ratio

abstract: Turbulent flow around a swept back circular cylinder was investigated experimentally using one or two small sweeping jets emanating tangentially to the surface and orthogonal to the axis of the cylinder creating a yawing moment that overcomes the natural restoring force to the plane of symmetry. It appears from the integral force balance data that large yawing moment coefficients can be generated in this manner, and the results could be used in the orientation and attitude control of a refueling boom thus avoiding the H-shape control surfaces that are currently used on Air Force tankers. The interaction between the jet and the flow in the lee of the cylinder was mapped using surface oil flow visualization and 2D-Particle Image velocimetry technique. The sensitivity of the interaction and its outcome to the change in the azimuthal location of the actuators was investigated.


title: Optimal Service Provisioning in IoT Fog-based Environment for QoS-aware Delay-sensitive Application

abstract: This paper addresses the escalating challenges posed by the ever-increasing data volume, velocity, and the demand for low-latency applications, driven by the proliferation of smart devices and Internet of Things (IoT) applications. To mitigate service delay and enhance Quality of Service (QoS), we introduce a hybrid optimization of Particle Swarm (PSO) and Chemical Reaction (CRO) to improve service delay in FogPlan, an offline framework that prioritizes QoS and enables dynamic fog service deployment. The method optimizes fog service allocation based on incoming traffic to each fog node, formulating it as an Integer Non-Linear Programming (INLP) problem, considering various service attributes and costs. Our proposed algorithm aims to minimize service delay and QoS degradation. The evaluation using real MAWI Working Group traffic data demonstrates a substantial 29.34% reduction in service delay, a 66.02% decrease in service costs, and a noteworthy 50.15% reduction in delay violations compared to the FogPlan framework.


title: Generalized Subspace Subcodes in the Rank Metric

abstract: Rank-metric codes were studied by E. Gabidulin in 1985 after a brief introduction by Delsarte in 1978 as an equivalent of Reed-Solomon codes, but based on linearized polynomials. They have found applications in many areas, including linear network coding and space-time coding. They are also used in cryptography to reduce the size of the keys compared to Hamming metric codes at the same level of security. However, some families of rank-metric codes suffer from structural attacks due to the strong algebraic structure from which they are defined. It therefore becomes interesting to find new code families in order to address these questions in the landscape of rank-metric codes. \par In this paper, we provide a generalization of Subspace Subcodes in Rank metric introduced by Gabidulin and Loidreau. We also characterize this family by giving an algorithm which allows to have its generator and parity-check matrices based on the associated extended codes. We have also studied the specific case of Gabidulin codes whose underlying decoding algorithms are known. Bounds for the cardinalities of these codes, both in the general case and in the case of Gabidulin codes, are also provided.


title: Lepton portal dark matter at muon colliders: Total rates and generic features for phenomenologically viable scenarios

abstract: Lepton portal dark matter (DM) models are a class of models where the DM candidates solely couple to charged leptons through a mediator carrying a lepton number. These models are very interesting since they avoid constraints from direct detection experiments even for coupling of order ${\cal O}(1)$, they have small annihilation cross sections, and can be probed efficiently at lepton colliders. In this work, we consider a minimal lepton portal DM model which consists of extending the SM with two $SU(2)_L$ singlets: a charged scalar singlet and an electrically neutral right-handed fermion. We systematically study the production mechanisms of DM at multi-TeV muon colliders. After considering all the possible theoretical and experimental constraints and studying the phenomenology of lepton flavour violation and DM in the muon-philic scenario, we analyse the production rates of 54 channels (26 channels for prompt DM production and 28 channels for charged scalar production) at multi-TeV muon colliders. Finally, we discuss the possible collider signatures of some channels and the corresponding backgrounds. We find that at least 9 channels for DM production can be very efficient in testing DM with masses up to about $1$ TeV.


title: Composer's Assistant: An Interactive Transformer for Multi-Track MIDI Infilling

abstract: We introduce Composer's Assistant, a system for interactive human-computer composition in the REAPER digital audio workstation. We consider the task of multi-track MIDI infilling when arbitrary track-measures have been deleted from a contiguous slice of measures from a MIDI file, and we train a T5-like model to accomplish this task. Composer's Assistant consists of this model together with scripts that enable interaction with the model in REAPER. We conduct objective and subjective tests of our model. We release our complete system, consisting of source code, pretrained models, and REAPER scripts. Our models were trained only on permissively-licensed MIDI files.


title: Outer Bounds on the CEO Problem with Privacy Constraints

abstract: We investigate the rate-distortion-leakage region of the Chief Executive Officer (CEO) problem with a passive eavesdropper and privacy constraints, considering a general distortion measure. While an inner bound directly follows from the previous work, an outer bound is newly developed in this paper. To derive this bound, we introduce a new lemma tailored for analyzing privacy constraints. As a specific instance, we demonstrate that the tight bound for discrete and Gaussian sources is obtained when the eavesdropper can only observe the messages under logarithmic loss distortion. We further investigate the rate-distortion-leakage region for a scenario where the eavesdropper possesses the messages and side information under the same distortion, and provide an outer bound for this particular case. The derived outer bound differs from the inner bound by only a minor quantity that appears in the constraints associated with the privacy-leakage rates, and it becomes tight when the distortion is large.


title: Diverse, Difficult, and Odd Instances (D2O): A New Test Set for Object Classification

abstract: Test sets are an integral part of evaluating models and gauging progress in object recognition, and more broadly in computer vision and AI. Existing test sets for object recognition, however, suffer from shortcomings such as bias towards the ImageNet characteristics and idiosyncrasies (e.g., ImageNet-V2), being limited to certain types of stimuli (e.g., indoor scenes in ObjectNet), and underestimating the model performance (e.g., ImageNet-A). To mitigate these problems, we introduce a new test set, called D2O, which is sufficiently different from existing test sets. Images are a mix of generated images as well as images crawled from the web. They are diverse, unmodified, and representative of real-world scenarios and cause state-of-the-art models to misclassify them with high confidence. To emphasize generalization, our dataset by design does not come paired with a training set. It contains 8,060 images spread across 36 categories, out of which 29 appear in ImageNet. The best Top-1 accuracy on our dataset is around 60% which is much lower than 91% best Top-1 accuracy on ImageNet. We find that popular vision APIs perform very poorly in detecting objects over D2O categories such as ``faces'', ``cars'', and ``cats''. Our dataset also comes with a ``miscellaneous'' category, over which we test the image tagging models. Overall, our investigations demonstrate that the D2O test set contain a mix of images with varied levels of difficulty and is predictive of the average-case performance of models. It can challenge object recognition models for years to come and can spur more research in this fundamental area.


title: Sequential Estimation of Gaussian Process-based Deep State-Space Models

abstract: We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian processes that are implemented via random feature-based Gaussian processes. In these models, we have two sets of unknowns, highly nonlinear unknowns (the values of the latent processes) and conditionally linear unknowns (the constant parameters of the random feature-based Gaussian processes). We present a method based on particle filtering where the parameters of the random feature-based Gaussian processes are integrated out in obtaining the predictive density of the states and do not need particles. We also propose an ensemble version of the method, with each member of the ensemble having its own set of features. With several experiments, we show that the method can track the latent processes up to a scale and rotation.


title: Basis condition for generalized spline modules

abstract: A generalized spline on an edge labeled graph $(G,\alpha)$ is defined as a vertex labeling, such that the difference of labels on adjacent vertices lies in the ideal generated by the edge label. We study generalized splines over greatest common divisor domains and present a determinantal basis condition for generalized spline modules on arbitrary graphs. The main result of the paper answers a conjecture that appeared in several papers.


title: G-Rank: Unsupervised Continuous Learn-to-Rank for Edge Devices in a P2P Network

abstract: Ranking algorithms in traditional search engines are powered by enormous training data sets that are meticulously engineered and curated by a centralized entity. Decentralized peer-to-peer (p2p) networks such as torrenting applications and Web3 protocols deliberately eschew centralized databases and computational architectures when designing services and features. As such, robust search-and-rank algorithms designed for such domains must be engineered specifically for decentralized networks, and must be lightweight enough to operate on consumer-grade personal devices such as a smartphone or laptop computer. We introduce G-Rank, an unsupervised ranking algorithm designed exclusively for decentralized networks. We demonstrate that accurate, relevant ranking results can be achieved in fully decentralized networks without any centralized data aggregation, feature engineering, or model training. Furthermore, we show that such results are obtainable with minimal data preprocessing and computational overhead, and can still return highly relevant results even when a user's device is disconnected from the network. G-Rank is highly modular in design, is not limited to categorical data, and can be implemented in a variety of domains with minimal modification. The results herein show that unsupervised ranking models designed for decentralized p2p networks are not only viable, but worthy of further research.


title: PhyCV: The First Physics-inspired Computer Vision Library

abstract: PhyCV is the first computer vision library which utilizes algorithms directly derived from the equations of physics governing physical phenomena. The algorithms appearing in the current release emulate, in a metaphoric sense, the propagation of light through a physical medium with natural and engineered diffractive properties followed by coherent detection. Unlike traditional algorithms that are a sequence of hand-crafted empirical rules or deep learning algorithms that are usually data-driven and computationally heavy, physics-inspired algorithms leverage physical laws of nature as blueprints for inventing algorithms. PhyCV features low-dimensionality and high- efficiency, making it ideal for edge computing applications. We demonstrate real-time video processing on NVIDIA Jetson Nano using PhyCV. In addition, these algorithms have the potential to be implemented in real physical devices for fast and efficient computation in the form of analog computing. The open-sourced code is available at https://github.com/JalaliLabUCLA/phycv


title: Credible, Optimal Auctions via Blockchains

abstract: Akbarpour and Li (2020) formalized credibility as an auction desideratum where the auctioneer cannot benefit by implementing undetectable deviations from the promised auction and showed that, in the plain model, the ascending price auction with reserves is the only credible, strategyproof, revenue-optimal auction. Ferreira and Weinberg (2020) proposed the Deferred Revelation Auction (DRA) as a communication efficient auction that avoids the uniqueness results from Akbarpour and Li (2020) assuming the existence of cryptographic commitments and as long as bidder valuations are MHR. They also showed DRA is not credible in settings where bidder valuations are $\alpha$-strongly regular unless $\alpha > 1$. In this paper, we ask if blockchains allow us to design a larger class of credible auctions. We answer this question positively, by showing that DRA is credible even for $\alpha$-strongly regular distributions for all $\alpha > 0$ if implemented over a secure and censorship-resistant blockchain. We argue ledgers provide two properties that limit deviations from a self-interested auctioneer. First, the existence of smart contracts allows one to extend the concept of credibility to settings where the auctioneer does not have a reputation -- one of the main limitations for the definition of credibility from Akbarpour and Li (2020). Second, blockchains allow us to implement mechanisms over a public broadcast channel, removing the adaptive undetectable deviations driving the negative results of Ferreira and Weinberg (2020).


title: MSG: A software package for interpolating stellar spectra in pre-calculated grids

abstract: While the spectrum of the light emitted by a star can be calculated by simulating the flow of radiation through each layer of the star's atmosphere, this process is computationally expensive. Therefore, it is often far more efficient to pre-calculate spectra over a grid of photospheric parameters, and then interpolate within this grid. MSG (short for Multidimensional Spectral Grids) is a software package that implements this interpolation capability.


title: Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is Offensive

abstract: Offensive speech detection is a key component of content moderation. However, what is offensive can be highly subjective. This paper investigates how machine and human moderators disagree on what is offensive when it comes to real-world social web political discourse. We show that (1) there is extensive disagreement among the moderators (humans and machines); and (2) human and large-language-model classifiers are unable to predict how other human raters will respond, based on their political leanings. For (1), we conduct a noise audit at an unprecedented scale that combines both machine and human responses. For (2), we introduce a first-of-its-kind dataset of vicarious offense. Our noise audit reveals that moderation outcomes vary wildly across different machine moderators. Our experiments with human moderators suggest that political leanings combined with sensitive issues affect both first-person and vicarious offense. The dataset is available through https://github.com/Homan-Lab/voiced.


title: Concurrent Shuffle Differential Privacy Under Continual Observation

abstract: We introduce the concurrent shuffle model of differential privacy. In this model we have multiple concurrent shufflers permuting messages from different, possibly overlapping, batches of users. Similarly to the standard (single) shuffle model, the privacy requirement is that the concatenation of all shuffled messages should be differentially private. We study the private continual summation problem (a.k.a. the counter problem) and show that the concurrent shuffle model allows for significantly improved error compared to a standard (single) shuffle model. Specifically, we give a summation algorithm with error $\tilde{O}(n^{1/(2k+1)})$ with $k$ concurrent shufflers on a sequence of length $n$. Furthermore, we prove that this bound is tight for any $k$, even if the algorithm can choose the sizes of the batches adaptively. For $k=\log n$ shufflers, the resulting error is polylogarithmic, much better than $\tilde{\Theta}(n^{1/3})$ which we show is the smallest possible with a single shuffler. We use our online summation algorithm to get algorithms with improved regret bounds for the contextual linear bandit problem. In particular we get optimal $\tilde{O}(\sqrt{n})$ regret with $k= \tilde{\Omega}(\log n)$ concurrent shufflers.


title: Random points are good for universal discretization

abstract: There has been significant progress in the study of sampling discretization of integral norms for both a designated finite-dimensional function space and a finite collection of such function spaces (universal discretization). Sampling discretization results turn out to be very useful in various applications, particularly in sampling recovery. Recent sampling discretization results typically provide existence of good sampling points for discretization. In this paper, we show that independent and identically distributed random points provide good universal discretization with high probability. Furthermore, we demonstrate that a simple greedy algorithm based on those points that are good for universal discretization provides excellent sparse recovery results in the square norm.


title: Non-Asymptotic State-Space Identification of Closed-Loop Stochastic Linear Systems using Instrumental Variables

abstract: The paper suggests a generalization of the Sign-Perturbed Sums (SPS) finite sample system identification method for the identification of closed-loop observable stochastic linear systems in state-space form. The solution builds on the theory of matrix-variate regression and instrumental variable methods to construct distribution-free confidence regions for the state-space matrices. Both direct and indirect identification are studied, and the exactness as well as the strong consistency of the construction are proved. Furthermore, a new, computationally efficient ellipsoidal outer-approximation algorithm for the confidence regions is proposed. The new construction results in a semidefinite optimization problem which has an order-of-magnitude smaller number of constraints, as if one applied the ellipsoidal outer-approximation after vectorization. The effectiveness of the approach is also demonstrated empirically via a series of numerical experiments.


title: On Approximating the Dynamic Response of Synchronous Generators via Operator Learning: A Step Towards Building Deep Operator-based Power Grid Simulators

abstract: This paper designs an Operator Learning framework to approximate the dynamic response of synchronous generators. One can use such a framework to (i) design a neural-based generator model that can interact with a numerical simulator of the rest of the power grid or (ii) shadow the generator's transient response. To this end, we design a data-driven Deep Operator Network~(DeepONet) that approximates the generators' infinite-dimensional solution operator. Then, we develop a DeepONet-based numerical scheme to simulate a given generator's dynamic response over a short/medium-term horizon. The proposed numerical scheme recursively employs the trained DeepONet to simulate the response for a given multi-dimensional input, which describes the interaction between the generator and the rest of the system. Furthermore, we develop a residual DeepONet numerical scheme that incorporates information from mathematical models of synchronous generators. We accompany this residual DeepONet scheme with an estimate for the prediction's cumulative error. We also design a data aggregation (DAgger) strategy that allows (i) employing supervised learning to train the proposed DeepONets and (ii) fine-tuning the DeepONet using aggregated training data that the DeepONet is likely to encounter during interactive simulations with other grid components. Finally, as a proof of concept, we demonstrate that the proposed DeepONet frameworks can effectively approximate the transient model of a synchronous generator.


title: Domain-wall orientation in antiferromagnets controlled by magnetoelastic effects

abstract: In this paper, we develop the mathematical framework to describe the physical phenomenon behind the equilibrium configuration joining two antiferromagnetic domains. We firstly define the total energy of the system and deduce the governing equations by minimizing it with respect to the field variables. Then, we solve the resulting system of nonlinear PDEs together with proper initial and boundary conditions by varying the orientation of the 90$^{\circ}$ domain wall (DW) configuration along the sample. Finally, the angular dependence of elastic and magnetoelastic energies as well as of incompatibility-driven volume effects is computed.


title: Implicit Regularization for Group Sparsity

abstract: We study the implicit regularization of gradient descent towards structured sparsity via a novel neural reparameterization, which we call a diagonally grouped linear neural network. We show the following intriguing property of our reparameterization: gradient descent over the squared regression loss, without any explicit regularization, biases towards solutions with a group sparsity structure. In contrast to many existing works in understanding implicit regularization, we prove that our training trajectory cannot be simulated by mirror descent. We analyze the gradient dynamics of the corresponding regression problem in the general noise setting and obtain minimax-optimal error rates. Compared to existing bounds for implicit sparse regularization using diagonal linear networks, our analysis with the new reparameterization shows improved sample complexity. In the degenerate case of size-one groups, our approach gives rise to a new algorithm for sparse linear regression. Finally, we demonstrate the efficacy of our approach with several numerical experiments.


title: Supervised and Contrastive Self-Supervised In-Domain Representation Learning for Dense Prediction Problems in Remote Sensing

abstract: In recent years Convolutional neural networks (CNN) have made significant progress in computer vision. These advancements have been applied to other areas, such as remote sensing and have shown satisfactory results. However, the lack of large labeled datasets and the inherent complexity of remote sensing problems have made it difficult to train deep CNNs for dense prediction problems. To solve this issue, ImageNet pretrained weights have been used as a starting point in various dense predictions tasks. Although this type of transfer learning has led to improvements, the domain difference between natural and remote sensing images has also limited the performance of deep CNNs. On the other hand, self-supervised learning methods for learning visual representations from large unlabeled images have grown substantially over the past two years. Accordingly, in this paper we have explored the effectiveness of in-domain representations in both supervised and self-supervised forms to solve the domain difference between remote sensing and the ImageNet dataset. The obtained weights from remote sensing images are utilized as initial weights for solving semantic segmentation and object detection tasks and state-of-the-art results are obtained. For self-supervised pre-training, we have utilized the SimSiam algorithm as it is simple and does not need huge computational resources. One of the most influential factors in acquiring general visual representations from remote sensing images is the pre-training dataset. To examine the effect of the pre-training dataset, equal-sized remote sensing datasets are used for pre-training. Our results have demonstrated that using datasets with a high spatial resolution for self-supervised representation learning leads to high performance in downstream tasks.


title: A Note on the Estimation of Job Amenities and Labor Productivity

abstract: This paper introduces a maximum likelihood estimator of the value of job amenities and labor productivity in a single matching market based on the observation of equilibrium matches and wages. The estimation procedure simultaneously fits both the matching patterns and the wage curve. While our estimator is suited for a wide range of assignment problems, we provide an application to the estimation of the Value of a Statistical Life using compensating wage differentials for the risk of fatal injury on the job. Using US data for 2017, we estimate the Value of Statistical Life at \$ 6.3 million (\$2017).


title: A gauge-invariant differential equation for covariant Lyapunov vectors

abstract: We introduce the concept of ``covariant Lyapunov field'', which assigns all the components of covariant Lyapunov vectors at almost all points of the phase space of a dynamical system. We show that in ergodic systems such fields can be characterized as the global solutions of a partial differential equation on the phase space. Due to the arbitrariness in the choice of a multiplicative scalar factor for the Lyapunov vector at each point of the phase space, this partial differential equation presents a gauge invariance that is formally analogous to that of electrodynamics.

categories: math-ph math.MP nlin.CD physics.class-ph


title: The Poisson Geometry of Plancherel Formulas for Triangular Groups

abstract: In this paper we establish the existence of canonical coordinates for generic co-adjoint orbits on triangular groups. These orbits correspond to a set of full Plancherel measure on the associated dual groups. This generalizes a well-known coordinatization of co-adjoint orbits of a minimal (non-generic) type originally discovered by Flaschka. The latter had strong connections to the classical Toda lattice and its associated Poisson geometry. Our results develop connections with the Full Kostant-Toda lattice and its Poisson geometry. This leads to novel insights relating the details of Plancherel theorems for Borel Lie groups to the invariant theory for Borels and their subgroups. We also discuss some implications for the quantum integrability of the Full Kostant Toda lattice.


title: Effects of disorder on deformation and failure of brittle porous materials

abstract: The mechanical behavior of porous materials depends strongly on porosity and pore geometry, but also on morphological parameters characterizing the spatial arrangement of pores. Here we use bond-based peridynamics to study effects of disorder on the deformation and failure behavior of brittle porous solids both in the quasi-static limit and in case of dynamic loading scenarios. We show that structural disorder, which has a strong influence on stiffness, strength and toughness in the quasi-static limit, becomes less relevant under dynamic loading conditions.


title: Dark matter and dark radiation from the early universe with a modulus coupled to the PQMSSM

abstract: The supersymmetrized DFSZ axion model is especially compelling in that it contains 1. the SUSY solution to the gauge hierarchy problem, 2. the Peccei-Quinn (PQ) solution to the strong CP problem and 3. the Kim-Nilles solution to the SUSY mu problem. In a string setting, where a discrete R-symmetry ({\bf Z}_{24}^R for example) may emerge from the compactification process, a high-quality accidental axion (accion) can emerge from the accidental, approximate remnant global U(1)_{PQ} symmetry where the decay constant f_a is linked to the SUSY breaking scale, and is within the cosmological sweet zone. In this setup, one also expects the presence of stringy remnant moduli fields \phi_i. Here, we consider the situation of a single light modulus \phi coupled to the PQMSSM in the early universe, with mixed axion plus higgsino-like WIMP dark matter. We evaluate dark matter and dark radiation production via nine coupled Boltzmann equations and assess the severity of the cosmological moduli problem (CMP) along with dark matter and dark radiation production rates. We find that typically the light modulus mass should be m_{\phi}>~ 10^4 TeV to avoid the moduli-induced dark matter overproduction problem. If one is able to (anthropically) tune the modulus field amplitude, we find a value of \phi_0 <~ 10^{-7}m_P would be required to solve the overall CMP.


title: Quid pro Quo in Streaming Services: Algorithms for Cooperative Recommendations

abstract: Recommendations are employed by Content Providers (CPs) of streaming services in order to boost user engagement and their revenues. Recent works suggest that nudging recommendations towards cached items can reduce operational costs in the caching networks, e.g., Content Delivery Networks (CDNs) or edge cache providers in future wireless networks. However, cache-friendly recommendations could deviate from users' tastes, and potentially affect the CP's revenues. Motivated by real-world business models, this work identifies the misalignment of the financial goals of the CP and the caching network provider, and presents a network-economic framework for recommendations. We propose a cooperation mechanism leveraging the Nash bargaining solution that allows the two entities to jointly design the recommendation policy. We consider different problem instances that vary on the extent these entities are willing to share their cost and revenue models, and propose two cooperative policies, CCR and DCR, that allow them to make decisions in a centralized or distributed way. In both cases, our solution guarantees reaching a fair and Pareto optimal allocation of the cooperation gains. Moreover, we discuss the extension of our framework towards caching decisions. A wealth of numerical experiments in realistic scenarios show the policies lead to significant gains for both entities.


title: Global Flood Prediction: a Multimodal Machine Learning Approach

abstract: Flooding is one of the most destructive and costly natural disasters, and climate changes would further increase risks globally. This work presents a novel multimodal machine learning approach for multi-year global flood risk prediction, combining geographical information and historical natural disaster dataset. Our multimodal framework employs state-of-the-art processing techniques to extract embeddings from each data modality, including text-based geographical data and tabular-based time-series data. Experiments demonstrate that a multimodal approach, that is combining text and statistical data, outperforms a single-modality approach. Our most advanced architecture, employing embeddings extracted using transfer learning upon DistilBert model, achieves 75\%-77\% ROCAUC score in predicting the next 1-5 year flooding event in historically flooded locations. This work demonstrates the potentials of using machine learning for long-term planning in natural disaster management.


title: Unlocking Deterministic Robustness Certification on ImageNet

abstract: Despite the promise of Lipschitz-based methods for provably-robust deep learning with deterministic guarantees, current state-of-the-art results are limited to feed-forward Convolutional Networks (ConvNets) on low-dimensional data, such as CIFAR-10. This paper investigates strategies for expanding certifiably robust training to larger, deeper models. A key challenge in certifying deep networks is efficient calculation of the Lipschitz bound for residual blocks found in ResNet and ViT architectures. We show that fast ways of bounding the Lipschitz constant for conventional ResNets are loose, and show how to address this by designing a new residual block, leading to the \emph{Linear ResNet} (LiResNet) architecture. We then introduce \emph{Efficient Margin MAximization} (EMMA), a loss function that stabilizes robust training by simultaneously penalizing worst-case adversarial examples from \emph{all} classes. Together, these contributions yield new \emph{state-of-the-art} robust accuracy on CIFAR-10/100 and Tiny-ImageNet under $\ell_2$ perturbations. Moreover, for the first time, we are able to scale up fast deterministic robustness guarantees to ImageNet, demonstrating that this approach to robust learning can be applied to real-world applications. We release our code on Github: \url{https://github.com/klasleino/gloro}.


title: Ap\'ery-Like Sums and Colored Multiple Zeta Values

abstract: In this article we shall survey some recent progress on the study of Ap\'ery-like sums which are multiple variable generalizations of the two sums Ap\'ery used in his famous proof of the irrationality of $\zeta(2)$ and $\zeta(3)$. We only allow the central binomial coefficients to appear in these infinite sums but they can appear either on the numerator or on the denominator. Special values of both types are closely related to the colored multiple zeta values and have played important roles in the calculations of the $\eps$-expansion of multiloop Feynman diagrams. We will summarize several different approaches to computing these sums and prove a few conjectural identities of Z.-W. Sun as corollaries along the way.