title: MACC: Cross-Layer Multi-Agent Congestion Control with Deep Reinforcement Learning

abstract: Congestion Control (CC), as the core networking task to efficiently utilize network capacity, received great attention and widely used in various Internet communication applications such as 5G, Internet-of-Things, UAN, and more. Various CC algorithms have been proposed both on network and transport layers such as Active Queue Management (AQM) algorithm and Transmission Control Protocol (TCP) congestion control mechanism. But it is hard to model dynamic AQM/TCP system and cooperate two algorithms to obtain excellent performance under different communication scenarios. In this paper, we explore the performance of multi-agent reinforcement learning-based cross-layer congestion control algorithms and present cooperation performance of two agents, known as MACC (Multi-agent Congestion Control). We implement MACC in NS3. The simulation results show that our scheme outperforms other congestion control combination in terms of throughput and delay, etc. Not only does it proves that networking protocols based on multi-agent deep reinforcement learning is efficient for communication managing, but also verifies that networking area can be used as new playground for machine learning algorithms.


title: Observation of the quantum Gouy phase

abstract: Controlling the evolution of a photonic quantum states is crucial for most quantum information processing and metrology tasks. Because of its importance, many mechanisms of quantum state evolution have been tested in detail and are well understood. However, the fundamental phase anomaly of evolving waves called the Gouy phase has not been studied in the context of elementary quantum states of light such as photon number states. Here we outline a simple method for calculating the quantum state evolution upon propagation and demonstrate experimentally how this quantum Gouy phase affects two-photon quantum states. Our results show that the increased phase sensitivity of multi-photon states also extends to this fundamental phase anomaly and has to be taken into account to fully understand the state evolution. We further demonstrate how the Gouy phase can be used as a tool for manipulating quantum states of any bosonic system in future quantum technologies, outline a possible application in quantum-enhanced sensing, and dispel a common misconception related to the nature of the increased phase sensitivity of multi-photon quantum states.


title: Optomechanical Schr\"{o}dinger cat states in a cavity Bose-Einstein condensate

abstract: Schr\"{o}dinger cat states, consisting of superpositions of macroscopically distinct states, provide key resources for a large number of emerging quantum technologies in quantum information processing. Here we propose how to generate and manipulate mechanical and optical Schr\"{o}dinger cat states with distinguishable superposition components by exploiting the unique properties of cavity optomechanical systems based on Bose-Einstein condensate. Specifically, we show that in comparison with its solid-state counterparts, almost a $3$ order of magnitude enhancement in the size of the mechanical Schr\"{o}dinger cat state could be achieved, characterizing a much smaller overlap between its two superposed coherent-state components. By exploiting this generated cat state, we further show how to engineer the quadrature squeezing of the mechanical mode. Besides, we also provide an efficient method to create multicomponent optical Schr\"{o}dinger cat states in our proposed scheme. Our work opens up a new way to achieve nonclassical states of massive objects, facilitating the development of fault-tolerant quantum processors and sensors.


title: Super-localized orthogonal decomposition for convection-dominated diffusion problems

abstract: This paper presents a multi-scale method for convection-dominated diffusion problems in the regime of large P\'eclet numbers. The application of the solution operator to piecewise constant right-hand sides on some arbitrary coarse mesh defines a finite-dimensional coarse ansatz space with favorable approximation properties. For some relevant error measures, including the $L^2$-norm, the Galerkin projection onto this generalized finite element space even yields $\varepsilon$-independent error bounds, $\varepsilon$ being the singular perturbation parameter. By constructing an approximate local basis, the approach becomes a novel multi-scale method in the spirit of the Super-Localized Orthogonal Decomposition (SLOD). The error caused by basis localization can be estimated in an a-posteriori way. In contrast to existing multi-scale methods, numerical experiments indicate $\varepsilon$-independent convergence without preasymptotic effects even in the under-resolved regime of large mesh P\'eclet numbers.


title: Miscellaneous results related to the Gaussian product inequality conjecture for the joint distribution of traces of Wishart matrices

abstract: This note reports partial results related to the Gaussian product inequality (GPI) conjecture for the joint distribution of traces of Wishart matrices. In particular, several GPI-related results from Wei (2014) and Liu et al. (2015) are extended in two ways: by replacing the power functions with more general classes of functions, and by replacing the usual Gaussian and multivariate gamma distributional assumptions by the more general trace-Wishart distribution assumption. These findings suggest that a Kronecker product form of the GPI holds for diagonal blocks of any Wishart distribution.


title: Stabilization of underactuated linear coupled reaction-diffusion PDEs via distributed or boundary actuation

abstract: This work concerns the exponential stabilization of underactuated linear homogeneous systems of m parabolic partial differential equations (PDEs) in cascade (reaction-diffusion systems), where only the first state is controlled either internally or from the right boundary and in which the diffusion coefficients are distinct. For the distributed control case, a proportional-type stabilizing control is given explicitly. After applying modal decomposition, the stabilizing law is based on a transformation for the ordinary differential equations (ODE) system corresponding to the comparatively unstable modes into a target one, where the calculation of the stabilization law is independent of the arbitrarily large number of these modes. This is achieved by solving generalized Sylvester equations recursively. For the boundary control case, under appropriate sufficient conditions on the coupling matrix (reaction term), the proposed controller is dynamic. A dynamic extension technique via trigonometric change of variables that places the control internally is first performed. Then, modal decomposition is applied followed by a state transformation of the ODE system, which must be stabilized in order to be written in a form where a dynamic law can be established. For both distributed and boundary control systems, a constructive and scalable stabilization algorithm is proposed, as the choice of the controller gains is independent of the number of unstable modes and only relies on the stabilization of the reaction term. The present approach solves the problem of stabilization of underactuated systems when in the presence of distinct diffusion coefficients, the problem is not directly solvable, similarly to the scalar PDE case. Keywords: Linear parabolic PDE systems, underactuated systems, stabilization, modal decomposition


title: Inbetween: Visual Selection in Parametric Design

abstract: The act of selection plays a leading role in the design process and in the definition of personal style. This work introduces visual selection catalogs into parametric design environments. A two-fold contribution is presented: (i) guidelines for construction of a minimal-bias visual selection catalog from a parametric space, and (ii) Inbetween, a catalog for a parametric typeface that adheres to the guidelines, allows for font selection from a continuous design space, and enables the investigation of personal style. A user study conducted among graphic designers, revealed self-coherent characteristics in selection patterns, and a high correlation in selection patterns within tasks. These findings suggest that such patterns reflect personal user styles, formalizing the style selection process as traversals of decision trees. Together, our guidelines and catalog aid in making visual selection a key building block in the digital creation process and validate selection processes as a measure of personal style.


title: A new approach to improve the performance of OFDM signal for 6G communication

abstract: The orthogonal frequency division multiplexing is a very efficient modulation technique that can achieve very high throughput by transmitting many carriers simultaneously and it is spectrally efficient because of the proximity of the subcarriers. OFDM is used in 5G communication for higher data transmission. 6th generation communication also demands OFDM, since it is more spectrally efficient and suitable for high data transmission. The drawback of the OFDM includes peak to average power ratio and sensitivity to carrier offsets and drifts. The usage of a non-linear power amplifier causes the signal spreading and leads to inter-modulation and signal constellation distortion. These two distortions have an impact on the signal-to-noise ratio and hence reduce the efficiency. The methods used to reduce PAPR are clipping and filtering, selective mapping, partial transmit sequence, tone reservation, and injection and non-linear commanding. The drawbacks of the above methods are computational complexity, spectrum inefficiency, increase in bit error rate and PAPR rate. In this work, three effective methods are discussed and compared to improve the performance parameters. These are adaptive peak window method based on harmonize clipping, harmonics kernel adaptive filter and Slepian-based flat-top window techniques are presented to reduce the BER, PAPR, and CCDF to improve the signal-to-noise of the system. This window technique averages out the noise spread out in the spectrum and thus reduces the signal loss by minimizing peak to average power ratio. The results are analyzed and compared with the existing conventional methods. Finally, the reductions in PAPR, BER and CCDF obtained are discussed in the results and comparison section. The proposed work has a higher signal-to-noise ratio than the conventional methods.


title: Modelling and Mining of Patient Pathways: A Scoping Review

abstract: The sequence of visits and procedures performed by the patient in the health system, also known as the patient's pathway or trajectory, can reveal important information about the clinical treatment adopted and the health service provided. The rise of electronic health data availability made it possible to assess the pathways of a large number of patients. Nevertheless, some challenges also arose concerning how to synthesize these pathways and how to mine them from the data, fostering a new field of research. The objective of this review is to survey this new field of research, highlighting representation models, mining techniques, methods of analysis, and examples of case studies.


title: Evaluation of Xilinx Deep Learning Processing Unit under Neutron Irradiation

abstract: This paper studies the dependability of the Xilinx Deep-Learning Processing Unit (DPU) under neutron irradiation. It analyses the impact of Single Event Effects (SEEs) on the accuracy of the DPU running the resnet50 model on a Xilinx Ultrascale+ MPSoC.


title: Avoiding barren plateaus via transferability of smooth solutions in Hamiltonian Variational Ansatz

abstract: A large ongoing research effort focuses on Variational Quantum Algorithms (VQAs), representing leading candidates to achieve computational speed-ups on current quantum devices. The scalability of VQAs to a large number of qubits, beyond the simulation capabilities of classical computers, is still debated. Two major hurdles are the proliferation of low-quality variational local minima, and the exponential vanishing of gradients in the cost function landscape, a phenomenon referred to as barren plateaus. Here we show that by employing iterative search schemes one can effectively prepare the ground state of paradigmatic quantum many-body models, circumventing also the barren plateau phenomenon. This is accomplished by leveraging the transferability to larger system sizes of iterative solutions, displaying an intrinsic smoothness of the variational parameters, a result that does not extend to other solutions found via random-start local optimization. Our scheme could be directly tested on near-term quantum devices, running a refinement optimization in a favorable local landscape with non-vanishing gradients.


title: Constructing Goeritz matrix from Dehn coloring matrix

abstract: Associated to a knot diagram, Goeritz introduced an integral matrix, which is now called a Goeritz matrix. It was shown by Traldi that the solution space of the equations with Goeritz matrix (precisely, unreduced Goeritz matrix called in his paper) as a coefficient matrix is isomorphic to the linear space consisting of the Dehn colorings for a knot. In this paper, we give a construction of a Goeritz matrix from a Dehn coloring matrix, from which Dehn colorings are induced. Moreover, if the knot diagram is prime, we give a purely algebraic construction of a Goeritz matrix from a Dehn coloring matrix.


title: Geodesic Properties of a Generalized Wasserstein Embedding for Time Series Analysis

abstract: Transport-based metrics and related embeddings (transforms) have recently been used to model signal classes where nonlinear structures or variations are present. In this paper, we study the geodesic properties of time series data with a generalized Wasserstein metric and the geometry related to their signed cumulative distribution transforms in the embedding space. Moreover, we show how understanding such geometric characteristics can provide added interpretability to certain time series classifiers, and be an inspiration for more robust classifiers.


title: One-component bounded functions

abstract: Three different characterizations of one-component bounded analytic functions are provided. The first one is related to the the inner-outer factorization, the second one is in terms of the size of the reproducing kernels in the corresponding de Branges-Rovnyak spaces and the last one concerns the associated Clark measure.


title: Delving into the Openness of CLIP

abstract: Contrastive Language-Image Pre-training (CLIP) formulates image classification as an image-to-text matching task, i.e., matching images to the corresponding natural language descriptions instead of discrete category IDs. This allows for open-vocabulary visual recognition, where the model can recognize images from an open class set (also known as an open vocabulary) in a zero-shot manner. However, evaluating the openness of CLIP-like models is challenging, as the models are open to arbitrary vocabulary in theory, but their accuracy varies in practice. To address this, we resort to an incremental perspective to assess the openness through vocabulary expansions, and define extensibility to measure a model's ability to handle novel classes. Our evaluation shows that CLIP-like models are not truly open, and their performance deteriorates as the vocabulary expands. We further dissect the feature space of CLIP from the perspectives of representation alignment and uniformity. Our investigation reveals that the overestimation of openness is due to confusion among competing text features, rather than a failure to capture the similarity between image features and text features of novel classes. We hope that our investigation and analysis will facilitate future research on the CLIP openness issue.


title: Atypical lexical abbreviations identification in Russian medical texts

abstract: Abbreviation is a method of word formation that aims to construct the shortened term from the first letters of the initial phrase. Implicit abbreviations frequently cause the comprehension difficulties for unprepared readers. In this paper, we propose an efficient ML-based algorithm which allows to identify the abbreviations in Russian texts. The method achieves ROC AUC score 0.926 and F1 score 0.706 which are confirmed as competitive in comparison with the baselines. Along with the pipeline, we also establish first to our knowledge Russian dataset that is relevant for the desired task.


title: Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation

abstract: Automatic generation of ophthalmic reports using data-driven neural networks has great potential in clinical practice. When writing a report, ophthalmologists make inferences with prior clinical knowledge. This knowledge has been neglected in prior medical report generation methods. To endow models with the capability of incorporating expert knowledge, we propose a Cross-modal clinical Graph Transformer (CGT) for ophthalmic report generation (ORG), in which clinical relation triples are injected into the visual features as prior knowledge to drive the decoding procedure. However, two major common Knowledge Noise (KN) issues may affect models' effectiveness. 1) Existing general biomedical knowledge bases such as the UMLS may not align meaningfully to the specific context and language of the report, limiting their utility for knowledge injection. 2) Incorporating too much knowledge may divert the visual features from their correct meaning. To overcome these limitations, we design an automatic information extraction scheme based on natural language processing to obtain clinical entities and relations directly from in-domain training reports. Given a set of ophthalmic images, our CGT first restores a sub-graph from the clinical graph and injects the restored triples into visual features. Then visible matrix is employed during the encoding procedure to limit the impact of knowledge. Finally, reports are predicted by the encoded cross-modal features via a Transformer decoder. Extensive experiments on the large-scale FFA-IR benchmark demonstrate that the proposed CGT is able to outperform previous benchmark methods and achieve state-of-the-art performances.


title: Computation of NMR shieldings at the CASSCF level using gauge-including atomic orbitals and Cholesky decomposition

abstract: We present an implementation of coupled-perturbed complete active space self-consistent field (CP-CASSCF) theory for the computation of nuclear magnetic resonance chemical shifts using gauge-including atomic orbitals and Cholesky decomposed two-electron integrals. The CP-CASSCF equations are solved using a direct algorithm where the magnetic Hessian matrix-vector product is expressed in terms of one-index transformed quantities. Numerical tests on systems with up to about 1300 basis functions provide information regarding both the computational efficiency and limitations of our implementation.


title: Combining the Morris Method and Multiple Error Metrics to Assess Aquifer Characteristics and Recharge in the Lower Ticino Basin, in Italy

abstract: Groundwater flow model accuracy is often limited by the uncertainty in model parameters that characterize aquifer properties and aquifer recharge. Aquifer properties such as hydraulic conductivity can have an uncertainty spanning orders of magnitude. Meanwhile, parameters used to configure model boundary conditions can introduce additional uncertainty. In this study, the Morris Method sensitivity analysis is performed on multiple quantities of interest to assess the sensitivity of a steady-state groundwater flow model to uncertain input parameters. The Morris Method determines which of these parameters are less influential on model outputs. Uninfluential parameters can be set constant during subsequent parameter optimization to reduce computational expense. Combining multiple quantities of interest (e.g., RMSE, groundwater fluxes) when performing both the Morris Method and parameter optimization offers a more complete assessment of groundwater models, providing a more reliable and physically consistent estimate of uncertain parameters. The parameter optimization procedure also provides us an estimate of the residual uncertainty in the parameter values, resulting in a more complete estimate of the remaining uncertainty. By employing such techniques, the current study was able to estimate the aquifer hydraulic conductivity and recharge rate due to rice field irrigation in a groundwater basin in Northern Italy, revealing that a significant proportion of surficial aquifer recharge (approximately 81-94%) during the later summer is due to the flood irrigation practices applied to these fields.


title: Constructing unbiased gradient estimators with finite variance for conditional stochastic optimization

abstract: We study stochastic gradient descent for solving conditional stochastic optimization problems, in which an objective to be minimized is given by a parametric nested expectation with an outer expectation taken with respect to one random variable and an inner conditional expectation with respect to the other random variable. The gradient of such a parametric nested expectation is again expressed as a nested expectation, which makes it hard for the standard nested Monte Carlo estimator to be unbiased. In this paper, we show under some conditions that a multilevel Monte Carlo gradient estimator is unbiased and has finite variance and finite expected computational cost, so that the standard theory from stochastic optimization for a parametric (non-nested) expectation directly applies. We also discuss a special case for which yet another unbiased gradient estimator with finite variance and cost can be constructed.


title: CAINNFlow: Convolutional block Attention modules and Invertible Neural Networks Flow for anomaly detection and localization tasks

abstract: Detection of object anomalies is crucial in industrial processes, but unsupervised anomaly detection and localization is particularly important due to the difficulty of obtaining a large number of defective samples and the unpredictable types of anomalies in real life. Among the existing unsupervised anomaly detection and localization methods, the NF-based scheme has achieved better results. However, the two subnets (complex functions) $s_{i}(u_{i})$ and $t_{i}(u_{i})$ in NF are usually multilayer perceptrons, which need to squeeze the input visual features from 2D flattening to 1D, destroying the spatial location relationship in the feature map and losing the spatial structure information. In order to retain and effectively extract spatial structure information, we design in this study a complex function model with alternating CBAM embedded in a stacked $3\times3$ full convolution, which is able to retain and effectively extract spatial structure information in the normalized flow model. Extensive experimental results on the MVTec AD dataset show that CAINNFlow achieves advanced levels of accuracy and inference efficiency based on CNN and Transformer backbone networks as feature extractors, and CAINNFlow achieves a pixel-level AUC of $98.64\%$ for anomaly detection in MVTec AD.


title: KSSOLV 2.0: An efficient MATLAB toolbox for solving the Kohn-Sham equations with plane-wave basis set

abstract: KSSOLV (Kohn-Sham Solver) is a MATLAB toolbox for performing Kohn-Sham density functional theory (DFT) calculations with a plane-wave basis set. KSSOLV 2.0 preserves the design features of the original KSSOLV software to allow users and developers to easily set up a problem and perform ground-state calculations as well as to prototype and test new algorithms. Furthermore, it includes new functionalities such as new iterative diagonalization algorithms, k-point sampling for electron band structures, geometry optimization and advanced algorithms for performing DFT calculations with local, semi-local, and hybrid exchange-correlation functionals. It can be used to study the electronic structures of both molecules and solids. We describe these new capabilities in this work through a few use cases. We also demonstrate the numerical accuracy and computational efficiency of KSSOLV on a variety of examples.


title: Lov\`{a}sz's hom-counting theorem by inclusion-exclusion principle

abstract: Let ${\mathcal C}$ be the category of finite graphs. Lov\`{a}sz (1967) shows that if $|\mathrm{Hom}(X,A)|=|\mathrm{Hom}(X,B)|$ holds for any $X$, then $A$ is isomorphic to $B$. Pultr (1973) gives a categorical generalization using a similar argument. Both proofs assume that each object has a finite number of isomorphism classes of subobjects. Generalizations without this assumption are given by Dawar, Jakl, and Reggio (2021) and Regio (2021). Here another generalization without this assumption is given, with a shorter proof. Examples of categories are given, for which our theorem is applicable, but the existing theorems are not.


title: Combinatorial Causal Bandits

abstract: In combinatorial causal bandits (CCB), the learning agent chooses at most $K$ variables in each round to intervene, collects feedback from the observed variables, with the goal of minimizing expected regret on the target variable $Y$. We study under the context of binary generalized linear models (BGLMs) with a succinct parametric representation of the causal models. We present the algorithm BGLM-OFU for Markovian BGLMs (i.e. no hidden variables) based on the maximum likelihood estimation method, and show that it achieves $O(\sqrt{T}\log T)$ regret, where $T$ is the time horizon. For the special case of linear models with hidden variables, we apply causal inference techniques such as the do-calculus to convert the original model into a Markovian model, and then show that our BGLM-OFU algorithm and another algorithm based on the linear regression both solve such linear models with hidden variables. Our novelty includes (a) considering the combinatorial intervention action space and the general causal models including ones with hidden variables, (b) integrating and adapting techniques from diverse studies such as generalized linear bandits and online influence maximization, and (c) avoiding unrealistic assumptions (such as knowing the joint distribution of the parents of $Y$ under all interventions) and regret factors exponential to causal graph size in prior studies.


title: Plasma-Electric Field Controlled Growth of Oriented Graphene for Energy Storage Applications

abstract: Graphene is well known to grow as flat sheets aligned with the growth substrate. Oriented graphene structures typically normal to the substrate have recently gained major attention. Most often, normal orientation is achieved in plasma-assisted growth and is believed to be due to plasma induced in-built electric field, which is usually oriented normal to the substrate. This work focuses on the effect of in-built electric field on growth direction, morphology, interconnectedness, and physical properties of various configurations of graphene structures and reveals the unique dependence of these features on electric field orientation. It is shown that tilting of growth substrates from parallel to normal direction with respect to the direction of inbuilt plasma electric field leads to the morphological transitions from flat graphene structure, to oriented individual graphene sheets and then interconnected three-dimensional networks of oriented graphene sheets. The revealed transition of the growth orientation leads to change in wetting nature, types of defect in graphitic structures as well as affects their charge storage capacity when used as supercapacitor electrodes. This simple and versatile approach opens new opportunities for the production of potentially large batches of differently oriented and structured graphene sheets in one production run.


title: The accurate mass distribution of M87, the Giant Galaxy with imaged shadow of its supermassive black hole, as a portal to new Physics

abstract: The very careful Event Horizon Telescope estimate of the mass of the supermassive black hole at the center of the Giant CD galaxy M87, allied with recent high quality photometric and spectroscopic measurements, yields a proper dark/luminous mass decomposition from the galaxy center to its virial radius. That provides us with decisive information on crucial cosmological and astrophysical issues. The dark and the standard matter distributions in a wide first time detected galaxy region under the supermassive black hole gravitational control. The well known supermassive black hole mass vs stellar dispersion velocity relationship at the highest galaxy masses implies an exotic growth of the former. This may be the first case in which one can argue that the supermassive black hole mass growth was also contributed by the Dark Matter component. A huge dark matter halo core in a galaxy with inefficient baryonic feedback is present and consequently constrains the nature of the dark halo particles. The unexplained entanglement between dark/luminous structural properties, already emerged in disk systems, also appears.


title: Metal Oxide-Vertical Graphene Nanosheets for 2.6 V Aqueous Electrochemical Hybrid Capacitor

abstract: Aqueous asymmetric electrochemical capacitor, with their high power density and superior cycle stability in comparison to conventional batteries, are presently considered as the most promising contender for energy storage. However, fabricating an electrode material and choosing a suitable aqueous electrolyte are vital in developing an electrochemical capacitor device with high charge storage capacity. Herein, we report a feasible method to synthesize MnO2/Vertical graphene nanosheets (VGN) and Fe2O3/VGN as positive and negative electrodes, respectively. The surface of VGN skeleton is independently decorated with MnO2 having sponge gourd-like morphology and Fe2O3 having nanorice like morphology. A schematic representation of the growth mechanism for metal oxide on VGN network is established. Both the electrode have shown around 250 times higher charge-storage capacity than the bare VGN (0.47 mF/cm2) with the specific capacitance of 118 (MnO2/VGN) and 151 mF/cm2 (Fe2O3/VGN). In addition to the double layer capacitance contribution, the porous interconnected vertical graphene architecture serves as a mechanical backbone for the metal oxide materials and provides multiple conducting channels for the electron transport. The fabricated asymmetric device exhibited a specific capacitance of 76 mF/cm2 and energy density of 71 microWh/cm2 with an excellent electrochemical stability up to 12000 cycles, over a potential window of 2.6 V. The commendable performance of asymmetric electrochemical capacitor device authenticated its potential utilization for next-generation portable energy storage device.


title: MSR: Making Self-supervised learning Robust to Aggressive Augmentations

abstract: Most recent self-supervised learning methods learn visual representation by contrasting different augmented views of images. Compared with supervised learning, more aggressive augmentations have been introduced to further improve the diversity of training pairs. However, aggressive augmentations may distort images' structures leading to a severe semantic shift problem that augmented views of the same image may not share the same semantics, thus degrading the transfer performance. To address this problem, we propose a new SSL paradigm, which counteracts the impact of semantic shift by balancing the role of weak and aggressively augmented pairs. Specifically, semantically inconsistent pairs are of minority and we treat them as noisy pairs. Note that deep neural networks (DNNs) have a crucial memorization effect that DNNs tend to first memorize clean (majority) examples before overfitting to noisy (minority) examples. Therefore, we set a relatively large weight for aggressively augmented data pairs at the early learning stage. With the training going on, the model begins to overfit noisy pairs. Accordingly, we gradually reduce the weights of aggressively augmented pairs. In doing so, our method can better embrace the aggressive augmentations and neutralize the semantic shift problem. Experiments show that our model achieves 73.1% top-1 accuracy on ImageNet-1K with ResNet-50 for 200 epochs, which is a 2.5% improvement over BYOL. Moreover, experiments also demonstrate that the learned representations can transfer well for various downstream tasks.


title: Hybrid Value Estimation for Off-policy Evaluation and Offline Reinforcement Learning

abstract: Value function estimation is an indispensable subroutine in reinforcement learning, which becomes more challenging in the offline setting. In this paper, we propose Hybrid Value Estimation (HVE) to reduce value estimation error, which trades off bias and variance by balancing between the value estimation from offline data and the learned model. Theoretical analysis discloses that HVE enjoys a better error bound than the direct methods. HVE can be leveraged in both off-policy evaluation and offline reinforcement learning settings. We, therefore, provide two concrete algorithms Off-policy HVE (OPHVE) and Model-based Offline HVE (MOHVE), respectively. Empirical evaluations on MuJoCo tasks corroborate the theoretical claim. OPHVE outperforms other off-policy evaluation methods in all three metrics measuring the estimation effectiveness, while MOHVE achieves better or comparable performance with state-of-the-art offline reinforcement learning algorithms. We hope that HVE could shed some light on further research on reinforcement learning from fixed data.


title: A PDE-based Explanation of Extreme Numerical Sensitivities and Edge of Stability in Training Neural Networks

abstract: We discover restrained numerical instabilities in current training practices of deep networks with stochastic gradient descent (SGD), and its variants. We show numerical error (on the order of the smallest floating point bit and thus the most extreme or limiting numerical perturbations induced from floating point arithmetic in training deep nets can be amplified significantly and result in significant test accuracy variance (sensitivities), comparable to the test accuracy variance due to stochasticity in SGD. We show how this is likely traced to instabilities of the optimization dynamics that are restrained, i.e., localized over iterations and regions of the weight tensor space. We do this by presenting a theoretical framework using numerical analysis of partial differential equations (PDE), and analyzing the gradient descent PDE of convolutional neural networks (CNNs). We show that it is stable only under certain conditions on the learning rate and weight decay. We show that rather than blowing up when the conditions are violated, the instability can be restrained. We show this is a consequence of the non-linear PDE associated with the gradient descent of the CNN, whose local linearization changes when over-driving the step size of the discretization, resulting in a stabilizing effect. We link restrained instabilities to the recently discovered Edge of Stability (EoS) phenomena, in which the stable step size predicted by classical theory is exceeded while continuing to optimize the loss and still converging. Because restrained instabilities occur at the EoS, our theory provides new insights and predictions about the EoS, in particular, the role of regularization and the dependence on the network complexity.


title: CVNets: High Performance Library for Computer Vision

abstract: We introduce CVNets, a high-performance open-source library for training deep neural networks for visual recognition tasks, including classification, detection, and segmentation. CVNets supports image and video understanding tools, including data loading, data transformations, novel data sampling methods, and implementations of several standard networks with similar or better performance than previous studies. Our source code is available at: \url{https://github.com/apple/ml-cvnets}.


title: Reproducibility in Cytometry: Signals Analysis and its Connection to Uncertainty Quantification

abstract: Signals analysis for cytometry remains a challenging task that has a significant impact on uncertainty. Conventional cytometers assume that individual measurements are well characterized by simple properties such as the signal area, width, and height. However, these approaches have difficulty distinguishing inherent biological variability from instrument artifacts and operating conditions. As a result, it is challenging to quantify uncertainty in the properties of individual cells and perform tasks such as doublet deconvolution. We address these problems via signals analysis techniques that use scale transformations to: (I) separate variation in biomarker expression from effects due to flow conditions and particle size; (II) quantify reproducibility associated with a given laser interrogation region; (III) estimate uncertainty in measurement values on a per-event basis; and (IV) extract the singlets that make up a multiplet. The key idea behind this approach is to model how variable operating conditions deform the signal shape and then use constrained optimization to "undo" these deformations for measured signals; residuals to this process characterize reproducibility. Using a recently developed microfluidic cytometer, we demonstrate that these techniques can account for instrument and measurand induced variability with a residual uncertainty of less than 2.5% in the signal shape and less than 1% in integrated area.


title: Chemical Short-Range Ordering in a CrCoNi Medium-Entropy Alloy

abstract: The exceptional mechanical strengths of medium and high-entropy alloys have been attributed to hardening in random solid solutions. Here, we evidence non-random chemical mixings in CrCoNi alloys, resulting from short range ordering. A novel data-mining approach of electron nanodiffraction patterns enabled the study, which is assisted by neutron scattering, atom probe tomography, and diffraction simulation using first principles theory models. Results reveal two critical types of short range orders in nanoclusters that minimize the Cr and Cr nearest neighbors (L11) or segregate Cr on alternating close-packed planes (L12). The makeup of ordering-strengthened nanoclusters can be tuned by heat treatments to affect deformation mechanisms. These findings uncover a mixture of bonding preferences and their control at the nanoscopic scale in CrCoNi and provide general opportunities for an atomistic-structure study in concentrated alloys for the design of strong and ductile materials.


title: Open Challenges in Developing Generalizable Large Scale Machine Learning Models for Catalyst Discovery

abstract: The development of machine learned potentials for catalyst discovery has predominantly been focused on very specific chemistries and material compositions. While effective in interpolating between available materials, these approaches struggle to generalize across chemical space. The recent curation of large-scale catalyst datasets has offered the opportunity to build a universal machine learning potential, spanning chemical and composition space. If accomplished, said potential could accelerate the catalyst discovery process across a variety of applications (CO2 reduction, NH3 production, etc.) without additional specialized training efforts that are currently required. The release of the Open Catalyst 2020 (OC20) has begun just that, pushing the heterogeneous catalysis and machine learning communities towards building more accurate and robust models. In this perspective, we discuss some of the challenges and findings of recent developments on OC20. We examine the performance of current models across different materials and adsorbates to identify notably underperforming subsets. We then discuss some of the modeling efforts surrounding energy-conservation, approaches to finding and evaluating the local minima, and augmentation of off-equilibrium data. To complement the community's ongoing developments, we end with an outlook to some of the important challenges that have yet to be thoroughly explored for large-scale catalyst discovery.


title: Combinatorial optimization for low bit-width neural networks

abstract: Low-bit width neural networks have been extensively explored for deployment on edge devices to reduce computational resources. Existing approaches have focused on gradient-based optimization in a two-stage train-and-compress setting or as a combined optimization where gradients are quantized during training. Such schemes require high-performance hardware during the training phase and usually store an equivalent number of full-precision weights apart from the quantized weights. In this paper, we explore methods of direct combinatorial optimization in the problem of risk minimization with binary weights, which can be made equivalent to a non-monotone submodular maximization under certain conditions. We employ an approximation algorithm for the cases with single and multilayer neural networks. For linear models, it has $\mathcal{O}(nd)$ time complexity where $n$ is the sample size and $d$ is the data dimension. We show that a combination of greedy coordinate descent and this novel approach can attain competitive accuracy on binary classification tasks.


title: Labeled Chip-firing on Binary Trees with $2^n-1$ Chips

abstract: We study labeled chip-firing on binary trees and some of its modifications. We prove a sorting property of terminal configurations of the process. We also analyze the endgame moves poset and prove that this poset is a modular lattice.


title: Hidden Degrees of Freedom in Implicit Vortex Filaments

abstract: This paper presents a new representation of curve dynamics, with applications to vortex filaments in fluid dynamics. Instead of representing these filaments with explicit curve geometry and Lagrangian equations of motion, we represent curves implicitly with a new co-dimensional 2 level set description. Our implicit representation admits several redundant mathematical degrees of freedom in both the configuration and the dynamics of the curves, which can be tailored specifically to improve numerical robustness, in contrast to naive approaches for implicit curve dynamics that suffer from overwhelming numerical stability problems. Furthermore, we note how these hidden degrees of freedom perfectly map to a Clebsch representation in fluid dynamics. Motivated by these observations, we introduce untwisted level set functions and non-swirling dynamics which successfully regularize sources of numerical instability, particularly in the twisting modes around curve filaments. A consequence is a novel simulation method which produces stable dynamics for large numbers of interacting vortex filaments and effortlessly handles topological changes and re-connection events.


title: FLECS: A Federated Learning Second-Order Framework via Compression and Sketching

abstract: Inspired by the recent work FedNL (Safaryan et al, FedNL: Making Newton-Type Methods Applicable to Federated Learning), we propose a new communication efficient second-order framework for Federated learning, namely FLECS. The proposed method reduces the high-memory requirements of FedNL by the usage of an L-SR1 type update for the Hessian approximation which is stored on the central server. A low dimensional `sketch' of the Hessian is all that is needed by each device to generate an update, so that memory costs as well as number of Hessian-vector products for the agent are low. Biased and unbiased compressions are utilized to make communication costs also low. Convergence guarantees for FLECS are provided in both the strongly convex, and nonconvex cases, and local linear convergence is also established under strong convexity. Numerical experiments confirm the practical benefits of this new FLECS algorithm.


title: Variational regularization with oversmoothing penalty term in Banach spaces

abstract: In the present work, we discuss variational regularization for ill-posed nonlinear problems with focus on an oversmoothing penalty term. This means in our model that the searched-for solution of the considered nonlinear operator equation does not belong to the domain of definition of the penalty functional. In the past years, such variational regularization has been investigated comprehensively in Hilbert scales. Our present study tries to continue and to extend those investigations to Banach scales. This new study includes convergence rates results for a priori choices of the regularization parameter, both for H\"older-type smoothness and low order-type smoothness. The necessary tools for low order smoothness in the Banach space setting are provided.


title: Coevolution of broad emission lines and X-ray spectrum in changing-look AGNs

abstract: Changing-look active galactic nuclei (CLAGNs) show the disappearance and reappearance of broad emission lines in a few years, which challenges the orientation-based AGN unification model. We reduce the X-ray data for five well-studied CLAGNs that show a strong change in broad emission lines in the past several decades. We find that the X-ray photon index, $\Gamma$, and the Eddington-scaled X-ray luminosity, $L_{\rm 2-10 keV}/L_{\rm Edd}$, normally follow negative and positive correlations when the Eddington ratio is lower and higher than a critical value of $\sim 10^{-3}$. We find that the CLAGNs observed with broad H$\beta$ emission lines stay in the positive part of the $\Gamma-L_{\rm 2-10 keV}/L_{\rm Edd}$ correlation, while the broad H$\beta$ lines become weak or disappear in the anticorrelation part of the $\Gamma-L_{\rm 2-10 keV}/L_{\rm Edd}$ correlation, which suggests that the evolution of the broad lines should be correlated with the evolution of the underlying accretion process. We further find that the CLAGNs are consistent with the other different types of AGNs in the $L_{\rm bol}-L_{\rm bol}/L_{\rm Edd}$ correlation. These results support that the CLAGNs are belong to a special stage of AGNs with a bolometric Eddington ratio $\sim$1\%, where the broad emission lines are easily affected by the strong variation in ionization luminosity that is caused by the transition of accretion modes.


title: Concentration of the missing mass in metric spaces

abstract: We study the estimation and concentration on its expectation of the probability to observe data further than a specified distance from a given iid sample in a metric space. The problem extends the classical problem of estimation of the missing mass in discrete spaces. We give some estimators for the conditional missing mass and show that estimation of the expected missing mass is difficult in general. Conditions on the distribution, under which the Good-Turing estimator and the conditional missing mass concentrate on their expectations are identified. Applications to anomaly detection, coding, the Wasserstein distance between true and empirical measure and simple learning bounds are sketched.


title: Causal Discovery in Heterogeneous Environments Under the Sparse Mechanism Shift Hypothesis

abstract: Machine learning approaches commonly rely on the assumption of independent and identically distributed (i.i.d.) data. In reality, however, this assumption is almost always violated due to distribution shifts between environments. Although valuable learning signals can be provided by heterogeneous data from changing distributions, it is also known that learning under arbitrary (adversarial) changes is impossible. Causality provides a useful framework for modeling distribution shifts, since causal models encode both observational and interventional distributions. In this work, we explore the sparse mechanism shift hypothesis, which posits that distribution shifts occur due to a small number of changing causal conditionals. Motivated by this idea, we apply it to learning causal structure from heterogeneous environments, where i.i.d. data only allows for learning an equivalence class of graphs without restrictive assumptions. We propose the Mechanism Shift Score (MSS), a score-based approach amenable to various empirical estimators, which provably identifies the entire causal structure with high probability if the sparse mechanism shift hypothesis holds. Empirically, we verify behavior predicted by the theory and compare multiple estimators and score functions to identify the best approaches in practice. Compared to other methods, we show how MSS bridges a gap by both being nonparametric as well as explicitly leveraging sparse changes.


title: Actuarial Applications of Natural Language Processing Using Transformers: Case Studies for Using Text Features in an Actuarial Context

abstract: This tutorial demonstrates workflows to incorporate text data into actuarial classification and regression tasks. The main focus is on methods employing transformer-based models. A dataset of car accident descriptions with an average length of 400 words, available in English and German, and a dataset with short property insurance claims descriptions are used to demonstrate these techniques. The case studies tackle challenges related to a multi-lingual setting and long input sequences. They also show ways to interpret model output, to assess and improve model performance, by fine-tuning the models to the domain of application or to a specific prediction task. Finally, the tutorial provides practical approaches to handle classification tasks in situations with no or only few labeled data, including but not limited to ChatGPT. The results achieved by using the language-understanding skills of off-the-shelf natural language processing (NLP) models with only minimal pre-processing and fine-tuning clearly demonstrate the power of transfer learning for practical applications.


title: APES: Articulated Part Extraction from Sprite Sheets

abstract: Rigged puppets are one of the most prevalent representations to create 2D character animations. Creating these puppets requires partitioning characters into independently moving parts. In this work, we present a method to automatically identify such articulated parts from a small set of character poses shown in a sprite sheet, which is an illustration of the character that artists often draw before puppet creation. Our method is trained to infer articulated parts, e.g. head, torso and limbs, that can be re-assembled to best reconstruct the given poses. Our results demonstrate significantly better performance than alternatives qualitatively and quantitatively.Our project page https://zhan-xu.github.io/parts/ includes our code and data.


title: Is $L^2$ Physics-Informed Loss Always Suitable for Training Physics-Informed Neural Network?

abstract: The Physics-Informed Neural Network (PINN) approach is a new and promising way to solve partial differential equations using deep learning. The $L^2$ Physics-Informed Loss is the de-facto standard in training Physics-Informed Neural Networks. In this paper, we challenge this common practice by investigating the relationship between the loss function and the approximation quality of the learned solution. In particular, we leverage the concept of stability in the literature of partial differential equation to study the asymptotic behavior of the learned solution as the loss approaches zero. With this concept, we study an important class of high-dimensional non-linear PDEs in optimal control, the Hamilton-Jacobi-Bellman(HJB) Equation, and prove that for general $L^p$ Physics-Informed Loss, a wide class of HJB equation is stable only if $p$ is sufficiently large. Therefore, the commonly used $L^2$ loss is not suitable for training PINN on those equations, while $L^{\infty}$ loss is a better choice. Based on the theoretical insight, we develop a novel PINN training algorithm to minimize the $L^{\infty}$ loss for HJB equations which is in a similar spirit to adversarial training. The effectiveness of the proposed algorithm is empirically demonstrated through experiments. Our code is released at https://github.com/LithiumDA/L_inf-PINN.


title: Feature screening for multi-response linear models by empirical likelihood

abstract: This paper proposes a new feature screening method for the multi-response ultrahigh dimensional linear model by empirical likelihood. Through a multivariate moment condition, the empirical likelihood induced ranking statistics can exploit the joint effect among responses, and thus result in a much better performance than the methods considering responses individually. More importantly, by the use of empirical likelihood, the new method adapts to the heterogeneity in the conditional variance of random error. The sure screening property of the newly proposed method is proved with the model size controlled within a reasonable scale. Additionally, the new screening method is also extended to a conditional version so that it can recover the hidden predictors which are easily missed by the unconditional method. The corresponding theoretical properties are also provided. Finally, both numerical studies and real data analysis are provided to illustrate the effectiveness of the proposed methods.


title: Twisted Affine Integrable Hierarchies and Soliton Solutions

abstract: A systematic construction of a class of integrable hierarchy is discussed in terms of the twisted affine $A_{2r}^{(2)}$ Lie algebra. The zero curvature representation of the time evolution equations are shown to be classified according to its algebraic structure and according to its vacuum solutions. It is shown that a class of models admit both zero and constant (non zero) vacuum solutions. Another, consists essentially of integral non-local equations and can be classified into two sub-classes, one admitting zero vacuum and another of constant, non zero vacuum solutions. The two dimensional gauge potentials in the vacuum plays a crucial ingredient and are shown to be expanded in powers of the vacuum parameter $v_0$. Soliton solutions are constructed from vertex operators, which for the non zero vacuum solutions, correspond to deformations characterized by $v_0$.


title: Symmetry as a Representation of Intuitive Geometry?

abstract: Recognition of geometrical patterns seems to be an important aspect of human intelligence. Geometric pattern recognition is used in many intelligence tests, including Dehaene's odd-one-out test of Core Geometry (CG)) based on intuitive geometrical concepts (Dehaene et al., 2006). Earlier work has developed a symmetry-based cognitive model of Dehaene's test and demonstrated performance comparable to that of humans. In this work, we further investigate the role of symmetry in geometrical intuition and build a cognitive model for the 2-Alternative Forced Choice (2-AFC) variation of the CG test (Marupudi & Varma 2021). In contrast to Dehaene's test, 2-AFC leaves almost no space for cognitive models based on generalization over multiple examples. Our symmetry-based model achieves an accuracy comparable to the human average on the 2-AFC test and appears to capture an essential part of intuitive geometry.


title: Extended optimal Fermi averaging for near-recoilless $\Lambda$ production in the ($K^-$, $\pi^-$) reaction on nuclei

abstract: We propose to extend the optimal Fermi averaging procedure theoretically in order to calculate an in-medium $K^-n\to \pi^- \Lambda$ amplitude for the exothermic ($K^-$, $\pi^-$) reaction on nuclei in the framework of a distorted-wave impulse approximation, taking into account the local momentum transfer generated by semiclassical distorted waves for $K^-$ and $\pi^-$ mesons. Angular distributions for the $^{12}$C($K^-$, $\pi^-$)$^{12}_\Lambda$C reaction in which a momentum transfer is $q \lesssim$ 80 MeV/$c$ at $p_K=$ 800 MeV/$c$ in the $\pi^-$ forward direction, are estimated by applying the extended procedure. The result shows that the calculated angular distributions are in good agreement with those of the data, and this extension is a successful prescription making it possible to describe the reaction cross sections in near-recoilless reactions such as ($K^-$, $\pi^-$) in our framework.


title: Perspective on Epitaxial NiCo2O4 Film as an Emergent Spintronic Material: Magnetism and Transport Properties

abstract: The ferrimagnetic inverse spinel NiCo2O4 has attracted extensive research interests for its versatile electrochemical properties, robust magnetic order, high conductivity, and fast spin dynamics, as well as its highly tunable nature due to the closely coupled charge, spin, orbital, lattice, and defect effects. Single-crystalline epitaxial thin films of NiCo2O4 present a model system for elucidating the intrinsic physical properties and strong tunability, which are not viable in bulk single crystals. In this perspective, we discuss the recent advances in epitaxial NiCo2O4 thin films, focusing on understanding its unusual magnetic and transport properties in light of crystal structure and electronic structure. The perpendicular magnetic anisotropy in compressively strained NiCo2O4 films is explained by considering the strong spin-lattice coupling, particularly on Co ions. The prominent effect of growth conditions reveals the complex interplay between the crystal structure, cation stoichiometry, valence state, and site occupancy. NiCo2O4 thin films also exhibit various magnetotransport anomalies, including linear magnetoresistance and sign change in anomalous Hall effect, which illustrate the competing effects of band intrinsic Berry phase and impurity scattering. The fundamental understanding of these phenomena will facilitate the functional design of NiCo2O4 thin films for nanoscale spintronic applications.


title: A $p$-Adic 6-Functor Formalism in Rigid-Analytic Geometry

abstract: We develop a full 6-functor formalism for $p$-torsion \'etale sheaves in rigid-analytic geometry. More concretely, we use the recently developed condensed mathematics by Clausen--Scholze to associate to every small v-stack (e.g. rigid-analytic variety) $X$ with pseudouniformizer $\pi$ an $\infty$-category $\mathcal D^a_\square(\mathcal O^+_X/\pi)$ of "derived quasicoherent complete topological $\mathcal O^+_X/\pi$-modules" on $X$. We then construct the six functors $\otimes$, $\underline{Hom}$, $f^*$, $f_*$, $f_!$ and $f^!$ in this setting and show that they satisfy all the expected compatibilities, similar to the $\ell$-adic case. By introducing $\varphi$-module structures and proving a version of the $p$-torsion Riemann-Hilbert correspondence we relate $\mathcal O^+_X/\pi$-sheaves to $\mathbb F_p$-sheaves. As a special case of this formalism we prove Poincar\'e duality for $\mathbb F_p$-cohomology on rigid-analytic varieties. In the process of constructing $\mathcal D^a_\square(\mathcal O^+_X/\pi)$ we also develop a general descent formalism for condensed modules over condensed rings.


title: A statistical comparison of different approximate Hamiltonian-based anharmonic free energy estimators

abstract: Ensuring a satisfactory statistical convergence of anharmonic thermodynamic properties requires sampling of many atomic configurations, however the methods to obtain those necessarily produce correlated samples, thereby reducing the effective sample size and increasing the uncertainty compared to purely random sampling. In previous works procedures have been implemented to accelerate the computations by first performing simulations using an approximate Hamiltonian which is computationally more efficient than the accurate one and then using various methods to correct for the resulting error. Those rely on recalculating the accurate energies of a random subset of configurations obtained using the approximate Hamiltonian thereby maximizing the effective sample size. This procedure can be particularly suitable for calculating thermodynamic properties using density-functional theory in which case the accurate and approximate Hamiltonians may be represented by parametrically suitably converged and non-converged ones. Whereas it is qualitatively known that there needs to be a sufficient overlap between the phase spaces of the approximate and the accurate Hamiltonians, the quantitative limits of applicability and the relative efficiencies of such methods is not well known. In this paper a statistical analysis is performed first theoretically and then quantitatively by numerical analysis. The sampling distributions of different free energy estimators are obtained and the dependence of their bias and variance with respect to convergence parameters, simulation times and reference potentials is estimated.


title: Nonlinear beam self-maintaining effect in graded-index multimode fiber

abstract: Multimode fiber systems are desirable for industrial and scientific applications. As an interesting effect for the laser beam propagation in a multimode fiber, nonlinear Kerr beam cleanup has attracted considerable research interest due to the spatial beam compressing. However, its physical mechanisms, especially the influences of input conditions on its performances, remain unclear. Here, we report a new self-organized regime for the multimode beam propagation in a graded-index multimode fiber: when the input laser has a dominant mode in which most of the laser energy is concentrated, the beam profile can be maintaining in a well-defined structure similar to the input dominant mode in nonlinear regime, while it will evolve to an irregular pattern in linear regime. The existence and universality of this nonlinear beam self-maintaining effect have been verified by the experimental and numerical data. Our results also provide evidence that nonlinear Kerr effects can be the driving mechanism and nonlinear Kerr beam cleanup is a specific case of this effect. Further research into this spatial beam shaping effect may provide a new perspective to understand other multimode fiber nonlinearities.


title: Between Rate-Distortion Theory & Value Equivalence in Model-Based Reinforcement Learning

abstract: The quintessential model-based reinforcement-learning agent iteratively refines its estimates or prior beliefs about the true underlying model of the environment. Recent empirical successes in model-based reinforcement learning with function approximation, however, eschew the true model in favor of a surrogate that, while ignoring various facets of the environment, still facilitates effective planning over behaviors. Recently formalized as the value equivalence principle, this algorithmic technique is perhaps unavoidable as real-world reinforcement learning demands consideration of a simple, computationally-bounded agent interacting with an overwhelmingly complex environment. In this work, we entertain an extreme scenario wherein some combination of immense environment complexity and limited agent capacity entirely precludes identifying an exactly value-equivalent model. In light of this, we embrace a notion of approximate value equivalence and introduce an algorithm for incrementally synthesizing simple and useful approximations of the environment from which an agent might still recover near-optimal behavior. Crucially, we recognize the information-theoretic nature of this lossy environment compression problem and use the appropriate tools of rate-distortion theory to make mathematically precise how value equivalence can lend tractability to otherwise intractable sequential decision-making problems.


title: Fast, Stable and Efficient Approximation of Multi-parameter Persistence Modules with MMA

abstract: In this article, we introduce a new parameterized family of topological invariants, taking the form of candidate decompositions, for multi-parameter persistence modules. We prove that our candidate decompositions are controllable approximations: when restricting to modules that can be decomposed into interval summands, we establish theoretical results about the approximation error between our candidate decompositions and the true underlying module in terms of the standard interleaving and bottleneck distances. Moreover, even when the underlying module does not admit such a decomposition, our candidate decompositions are nonetheless stable invariants; small perturbations in the underlying module lead to small perturbations in the candidate decomposition. Then, we introduce MMA (Multipersistence Module Approximation): an algorithm for computing stable instances of such invariants, which is based on fibered barcodes and exact matchings, two constructions that stem from the theory of single-parameter persistence. By design, MMA can handle an arbitrary number of filtrations, and has bounded complexity and running time. Finally, we present empirical evidence validating the generalization capabilities and running time speed-ups of MMA on several data sets.


title: Implicit Neural Representation for Mesh-Free Inverse Obstacle Scattering

abstract: Implicit representation of shapes as level sets of multilayer perceptrons has recently flourished in different shape analysis, compression, and reconstruction tasks. In this paper, we introduce an implicit neural representation-based framework for solving the inverse obstacle scattering problem in a mesh-free fashion. We express the obstacle shape as the zero-level set of a signed distance function which is implicitly determined by network parameters. To solve the direct scattering problem, we implement the implicit boundary integral method. It uses projections of the grid points in the tubular neighborhood onto the boundary to compute the PDE solution directly in the level-set framework. The proposed implicit representation conveniently handles the shape perturbation in the optimization process. To update the shape, we use PyTorch's automatic differentiation to backpropagate the loss function w.r.t. the network parameters, allowing us to avoid complex and error-prone manual derivation of the shape derivative. Additionally, we propose a deep generative model of implicit neural shape representations that can fit into the framework. The deep generative model effectively regularizes the inverse obstacle scattering problem, making it more tractable and robust, while yielding high-quality reconstruction results even in noise-corrupted setups.


title: Equatorially balanced C4-face-magic labelings on Klein bottle grid graphs

abstract: For a graph $G = (V, E)$ embedded in the Klein bottle, let $\mathcal{F}(G)$ denote the set of faces of $G$. Then, $G$ is called a $C_k$-face-magic Klein bottle graph if there exists a bijection $f: V(G) \to \{1, 2, \dots, |V(G)|\}$ such that for any $F \in \mathcal{F}(G)$ with $F \cong C_k$, the sum of all the vertex labelings along $C_k$ is a constant $S$. Let $x_v =f(v)$ for all $v\in V(G)$. We call $\{x_v : v\in V(G)\}$ a $C_k$-face-magic Klein bottle labeling on $G$. We consider the $m \times n$ grid graph, denoted by $\mathcal{K}_{m,n}$, embedded in the Klein bottle in the natural way. We show that for $m,n\ge 2$, $\mathcal{K}_{m,n}$ admits a $C_4$-face-magic Klein bottle labeling if and only if $n$ is even. We say that a $C_4$-face-magic Klein bottle labeling $\{x_{i,j}: (i,j) \in V(\mathcal{K}_{m,n}) \}$ on $\mathcal{K}_{m,n}$ is equatorially balanced if $x_{i,j} + x_{i,n+1-j} = \tfrac{1}{2} S$ for all $(i,j) \in V(\mathcal{K}_{m,n})$. We show that when $m$ is odd, a $C_4$-face-magic Klein bottle labeling on $\mathcal{K}_{m,n}$ must be equatorially balanced. Also when $m$ is odd, we show that (up to symmetries on the Klein bottle) the number of $C_4$-face-magic Klein bottle labelings on the $m \times 4$ Klein bottle grid graph is $2^m \, (m-1)! \, \tau(m)$, where $\tau(m)$ is the number of positive divisors of $m$. Furthermore, let $m\ge 3$ be an odd integer and $n \ge 6$ be an even integer. Then, the minimum number of distinct $C_4$-face-magic Klein bottle labelings $X$ on $\mathcal{K}_{m,n}$ (up to symmetries on a Klein bottle) is either $(5\cdot 2^m)(m-1)!$ if $n \equiv 0\pmod{4}$, or $(6\cdot 2^m)(m-1)!$ if $n \equiv 2\pmod{4}$.


title: Guided Deep Metric Learning

abstract: Deep Metric Learning (DML) methods have been proven relevant for visual similarity learning. However, they sometimes lack generalization properties because they are trained often using an inappropriate sample selection strategy or due to the difficulty of the dataset caused by a distributional shift in the data. These represent a significant drawback when attempting to learn the underlying data manifold. Therefore, there is a pressing need to develop better ways of obtaining generalization and representation of the underlying manifold. In this paper, we propose a novel approach to DML that we call Guided Deep Metric Learning, a novel architecture oriented to learning more compact clusters, improving generalization under distributional shifts in DML. This novel architecture consists of two independent models: A multi-branch master model, inspired from a Few-Shot Learning (FSL) perspective, generates a reduced hypothesis space based on prior knowledge from labeled data, which guides or regularizes the decision boundary of a student model during training under an offline knowledge distillation scheme. Experiments have shown that the proposed method is capable of a better manifold generalization and representation to up to 40% improvement (Recall@1, CIFAR10), using guidelines suggested by Musgrave et al. to perform a more fair and realistic comparison, which is currently absent in the literature


title: Self-Consistent Description of Vapor-Liquid Interface in Ionic Fluids

abstract: Inhomogeneity of ion correlation widely exists in many physicochemical, soft matter, and biological systems. Here, we apply the modified Gaussian renormalized fluctuation theory to study the classic example of the vapor-liquid interface of ionic fluids. The ion correlation is decomposed into a short-range contribution associated with the local electrostatic environment and a long-range contribution accounting for the spatially varying ionic strength and dielectric permittivity. For symmetric salt, both the coexistence curve and the interfacial tension predicted by our theory are in quantitative agreement with simulation data reported in the literature. Furthermore, we provide the first theoretical prediction of interfacial structure for asymmetric salt, highlighting the importance of capturing local charge separation.


title: A one-sentence elementary proof of the combinatorial Fa\`a di Bruno's formula

abstract: We give a one-sentence elementary proof of the combinatorial Fa\`a di Bruno's formula.


title: A Neural Network Approach for Homogenization of Multiscale Problems

abstract: We propose a neural network-based approach to the homogenization of multiscale problems. The proposed method uses a derivative-free formulation of a training loss, which incorporates Brownian walkers to find the macroscopic description of a multiscale PDE solution. Compared with other network-based approaches for multiscale problems, the proposed method is free from the design of hand-crafted neural network architecture and the cell problem to calculate the homogenization coefficient. The exploration neighborhood of the Brownian walkers affects the overall learning trajectory. We determine the bounds of micro- and macro-time steps that capture the local heterogeneous and global homogeneous solution behaviors, respectively, through a neural network. The bounds imply that the computational cost of the proposed method is independent of the microscale periodic structure for the standard periodic problems. We validate the efficiency and robustness of the proposed method through a suite of linear and nonlinear multiscale problems with periodic and random field coefficients.


title: Scrambling of Algebras in Open Quantum Systems

abstract: Many quantitative approaches to the dynamical scrambling of information in quantum systems involve the study of out-of-time-ordered correlators (OTOCs). In this paper, we introduce an algebraic OTOC ($\mathcal{A}$-OTOC) that allows us to study information scrambling of generalized quantum subsystems under quantum channels. For closed quantum systems, this algebraic framework was recently employed to unify quantum information-theoretic notions of operator entanglement, coherence-generating power, and Loschmidt echo. The main focus of this work is to provide a natural generalization of these techniques to open quantum systems. We first show that, for unitary dynamics, the $\mathcal{A}$-OTOC quantifies a generalized notion of information scrambling, namely between a subalgebra of observables and its commutant. For open quantum systems, on the other hand, we find a competition between the global environmental decoherence and the local scrambling of information. We illustrate this interplay by analytically studying various illustrative examples of algebras and quantum channels. To complement our analytical results, we perform numerical simulations of two paradigmatic systems: the PXP model and the Heisenberg XXX model, under dephasing. Our numerical results reveal connections with many-body scars and the stability of decoherence-free subspaces.

categories: quant-ph cond-mat.dis-nn math-ph math.MP


title: A Control Theoretic Framework for Adaptive Gradient Optimizers in Machine Learning

abstract: Adaptive gradient methods have become popular in optimizing deep neural networks; recent examples include AdaGrad and Adam. Although Adam usually converges faster, variations of Adam, for instance, the AdaBelief algorithm, have been proposed to enhance Adam's poor generalization ability compared to the classical stochastic gradient method. This paper develops a generic framework for adaptive gradient methods that solve non-convex optimization problems. We first model the adaptive gradient methods in a state-space framework, which allows us to present simpler convergence proofs of adaptive optimizers such as AdaGrad, Adam, and AdaBelief. We then utilize the transfer function paradigm from classical control theory to propose a new variant of Adam, coined AdamSSM. We add an appropriate pole-zero pair in the transfer function from squared gradients to the second moment estimate. We prove the convergence of the proposed AdamSSM algorithm. Applications on benchmark machine learning tasks of image classification using CNN architectures and language modeling using LSTM architecture demonstrate that the AdamSSM algorithm improves the gap between generalization accuracy and faster convergence than the recent adaptive gradient methods.


title: Instantaneous gelation and nonexistence for the Oort-Hulst-Safronov coagulation model

abstract: The possible occurrence of instantaneous gelation to Oort-Hulst-Safronov (OHS) coagulation equation is investigated for a certain class of unbounded coagulation kernels. The existence of instantaneous gelation is confirmed by showing the nonexistence of mass-conserving weak solutions. Finally, it is shown that for such kernels, there is no weak solution to the OHS coagulation equation at any time interval.


title: Interpolating Between Softmax Policy Gradient and Neural Replicator Dynamics with Capped Implicit Exploration

abstract: Neural replicator dynamics (NeuRD) is an alternative to the foundational softmax policy gradient (SPG) algorithm motivated by online learning and evolutionary game theory. The NeuRD expected update is designed to be nearly identical to that of SPG, however, we show that the Monte Carlo updates differ in a substantial way: the importance correction accounting for a sampled action is nullified in the SPG update, but not in the NeuRD update. Naturally, this causes the NeuRD update to have higher variance than its SPG counterpart. Building on implicit exploration algorithms in the adversarial bandit setting, we introduce capped implicit exploration (CIX) estimates that allow us to construct NeuRD-CIX, which interpolates between this aspect of NeuRD and SPG. We show how CIX estimates can be used in a black-box reduction to construct bandit algorithms with regret bounds that hold with high probability and the benefits this entails for NeuRD-CIX in sequential decision-making settings. Our analysis reveals a bias--variance tradeoff between SPG and NeuRD, and shows how theory predicts that NeuRD-CIX will perform well more consistently than NeuRD while retaining NeuRD's advantages over SPG in non-stationary environments.


title: Spectrum of the Maxwell Equations for a Flat Interface between Homogeneous Dispersive Media

abstract: The paper determines and classifies the spectrum of a non-self-adjoint operator pencil generated by the time-harmonic Maxwell problem with a nonlinear dependence on the frequency for the case of two homogeneous materials joined at a planar interface. We study spatially one-dimensional and two-dimensional reductions in the whole space $\mathbb{R}$ and $\mathbb{R}^2$. The dependence on the spectral parameter, i.e. the frequency, is in the dielectric function and we make no assumptions on its form. These function values determine the spectral sets. In order to allow also for non-conservative media, the dielectric function is allowed to be complex, yielding a non-self-adjoint problem. The whole spectrum consists of eigenvalues and the essential spectrum, but the various standard types of essential spectra do not coincide in all cases. The main tool for determining the essential spectra are Weyl sequences.


title: Search for direct $CP$ violation in charged charmless $B \to PV$ decays

abstract: Measurements of $CP$ asymmetry in charmless $B\to PV$ decays are presented, where $P$ and $V$ denote a pseudoscalar and a vector meson, respectively. Five different $B\to PV$ decays from four final states, $B^\pm \to \pi^\pm \pi^+ \pi^-$, $B^\pm \to K^\pm \pi^+ \pi^-$, $B^\pm \to K^\pm K^+ K^-$ and $B^\pm \to \pi^\pm K^+ K^-$ are analyzed. The measurements are based on a method that does not require full amplitude analyses, and are performed using proton-proton collision data at a center-of-mass energy of 13 TeV collected by LHCb between 2015 and 2018, corresponding to an integrated luminosity of 5.9 fb$^{-1}$. In the $\pi^+ \pi^-$ $\textit{P}$-wave, in the region dominated by the $B^\pm \to \rho(770)^0 K^\pm$ decay, a $CP$ asymmetry of $\mbox{$A_{CP}$ = +0.150 $\pm$ 0.019 $\pm$ 0.011}$ is measured, where the first uncertainty is statistical and the second is systematic. This is the first observation of $CP$ violation in this process. For the other four decay channels, in regions dominated by the $B^\pm \to \rho(770)^0 \pi^\pm$, $B^\pm \to \overset{(-)}{K^*}(892)^0 \pi^\pm$, $B^\pm \to \overset{(-)}{K^*}(892)^0 K^\pm$ and $B^\pm \to \phi(1020) K^\pm$ decays, $CP$ asymmetries in the $\textit{P}$-wave compatible with zero are measured.


title: Beyond Value: CHECKLIST for Testing Inferences in Planning-Based RL

abstract: Reinforcement learning (RL) agents are commonly evaluated via their expected value over a distribution of test scenarios. Unfortunately, this evaluation approach provides limited evidence for post-deployment generalization beyond the test distribution. In this paper, we address this limitation by extending the recent CheckList testing methodology from natural language processing to planning-based RL. Specifically, we consider testing RL agents that make decisions via online tree search using a learned transition model and value function. The key idea is to improve the assessment of future performance via a CheckList approach for exploring and assessing the agent's inferences during tree search. The approach provides the user with an interface and general query-rule mechanism for identifying potential inference flaws and validating expected inference invariances. We present a user study involving knowledgeable AI researchers using the approach to evaluate an agent trained to play a complex real-time strategy game. The results show the approach is effective in allowing users to identify previously-unknown flaws in the agent's reasoning. In addition, our analysis provides insight into how AI experts use this type of testing approach, which may help improve future instantiations.


title: MetaNOR: A Meta-Learnt Nonlocal Operator Regression Approach for Metamaterial Modeling

abstract: We propose MetaNOR, a meta-learnt approach for transfer-learning operators based on the nonlocal operator regression. The overall goal is to efficiently provide surrogate models for new and unknown material-learning tasks with different microstructures. The algorithm consists of two phases: (1) learning a common nonlocal kernel representation from existing tasks; (2) transferring the learned knowledge and rapidly learning surrogate operators for unseen tasks with a different material, where only a few test samples are required. We apply MetaNOR to model the wave propagation within 1D metamaterials, showing substantial improvements on the sampling efficiency for new materials.


title: First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spaces

abstract: From optimal transport to robust dimensionality reduction, a plethora of machine learning applications can be cast into the min-max optimization problems over Riemannian manifolds. Though many min-max algorithms have been analyzed in the Euclidean setting, it has proved elusive to translate these results to the Riemannian case. Zhang et al. [2022] have recently shown that geodesic convex concave Riemannian problems always admit saddle-point solutions. Inspired by this result, we study whether a performance gap between Riemannian and optimal Euclidean space convex-concave algorithms is necessary. We answer this question in the negative-we prove that the Riemannian corrected extragradient (RCEG) method achieves last-iterate convergence at a linear rate in the geodesically strongly-convex-concave case, matching the Euclidean result. Our results also extend to the stochastic or non-smooth case where RCEG and Riemanian gradient ascent descent (RGDA) achieve near-optimal convergence rates up to factors depending on curvature of the manifold.


title: Developing hierarchical anticipations via neural network-based event segmentation

abstract: Humans can make predictions on various time scales and hierarchical levels. Thereby, the learning of event encodings seems to play a crucial role. In this work we model the development of hierarchical predictions via autonomously learned latent event codes. We present a hierarchical recurrent neural network architecture, whose inductive learning biases foster the development of sparsely changing latent state that compress sensorimotor sequences. A higher level network learns to predict the situations in which the latent states tend to change. Using a simulated robotic manipulator, we demonstrate that the system (i) learns latent states that accurately reflect the event structure of the data, (ii) develops meaningful temporal abstract predictions on the higher level, and (iii) generates goal-anticipatory behavior similar to gaze behavior found in eye-tracking studies with infants. The architecture offers a step towards the autonomous learning of compressed hierarchical encodings of gathered experiences and the exploitation of these encodings to generate adaptive behavior.


title: UAV-Aided Multi-Community Federated Learning

abstract: In this work, we investigate the problem of an online trajectory design for an Unmanned Aerial Vehicle (UAV) in a Federated Learning (FL) setting where several different communities exist, each defined by a unique task to be learned. In this setting, spatially distributed devices belonging to each community collaboratively contribute towards training their community model via wireless links provided by the UAV. Accordingly, the UAV acts as a mobile orchestrator coordinating the transmissions and the learning schedule among the devices in each community, intending to accelerate the learning process of all tasks. We propose a heuristic metric as a proxy for the training performance of the different tasks. Capitalizing on this metric, a surrogate objective is defined which enables us to jointly optimize the UAV trajectory and the scheduling of the devices by employing convex optimization techniques and graph theory. The simulations illustrate the out-performance of our solution when compared to other handpicked static and mobile UAV deployment baselines.


title: Clique Polynomials and Chordal Graphs

abstract: The ordinary generating function of the number of complete subgraphs of $G$ is called a clique polynomial of $G$ and is denoted by $C(G,x)$. A real root of $C(G,x)$ is called a clique root of the graph $G$. Hajiabolhasan and Mehrabadi showed that the clique polynomial has always a real root in the interval $[-1,0)$. Moreover, they showed that the class of triangle-free graphs has only clique roots. Here, we generalize their result by showing that the class of $K_4$-free chordal graphs has also only clique roots. Moreover, we show that this class has always a clique root $-1$. We finally conclude the paper with several important questions and conjectures.


title: Bilinear character correlators in superintegrable theory

abstract: We continue investigating the superintegrability property of matrix models, i.e. factorization of the matrix model averages of characters. This paper focuses on the Gaussian Hermitian example, where the role of characters is played by the Schur functions. We find a new intriguing corollary of superintegrability: factorization of an infinite set of correlators bilinear in the Schur functions. More exactly, these are correlators of products of the Schur functions and polynomials $K_\Delta$ that form a complete basis in the space of invariant matrix polynomials. Factorization of these correlators with a small subset of these $K_\Delta$ follow from the fact that the Schur functions are eigenfunctions of the generalized cut-an-join operators, but the full set of $K_\Delta$ is generated by another infinite commutative set of operators, which we manifestly describe.


title: Peculiar thermal states in the first-order thermodynamics of gravity

abstract: In the context of the recently proposed first-order thermodynamics of scalar-tensor gravity, we discuss the possibility of zero-temperature states of equilibrium other than Einstein gravity, including pathological Brans-Dicke theory, Palatini $f(R)$ gravity, and cuscuton gravity, all with non-dynamical scalar fields. The formalism is extended to Nordstr\"om gravity, which contains only a scalar degree of freedom and has negative temperature relative to general relativity.


title: On the Generalization Power of the Overfitted Three-Layer Neural Tangent Kernel Model

abstract: In this paper, we study the generalization performance of overparameterized 3-layer NTK models. We show that, for a specific set of ground-truth functions (which we refer to as the "learnable set"), the test error of the overfitted 3-layer NTK is upper bounded by an expression that decreases with the number of neurons of the two hidden layers. Different from 2-layer NTK where there exists only one hidden-layer, the 3-layer NTK involves interactions between two hidden-layers. Our upper bound reveals that, between the two hidden-layers, the test error descends faster with respect to the number of neurons in the second hidden-layer (the one closer to the output) than with respect to that in the first hidden-layer (the one closer to the input). We also show that the learnable set of 3-layer NTK without bias is no smaller than that of 2-layer NTK models with various choices of bias in the neurons. However, in terms of the actual generalization performance, our results suggest that 3-layer NTK is much less sensitive to the choices of bias than 2-layer NTK, especially when the input dimension is large.


title: Quantization of (-1)-Shifted Derived Poisson Manifolds

abstract: We investigate the quantization problem of $(-1)$-shifted derived Poisson manifolds in terms of $\BV_\infty$-operators on the space of Berezinian half-densities. We prove that quantizing such a $(-1)$-shifted derived Poisson manifold is equivalent to the lifting of a consecutive sequences of Maurer-Cartan elements of short exact sequences of differential graded Lie algebras, where the obstruction is a certain class in the second Poisson cohomology. Consequently, a $(-1)$-shifted derived Poisson manifold is quantizable if the second Poisson cohomology group vanishes. We also prove that for any $\L$-algebroid $\Cc{\aV}$, its corresponding linear $(-1)$-shifted derived Poisson manifold $\Cc{\aV}^\vee[-1]$ admits a canonical quantization. Finally, given a Lie algebroid $A$ and a one-cocycle $s\in \sections{A^\vee}$, the $(-1)$-shifted derived Poisson manifold corresponding to the derived intersection of coisotropic submanifolds determined by the graph of $s$ and the zero section of the Lie Poisson $A^\vee$ is shown to admit a canonical quantization in terms of Evens-Lu-Weinstein module.


title: Exponentially small quantum correction to conductance

abstract: When time-reversal symmetry is broken, the average conductance through a chaotic cavity, from an entrance lead with $N_1$ open channels to an exit lead with $N_2$ open channels, is given by $N_1N_2/M$, where $M=N_1+N_2$. We show that, when tunnel barriers of reflectivity $\gamma$ are placed on the leads, two correction terms appear in the average conductance, and that one of them is proportional to $\gamma^{M}$. Since $M\sim \hbar^{-1}$, this correction is exponentially small in the semiclassical limit. Surprisingly, we derive this term from a semiclassical approximation, generally expected to give only leading orders in powers of $\hbar$. Even though the theory is built perturbatively both in $\gamma$ and in $1/M$, the final result is exact.


title: Learning Speaker-specific Lip-to-Speech Generation

abstract: Understanding the lip movement and inferring the speech from it is notoriously difficult for the common person. The task of accurate lip-reading gets help from various cues of the speaker and its contextual or environmental setting. Every speaker has a different accent and speaking style, which can be inferred from their visual and speech features. This work aims to understand the correlation/mapping between speech and the sequence of lip movement of individual speakers in an unconstrained and large vocabulary. We model the frame sequence as a prior to the transformer in an auto-encoder setting and learned a joint embedding that exploits temporal properties of both audio and video. We learn temporal synchronization using deep metric learning, which guides the decoder to generate speech in sync with input lip movements. The predictive posterior thus gives us the generated speech in speaker speaking style. We have trained our model on the Grid and Lip2Wav Chemistry lecture dataset to evaluate single speaker natural speech generation tasks from lip movement in an unconstrained natural setting. Extensive evaluation using various qualitative and quantitative metrics with human evaluation also shows that our method outperforms the Lip2Wav Chemistry dataset(large vocabulary in an unconstrained setting) by a good margin across almost all evaluation metrics and marginally outperforms the state-of-the-art on GRID dataset.


title: Fast and Accurate Error Simulation for CNNs against Soft Errors

abstract: The great quest for adopting AI-based computation for safety-/mission-critical applications motivates the interest towards methods for assessing the robustness of the application w.r.t. not only its training/tuning but also errors due to faults, in particular soft errors, affecting the underlying hardware. Two strategies exist: architecture-level fault injection and application-level functional error simulation. We present a framework for the reliability analysis of Convolutional Neural Networks (CNNs) via an error simulation engine that exploits a set of validated error models extracted from a detailed fault injection campaign. These error models are defined based on the corruption patterns of the output of the CNN operators induced by faults and bridge the gap between fault injection and error simulation, exploiting the advantages of both approaches. We compared our methodology against SASSIFI for the accuracy of functional error simulation w.r.t. fault injection, and against TensorFI in terms of speedup for the error simulation strategy. Experimental results show that our methodology achieves about 99\% accuracy of the fault effects w.r.t. SASSIFI, and a speedup ranging from 44x up to 63x w.r.t. TensorFI, that only implements a limited set of error models.


title: Radiation backreaction in axion electrodynamics

abstract: Energy-momentum conservation of classical axion-electrodynamics is carefully analyzed in the Hamiltonian formulation of the theory. The term responsible for the energy transfer between the electromagnetic and the axion sectors is identified. As a special application the axion-to-light Primakoff-process in the background of a static magnetic field is worked out and the radiative self-damping of the axion oscillations is characterized quantitatively. The damping time turns out comparable to the age of the Universe in the preferred axion mass range.


title: Black holes, fast scrambling and the breakdown of the equivalence principle

abstract: Black holes are conjectured to be the fastest quantum scramblers in nature, with the stretched horizon being the scrambling boundary. Under this assumption, we show that any infalling body must couple to virtually the entire black hole Hilbert space even prior to the Page time in order for there to be any hope of preserving the often-cited claim of the equivalence principle that such bodies should experience `no drama' as they pass a black hole's horizon. Further, under the scrambling assumption, we recover the usual firewall result at the black hole's Page time for an initially pure-state black hole without the need for any complexity or computational assumptions. For a black hole that is initially impure, we find that the onset of the firewall is advanced to times prior to the standard Page time. Finally, if black holes really do efficiently scramble quantum information, this suggests that, in order to preserve this claim of the equivalence principle even prior to the onset of a full-blown firewall, the quantum state of a black hole interior must be a Bose-Einstein condensate.


title: Searching for High-Energy Neutrino Emission from Galaxy Clusters with IceCube

abstract: Galaxy clusters have the potential to accelerate cosmic rays (CRs) to ultra-high energies via accretion shocks or embedded CR acceleration sites. CRs with energies below the Hillas condition will be confined within the cluster and will eventually interact with the intracluster medium (ICM) gas to produce secondary neutrinos and $\gamma$ rays. Using 9.5 years of muon-neutrino track events from the IceCube Neutrino Observatory, we report the results of a stacking analysis of 1094 galaxy clusters, with masses $\gtrsim 10^{14}$ \(\textup{M}_\odot\) and redshifts between 0.01 and $\sim$1, detected by the {\it Planck} mission via the Sunyaev-Zeldovich (SZ) effect. We find no evidence for significant neutrino emission and report upper limits on the cumulative unresolved neutrino flux from massive galaxy clusters after accounting for the completeness of the catalog up to a redshift of 2, assuming three different weighting scenarios for the stacking and three different power-law spectra. Weighting the sources according to mass and distance, we set upper limits at $90\%$ confidence level that constrain the flux of neutrinos from massive galaxy clusters ($\gtrsim 10^{14}$ \(\textup{M}_\odot\)) to be no more than $4.6\%$ of the diffuse IceCube observations at 100~TeV, assuming an unbroken $E^{-2.5}$ power-law spectrum.


title: How to recognize the universal aspects of Mott criticality?

abstract: In this paper we critically discuss several examples of two-dimensional electronic systems displaying interaction-driven metal-insulator transitions of the Mott (or Wigner--Mott) type, including dilute two-dimension electron gases (2DEG) in semiconductors, Mott organic materials, as well as the recently discovered transition-metal dichalcogenide (TMD) moir\'e bilayers. Remarkably similar behavior is found in all these systems, which is starting to paint a robust picture of Mott criticality. Most notable, on the metallic side a resistivity maximum is observed whose temperature scale vanishes at the transition. We compare the available experimental data on these systems to three existing theoretical scenarios: spinon theory, Dynamical Mean Field Theory (DMFT) and percolation theory. We show that the DMFT and percolation pictures for Mott criticality can be distinguished by studying the origins of the resistivity maxima using an analysis of the dielectric response.


title: Interpretable Models Capable of Handling Systematic Missingness in Imbalanced Classes and Heterogeneous Datasets

abstract: Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among application domain experts. Medical datasets face common issues such as heterogeneous measurements, imbalanced classes with limited sample size, and missing data, which hinder the straightforward application of machine learning techniques. In this paper we present a family of prototype-based (PB) interpretable models which are capable of handling these issues. The models introduced in this contribution show comparable or superior performance to alternative techniques applicable in such situations. However, unlike ensemble based models, which have to compromise on easy interpretation, the PB models here do not. Moreover we propose a strategy of harnessing the power of ensembles while maintaining the intrinsic interpretability of the PB models, by averaging the model parameter manifolds. All the models were evaluated on a synthetic (publicly available dataset) in addition to detailed analyses of two real-world medical datasets (one publicly available). Results indicated that the models and strategies we introduced addressed the challenges of real-world medical data, while remaining computationally inexpensive and transparent, as well as similar or superior in performance compared to their alternatives.