title: Dynamic Meta-theorems for Distance and Matching

abstract: Reachability, distance, and matching are some of the most fundamental graph problems that have been of particular interest in dynamic complexity theory in recent years [DKMSZ18, DMVZ18, DKMTVZ20]. Reachability can be maintained with first-order update formulas, or equivalently in DynFO in general graphs with n nodes [DKMSZ18], even under O(log n/loglog n) changes per step [DMVZ18]. In the context of how large the number of changes can be handled, it has recently been shown [DKMTVZ20] that under a polylogarithmic number of changes, reachability is in DynFOpar in planar, bounded treewidth, and related graph classes -- in fact in any graph where small non-zero circulation weights can be computed in NC. We continue this line of investigation and extend the meta-theorem for reachability to distance and bipartite maximum matching with the same bounds. These are amongst the most general classes of graphs known where we can maintain these problems deterministically without using a majority quantifier and even maintain witnesses. For the bipartite matching result, modifying the approach from [FGT], we convert the static non-zero circulation weights to dynamic matching-isolating weights. While reachability is in DynFOar under O(log n/loglog n) changes, no such bound is known for either distance or matching in any non-trivial class of graphs under non-constant changes. We show that, in the same classes of graphs as before, bipartite maximum matching is in DynFOar under O(log n/loglog n) changes per step. En route to showing this we prove that the rank of a matrix can be maintained in DynFOar, also under O(log n/loglog n) entry changes, improving upon the previous O(1) bound [DKMSZ18]. This implies similar extension for the non-uniform DynFO bound for maximum matching in general graphs and an alternate algorithm for maintaining reachability under O(log n/loglog n) changes [DMVZ18].


title: Attentive Neural Controlled Differential Equations for Time-series Classification and Forecasting

abstract: Neural networks inspired by differential equations have proliferated for the past several years. Neural ordinary differential equations (NODEs) and neural controlled differential equations (NCDEs) are two representative examples of them. In theory, NCDEs provide better representation learning capability for time-series data than NODEs. In particular, it is known that NCDEs are suitable for processing irregular time-series data. Whereas NODEs have been successfully extended after adopting attention, however, it had not been studied yet how to integrate attention into NCDEs. To this end, we present the method of Attentive Neural Controlled Differential Equations (ANCDEs) for time-series classification and forecasting, where dual NCDEs are used: one for generating attention values, and the other for evolving hidden vectors for a downstream machine learning task. We conduct experiments with three real-world time-series datasets and 10 baselines. After dropping some values, we also conduct irregular time-series experiments. Our method consistently shows the best accuracy in all cases by non-trivial margins. Our visualizations also show that the presented attention mechanism works as intended by focusing on crucial information.


title: Multi-State Formulation of the Frozen-Density Embedding Quasi-Diabatization Approach

abstract: We present a multi-state implementation of the recently developed FDE-diab methodology [J. Chem. Phys., 148 (2018), 214104] in the Serenity program. The new framework extends the original approach such that any number of charge-localized quasi-diabatic states can be coupled, giving an access to calculations of ground and excited state spin-density distributions as well as to excitation energies. We show that it is possible to obtain results similar to those from correlated wave function approaches such as the complete active space self-consistent field method at much lower computational effort. Additionally, we present a series of approximate computational schemes, which further decrease the overall computational cost and systematically converge to the full FDE-diab solution. The proposed methodology enables computational studies on spin-density distributions and related properties for large molecular systems of biochemical interest.


title: Robust Mitosis Detection Using a Cascade Mask-RCNN Approach With Domain-Specific Residual Cycle-GAN Data Augmentation

abstract: For the MIDOG mitosis detection challenge, we created a cascade algorithm consisting of a Mask-RCNN detector, followed by a classification ensemble consisting of ResNet50 and DenseNet201 to refine detected mitotic candidates. The MIDOG training data consists of 200 frames originating from four scanners, three of which are annotated for mitotic instances with centroid annotations. Our main algorithmic choices are as follows: first, to enhance the generalizability of our detector and classification networks, we use a state-of-the-art residual Cycle-GAN to transform each scanner domain to every other scanner domain. During training, we then randomly load, for each image, one of the four domains. In this way, our networks can learn from the fourth non-annotated scanner domain even if we don't have annotations for it. Second, for training the detector network, rather than using centroid-based fixed-size bounding boxes, we create mitosis-specific bounding boxes. We do this by manually annotating a small selection of mitoses, training a Mask-RCNN on this small dataset, and applying it to the rest of the data to obtain full annotations. We trained the follow-up classification ensemble using only the challenge-provided positive and hard-negative examples. On the preliminary test set, the algorithm scores an F1 score of 0.7578, putting us as the second-place team on the leaderboard.


title: Moving Object Detection for Event-based Vision using k-means Clustering

abstract: Moving object detection is important in computer vision. Event-based cameras are bio-inspired cameras that work by mimicking the working of the human eye. These cameras have multiple advantages over conventional frame-based cameras, like reduced latency, HDR, reduced motion blur during high motion, low power consumption, etc. In spite of these advantages, event-based cameras are noise-sensitive and have low resolution. Moreover, the task of moving object detection in these cameras is difficult, as event-based sensors lack useful visual features like texture and color. In this paper, we investigate the application of the k-means clustering technique in detecting moving objects in event-based data.


title: Deep learning facilitates fully automated brain image registration of optoacoustic tomography and magnetic resonance imaging

abstract: Multi-spectral optoacoustic tomography (MSOT) is an emerging optical imaging method providing multiplex molecular and functional information from the rodent brain. It can be greatly augmented by magnetic resonance imaging (MRI) that offers excellent soft-tissue contrast and high-resolution brain anatomy. Nevertheless, registration of multi-modal images remains challenging, chiefly due to the entirely different image contrast rendered by these modalities. Previously reported registration algorithms mostly relied on manual user-dependent brain segmentation, which compromised data interpretation and accurate quantification. Here we propose a fully automated registration method for MSOT-MRI multimodal imaging empowered by deep learning. The automated workflow includes neural network-based image segmentation to generate suitable masks, which are subsequently registered using an additional neural network. Performance of the algorithm is showcased with datasets acquired by cross-sectional MSOT and high-field MRI preclinical scanners. The automated registration method is further validated with manual and half-automated registration, demonstrating its robustness and accuracy.


title: A Bayesian semi-parametric approach for modeling memory decay in dynamic social networks

abstract: In relational event networks, the tendency for actors to interact with each other depends greatly on the past interactions between the actors in a social network. Both the quantity of past interactions and the time that elapsed since the past interactions occurred affect the actors' decision-making to interact with other actors in the network. Recently occurred events generally have a stronger influence on current interaction behavior than past events that occurred a long time ago--a phenomenon known as "memory decay". Previous studies either predefined a short-run and long-run memory or fixed a parametric exponential memory using a predefined half-life period. In real-life relational event networks however it is generally unknown how the memory of actors about the past events fades as time goes by. For this reason it is not recommendable to fix this in an ad hoc manner, but instead we should learn the shape of memory decay from the observed data. In this paper, a novel semi-parametric approach based on Bayesian Model Averaging is proposed for learning the shape of the memory decay without requiring any parametric assumptions. The method is applied to relational event history data among socio-political actors in India.


title: The structure of connected (graded) Hopf algebras revisited

abstract: Let $H$ be a connected graded Hopf algebra over a field of characteristic zero and $K$ an arbitrary graded Hopf subalgebra of $H$. We show that there is a family of homogeneous elements of $H$ and a total order on the index set that satisfy several desirable conditions, which reveal some interesting connections between $H$ and $K$. As one of its consequences, we see that $H$ is a graded iterated Hopf Ore extension of $K$ of derivation type provided that $H$ is of finite Gelfand-Kirillov dimension. The main tool of this work is Lyndon words, along the idea developed by Lu, Shen and the second-named author in [24].


title: The fragility-constrained vehicle routing problem with time windows

abstract: We study a new variant of the well-studied Vehicle Routing Problem with Time Windows (VRPTW), called the fragility-constrained VRPTW, which assumes that 1) the capacity of a vehicle is organized in multiple identical stacks; 2) all items picked up at a customer are either "fragile" or not; 3) no non-fragile items can be put on top of a fragile item (the fragility constraint) ; and 4) no en-route load rearrangement is possible. We first characterize the feasibility of a route with respect to this fragility constraint. Then, to solve this new problem, we develop an exact branch-price-and-cut (BPC) algorithm that includes a labeling algorithm exploiting this feasibility characterization to efficiently generate feasible routes. This algorithm is benchmarked against another BPC algorithm that deals with the fragility constraint in the column generation master problem through infeasible path cuts. Our computational results show that the former BPC algorithm clearly outperforms the latter in terms of computational time and that the fragility constraint has a greater impact on the optimal solution cost (compared to that of the VRPTW) when vehicle capacity decreases, stack height increases and for a more balance mix of customers with fragile and non-fragile items.


title: Numerical calculation of extremal Steklov eigenvalues in 3D and 4D

abstract: We develop a numerical method for solving shape optimization of functionals involving Steklov eigenvalues and apply it to the problem of maximization of the $k$-th Steklov eigenvalue, under volume constraint. A similar study in the planar case was addressed in [E. Akhmetgaliyev, C.-Y. Kao and B. Osting, SIAM J. Control Optim. 55(2), 1226-1240, (2017)] using the boundary integral equation method. Here we extend that study to the 3D and 4D cases, using the Method of Fundamental Solutions as forward solver.


title: Incentives for Collective Innovation

abstract: Agents exert hidden effort to produce randomly-sized innovations in a technology they share. Returns from using the technology grow as it develops, but so does the opportunity cost of effort, due to an 'exploration-exploitation' trade-off. As monitoring is imperfect, there exists a unique (strongly) symmetric equilibrium, and effort in any equilibrium ceases no later than in the single-agent problem. Small innovations may hurt all agents in the symmetric equilibrium, as they severely reduce effort. Allowing agents to discard innovations increases effort and payoffs, preserving uniqueness. Under natural conditions, payoffs rise above those of all equilibria with forced disclosure.


title: A well conditioned Method of Fundamental Solutions

abstract: The method of fundamental solutions (MFS) is a numerical method for solving boundary value problems involving linear partial differential equations. It is well known that it can be very effective assuming regularity of the domain and boundary conditions. The main drawback of the MFS is that the matrices involved typically are ill-conditioned and this may prevent to achieve high accuracy. In this work, we propose a new algorithm to remove the ill conditioning of the classical MFS in the context of Laplace equation defined in planar domains. The main idea is to expand the MFS basis functions in terms of harmonic polynomials. Then, using the singular value decomposition and Arnoldi orthogonalization we define well conditioned basis functions spanning the same functional space as the MFS's. Several numerical examples show that this approach is much superior to previous approaches, such as the classical MFS or the MFS-QR.


title: Weakly supervised semantic segmentation of tomographic images in the diagnosis of stroke

abstract: This paper presents an automatic algorithm for the segmentation of areas affected by an acute stroke on the non-contrast computed tomography brain images. The proposed algorithm is designed for learning in a weakly supervised scenario when some images are labeled accurately, and some images are labeled inaccurately. Wrong labels appear as a result of inaccuracy made by a radiologist in the process of manual annotation of computed tomography images. We propose methods for solving the segmentation problem in the case of inaccurately labeled training data. We use the U-Net neural network architecture with several modifications. Experiments on real computed tomography scans show that the proposed methods increase the segmentation accuracy.


title: Quantum master equations and steady states for the ultrastrong-coupling limit and the strong-decoherence limit

abstract: In the framework of theory of open quantum systems, we derive quantum master equations for the ultrastrong system-bath coupling regime and, more generally, the strong-decoherence regime. In this regime, the strong decoherence is complemented by slow relaxation processes. We use a generalization of the Foerster and modified Redfield peturbation theories known in theory of excitation energy transfer. Also, we show that the mean force Gibbs state in the corresponding limits are stationary for the derived master equations.


title: Fast Image-Anomaly Mitigation for Autonomous Mobile Robots

abstract: Camera anomalies like rain or dust can severelydegrade image quality and its related tasks, such as localizationand segmentation. In this work we address this importantissue by implementing a pre-processing step that can effectivelymitigate such artifacts in a real-time fashion, thus supportingthe deployment of autonomous systems with limited computecapabilities. We propose a shallow generator with aggregation,trained in an adversarial setting to solve the ill-posed problemof reconstructing the occluded regions. We add an enhancer tofurther preserve high-frequency details and image colorization.We also produce one of the largest publicly available datasets1to train our architecture and use realistic synthetic raindrops toobtain an improved initialization of the model. We benchmarkour framework on existing datasets and on our own imagesobtaining state-of-the-art results while enabling real-time per-formance, with up to 40x faster inference time than existingapproaches.


title: Spectra of Higher Spin Operators on the Sphere

abstract: We present explicit formulas for the spectra of higher spin operators on the subbundle of the bundle of spinor-valued trace free symmetric tensors that are annihilated by the Clifford multiplication over the standard sphere in odd dimension. In even dimensional case, we give the spectra of the square of such operators. The Dirac and Rarita-Schwinger operators are zero-form and one-form cases, respectively. We also give eigenvalue formulas for the conformally invariant differential operators of all odd orders on the subbundle of the bundle of spinor-valued forms that are annihilated by the Clifford multiplication in both even and odd dimensions on the sphere.


title: Bulk band structure of Sb$_2$Te$_3$ determined by angle-resolved photoemission spectroscopy

abstract: The bulk band structure of the topological insulator \sbte~ is investigated by angle-resolved photoemission spectroscopy. Of particular interest is the dispersion of the uppermost valence band with respect to the topological surface state Dirac point. The valence band maximum has been calculated to be either near the Brillouin zone centre or in a low-symmetry position in the $\bar{\Gamma}-\bar{M}$ azimuthal direction. In order to observe the full energy range of the valence band, the strongly p-doped crystals are counter-doped by surface alkali adsorption. The data show that that the absolute valence band maximum is likely to be found at the bulk $\Gamma$ point and predictions of a low-symmetry position with an energy higher than the surface Dirac point can be ruled out.


title: Fast Succinct Retrieval and Approximate Membership using Ribbon

abstract: A retrieval data structure for a static function $f:S\rightarrow \{0,1\}^r$ supports queries that return $f(x)$ for any $x \in S$. Retrieval data structures can be used to implement a static approximate membership query data structure (AMQ), i.e., a Bloom filter alternative, with false positive rate $2^{-r}$. The information-theoretic lower bound for both tasks is $r|S|$ bits. While succinct theoretical constructions using $(1+o(1))r|S|$ bits were known, these could not achieve very small overheads in practice because they have an unfavorable space--time tradeoff hidden in the asymptotic costs or because small overheads would only be reached for physically impossible input sizes. With bumped ribbon retrieval (BuRR), we present the first practical succinct retrieval data structure. In an extensive experimental evaluation BuRR achieves space overheads well below 1\,\% while being faster than most previously used retrieval data structures (typically with space overheads at least an order of magnitude larger) and faster than classical Bloom filters (with space overhead $\geq 44\,\%$). This efficiency, including favorable constants, stems from a combination of simplicity, word parallelism, and high locality. We additionally describe homogeneous ribbon filter AMQs, which are even simpler and faster at the price of slightly larger space overhead.


title: Silicon diphosphide (SiP2) and silicon diarsenide (SiAs2): Novel stable 2D semiconductors with high carrier mobilities, promising for water splitting photocatalysts

abstract: Two dimensional (2D) semiconducting light absorbers, have recently considered as promising components to improve the efficiency in the photocatalytic hydrogen production via water splitting. In this work, by employing density functional theory computations, we introduced novel SiX2 (X = P, As) nanosheets in tetragonal (penta-) and orthorhombic (rec-) phases, as promising light absorber semiconductors for overall water splitting. The predicted nanomembranes exhibit good mechanical, dynamical and thermal stabilities. They also show small cleavage energies in the range of 0.31 J/m2 to 0.39 J/m2, comparable to that of the graphene and thus suggesting the feasibility of their experimental exfoliation. Notably, predicted monolayers are semiconductors with indirect band gaps of 2.65 eV for penta-SiP2, 2.35 eV for penta-SiAs2, 1.89 eV for rec-SiAs2, and a direct band gap of 2.21 eV for rec-SiP2. These nanomaterials however show relatively large interlayer quantum confinement effects, resulting in smaller band gap values for bilayer lattices. We observed a huge difference between the electron and hole mobilities for penta-SiP2 and rec-SiAs2 monolayers and highly directional dependent electron and hole mobilities in rec-SiP2, yielding an effective separation of photogenerated charge carriers. Remarkably, these novel nanomembranes show strong absorption in the visible region of light as well as suitable band edge positions for photocatalytic water splitting reaction, specifically under neutral conditions.


title: Integrated community occupancy models: A framework to assess occurrence and biodiversity dynamics using multiple data sources

abstract: The occurrence and distributions of wildlife populations and communities are shifting as a result of global changes. To evaluate whether these shifts are negatively impacting biodiversity processes, it is critical to monitor the status, trends, and effects of environmental variables on entire communities. However, modeling the dynamics of multiple species simultaneously can require large amounts of diverse data, and few modeling approaches exist to simultaneously provide species and community level inferences. We present an "integrated community occupancy model" (ICOM) that unites principles of data integration and hierarchical community modeling in a single framework to provide inferences on species-specific and community occurrence dynamics using multiple data sources. We use simulations to compare the ICOM to previously developed hierarchical community occupancy models and single species integrated distribution models. We then apply our model to assess the occurrence and biodiversity dynamics of foliage-gleaning birds in the White Mountain National Forest in the northeastern USA from 2010-2018 using three independent data sources. Simulations reveal that integrating multiple data sources in the ICOM increased precision and accuracy of species and community level inferences compared to single data source models, although benefits of integration were dependent on data source quality (e.g., amount of replication). Compared to single species models, the ICOM yielded more precise species-level estimates. Within our case study, the ICOM had the highest out-of-sample predictive performance compared to single species models and models that used only a subset of the three data sources. The ICOM offers an attractive approach to estimate species and biodiversity dynamics, which is additionally valuable to inform management objectives of both individual species and their broader communities.


title: Ephemeral Islands, Plunging Quantum Extremal Surfaces and BCFT channels

abstract: We consider entanglement entropies of finite spatial intervals in Minkowski radiation baths coupled to the eternal black hole in JT gravity, and the related problem involving free fermion BCFT in the thermofield double state. We show that the non-monotonic entropy evolution in the black hole problem precisely matches that of the free fermion theory in a high temperature limit, and the results have the form expected for CFTs with quasiparticle description. Both exhibit rich behaviour that involves at intermediate times, an entropy saddle with an island in the former case, and in the latter a special class of disconnected OPE channels. The quantum extremal surfaces start inside the horizon, but can emerge from and plunge back inside as time evolves, accompanied by a characteristic dip in the entropy also seen in the free fermion BCFT. Finally an entropy equilibrium is reached with a no-island saddle.


title: GamePlan: Game-Theoretic Multi-Agent Planning with Human Drivers at Intersections, Roundabouts, and Merging

abstract: We present a new method for multi-agent planning involving human drivers and autonomous vehicles (AVs) in unsignaled intersections, roundabouts, and during merging. In multi-agent planning, the main challenge is to predict the actions of other agents, especially human drivers, as their intentions are hidden from other agents. Our algorithm uses game theory to develop a new auction, called GamePlan, that directly determines the optimal action for each agent based on their driving style (which is observable via commonly available sensors). GamePlan assigns a higher priority to more aggressive or impatient drivers and a lower priority to more conservative or patient drivers; we theoretically prove that such an approach is game-theoretically optimal prevents collisions and deadlocks. We compare our approach with prior state-of-the-art auction techniques including economic auctions, time-based auctions (first-in first-out), and random bidding and show that each of these methods result in collisions among agents when taking into account driver behavior. We compare with methods based on DRL, deep learning, and game theory and present our benefits over these approaches. Finally, we show that our approach can be implemented in the real-world with human drivers.


title: Random-batch method for multi-species stochastic interacting particle systems

abstract: A random-batch method for multi-species interacting particle systems is proposed, extending the method of S. Jin, L. Li, and J.-G. Liu [J. Comput. Phys. 400 (2020), 108877]. The idea of the algorithmus is to randomly divide, at each time step, the ensemble of particles into small batches and then to evolve the interaction of each particle within the batches until the next time step. This reduces the computational cost by one order of magnitude, while keeping a certain accuracy. It is proved that the $L^2$ error of the error process behaves like the square root of the time step size, uniformly in time, thus providing the convergence of the scheme. The numerical efficiency is tested for some examples, and numerical simulations of the opinion dynamics in a hierarchical company, consisting of workers, managers, and CEOs, are presented.


title: Confidence Distribution and Distribution Estimation for Modern Statistical Inference

abstract: This paper introduces to readers the new concept and methodology of confidence distribution and the modern-day distributional inference in statistics. This discussion should be of interest to people who would like to go into the depth of the statistical inference methodology and to utilize distribution estimators in practice. We also include in the discussion the topic of generalized fiducial inference, a special type of modern distributional inference, and relate it to the concept of confidence distribution. Several real data examples are also provided for practitioners. We hope that the selected content covers the greater part of the developments on this subject.


title: On the local well-posedness for the relativistic Euler equations for a liquid body

abstract: We prove a local existence theorem for the free boundary problem for a relativistic fluid in a fixed spacetime. Our proof involves an a priori estimate which only requires control of derivatives tangential to the boundary, which holds also in the Newtonian compressible case.


title: Uncovering the Limits of Text-based Emotion Detection

abstract: Identifying emotions from text is crucial for a variety of real world tasks. We consider the two largest now-available corpora for emotion classification: GoEmotions, with 58k messages labelled by readers, and Vent, with 33M writer-labelled messages. We design a benchmark and evaluate several feature spaces and learning algorithms, including two simple yet novel models on top of BERT that outperform previous strong baselines on GoEmotions. Through an experiment with human participants, we also analyze the differences between how writers express emotions and how readers perceive them. Our results suggest that emotions expressed by writers are harder to identify than emotions that readers perceive. We share a public web interface for researchers to explore our models.


title: The anatomy of Boris type solvers and the Lie operator formalism for deriving large time-step magnetic field integrators

abstract: This work gives a Lie operator derivation of various Boris solvers via a detailed study of trajectory errors in a constant magnetic field. These errors in the gyrocenter location and the gyroradius are the foundational basis for why Boris solvers existed, independent of any finite-difference schemes. This work shows that there are two distinct ways of eliminating these errors so that the trajectory of a charged particle in a constant magnetic field is exactly on the cyclotron orbit. One way reproduces the known second-order symmetric Boris solver. The other yields a previously unknown, but also on-orbit solver, not derivable from finite-difference schemes. By revisiting some historical calculations, it is found that many publications do not distinguish the poorly behaved leap-frog Boris solver from the symmetric second-order Boris algorithm. This symmetric second-order Boris solver's trajectory is much more accurate and remains close to the exact orbit in a combined $nonuniform$ electric and magnetic field at time-steps greater than the cyclotron period. Finally, this operator formalism showed that Buneman's cycloid fitting scheme is mathematically identical to Boris' on-orbit solver and that Boris' E-B splitting is unnecessary.


title: Barycentric-alignment and reconstruction loss minimization for domain generalization

abstract: This paper advances the theory and practice of Domain Generalization (DG) in machine learning. We consider the typical DG setting where the hypothesis is composed of a representation mapping followed by a labeling function. Within this setting, the majority of popular DG methods aim to jointly learn the representation and the labeling functions by minimizing a well-known upper bound for the classification risk in the unseen domain. In practice, however, methods based on this theoretical upper bound ignore a term that cannot be directly optimized due to its dual dependence on both the representation mapping and the unknown optimal labeling function in the unseen domain. To bridge this gap between theory and practice, we introduce a new upper bound that is free of terms having such dual dependence, resulting in a fully optimizable risk upper bound for the unseen domain. Our derivation leverages classical and recent transport inequalities that link optimal transport metrics with information-theoretic measures. Compared to previous bounds, our bound introduces two new terms: (i) the Wasserstein-2 barycenter term that aligns distributions between domains, and (ii) the reconstruction loss term that assesses the quality of representation in reconstructing the original data. Based on this new upper bound, we propose a novel DG algorithm named Wasserstein Barycenter Auto-Encoder (WBAE) that simultaneously minimizes the classification loss, the barycenter loss, and the reconstruction loss. Numerical results demonstrate that the proposed method outperforms current state-of-the-art DG algorithms on several datasets.


title: Robust fine-tuning of zero-shot models

abstract: Large pre-trained models such as CLIP or ALIGN offer consistent accuracy across a range of data distributions when performing zero-shot inference (i.e., without fine-tuning on a specific dataset). Although existing fine-tuning methods substantially improve accuracy on a given target distribution, they often reduce robustness to distribution shifts. We address this tension by introducing a simple and effective method for improving robustness while fine-tuning: ensembling the weights of the zero-shot and fine-tuned models (WiSE-FT). Compared to standard fine-tuning, WiSE-FT provides large accuracy improvements under distribution shift, while preserving high accuracy on the target distribution. On ImageNet and five derived distribution shifts, WiSE-FT improves accuracy under distribution shift by 4 to 6 percentage points (pp) over prior work while increasing ImageNet accuracy by 1.6 pp. WiSE-FT achieves similarly large robustness gains (2 to 23 pp) on a diverse set of six further distribution shifts, and accuracy gains of 0.8 to 3.3 pp compared to standard fine-tuning on seven commonly used transfer learning datasets. These improvements come at no additional computational cost during fine-tuning or inference.


title: Estimating Categorical Counterfactuals via Deep Twin Networks

abstract: Counterfactual inference is a powerful tool, capable of solving challenging problems in high-profile sectors. To perform counterfactual inference, one requires knowledge of the underlying causal mechanisms. However, causal mechanisms cannot be uniquely determined from observations and interventions alone. This raises the question of how to choose the causal mechanisms so that resulting counterfactual inference is trustworthy in a given domain. This question has been addressed in causal models with binary variables, but the case of categorical variables remains unanswered. We address this challenge by introducing for causal models with categorical variables the notion of counterfactual ordering, a principle that posits desirable properties causal mechanisms should posses, and prove that it is equivalent to specific functional constraints on the causal mechanisms. To learn causal mechanisms satisfying these constraints, and perform counterfactual inference with them, we introduce deep twin networks. These are deep neural networks that, when trained, are capable of twin network counterfactual inference -- an alternative to the abduction, action, & prediction method. We empirically test our approach on diverse real-world and semi-synthetic data from medicine, epidemiology, and finance, reporting accurate estimation of counterfactual probabilities while demonstrating the issues that arise with counterfactual reasoning when counterfactual ordering is not enforced.


title: Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential Learning

abstract: Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event-driven manner and have internal states to retain information over time, providing opportunities for energy-efficient neuromorphic computing, especially on edge devices. Note, however, many representative works on SNNs do not fully demonstrate the usefulness of their inherent recurrence (membrane potentials retaining information about the past) for sequential learning. Most of the works train SNNs to recognize static images by artificially expanded input representation in time through rate coding. We show that SNNs can be trained for sequential tasks and propose modifications to a network of LIF neurons that enable internal states to learn long sequences and make their inherent recurrence resilient to the vanishing gradient problem. We then develop a training scheme to train the proposed SNNs with improved inherent recurrence dynamics. Our training scheme allows spiking neurons to produce multi-bit outputs (as opposed to binary spikes) which help mitigate the mismatch between a derivative of spiking neurons' activation function and a surrogate derivative used to overcome spiking neurons' non-differentiability. Our experimental results indicate that the proposed SNN architecture on TIMIT and LibriSpeech 100h dataset yields accuracy comparable to that of LSTMs (within 1.10% and 0.36%, respectively), but with 2x fewer parameters than LSTMs. The sparse SNN outputs also lead to 10.13x and 11.14x savings in multiplication operations compared to GRUs, which is generally con-sidered as a lightweight alternative to LSTMs, on TIMIT and LibriSpeech 100h datasets, respectively.


title: Wheeling around Mazur rotations problem

abstract: We study Mazur rotations problem focusing on the metric aspects of the action of the isometry group and semitransitivity properties.


title: On the inverse problem of vibro-acoustography

abstract: The aim of this paper is to put the problem of vibroacoustic imaging into the mathematical framework of inverse problems (more precisely, coefficient identification in PDEs) and regularization. We present a model in frequency domain, prove uniqueness of recovery of the spatially varying nonlinearity parameter from measurements of the acoustic pressure at multiple frequencies, and derive Newton as well as gradient based reconstruction methods.


title: Observation of B$^0_s$ mesons and measurement of the B$^0_s$ / B$^+$ yield ratio in PbPb collisions at $\sqrt{s_\mathrm{NN}} =$ 5.02 TeV

abstract: The B$^0_s$ and B$^+$ production yields are measured in PbPb collisions at a center-of-mass energy per nucleon pair of 5.02 TeV. The data sample, collected with the CMS detector at the LHC, corresponds to an integrated luminosity of 1.7 nb$^{-1}$. The mesons are reconstructed in the exclusive decay channels B$^0_s$ $\to$ J/$\psi(\mu^+\mu^-)\phi($K$^+$K$^-)$ and B$^+$ $\to$ J/$\psi(\mu^+\mu^-)$K$^+$, in the transverse momentum range 7-50 GeV/c and absolute rapidity 0-2.4. The B$^0_s$ meson is observed with a statistical significance in excess of five standard deviations for the first time in nucleus-nucleus collisions. The measurements are performed as functions of the transverse momentum of the B mesons and of the PbPb collision centrality. The ratio of production yields of B$^0_s$ and B$^+$ is measured and compared to theoretical models that include quark recombination effects.


title: On certain identities involving Nahm-type sums with double poles

abstract: We prove certain Nahm-type sum representations for the (odd modulus) Andrews-Gordon identities, the (even modulus) Andrews-Bressoud identities, and Rogers' false theta functions. These identities are motivated on one hand by a recent work of C. Jennings-Shaffer and one of us on double pole series, and, on the other hand, by C\'ordova, Gaiotto and Shao's work on defect Schur's indices.


title: Global solutions for the generalized Benney-Lin equation posed on bounded intervals and on a half-line

abstract: Initial boundary value problems for the generalized Benney-Lin equation posed on bounded intervals and on the right half-line were considered. The existence and uniqueness of global regular solutions on arbitrary intervals as well as their exponential decay for small solutions and for a special choice of a bounded interval have been established.


title: Light pseudo-scalar meson masses under strong magnetic fields within the SU(3) Nambu-Jona-Lasinio model

abstract: We calculate the pole masses of pseudoscalar mesons in a strongly magnetized medium within the framework of the SU(3) Nambu-Jona--Lasinio model, using a magnetic field-independent regularization scheme. We employ both a constant and a magnetic field-dependent coupling $G(B)$, the latter being fitted to reproduce lattice QCD results for the pseudocritical chiral transition temperature. Numerical results for the pole masses are obtained for definite parametrizations of the model. For neutral mesons, the use of $G(B)$ provides closer agreement with lattice QCD results, which reveal a decrease of the mass with the external field. On the contrary, charged mesons masses are enhanced by $B$, showing no sign of the non-monotonous behavior found in recent lattice QCD simulations.


title: Quantum reference frames: derivation of perspective-dependent descriptions via a perspective-neutral structure

abstract: In standard quantum mechanics, reference frames are treated as abstract entities. We can think of them as idealized, infinite-mass subsystems which decouple from the rest of the system. In nature, however, all reference frames are realized through finite-mass systems that are subject to the laws of quantum mechanics and must be included in the dynamical evolution. A fundamental physical theory should take this fact seriously. In this paper, we further develop a symmetry-inspired approach to describe physics from the perspective of quantum reference frames. We find a unifying framework allowing us to systematically derive a broad class of perspective dependent descriptions and the transformations between them. Working with a translational-invariant toy model of three free particles, we discover that the introduction of relative coordinates leads to a Hamiltonian structure with two non-commuting constraints. This structure can be said to contain all observer-perspectives at once, while the redundancies prevent an immediate operational interpretation. We show that the operationally meaningful perspective dependent descriptions are given by Darboux coordinates on the constraint surface and that reference frame transformations correspond to reparametrizations of the constraint surface. We conclude by constructing a quantum perspective neutral structure, via which we can derive and change perspective dependent descriptions without referring to the classical theory. In addition to the physical findings, this work illuminates the interrelation of first and second class constrained systems and their respective quantization procedures.


title: Drift Orbit Bifurcations and Cross-field Transport in the Outer Radiation Belt: Global MHD and Integrated Test-Particle Simulations

abstract: Energetic particle fluxes in the outer magnetosphere present a significant challenge to modelling efforts as they can vary by orders of magnitude in response to solar wind driving conditions. In this article, we demonstrate the ability to propagate test particles through global MHD simulations to a high level of precision and use this to map the cross-field radial transport associated with relativistic electrons undergoing drift orbit bifurcations (DOBs). The simulations predict DOBs primarily occur within an Earth radius of the magnetopause loss cone and appears significantly different for southward and northward interplanetary magnetic field orientations. The changes to the second invariant are shown to manifest as a dropout in particle fluxes with pitch angles close to 90$^\circ$ and indicate DOBs are a cause of butterfly pitch angle distributions within the night-time sector. The convective electric field, not included in previous DOB studies, is found to have a significant effect on the resultant long term transport, and losses to the magnetopause and atmosphere are identified as a potential method for incorporating DOBs within Fokker-Planck transport models.

categories: physics.space-ph astro-ph.EP astro-ph.IM physics.comp-ph physics.plasm-ph


title: Simulation of X-ray diffraction in Mn$_x$Bi$_2$Te$_{3+x}$ epitaxic films

abstract: Disordered heterostructures stand as a general description for compounds that are part of homologous series such as bismuth chalcogenides. In device engineering, van der Waals epitaxy of these compounds is very promising for applications in spintronic and quantum computing. Structural analysis methods are essential to control and improve their synthesis in the form of thin films. Recently, X-rays tools have been proposed for structural modeling of disordered heterostructures [arXiv:2107.12280]. Here, we further evaluate the use of these tools to study the compound Mn$_x$Bi$_2$Te$_{3+x}$ in the grazing incidence region of the reflectivity curves, as well as the effect of thickness fluctuation in the wide angle region.


title: Sparse Spatial Attention Network for Semantic Segmentation

abstract: The spatial attention mechanism captures long-range dependencies by aggregating global contextual information to each query location, which is beneficial for semantic segmentation. In this paper, we present a sparse spatial attention network (SSANet) to improve the efficiency of the spatial attention mechanism without sacrificing the performance. Specifically, a sparse non-local (SNL) block is proposed to sample a subset of key and value elements for each query element to capture long-range relations adaptively and generate a sparse affinity matrix to aggregate contextual information efficiently. Experimental results show that the proposed approach outperforms other context aggregation methods and achieves state-of-the-art performance on the Cityscapes, PASCAL Context and ADE20K datasets.


title: Heteroepitaxial growth of high optical quality, wafer-scale van der Waals heterostrucutres

abstract: Transition metal dichalcogenides (TMDs) are materials that can exhibit intriguing optical properties like a change of the bandgap from indirect to direct when being thinned down to a monolayer. Well-resolved narrow excitonic resonances can be observed for such monolayers, however only for materials of sufficient crystalline quality, so far mostly available in the form of micrometer-sized flakes. A further significant improvement of optical and electrical properties can be achieved by transferring the TMD on hexagonal boron nitride (hBN). To exploit the full potential of TMDs in future applications, epitaxial techniques have to be developed that not only allow to growlarge-scale, high-quality TMD monolayers, but allow to perform the growth directly on large-scale epitaxial hBN. In this work we address this problem and demonstrate that MoSe2 of high optical quality can be directly grown on epitaxial hBN on an entire two-inch wafer. We developed a combined growth theme for which hBN is first synthesized at high temperature by Metal Organic Vapor Phase Epitaxy (MOVPE) and as a second step MoSe2 is deposited on top by Molecular Beam Epitaxy (MBE) at much lower temperatures. We show that this structure exhibits excellent optical properties, manifested by narrow excitonic lines in the photoluminescence spectra. Moreover, the material is homogeneous on the area of the whole two-inch wafer, with only +/-0.14 meV deviation of excitonic energy. Our mixed growth technique may guide the way for future large-scale production of high quality TMD/hBN heterostructures.


title: The complete singlet contribution to the massless quark form factor at three loops in QCD

abstract: It is well known that the effect of top quark loop corrections in the axial part of quark form factors (FF) does not decouple in the large top mass or low energy limit due to the presence of the axial-anomaly type diagrams. The top-loop induced singlet-type contribution should be included in addition to the purely massless result for quark FFs when applied to physics in the low energy region, both for the non-decoupling mass logarithms and for an appropriate renormalization scale dependence. In this work, we have numerically computed the so-called singlet contribution to quark FFs with the exact top quark mass dependence over the full kinematic range. We discuss in detail the renormalization formulae of the individual subsets of the singlet contribution to an axial quark FF with a particular flavor, as well as the renormalization group equations that govern their individual scale dependence. Finally we have extracted the 3-loop Wilson coefficient in the low energy effective Lagrangian, renormalized in a non-$\overline{\mathrm{MS}}$ scheme and constructed to encode the leading large mass approximation of our exact results for singlet quark FFs. We have also examined the accuracy of the approximation in the low energy region.


title: Training Graph Neural Networks by Graphon Estimation

abstract: In this work, we propose to train a graph neural network via resampling from a graphon estimate obtained from the underlying network data. More specifically, the graphon or the link probability matrix of the underlying network is first obtained from which a new network will be resampled and used during the training process at each layer. Due to the uncertainty induced from the resampling, it helps mitigate the well-known issue of over-smoothing in a graph neural network (GNN) model. Our framework is general, computationally efficient, and conceptually simple. Another appealing feature of our method is that it requires minimal additional tuning during the training process. Extensive numerical results show that our approach is competitive with and in many cases outperform the other over-smoothing reducing GNN training methods.


title: Equation of state and composition of proto-neutron stars and merger remnants with hyperons

abstract: Finite-temperature equation of state (EoS) and the composition of dense nuclear and hypernuclear matter under conditions characteristic of neutron star binary merger remnants and supernovas are discussed. We consider both neutrino free-streaming and trapped regimes which are separated by a temperature of a few MeV. The formalism is based on covariant density functional (CDF) theory for the full baryon octet with density-dependent couplings, suitably adjusted in the hypernuclear sector. The softening of the EoS with the introduction of the hyperons is quantified under various conditions of lepton fractions and temperatures. We find that $\Lambda$, $\Xi^-$, and $\Xi^0$ hyperons appear in the given order with a sharp density increase at zero temperature at the threshold being replaced by an extended increment over a wide density range at high temperatures. The $\Lambda$ hyperon survives in the deep subnuclear regime. The triplet of $\Sigma$s is suppressed in cold hypernuclear matter up to around seven times the nuclear saturation density, but appears in significant fractions at higher temperatures, $T\geq 20$ MeV, in both supernova and merger remnant matter. We point out that a special isospin degeneracy point exists where the baryon abundances within each of the three isospin multiplets are equal to each other as a result of (approximate) isospin symmetry. At that point, the charge chemical potential of the system vanishes. We find that under the merger remnant conditions, the fractions of electron and $\mu$-on neutrinos are close and are about 1\%, whereas in the supernova case, we only find a significant fraction ($\sim$10\%) of electron neutrinos, given that in this case, the $\mu$-on lepton number is zero.


title: Schr\"{o}dinger-Poisson Solitons: Perturbation Theory

abstract: Self-gravitating quantum matter may exist in a wide range of cosmological and astrophysical settings from the very early universe through to present-day boson stars. Such quantum matter arises in a number of different theories, including the Peccei-Quinn axion and UltraLight (ULDM) or Fuzzy (FDM) dark matter scenarios. We consider the dynamical evolution of perturbations to the spherically symmetric soliton, the ground state solution to the Schr\"{o}dinger-Poisson system common to all these scenarios. We construct the eigenstates of the Schr\"{o}dinger equation, holding the gravitational potential fixed to its ground state value. We see that the eigenstates qualitatively capture the properties seen in full ULDM simulations, including the soliton "breathing" mode, the random walk of the soliton center, and quadrupolar distortions of the soliton. We then show that the time-evolution of the gravitational potential and its impact on the perturbations can be well described within the framework of time-dependent perturbation theory. Applying our formalism to a synthetic ULDM halo reveals considerable mixing of eigenstates, even though the overall density profile is relatively stable. Our results provide a new analytic approach to understanding the evolution of these systems as well as possibilities for faster approximate simulations.


title: Origin of Charge Density Wave in Layered Kagome Metal CsV$_3$Sb$_5$

abstract: Using first-principles calculations, we identify the origin of the observed charge density wave (CDW) formation in a layered kagome metal CsV$_3$Sb$_5$. It is revealed that the structural distortion of kagome lattice forming the trimeric and hexameric V atoms is accompanied by the stabilization of quasimolecular states, which gives rise to the opening of CDW gaps for the V-derived multibands lying around the Fermi level. This Jahn-Teller-like instability having the local lattice distortion and its derived quasimolecular states is a driving force of the CDW order. Specifically, the saddle points of multiple Dirac bands near the Fermi level, located at the $M$ point, are hybridized to disappear along the $k_z$ direction, therefore not supporting the widely accepted Peierls-like electronic instability due to Fermi surface nesting. It is further demonstrated that applied hydrostatic pressure significantly reduces the interlayer spacing to destabilize the quasimolecular states, leading to a disappearance of the CDW phase at a pressure of ${\sim}$2 GPa. The presently proposed underlying mechanism of the CDW order in CsV$_3$Sb$_5$ can also be applicable to other isostructural kagome lattices such as KV$_3$Sb$_5$ and RbV$_3$Sb$_5$.


title: Many-body localization and the emergence of quantum darwinism

abstract: Quantum darwinism (QD) is the process responsible for the proliferation of redundant information in the environment of a quantum system that is being decohered. This enables independent observers to access separate environmental fragments and reach consensus about the system's state. In this work, we study the effect of disorder in the emergence of QD and find that a highly disordered environment is greatly beneficial for it. By introducing the notion of lack of redundancy to quantify objectivity, we show that it behaves analogously to the entanglement entropy (EE) of the environmental eigenstate taken as an initial state. This allows us to estimate the many-body mobility edge by means of our darwinistic measure, implicating the existence of a critical degree of disorder beyond which the degree of objectivity rises the larger the environment is. The latter hints the key role that disorder may play when the environment is of a thermodynamic size. At last, we show that a highly disordered evolution may reduce the spoiling of redundancy in the presence of intra-environment interactions.


title: Understanding TEE Containers, Easy to Use? Hard to Trust

abstract: As an emerging technique for confidential computing, trusted execution environment (TEE) receives a lot of attention. To better develop, deploy, and run secure applications on a TEE platform such as Intel's SGX, both academic and industrial teams have devoted much effort to developing reliable and convenient TEE containers. In this paper, we studied the isolation strategies of 15 existing TEE containers to protect secure applications from potentially malicious operating systems (OS) or untrusted applications, using a semi-automatic approach combining a feedback-guided analyzer with manual code review. Our analysis reveals the isolation protection each of these TEE containers enforces, and their security weaknesses. We observe that none of the existing TEE containers can fulfill the goal they set, due to various pitfalls in their design and implementation. We report the lessons learnt from our study for guiding the development of more secure containers, and further discuss the trend of TEE container designs. We also release our analyzer that helps evaluate the container middleware both from the enclave and from the kernel.


title: A Neural Network-Based Linguistic Similarity Measure for Entrainment in Conversations

abstract: Linguistic entrainment is a phenomenon where people tend to mimic each other in conversation. The core instrument to quantify entrainment is a linguistic similarity measure between conversational partners. Most of the current similarity measures are based on bag-of-words approaches that rely on linguistic markers, ignoring the overall language structure and dialogue context. To address this issue, we propose to use a neural network model to perform the similarity measure for entrainment. Our model is context-aware, and it further leverages a novel component to learn the shared high-level linguistic features across dialogues. We first investigate the effectiveness of our novel component. Then we use the model to perform similarity measure in a corpus-based entrainment analysis. We observe promising results for both evaluation tasks.


title: Ordinal Maximin Share Approximation for Goods

abstract: In fair division of indivisible goods, $\ell$-out-of-$d$ maximin share (MMS) is the value that an agent can guarantee by partitioning the goods into $d$ bundles and choosing the $\ell$ least preferred bundles. Most existing works aim to guarantee to all agents a constant fraction of their 1-out-of-$n$ MMS. But this guarantee is sensitive to small perturbation in agents' cardinal valuations. We consider a more robust approximation notion, which depends only on the agents' \emph{ordinal} rankings of bundles. We prove the existence of $\ell$-out-of-$\lfloor(\ell+\frac{1}{2})n\rfloor$ MMS allocations of goods for any integer $\ell\geq 1$, and present a polynomial-time algorithm that finds a $1$-out-of-$\lceil\frac{3n}{2}\rceil$ MMS allocation when $\ell = 1$. We further develop an algorithm that provides a weaker ordinal approximation to MMS for any $\ell > 1$.


title: Audio-Visual Transformer Based Crowd Counting

abstract: Crowd estimation is a very challenging problem. The most recent study tries to exploit auditory information to aid the visual models, however, the performance is limited due to the lack of an effective approach for feature extraction and integration. The paper proposes a new audiovisual multi-task network to address the critical challenges in crowd counting by effectively utilizing both visual and audio inputs for better modalities association and productive feature extraction. The proposed network introduces the notion of auxiliary and explicit image patch-importance ranking (PIR) and patch-wise crowd estimate (PCE) information to produce a third (run-time) modality. These modalities (audio, visual, run-time) undergo a transformer-inspired cross-modality co-attention mechanism to finally output the crowd estimate. To acquire rich visual features, we propose a multi-branch structure with transformer-style fusion in-between. Extensive experimental evaluations show that the proposed scheme outperforms the state-of-the-art networks under all evaluation settings with up to 33.8% improvement. We also analyze and compare the vision-only variant of our network and empirically demonstrate its superiority over previous approaches.


title: Toward Low-Temperature Solid-Source Synthesis of Monolayer MoS2

abstract: Two-dimensional (2D) semiconductors have been proposed for heterogeneous integration with existing silicon technology; however, their chemical vapor deposition (CVD) growth temperatures are often too high. Here, we demonstrate direct CVD solid-source precursor synthesis of continuous monolayer (1L) MoS$_2$ films at 560 C in 50 min, within the 450-to-600 C, 2 h thermal budget window required for back-end-of-the-line compatibility with modern silicon technology. Transistor measurements reveal on-state current up to ~140 $\mathrm{{\mu}A/{\mu}m}$ at 1 V drain-to-source voltage for 100 nm channel lengths, the highest reported to date for 1L MoS$_2$ grown below 600 C using solid-source precursors. The effective mobility from transfer length method test structures is $\mathrm{29 \pm 5\ cm^2V^{-1}s^{-1}}$ at $\mathrm{6.1 \times 10^{12}\ cm^{-2}}$ electron density, which is comparable to mobilities reported from films grown at higher temperatures. The results of this work provide a path toward the realization of high-quality, thermal-budget-compatible 2D semiconductors for heterogeneous integration with silicon manufacturing.


title: Modelling Arbitrary Complex Dielectric Properties -- an automated implementation for gprMax

abstract: There is a need to accurately simulate materials with complex electromagnetic properties when modelling Ground Penetrating Radar (GPR), as many objects encountered with GPR contain water, e.g. soils, curing concrete, and water-filled pipes. One of widely-used open-source software that simulates electromagnetic wave propagation is gprMax. It uses Yee's algorithm to solve Maxwell's equations with the Finite-Difference Time-Domain (FDTD) method. A significant drawback of the FDTD method is the limited ability to model materials with dispersive properties, currently narrowed to specific set of relaxation mechanisms, namely multi-Debye, Drude and Lorentz media. Consequently, modelling any arbitrary complex material should be done by approximating it as a combination of these functions. This paper describes work carried out as part of the Google Summer of Code (GSoC) programme 2021 to develop a new module within gprMax that can be used to simulate complex dispersive materials using multi-Debye expansions in an automatic manner. The module is capable of modelling Havriliak-Negami, Cole-Cole, Cole-Davidson, Jonscher, Complex-Refractive Index Models, and indeed any arbitrary dispersive material with real and imaginary permittivity specified by the user.

categories: math.NA cs.NA physics.comp-ph physics.geo-ph


title: On Neron-Severi lattices of Jacobian elliptic K3 surfaces

abstract: We classify all Jacobian elliptic fibrations on K3 surfaces with finite automorphism group. We also classify all extremal Jacobian elliptic fibrations on K3 surfaces with infinite automorphism group and 2-elementary N\'eron-Severi lattice.


title: Geometric bijections between spanning subgraphs and orientations of a graph

abstract: Let $G$ be a connected finite graph. Backman, Baker, and Yuen have constructed a family of explicit and easy-to-describe bijections $g_{\sigma,\sigma^*}$ between spanning trees of $G$ and $(\sigma,\sigma^*)$-compatible orientations, where the $(\sigma,\sigma^*)$-compatible orientations are the representatives of equivalence classes of orientations up to cycle-cocycle reversal which are determined by a cycle signature $\sigma$ and a cocycle signature $\sigma^*$. Their proof makes use of zonotopal subdivisions and the bijections $g_{\sigma,\sigma^*}$ are called \emph{geometric bijections}. In this paper, we extend the geometric bijections to subgraph-orientation correspondences. Moreover, we extend the geometric constructions accordingly. Our proofs are purely combinatorial, even for the geometric constructions. We also provide geometric proofs for partial results, which make use of zonotopal tiling, relate to Backman, Baker, and Yuen's method, and motivate our combinatorial constructions. Finally, we explain that the main results hold for \emph{regular matroids}.


title: Singularities in static spherically symmetric configurations of General Relativity with strongly nonlinear scalar fields

abstract: There are a number of publications on relativistic objects dealing either with black holes or naked singularities in the center. Here we show that there exist static spherically symmetric solutions of Einstein equations with a strongly nonlinear scalar field, which allow the appearance of singularities of a new type (``spherical singularities'') outside the center of curvature coordinates. As the example, we consider a scalar field potential $\sim$$\sinh(\phi^{2n}),\,n>2$, which grows rapidly for large field values. The space-time is assumed to be asymptotically flat. We fulfill a numerical investigation of solutions with different $n$ for different parameters, which define asymptotic properties at spatial infinity. Depending on the configuration parameters, we show that the distribution of the stable circular orbits of test bodies around the configuration is either similar to that in the case of the Schwarzschild solution (thus mimicking an ordinary black hole), or it contains additional rings of unstable orbits.


title: ISyNet: Convolutional Neural Networks design for AI accelerator

abstract: In recent years Deep Learning reached significant results in many practical problems, such as computer vision, natural language processing, speech recognition and many others. For many years the main goal of the research was to improve the quality of models, even if the complexity was impractically high. However, for the production solutions, which often require real-time work, the latency of the model plays a very important role. Current state-of-the-art architectures are found with neural architecture search (NAS) taking model complexity into account. However, designing of the search space suitable for specific hardware is still a challenging task. To address this problem we propose a measure of hardware efficiency of neural architecture search space - matrix efficiency measure (MEM); a search space comprising of hardware-efficient operations; a latency-aware scaling method; and ISyNet - a set of architectures designed to be fast on the specialized neural processing unit (NPU) hardware and accurate at the same time. We show the advantage of the designed architectures for the NPU devices on ImageNet and the generalization ability for the downstream classification and detection tasks.


title: Identification and Estimation of Causal Peer Effects Using Double Negative Controls for Unmeasured Network Confounding

abstract: Scientists have been interested in estimating causal peer effects to understand how people's behaviors are affected by their network peers. However, it is well known that identification and estimation of causal peer effects are challenging in observational studies for two reasons. The first is the identification challenge due to unmeasured network confounding, for example, homophily bias and contextual confounding. The second issue is network dependence of observations, which one must take into account for valid statistical inference. Negative control variables, also known as placebo variables, have been widely used in observational studies including peer effect analysis over networks, although they have been used primarily for bias detection. In this article, we establish a formal framework which leverages a pair of negative control outcome and exposure variables (double negative controls) to nonparametrically identify causal peer effects in the presence of unmeasured network confounding. We then propose a generalized method of moments estimator for causal peer effects, and establish its consistency and asymptotic normality under an assumption about $\psi$-network dependence. Finally, we provide a network heteroskedasticity and autocorrelation consistent variance estimator. Our methods are illustrated with an application to peer effects in education.


title: Weakly Supervised Relative Spatial Reasoning for Visual Question Answering

abstract: Vision-and-language (V\&L) reasoning necessitates perception of visual concepts such as objects and actions, understanding semantics and language grounding, and reasoning about the interplay between the two modalities. One crucial aspect of visual reasoning is spatial understanding, which involves understanding relative locations of objects, i.e.\ implicitly learning the geometry of the scene. In this work, we evaluate the faithfulness of V\&L models to such geometric understanding, by formulating the prediction of pair-wise relative locations of objects as a classification as well as a regression task. Our findings suggest that state-of-the-art transformer-based V\&L models lack sufficient abilities to excel at this task. Motivated by this, we design two objectives as proxies for 3D spatial reasoning (SR) -- object centroid estimation, and relative position estimation, and train V\&L with weak supervision from off-the-shelf depth estimators. This leads to considerable improvements in accuracy for the "GQA" visual question answering challenge (in fully supervised, few-shot, and O.O.D settings) as well as improvements in relative spatial reasoning. Code and data will be released \href{https://github.com/pratyay-banerjee/weak_sup_vqa}{here}.


title: Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case

abstract: Contextualised word embeddings is a powerful tool to detect contextual synonyms. However, most of the current state-of-the-art (SOTA) deep learning concept extraction methods remain supervised and underexploit the potential of the context. In this paper, we propose a self-supervised pre-training approach which is able to detect contextual synonyms of concepts being training on the data created by shallow matching. We apply our methodology in the sparse multi-class setting (over 15,000 concepts) to extract phenotype information from electronic health records. We further investigate data augmentation techniques to address the problem of the class sparsity. Our approach achieves a new SOTA for the unsupervised phenotype concept annotation on clinical text on F1 and Recall outperforming the previous SOTA with a gain of up to 4.5 and 4.0 absolute points, respectively. After fine-tuning with as little as 20\% of the labelled data, we also outperform BioBERT and ClinicalBERT. The extrinsic evaluation on three ICU benchmarks also shows the benefit of using the phenotypes annotated by our model as features.


title: Influence of NaMo App on Twitter

abstract: Social media plays a crucial role in today's society. It results in paradigm changes in how people relate and communicate, convey and exchange ideas. Moreover, social media has evolved into critical knowledge networks for consumers and also affects decision-making. In elections, social media became an integral part of political campaigning to reach a greater audience and gather more support. The 2019 Lok Sabha election saw a massive spike in the usage of online social media platforms such as Twitter, Facebook, and WhatsApp; with every major political party launching its own organized social media campaigns. In 2014, Bhartiya Janta Party (BJP) took one step ahead in organizing the campaign by launching its app - NaMo App. We focus our research on Twitter and NaMo App during the 2019 Lok Sabha elections and CAA protests. Twitter is a platform where every individual can express their views and is not biased. In contrast, NaMo App is one of the first apps centered around a specific political party. It acted as a digital medium for BJP for organizing the political campaign to make people's opinion in their favour. This research aims to characterize the role of the NaMo App in a more traditional network as Twitter in shaping political discourse and studies the existence of an online echo chamber. We began by analyzing the amount and type of content shared using the NaMo App on Twitter. We performed content and network analysis for the existence of the echo chamber. We also applied Hawkes process to see the influence that NaMo App has on Twitter. Through this research, we can conclude that the users who share content using NaMo App, may be part of an online echo chamber and are likely to be BJP workers. We show the reach and influence that the NaMo App has on Twitter is significantly less, indicating its inability to break through the diverse audience and change the narrative on Twitter.


title: Asymptotically Stable Observer-based Controller for Attitude Tracking with Systematic Convergence

abstract: This paper proposes a novel unit-quaternion observer-based controller for attitude tracking (attitude and angular velocity) with guaranteed transient and steady-state performance. The proposed approach is computationally cheap and can operate based on measurements provided, for instance by a typical low-cost inertial measurement unit (IMU) or magnetic, angular rate, and gravity (MARG) sensor without the knowledge of angular velocity. First, an observer evolved on $\mathbb{S}^{3}\times\mathbb{R}^{3}$ is developed guaranteeing asymptotic stability of the closed loop error signals starting from any initial condition. Afterwards, the observer is combined with the proposed controller such that the observer-based controller ensures asymptotic stability of the closed loop error signals starting from any initial condition. Simulation performed in discrete form at low sampling rate reveals the robustness and effectiveness of the proposed approach. Keywords: Observer-based controller, attitude, estimation, control, MARG, IMU, asymptotic stability.


title: Powerful method to evaluate the mass gaps of free-particle quantum critical systems

abstract: We present a numerical method for the evaluation of the mass gap, and the low-lying energy gaps, of a large family of free-fermionic and free-parafermionic quantum chains. The method is suitable for some generalizations of the quantum Ising and XY models with multispin interactions. We illustrate the method by considering the Ising quantum chains with uniform and random coupling constants. The mass gaps of these quantum chains are obtained from the largest root of a characteristic polynomial. We also show that the Laguerre bound, for the largest root of a polynomial, used as an initial guess for the largest root in the method, gives us estimates for the mass gaps sharing the same leading finite-size behavior as the exact results. This opens an interesting possibility of obtaining precise critical properties very efficiently which we explore by studying the critical point and the paramagnetic Griffiths phase of the quantum Ising chain with random couplings. In this last phase, we obtain the effective dynamical critical exponent as a function of the distance-to-criticality. Finally, we compare the mass gap estimates derived from the Laguerre bound and the strong-disorder renormalization-group method. Both estimates require comparable computational efforts, with the former having the advantage of being more accurate and also being applicable away from infinite-randomness fixed points. We believe this method is a relevant tool for tackling critical quantum chains with and without quenched disorder.

categories: cond-mat.stat-mech cond-mat.dis-nn hep-th math-ph math.MP


title: Building Groups From Restricted Diagrams of Groups

abstract: We consider the problem of realizing a group as the fundamental group of a graph of groups where the vertex groups are restricted to certain classes (for example, coming from a certain finite list of groups, or having bounded geometric rank). We show how this places restrictions on the possible groups that can be realized and we give a topological application of our results to the problem of constructing manifolds from a finite set of "building blocks".


title: Inverse Faraday effect in Mott insulators

abstract: The inverse Faraday effect (IFE), where a static magnetization is induced by circularly polarized light, offers a promising route to ultrafast control of spin states. Here we study the IFE in Mott insulators using the Floquet theory. We find two distinct IFE behavior governed by the inversion symmetry. In the Mott insulators with inversion symmetry, we find that the effective magnetic field induced by the IFE couples ferromagnetically to the neighboring spins. While for the Mott insulators without inversion symmetry, the effective magnetic field due to IFE couples antiferromagnetically to the neighboring spins. We apply the theory to the spin-orbit coupled single- and multi-orbital Hubbard model that is relevant for the Kitaev quantum spin liquid material and demonstrate that the magnetic interactions can be tuned by light.


title: Multi-scale dynamical symmetries and selection rules in nonlinear optics

abstract: Symmetries and their associated selection rules are extremely useful in all fields of science. In particular, for system that include electromagnetic (EM) fields interacting with matter, it has been shown that both of symmetries of matter and EM field's time-dependent polarization play a crucial role in determining the properties of linear and nonlinear responses. The relationship between the system's symmetry and the properties of its excitations facilitate precise control over light emission and enable ultrafast symmetry-breaking spectroscopy of variety of properties. Here. we formulate the first general theory that describes the macroscopic dynamical symmetries (including quasicrystal-like symmetries) of an EM vector field, revealing many new symmetries and selection rules in light-matter interactions. We demonstrate an example of multi-scale selection rules experimentally in the framework of high harmonic generation (HHG). This work waves the way for novel spectroscopic techniques in multi-scale system as well as for imprinting complex structures in EUV-X-ray beams, attosecond pulses, or the interacting medium itself.


title: On the ability of monolingual models to learn language-agnostic representations

abstract: Pretrained multilingual models have become a de facto default approach for zero-shot cross-lingual transfer. Previous work has shown that these models are able to achieve cross-lingual representations when pretrained on two or more languages with shared parameters. In this work, we provide evidence that a model can achieve language-agnostic representations even when pretrained on a single language. That is, we find that monolingual models pretrained and finetuned on different languages achieve competitive performance compared to the ones that use the same target language. Surprisingly, the models show a similar performance on a same task regardless of the pretraining language. For example, models pretrained on distant languages such as German and Portuguese perform similarly on English tasks.


title: Application Checkpoint and Power Study on Large Scale Systems

abstract: Power efficiency is critical in high performance computing (HPC) systems. To achieve high power efficiency on application level, it is vital importance to efficiently distribute power used by application checkpoints. In this study, we analyze the relation of application checkpoints and their power consumption. The observations could guide the design of power management.


title: Quantitative localization and comparison of invariant distances of domains in $\mathbb C^n$

abstract: We obtain explicit bounds on the difference and ratio between "local" and "global" Kobayashi distances in a domain of $\mathbb C^n$ as the points go toward a boundary point with appropriate geometric properties. We use this for the global comparison of various invariant distances. We provide some sharp estimates in dimension $1$.


title: Utilizing Adversarial Targeted Attacks to Boost Adversarial Robustness

abstract: Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial training does not make DNNs immune to adversarial perturbations. We propose a novel solution by adopting the recently suggested Predictive Normalized Maximum Likelihood. Specifically, our defense performs adversarial targeted attacks according to different hypotheses, where each hypothesis assumes a specific label for the test sample. Then, by comparing the hypothesis probabilities, we predict the label. Our refinement process corresponds to recent findings of the adversarial subspace properties. We extensively evaluate our approach on 16 adversarial attack benchmarks using ResNet-50, WideResNet-28, and a2-layer ConvNet trained with ImageNet, CIFAR10, and MNIST, showing a significant improvement of up to 5.7%, 3.7%, and 0.6% respectively.


title: An optimal transportation principle for interacting paths and congestion

abstract: In this work we study a modification of the Monge-Kantorovich problem taking into account path dependence and interaction effects between particles. We prove existence of solutions under mild conditions on the data, and after imposing stronger conditions, we characterize the minimizers by relating them to an auxiliary Monge-Kantorovich problem of the more standard kind. With this notion of how particles interact and travel along paths, we produce a dual problem. The main novelty here is to incorporate an interaction effect to the optimal path transport problem. This covers for instance, $N$-body dynamics when the underlying measures are discrete. Lastly, our results include an extension of Brenier's theorem on optimal transport maps.


title: Stretching Your Data With Taffy Filters

abstract: Popular approximate membership query structures such as Bloom filters and cuckoo filters are widely used in databases, security, and networking. These structures represent sets approximately, and support at least two operations - insert and lookup; lookup always returns true on elements inserted into the structure; it also returns true with some probability $0 < \varepsilon < 1$ on elements not inserted into the structure. These latter elements are called false positives. Compensatory for these false positives, filters can be much smaller than hash tables that represent the same set. However, unlike hash tables, cuckoo filters and Bloom filters must be initialized with the intended number of inserts to be performed, and cannot grow larger - inserts beyond this number fail or significantly increase the false positive probability. This paper presents designs and implementations of filters than can grow without inserts failing and without meaningfully increasing the false positive probability, even if the filters are created with a small initial size. The resulting code is available on GitHub under a permissive open source license.


title: Network Modulation Synthesis: New Algorithms for Generating Musical Audio Using Autoencoder Networks

abstract: A new framework is presented for generating musical audio using autoencoder neural networks. With the presented framework, called network modulation synthesis, users can create synthesis architectures and use novel generative algorithms to more easily move through the complex latent parameter space of an autoencoder model to create audio. Implementations of the new algorithms are provided for the open-source CANNe synthesizer network, and can be applied to other autoencoder networks for audio synthesis. Spectrograms and time-series encoding analysis demonstrate that the new algorithms provide simple mechanisms for users to generate time-varying parameter combinations, and therefore auditory possibilities, that are difficult to create by generating audio from handcrafted encodings.


title: Improving Joint Learning of Chest X-Ray and Radiology Report by Word Region Alignment

abstract: Self-supervised learning provides an opportunity to explore unlabeled chest X-rays and their associated free-text reports accumulated in clinical routine without manual supervision. This paper proposes a Joint Image Text Representation Learning Network (JoImTeRNet) for pre-training on chest X-ray images and their radiology reports. The model was pre-trained on both the global image-sentence level and the local image region-word level for visual-textual matching. Both are bidirectionally constrained on Cross-Entropy based and ranking-based Triplet Matching Losses. The region-word matching is calculated using the attention mechanism without direct supervision about their mapping. The pre-trained multi-modal representation learning paves the way for downstream tasks concerning image and/or text encoding. We demonstrate the representation learning quality by cross-modality retrievals and multi-label classifications on two datasets: OpenI-IU and MIMIC-CXR


title: Type Stability in Julia: Avoiding Performance Pathologies in JIT Compilation (Extended Version)

abstract: As a scientific programming language, Julia strives for performance but also provides high-level productivity features. To avoid performance pathologies, Julia users are expected to adhere to a coding discipline that enables so-called type stability. Informally, a function is type stable if the type of the output depends only on the types of the inputs, not their values. This paper provides a formal definition of type stability as well as a stronger property of type groundedness, shows that groundedness enables compiler optimizations, and proves the compiler correct. We also perform a corpus analysis to uncover how these type-related properties manifest in practice.


title: FewshotQA: A simple framework for few-shot learning of question answering tasks using pre-trained text-to-text models

abstract: The task of learning from only a few examples (called a few-shot setting) is of key importance and relevance to a real-world setting. For question answering (QA), the current state-of-the-art pre-trained models typically need fine-tuning on tens of thousands of examples to obtain good results. Their performance degrades significantly in a few-shot setting (< 100 examples). To address this, we propose a simple fine-tuning framework that leverages pre-trained text-to-text models and is directly aligned with their pre-training framework. Specifically, we construct the input as a concatenation of the question, a mask token representing the answer span and a context. Given this input, the model is fine-tuned using the same objective as that of its pre-training objective. Through experimental studies on various few-shot configurations, we show that this formulation leads to significant gains on multiple QA benchmarks (an absolute gain of 34.2 F1 points on average when there are only 16 training examples). The gains extend further when used with larger models (Eg:- 72.3 F1 on SQuAD using BART-large with only 32 examples) and translate well to a multilingual setting . On the multilingual TydiQA benchmark, our model outperforms the XLM-Roberta-large by an absolute margin of upto 40 F1 points and an average of 33 F1 points in a few-shot setting (<= 64 training examples). We conduct detailed ablation studies to analyze factors contributing to these gains.


title: Modeling the Evolution of Infectious Diseases with Functional Data Models: The Case of COVID-19 in Brazil

abstract: In this paper, we apply statistical methods for functional data to explain the heterogeneity in the evolution of number of deaths of Covid-19 over different regions. We treat the cumulative daily number of deaths in a specific region as a curve (functional data) such that the data comprise of a set of curves over a cross-section of locations. We start by using clustering methods for functional data to identify potential heterogeneity in the curves and their functional derivatives. This first stage is an unconditional descriptive analysis, as we do not use any covariate to estimate the clusters. The estimated clusters are analyzed as "levels of alert" to identify cities in a possible critical situation. In the second and final stage, we propose a functional quantile regression model of the death curves on a number of scalar socioeconomic and demographic indicators in order to investigate their functional effects at different levels of the cumulative number of deaths over time. The proposed model showed a superior predictive capacity by providing better curve fit at different levels of the cumulative number of deaths compared to the functional regression model based on ordinary least squares.


title: Hierarchical Qubit Maps and Hierarchical Quantum Error Correction

abstract: We consider hierarchically implemented quantum error correction (HI-QEC), in which the fidelities of logical qubits are differentially optimized to enhance the capabilities of quantum devices in scientific applications. By employing qubit representations that propagate hierarchies in simulated systems to those in logical qubit noise sensitivities, heterogeneity in the distribution of physical-to-logical qubits can be systematically structured. For concreteness, we estimate HI-QEC's impact on surface code resources in computing low-energy observables to fixed precision, finding up to $\sim 60\%$ reductions in qubit requirements plausible in early error corrected simulations. Hierarchical qubit maps are also possible without error correction in qubit and qudit systems where fidelities are non-uniform, either unintentionally or by design. Hierarchical optimizations are another element in the co-design process of quantum simulations for nuclear and particle physics.


title: An Exploration of Deep Learning Methods in Hungry Geese

abstract: Hungry Geese is a n-player variation of the popular game snake. This paper looks at state of the art Deep Reinforcement Learning Value Methods. The goal of the paper is to aggregate research of value based methods and apply it as an exercise to other environments. A vanilla Deep Q Network, a Double Q-network and a Dueling Q-Network were all examined and tested with the Hungry Geese environment. The best performing model was the vanilla Deep Q Network due to its simple state representation and smaller network structure. Converging towards an optimal policy was found to be difficult due to random geese initialization and food generation. Therefore we show that Deep Q Networks may not be the appropriate model for such a stochastic environment and lastly we present improvements that can be made along with more suitable models for the environment.


title: Iterative Threshold Decoding of Spatially Coupled, Parallel-Concatenated Codes

abstract: Spatially coupled, parallel concatenated codes (SC-PCCs) have been shown to approach channel capacity when decoded using optimal iterative methods. However, under complexity constraints such decoding strategies can result in unacceptable power and latency costs. In this work, we employ convolutional self-orthogonal component codes along with low-complexity, suboptimal a posteriori probability (APP) threshold decoders with SC-PCCs to reduce decoding complexity. The proposed code design is faster, more energy efficient, and easier to implement than optimal methods, while offering significant coding gain over existing threshold decodable, turbo-like constructions of similar latency and complexity. The design also serves to further illustrate the advantages spatial coupling can provide to existing code constructions and decoder implementations.


title: Farpoint: A High-Resolution Cosmology Simulation at the Gigaparsec Scale

abstract: In this paper we introduce the Farpoint simulation, the latest member of the Hardware/Hybrid Accelerated Cosmology Code (HACC) gravity-only simulation family. The domain covers a volume of (1000$h^{-1}$Mpc)$^3$ and evolves close to two trillion particles, corresponding to a mass resolution of $m_p\sim 4.6\cdot 10^7 h^{-1}$M$_\odot$. These specifications enable comprehensive investigations of the galaxy-halo connection, capturing halos down to small masses. Further, the large volume resolves scales typical of modern surveys with good statistical coverage of high mass halos. The simulation was carried out on the GPU-accelerated system Summit, one of the fastest supercomputers currently available. We provide specifics about the Farpoint run and present an initial set of results. The high mass resolution facilitates precise measurements of important global statistics, such as the halo concentration-mass relation and the correlation function down to small scales. Selected subsets of the simulation data products are publicly available via the HACC Simulation Data Portal.


title: Gravitational Lensing of Supernova Neutrino Bursts

abstract: Supernova neutrino bursts have been observed from extragalactic distances. This note addresses the question of how gravitational lensing could distort the information in the burst. We apply the gravitational lens hypothesis to try to understand the time and brightness structure of the SN1987A neutrino observations. Estimates of a possible lensing mass and alignment are made. These estimates suggest a path to verification.


title: SideControl: Controlled Open-domain Dialogue Generation via Additive Side Networks

abstract: Transformer-based pre-trained language models boost the performance of open-domain dialogue systems. Prior works leverage Transformer-based pre-trained language models to generate texts with desired attributes in two general approaches: (1) gradient-based methods: updating all latent representations of pre-trained models with gradients from attribute models; (2) weighted-decoding methods: re-ranking beam candidates from pre-trained models with attribute functions. However, gradient-based methods lead to high computation cost and can easily get overfitted on small training sets, while weighted-decoding methods are inherently constrained by the low-variance high-bias pre-trained model. In this work, we propose a novel approach to control the generation of Transformer-based pre-trained language models: the SideControl framework, which leverages a novel control attributes loss to incorporate useful control signals, and is shown to perform well with very limited training samples. We evaluate our proposed method on two benchmark open-domain dialogue datasets, and results show that the SideControl framework has better controllability, higher generation quality and better sample-efficiency than existing gradient-based and weighted-decoding baselines.


title: Limiting Behavior of Resistances in Triangular Graphs

abstract: Barrett et al studied resistance labels of electrical circuits whose underlying graphs when embedded in the Cartesian plane has the form of an $n$-grid, $n$ rows of upright triangles. Proofs in Barrett introduced a row-reduction algorithm which uses series, $\Delta$--Y, and Y--$\Delta$ electric transformations to transform an $n$-grid into an $n-1$ grid with equivalent resistances between specified nodes. This paper explores this row-reduction algorithm computationally. The introductory part of the paper presents several conjectures supported by numerical evidence, showing that repeated application of the row-reduction algorithm to an initial $n$-grid uniformly labeled 1 asymptotically produces triangular grids whose sides are labeled with rational multiples of $\frac{1}{e};$ moreover, the ratio of specified consecutive edges in the row-reduced grids are asymptotically described by four rational functions. The main part of this paper studies a family of graphs whose edge labels are determined using these limiting edge-ratios functions arising in the conjectures. The main result proven is that these $n$-grids and their repeated reductions under the row-reduction algorithm possess vertical and rotational symmetries and satisfy the relationships captured by the four edge-ratio functions. Thus, the limiting edge-ratio relationships are local algebraic relationships mirroring the global vertical and rotational symmetries possessed by the underlying graph. Additionally, because row-reduction is local (in contrast to the combinatoric Laplacian which is global) the paper is able to introduce a mechanical verification method of proof for assertions about effective resistance identities.


title: Classical Complexity of Unitary Transformations

abstract: We discuss a classical complexity of finite-dimensional unitary transformations, which can been seen as a computable approximation of classical descriptional complexity of a unitary transformation acting on a set of qubits.


title: A Fully-Integrated 5mW, 0.8Gbps Energy-Efficient Chip-to-Chip Data Link for Ultra-Low-Power IoT End-Nodes in 65-nm CMOS

abstract: The increasing complexity of Internet-of-Things (IoT) applications and near-sensor processing algorithms is pushing the computational power of low-power, battery-operated end-node systems. This trend also reveals growing demands for high-speed and energy-efficient inter-chip communications to manage the increasing amount of data coming from off-chip sensors and memories. While traditional micro-controller interfaces such as SPIs cannot cope with tight energy and large bandwidth requirements, low-voltage swing transceivers can tackle this challenge thanks to their capability to achieve several Gbps of the communication speed at milliwatt power levels. However, recent research on high-speed serial links focused on high-performance systems, with a power consumption significantly larger than the one of low-power IoT end-nodes, or on stand-alone designs not integrated at a system level. This paper presents a low-swing transceiver for the energy-efficient and low power chip-to-chip communication fully integrated within an IoT end-node System-on-Chip, fabricated in CMOS 65nm technology. The transceiver can be easily controlled via a software interface; thus, we can consider realistic scenarios for the data communication, which cannot be assessed in stand-alone prototypes. Chip measurements show that the transceiver achieves 8.46x higher energy efficiency at 15.9x higher performance than a traditional microcontroller interface such as a single-SPI.


title: Counterfactual Evaluation for Explainable AI

abstract: While recent years have witnessed the emergence of various explainable methods in machine learning, to what degree the explanations really represent the reasoning process behind the model prediction -- namely, the faithfulness of explanation -- is still an open problem. One commonly used way to measure faithfulness is \textit{erasure-based} criteria. Though conceptually simple, erasure-based criterion could inevitably introduce biases and artifacts. We propose a new methodology to evaluate the faithfulness of explanations from the \textit{counterfactual reasoning} perspective: the model should produce substantially different outputs for the original input and its corresponding counterfactual edited on a faithful feature. Specially, we introduce two algorithms to find the proper counterfactuals in both discrete and continuous scenarios and then use the acquired counterfactuals to measure faithfulness. Empirical results on several datasets show that compared with existing metrics, our proposed counterfactual evaluation method can achieve top correlation with the ground truth under diffe


title: Risk of Cascading Failures in Time-Delayed Vehicle Platooning

abstract: We develop a systemic risk framework to explore cascading systemic failures in networked control systems. A time-delayed version of the vehicle platooning problem is used as a benchmark to study the interplay among network connectivity, system dynamics, physical limitations, and uncertainty onto the possibility of cascading failure phenomena. The measure of value-at-risk is employed to investigate the domino effect of failures among pairs of vehicles within the platoon. The systemic risk framework is suitably extended to quantify the robustness of cascading failures via a novel manipulation of bi-variate distribution. We establish closed-form risk formulas that explain the effect of network parameters (e.g., Laplacian eigen-spectrum, time delay), noise statistics, and systemic event sets onto the cascading failures. Our findings can be applied to the design of robust platoons to lower the cascading risk. We support our theoretical results with extensive simulations.