title: Performance Analysis for Correlated AoI and Energy Efficiency in Heterogeneous CR-IoT System

abstract: We consider a cognitive radio based Internet of Things (CR-IoT) system where the secondary IoT device (SD) accesses the licensed channel during the transmission vacancies of the primary IoT device (PD). We focus on the impact of the IoT devices' heterogeneous traffic pattern on the energy efficiency and on the age of information (AoI) performance of the SD. We first derive closed-form expressions of the energy efficiency and the average AoI, and subsequently explore their convexity and monotonicity to the transmit power. Following these characterizations, an optimal transmit power optimization algorithm (TPOA) is proposed for the SD to maximize the energy efficiency while maintaining the average AoI under a predefined threshold. Numerical results verify the different preferences of the SD toward different PD traffic patterns, and provides insights into the tradeoff between the energy efficiency and the average AoI.


title: Challenges of Applying E-Learning in the Libyan Higher Education System

abstract: The adoption of ICT in classrooms is very important in order to improve education quality, promote effective management of knowledge, and improve delivery of knowledge in higher education. Some of the Libyan universities have already started using E-learning in classrooms, but many challenges are still hindering that adoption. This paper endeavors to find the obstacles that may face the adoption of E-learning in Libya and sketches out the possible solutions. Further, it highlights the potentials for the adoption of E-learning in the higher education system in Libya using both qualitative and quantitative approaches. Both questioner and interview have been used on a focused group to collect the data. Teachers and students at Al Asmarya Islamic University have been selected as a sample for this study. This paper reveals that the challenges hindering teachers and students from using ICT and E-learning are: the lack of knowledge about ICT and E-learning, the lack of ICT infrastructure, and the lack of financial support. However, the participants show a high level of interest in applying the ICT and E-learning in the university despite the unsuitability of the environment.


title: Existence and convergence of solutions to fractional pure critical exponent problems

abstract: We study existence and convergence properties of least-energy symmetric solutions (l.e.s.s.) to the pure critical problem \begin{equation*} (-\Delta)^su_s=|u_s|^{2^\star_s-2}u_s, \quad u_s\in D^s_0(\Omega),\quad 2^\star_s:=\frac{2N}{N-2s}, \end{equation*} where $s$ is any positive number, $\Omega$ is either $\mathbb{R}^N$ or a smooth symmetric bounded domain, and $D^s_0(\Omega)$ is the homogeneous Sobolev space. Depending on the kind of symmetry considered, solutions can be sign changing. We show that, up to a subsequence, a l.e.s.s. $u_s$ converges to a l.e.s.s. $u_{t}$ as $s$ goes to any $t>0$. In bounded domains, this convergence can be characterized in terms of an homogeneous fractional norm of order $t-\varepsilon$. A similar characterization is no longer possible in unbounded domains due to scaling invariance and an incompatibility with the functional spaces; to circumvent these difficulties, we use a suitable rescaling and characterize the convergence via cut-off functions. If $t$ is an integer, these results describe in a precise way the nonlocal-to-local transition. Finally, we also include a nonexistence result of nontrivial nonnegative solutions in a ball for any $s>1$.


title: NEAT: A Framework for Automated Exploration of Floating Point Approximations

abstract: Much recent research is devoted to exploring tradeoffs between computational accuracy and energy efficiency at different levels of the system stack. Approximation at the floating point unit (FPU) allows saving energy by simply reducing the number of computed floating point bits in return for accuracy loss. Although, finding the most energy efficient approximation for various applications with minimal effort is the main challenge. To address this issue, we propose NEAT: a pin tool that helps users automatically explore the accuracy-energy tradeoff space induced by various floating point implementations. NEAT helps programmers explore the effects of simultaneously using multiple floating point implementations to achieve the lowest energy consumption for an accuracy constraint or vice versa. NEAT accepts one or more user-defined floating point implementations and programmable placement rules for where/when to apply them. NEAT then automatically replaces floating point operations with different implementations based on the user-specified rules during the runtime and explores the resulting tradeoff space to find the best use of approximate floating point implementations for the precision tuning throughout the program. We evaluate NEAT by enforcing combinations of 24/53 different floating point implementations with three sets of placement rules on a wide range of benchmarks. We find that heuristic precision tuning at the function level provides up to 22% and 48% energy savings at 1% and 10% accuracy loss comparing to applying a single implementation for the whole application. Also, NEAT is applicable to neural networks where it finds the optimal precision level for each layer considering an accuracy target for the model.


title: Rotation of the convective core in $\gamma$ Dor stars measured by dips in period spacings of g modes coupled with inertial modes

abstract: The relation of period spacing ($\Delta P$) versus period ($P$) of dipole prograde g modes is known to be useful to measure rotation rates in the g-mode cavity of rapidly rotating $\gamma$ Dor and slowly pulsating B (SPB) stars. In a rapidly rotating star, an inertial mode in the convective core can resonantly couple with g modes propagative in the surrounding radiative region. The resonant coupling causes a dip in the $P$-$\Delta P$ relation, distinct from the modulations due to the chemical composition gradient. Such a resonance dip in $\Delta P$ of prograde dipole g modes appears around a frequency corresponding to a spin parameter $2f_{\rm rot}{\rm(cc)}/\nu_{\rm co-rot} \sim 8-11$ with $f_{\rm rot}$(cc) being the rotation frequency of the convective core and $\nu_{\rm co-rot}$ the pulsation frequency in the co-rotating frame. The spin parameter at the resonance depends somewhat on the extent of core overshooting, central hydrogen abundance, and other stellar parameters. We can fit the period at the observed dip with the prediction from prograde dipole g modes of a main-sequence model, allowing the convective core to rotate differentially from the surrounding g-mode cavity. We have performed such fittings for 16 selected $\gamma$ Dor stars having well defined dips, and found that the majority of $\gamma$ Dor stars we studied rotate nearly uniformly, while convective cores tend to rotate slightly faster than the g-mode cavity in less evolved stars.


title: First Target and Opinion then Polarity: Enhancing Target-opinion Correlation for Aspect Sentiment Triplet Extraction

abstract: Aspect Sentiment Triplet Extraction (ASTE) aims to extract triplets from a sentence, including target entities, associated sentiment polarities, and opinion spans which rationalize the polarities. Existing methods are short on building correlation between target-opinion pairs, and neglect the mutual interference among different sentiment triplets. To address these issues, we utilize a two-stage framework to enhance the correlation between targets and opinions: at stage one, we extract targets and opinions through sequence tagging; then we append a group of artificial tags named Perceivable Pair, which indicate the span of a specific target-opinion tuple, to the input sentence to obtain closer correlated target-opinion pair representation. Meanwhile, we reduce the negative interference between triplets by restricting tokens' attention field. Finally, the polarity is identified according to the representation of the Perceivable Pair. We conduct experiments on four datasets, and the experimental results show the effectiveness of our model.


title: Oscars: Adaptive Semi-Synchronous Parallel Model for Distributed Deep Learning with Global View

abstract: Deep learning has become an indispensable part of life, such as face recognition, NLP, etc., but the training of deep model has always been a challenge, and in recent years, the complexity of training data and models has shown explosive growth, so the training method is gradually transformed into distributed training. Classical synchronization strategy can guarantee accuracy but frequent communication can lead to a slow training speed, although asynchronous strategy training speed but can not guarantee the accuracy, and in the face of the training of the heterogeneous cluster, the above work is not efficient to work, on the one hand, can cause serious waste of resources, on the other hand, frequent communication also made slow training speed, so this paper proposes a semi-synchronous training strategy based on local-SDG, effectively improve the utilization efficiency of heterogeneous resources cluster and reduce communication overhead, to accelerate the training and ensure the accuracy of the model.


title: Weighted Recursive Least Square Filter and Neural Network based Residual Echo Suppression for the AEC-Challenge

abstract: This paper presents a real-time Acoustic Echo Cancellation (AEC) algorithm submitted to the AEC-Challenge. The algorithm consists of three modules: Generalized Cross-Correlation with PHAse Transform (GCC-PHAT) based time delay compensation, weighted Recursive Least Square (wRLS) based linear adaptive filtering and neural network based residual echo suppression. The wRLS filter is derived from a novel semi-blind source separation perspective. The neural network model predicts a Phase-Sensitive Mask (PSM) based on the aligned reference and the linear filter output. The algorithm achieved a mean subjective score of 4.00 and ranked 2nd in the AEC-Challenge.


title: Counting, equidistribution and entropy gaps at infinity with applications to cusped Hitchin representations

abstract: We show that if an eventually positive, non-arithmetic, locally H\"older continuous potential for a topologically mixing countable Markov shift with (BIP) has an entropy gap at infinity, then one may apply the renewal theorem of Kesseb\"ohmer and Kombrink to obtain counting and equidistribution results. We apply these general results to obtain counting and equidistribution results for cusped Hitchin representations, and more generally for cusped Anosov representations of geometrically finite Fuchsian groups.


title: Integrating Pre-trained Model into Rule-based Dialogue Management

abstract: Rule-based dialogue management is still the most popular solution for industrial task-oriented dialogue systems for their interpretablility. However, it is hard for developers to maintain the dialogue logic when the scenarios get more and more complex. On the other hand, data-driven dialogue systems, usually with end-to-end structures, are popular in academic research and easier to deal with complex conversations, but such methods require plenty of training data and the behaviors are less interpretable. In this paper, we propose a method to leverages the strength of both rule-based and data-driven dialogue managers (DM). We firstly introduce the DM of Carina Dialog System (CDS, an advanced industrial dialogue system built by Microsoft). Then we propose the "model-trigger" design to make the DM trainable thus scalable to scenario changes. Furthermore, we integrate pre-trained models and empower the DM with few-shot capability. The experimental results demonstrate the effectiveness and strong few-shot capability of our method.


title: Recoverability Landscape of Tree Structured Markov Random Fields under Symmetric Noise

abstract: We study the problem of learning tree-structured Markov random fields (MRF) on discrete random variables with common support when the observations are corrupted by a $k$-ary symmetric noise channel with unknown probability of error. For Ising models (support size = 2), past work has shown that graph structure can only be recovered up to the leaf clusters (a leaf node, its parent, and its siblings form a leaf cluster) and exact recovery is impossible. No prior work has addressed the setting of support size of 3 or more, and indeed this setting is far richer. As we show, when the support size is 3 or more, the structure of the leaf clusters may be partially or fully identifiable. We provide a precise characterization of this phenomenon and show that the extent of recoverability is dictated by the joint PMF of the random variables. In particular, we provide necessary and sufficient conditions for exact recoverability. Furthermore, we present a polynomial time, sample efficient algorithm that recovers the exact tree when this is possible, or up to the unidentifiability as promised by our characterization, when full recoverability is impossible. Finally, we demonstrate the efficacy of our algorithm experimentally.


title: Towards Memristive Deep Learning Systems for Real-time Mobile Epileptic Seizure Prediction

abstract: The unpredictability of seizures continues to distress many people with drug-resistant epilepsy. On account of recent technological advances, considerable efforts have been made using different hardware technologies to realize smart devices for the real-time detection and prediction of seizures. In this paper, we investigate the feasibility of using Memristive Deep Learning Systems (MDLSs) to perform real-time epileptic seizure prediction on the edge. Using the MemTorch simulation framework and the Children's Hospital Boston (CHB)-Massachusetts Institute of Technology (MIT) dataset we determine the performance of various simulated MDLS configurations. An average sensitivity of 77.4% and a Area Under the Receiver Operating Characteristic Curve (AUROC) of 0.85 are reported for the optimal configuration that can process Electroencephalogram (EEG) spectrograms with 7,680 samples in 1.408ms while consuming 0.0133W and occupying an area of 0.1269mm$^2$ in a 65nm Complementary Metal-Oxide-Semiconductor (CMOS) process.


title: Deep cross-modality (MR-CT) educed distillation learning for cone beam CT lung tumor segmentation

abstract: Despite the widespread availability of in-treatment room cone beam computed tomography (CBCT) imaging, due to the lack of reliable segmentation methods, CBCT is only used for gross set up corrections in lung radiotherapies. Accurate and reliable auto-segmentation tools could potentiate volumetric response assessment and geometry-guided adaptive radiation therapies. Therefore, we developed a new deep learning CBCT lung tumor segmentation method. Methods: The key idea of our approach called cross modality educed distillation (CMEDL) is to use magnetic resonance imaging (MRI) to guide a CBCT segmentation network training to extract more informative features during training. We accomplish this by training an end-to-end network comprised of unpaired domain adaptation (UDA) and cross-domain segmentation distillation networks (SDN) using unpaired CBCT and MRI datasets. Feature distillation regularizes the student network to extract CBCT features that match the statistical distribution of MRI features extracted by the teacher network and obtain better differentiation of tumor from background.} We also compared against an alternative framework that used UDA with MR segmentation network, whereby segmentation was done on the synthesized pseudo MRI representation. All networks were trained with 216 weekly CBCTs and 82 T2-weighted turbo spin echo MRI acquired from different patient cohorts. Validation was done on 20 weekly CBCTs from patients not used in training. Independent testing was done on 38 weekly CBCTs from patients not used in training or validation. Segmentation accuracy was measured using surface Dice similarity coefficient (SDSC) and Hausdroff distance at 95th percentile (HD95) metrics.


title: Re-identification of Individuals in Genomic Datasets Using Public Face Images

abstract: DNA sequencing is becoming increasingly commonplace, both in medical and direct-to-consumer settings. To promote discovery, collected genomic data is often de-identified and shared, either in public repositories, such as OpenSNP, or with researchers through access-controlled repositories. However, recent studies have suggested that genomic data can be effectively matched to high-resolution three-dimensional face images, which raises a concern that the increasingly ubiquitous public face images can be linked to shared genomic data, thereby re-identifying individuals in the genomic data. While these investigations illustrate the possibility of such an attack, they assume that those performing the linkage have access to extremely well-curated data. Given that this is unlikely to be the case in practice, it calls into question the pragmatic nature of the attack. As such, we systematically study this re-identification risk from two perspectives: first, we investigate how successful such linkage attacks can be when real face images are used, and second, we consider how we can empower individuals to have better control over the associated re-identification risk. We observe that the true risk of re-identification is likely substantially smaller for most individuals than prior literature suggests. In addition, we demonstrate that the addition of a small amount of carefully crafted noise to images can enable a controlled trade-off between re-identification success and the quality of shared images, with risk typically significantly lowered even with noise that is imperceptible to humans.


title: Machine-learning-assisted electron-spin readout of nitrogen-vacancy center in diamond

abstract: Machine learning is a powerful tool in finding hidden data patterns for quantum information processing. Here, we introduce this method into the optical readout of electron-spin states in diamond via single-photon collection and demonstrate improved readout precision at room temperature. The traditional method of summing photon counts in a time gate loses all the timing information crudely. We find that changing the gate width can only optimize the contrast or the state variance, not both. In comparison, machine learning adaptively learns from time-resolved fluorescence data, and offers the optimal data processing model that elaborately weights each time bin to maximize the extracted information. It is shown that our method can repair the processing result from imperfect data, reducing 7% in spin readout error while optimizing the contrast. Note that these improvements only involve recording photon time traces and consume no additional experimental time, they are thus robust and free. Our machine learning method implies a wide range of applications in precision measurement and optical detection of states.


title: Numerical Solver for the Boltzmann Equation With Self-Adaptive Collision Operators

abstract: We use the Burnett spectral method to solve the Boltzmann equation whose collision term is modeled by separate treatments for the low-frequency part and high-frequency part of the solution. For the low-frequency part representing the sketch of the distribution function, the binary collision is applied, while for the high-frequency part representing the finer details, the BGK approximation is applied. The parameter controlling the ratio of the high-frequency part and the low-frequency part is selected adaptively on every grid cell at every time step. This self-adaptation is based on an error indicator describing the difference between the model collision term and the original binary collision term. The indicator is derived by controlling the quadratic terms in the modeling error with linear operators. Our numerical experiments show that such an error indicator is effective and computationally affordable.


title: Fair division of graphs and of tangled cakes

abstract: A tangle is a connected topological space constructed by gluing several copies of the unit interval $[0, 1]$. We explore which tangles guarantee envy-free allocations of connected shares for n agents, meaning that such allocations exist no matter which monotonic and continuous functions represent agents' valuations. Each single tangle $\mathcal{T}$ corresponds in a natural way to an infinite topological class $\mathcal{G}(\mathcal{T})$ of multigraphs, many of which are graphs. This correspondence links EF fair division of tangles to EFk$_{outer}$ fair division of graphs. We know from Bil\`o et al that all Hamiltonian graphs guarantee EF1$_{outer}$ allocations when the number of agents is 2, 3, 4 and guarantee EF2$_{outer}$ allocations for arbitrarily many agents. We show that exactly six tangles are stringable; these guarantee EF connected allocations for any number of agents, and their associated topological classes contain only Hamiltonian graphs. Any non-stringable tangle has a finite upper bound r on the number of agents for which EF allocations of connected shares are guaranteed. Most graphs in the associated non-stringable topological class are not Hamiltonian, and a negative transfer theorem shows that for each $k \geq 1$ most of these graphs fail to guarantee EFk$_{outer}$ allocations of vertices for r + 1 or more agents. This answers a question posed in Bil\`o et al, and explains why a focus on Hamiltonian graphs was necessary. With bounds on the number of agents, however, we obtain positive results for some non-stringable classes. An elaboration of Stromquist's moving knife procedure shows that the non-stringable lips tangle guarantees envy-free allocations of connected shares for three agents. We then modify the discrete version of Stromquist's procedure in Bil\`o et al to show that all graphs in the topological class guarantee EF1$_{outer}$ allocations for three agents.


title: A single parameterization for dark energy and modified gravity models

abstract: Perhaps the most explored hypothesis for the accelerated cosmic expansion rate arises in the context of extra fields or modifications to General Relativity. A prevalent approach is to parameterize the expansion history through the equation of state, $\omega(z)$. We present a parametric form for $\omega(z)$ that can reproduce the generic behavior of the most widely used physical models for accelerated expansion with infrared corrections. The present proposal has at most 3 free parameters which can be mapped back to specific archetypal models for dark energy. We analyze in detail how different combinations of data can constrain the specific cases embedded in our form for $\omega(z)$. We implement our parametric equation for $\omega(z)$ to observations from CMB, the luminous distance of SNeIa, cosmic chronometers, and baryon acoustic oscillations identified in galaxies and in the Lymann-$\alpha$ forest. We find that the parameters can be well constrained by using different observational data sets. Our findings point to an oscillatory behavior consistent with an $f(R)$-like model or an unknown combination of scalar fields. When we let the three parameters vary freely, we find an EoS which oscillates around the phantom-dividing line, and, with over 99$\%$ of confidence, the cosmological constant solution is disfavored.


title: Mode-Assisted Joint Training of Deep Boltzmann Machines

abstract: The deep extension of the restricted Boltzmann machine (RBM), known as the deep Boltzmann machine (DBM), is an expressive family of machine learning models which can serve as compact representations of complex probability distributions. However, jointly training DBMs in the unsupervised setting has proven to be a formidable task. A recent technique we have proposed, called mode-assisted training, has shown great success in improving the unsupervised training of RBMs. Here, we show that the performance gains of the mode-assisted training are even more dramatic for DBMs. In fact, DBMs jointly trained with the mode-assisted algorithm can represent the same data set with orders of magnitude lower number of total parameters compared to state-of-the-art training procedures and even with respect to RBMs, provided a fan-in network topology is also introduced. This substantial saving in number of parameters makes this training method very appealing also for hardware implementations.


title: Hidden Symmetries in Deformed Very Special Relativity

abstract: We study particle dynamics in a space-time invariant under the $DISIM_b(2)$ group - the deformation of the $ISIM(2)$ symmetry group of very special relativity. We find that the Lorentz violation leads to the creation of higher order (hidden) symmetries which are connected to those broken at the space-time level. Through the perspective of the conserved quantities of the special relativistic case the Lorentz violation is linked to specific non-commutative relations in phase-space.


title: Testing the Turbulent Origin of the Stellar Initial Mass Function

abstract: Supersonic turbulence in the interstellar medium (ISM) is closely linked to the formation of stars, and hence many theories connect the stellar initial mass function (IMF) with the turbulent properties of molecular clouds. Here we test three turbulence-based IMF models (by Padoan & Nordlund 2002, Hennebelle & Chabrier 2008, and Hopkins 2012), which predict the relation between the high-mass slope ($\Gamma$) of the IMF, $\mathrm{d} N/\mathrm{d} \log M \propto M^{\Gamma}$ and the exponent n of the velocity power spectrum of turbulence, $E_v(k)\propto k^{-n} $, where $n\approx 2$ corresponds to typical ISM turbulence. Using hydrodynamic simulations, we drive turbulence with an unusual index of $n\approx 1$, measure $\Gamma$, and compare the results with $n\approx 2$. We find that reducing $n$ from 2 to 1 primarily changes the high-mass region of the IMF (beyond the median mass), where we measure high-mass slopes within the 95 per cent confidence interval of $-1.5<\Gamma<-1$ for $n \approx 1$ and $-3.7<\Gamma<-2.4$ for $n\approx 2$, respectively. Thus, we find that $n=1$ results in a significantly flatter high-mass slope of the IMF, with more massive stars formed than for $n \approx 2$. We compare these simulations with the predictions of the three IMF theories. We find that while the Padoan & Nordlund theory matches our simulations with fair accuracy, the other theories either fail to reproduce the main qualitative outcome of the simulations or require some modifications. We conclude that turbulence plays a key role in shaping the IMF, with a shallower turbulence power spectrum producing a shallower high-mass IMF, and hence more massive stars.


title: Contextual Skipgram: Training Word Representation Using Context Information

abstract: The skip-gram (SG) model learns word representation by predicting the words surrounding a center word from unstructured text data. However, not all words in the context window contribute to the meaning of the center word. For example, less relevant words could be in the context window, hindering the SG model from learning a better quality representation. In this paper, we propose an enhanced version of the SG that leverages context information to produce word representation. The proposed model, Contextual Skip-gram, is designed to predict contextual words with both the center words and the context information. This simple idea helps to reduce the impact of irrelevant words on the training process, thus enhancing the final performance


title: Functional Control of Oscillator Networks

abstract: Oscillatory activity is ubiquitous in natural and engineered network systems. The interaction scheme underlying interdependent oscillatory components governs the emergence of network-wide patterns of synchrony that regulate and enable complex functions. Yet, understanding, and ultimately harnessing, the structure-function relationship in oscillator networks remains an outstanding challenge of modern science. Here, we address this challenge by presenting a principled method to prescribe exact and robust functional configurations from local network interactions through optimal tuning of the oscillators' parameters. To quantify the behavioral synchrony between coupled oscillators, we introduce the notion of functional pattern, which encodes the pairwise relationships between the oscillators' phases. Our procedure is computationally efficient and provably correct, accounts for constrained interaction types, and allows to concurrently assign multiple desired functional patterns. Further, we derive algebraic and graph-theoretic conditions to guarantee the feasibility and stability of target functional patterns. These conditions provide an interpretable mapping between the structural constraints and their functional implications in oscillator networks. As a proof of concept, we apply the proposed method to replicate empirically recorded functional relationships from cortical oscillations in a human brain, and to redistribute the active power flow in different models of electrical grids.


title: Ensemble Transfer Learning of Elastography and B-mode Breast Ultrasound Images

abstract: Computer-aided detection (CAD) of benign and malignant breast lesions becomes increasingly essential in breast ultrasound (US) imaging. The CAD systems rely on imaging features identified by the medical experts for their performance, whereas deep learning (DL) methods automatically extract features from the data. The challenge of the DL is the insufficiency of breast US images available to train the DL models. Here, we present an ensemble transfer learning model to classify benign and malignant breast tumors using B-mode breast US (B-US) and strain elastography breast US (SE-US) images. This model combines semantic features from AlexNet & ResNet models to classify benign from malignant tumors. We use both B-US and SE-US images to train the model and classify the tumors. We retrospectively gathered 85 patients' data, with 42 benign and 43 malignant cases confirmed with the biopsy. Each patient had multiple B-US and their corresponding SE-US images, and the total dataset contained 261 B-US images and 261 SE-US images. Experimental results show that our ensemble model achieves a sensitivity of 88.89% and specificity of 91.10%. These diagnostic performances of the proposed method are equivalent to or better than manual identification. Thus, our proposed ensemble learning method would facilitate detecting early breast cancer, reliably improving patient care.


title: Generalizations of Alladi's formula for arithmetical semigroups

abstract: In this article, we prove that a general version of Alladi's formula with Dirichlet convolution holds for arithmetical semigroups satisfying Axiom $A$ or Axiom $A^{\#}$. As applications, we apply our main results to certain semigroups coming from algebraic number theory, arithmetical geometry and graph theory, particularly generalizing the results of Wang 2021, Kural et al. 2020 and Duan et al. 2020.


title: Constructing a Distance Sensitivity Oracle in $O(n^{2.5794}M)$ Time

abstract: We continue the study of distance sensitivity oracles (DSOs). Given a directed graph $G$ with $n$ vertices and edge weights in $\{1, 2, \dots, M\}$, we want to build a data structure such that given any source vertex $u$, any target vertex $v$, and any failure $f$ (which is either a vertex or an edge), it outputs the length of the shortest path from $u$ to $v$ not going through $f$. Our main result is a DSO with preprocessing time $O(n^{2.5794}M)$ and constant query time. Previously, the best preprocessing time of DSOs for directed graphs is $O(n^{2.7233}M)$, and even in the easier case of undirected graphs, the best preprocessing time is $O(n^{2.6865}M)$ [Ren, ESA 2020]. One drawback of our DSOs, though, is that it only supports distance queries but not path queries. Our main technical ingredient is an algorithm that computes the inverse of a degree-$d$ polynomial matrix (i.e. a matrix whose entries are degree-$d$ univariate polynomials) modulo $x^r$. The algorithm is adapted from [Zhou, Labahn, and Storjohann, Journal of Complexity, 2015], and we replace some of its intermediate steps with faster rectangular matrix multiplication algorithms. We also show how to compute unique shortest paths in a directed graph with edge weights in $\{1, 2, \dots, M\}$, in $O(n^{2.5286}M)$ time. This algorithm is crucial in the preprocessing algorithm of our DSO. Our solution improves the $O(n^{2.6865}M)$ time bound in [Ren, ESA 2020], and matches the current best time bound for computing all-pairs shortest paths.


title: Outside the Echo Chamber: Optimizing the Performative Risk

abstract: In performative prediction, predictions guide decision-making and hence can influence the distribution of future data. To date, work on performative prediction has focused on finding performatively stable models, which are the fixed points of repeated retraining. However, stable solutions can be far from optimal when evaluated in terms of the performative risk, the loss experienced by the decision maker when deploying a model. In this paper, we shift attention beyond performative stability and focus on optimizing the performative risk directly. We identify a natural set of properties of the loss function and model-induced distribution shift under which the performative risk is convex, a property which does not follow from convexity of the loss alone. Furthermore, we develop algorithms that leverage our structural assumptions to optimize the performative risk with better sample efficiency than generic methods for derivative-free convex optimization.


title: Self-Triggered Markov Decision Processes

abstract: In this paper, we study Markov Decision Processes (MDPs) with self-triggered strategies, where the idea of self-triggered control is extended to more generic MDP models. This extension broadens the application of self-triggering policies to a broader range of systems. We study the co-design problems of the control policy and the triggering policy to optimize two pre-specified cost criteria. The first cost criterion is introduced by incorporating a pre-specified update penalty into the traditional MDP cost criteria to reduce the use of communication resources. Under this criteria, a novel dynamic programming (DP) equation called DP equation with optimized lookahead to proposed to solve for the self-triggering policy under this criteria. The second self-triggering policy is to maximize the triggering time while still guaranteeing a pre-specified level of sub-optimality. Theoretical underpinnings are established for the computation and implementation of both policies. Through a gridworld numerical example, we illustrate the two policies' effectiveness in reducing sources consumption and demonstrate the trade-offs between resource consumption and system performance.


title: Unveiling the Hybridization Process in a Quantum Critical Ferromagnet by Ultrafast Optical Spectroscopy

abstract: We report the ultrafast optical pump-probe spectroscopy measurements on the recently discovered quantum critical ferromagnet CeRh$_6$Ge$_4$. Our experimental results reveal the two-stage development of the hybridization between localized $f$ moments and conduction electrons with lowering temperature, as evidenced by (1) the presence of hybridization fluctuation for temperatures from $\sim$85 K ($T^*$) to $\sim$140 K ($T^\dagger$), and (2) the emergence of collective hybridization below the coherence temperature, $T^*$, marked by the opening of an indirect gap of 2$\Delta$ $\approx$12 meV. We also observe three coherent phonon modes being softened anomalously below $T^*$, reflecting directly their coupling with the emergent coherent heavy electrons. Our findings establish the universal nature of the hybridization process in different heavy fermion systems.


title: Robust Mean Estimation in High Dimensions: An Outlier Fraction Agnostic and Efficient Algorithm

abstract: The problem of robust mean estimation in high dimensions is studied, in which a certain fraction (less than half) of the datapoints can be arbitrarily corrupted. Motivated by compressive sensing, the robust mean estimation problem is formulated as the minimization of the $\ell_0$-`norm' of an \emph{outlier indicator vector}, under a second moment constraint on the datapoints. The $\ell_0$-`norm' is then relaxed to the $\ell_p$-norm ($0<p\leq 1$) in the objective, and it is shown that the global minima for each of these objectives are order-optimal and have optimal breakdown point for the robust mean estimation problem. Furthermore, a computationally tractable iterative $\ell_p$-minimization and hard thresholding algorithm is proposed that outputs an order-optimal robust estimate of the population mean. The proposed algorithm (with breakdown point $\approx 0.3$) does not require prior knowledge of the fraction of outliers, in contrast with most existing algorithms, and for $p=1$ it has near-linear time complexity. Both synthetic and real data experiments demonstrate that the proposed algorithm outperforms state-of-the-art robust mean estimation methods.


title: Firefly Neural Architecture Descent: a General Approach for Growing Neural Networks

abstract: We propose firefly neural architecture descent, a general framework for progressively and dynamically growing neural networks to jointly optimize the networks' parameters and architectures. Our method works in a steepest descent fashion, which iteratively finds the best network within a functional neighborhood of the original network that includes a diverse set of candidate network structures. By using Taylor approximation, the optimal network structure in the neighborhood can be found with a greedy selection procedure. We show that firefly descent can flexibly grow networks both wider and deeper, and can be applied to learn accurate but resource-efficient neural architectures that avoid catastrophic forgetting in continual learning. Empirically, firefly descent achieves promising results on both neural architecture search and continual learning. In particular, on a challenging continual image classification task, it learns networks that are smaller in size but have higher average accuracy than those learned by the state-of-the-art methods.


title: End-to-end lyrics Recognition with Voice to Singing Style Transfer

abstract: Automatic transcription of monophonic/polyphonic music is a challenging task due to the lack of availability of large amounts of transcribed data. In this paper, we propose a data augmentation method that converts natural speech to singing voice based on vocoder based speech synthesizer. This approach, called voice to singing (V2S), performs the voice style conversion by modulating the F0 contour of the natural speech with that of a singing voice. The V2S model based style transfer can generate good quality singing voice thereby enabling the conversion of large corpora of natural speech to singing voice that is useful in building an E2E lyrics transcription system. In our experiments on monophonic singing voice data, the V2S style transfer provides a significant gain (relative improvements of 21%) for the E2E lyrics transcription system. We also discuss additional components like transfer learning and lyrics based language modeling to improve the performance of the lyrics transcription system.


title: Buckling without bending morphogenesis: Nonlinearities, spatial confinement, and branching hierarchies

abstract: During morphogenesis, a featureless convex cerebellum develops folds. As it does so, the cortex thickness is thinnest at the crest (gyri) and thickest at the trough (sulci) of the folds. This observation cannot be simply explained by elastic theories of buckling. A recent minimal model explained this phenomenon by modeling the developing cortex as a growing fluid under the constraints of radially spanning elastic fibers, a plia membrane and a nongrowing sub-cortex (Engstrom, et. al., PRX 2019). In this minimal buckling without bending morphogenesis (BWBM) model, the elastic fibers were assumed to act linearly with strain. Here, we explore how nonlinear elasticity influences shape development within BWBM. The nonlinear elasticity generates a quadratic nonlinearity in the differential equation governing the system's shape and leads to sharper troughs and wider crests, which is an identifying characteristic of cerebellar folds at later stages in development. As developing organs are typically not in isolation, we also explore the effects of steric confinement, and observe flattening of the crests. Finally, as a paradigmatic example, we propose a hierarchical version of BWBM from which a novel mechanism of branching morphogenesis naturally emerges to qualitatively predict later stages of the morphology of the developing cerebellum.


title: DO-GAN: A Double Oracle Framework for Generative Adversarial Networks

abstract: In this paper, we propose a new approach to train Generative Adversarial Networks (GANs) where we deploy a double-oracle framework using the generator and discriminator oracles. GAN is essentially a two-player zero-sum game between the generator and the discriminator. Training GANs is challenging as a pure Nash equilibrium may not exist and even finding the mixed Nash equilibrium is difficult as GANs have a large-scale strategy space. In DO-GAN, we extend the double oracle framework to GANs. We first generalize the players' strategies as the trained models of generator and discriminator from the best response oracles. We then compute the meta-strategies using a linear program. For scalability of the framework where multiple generators and discriminator best responses are stored in the memory, we propose two solutions: 1) pruning the weakly-dominated players' strategies to keep the oracles from becoming intractable; 2) applying continual learning to retain the previous knowledge of the networks. We apply our framework to established GAN architectures such as vanilla GAN, Deep Convolutional GAN, Spectral Normalization GAN and Stacked GAN. Finally, we conduct experiments on MNIST, CIFAR-10 and CelebA datasets and show that DO-GAN variants have significant improvements in both subjective qualitative evaluation and quantitative metrics, compared with their respective GAN architectures.


title: Evolving GAN Formulations for Higher Quality Image Synthesis

abstract: Generative Adversarial Networks (GANs) have extended deep learning to complex generation and translation tasks across different data modalities. However, GANs are notoriously difficult to train: Mode collapse and other instabilities in the training process often degrade the quality of the generated results, such as images. This paper presents a new technique called TaylorGAN for improving GANs by discovering customized loss functions for each of its two networks. The loss functions are parameterized as Taylor expansions and optimized through multiobjective evolution. On an image-to-image translation benchmark task, this approach qualitatively improves generated image quality and quantitatively improves two independent GAN performance metrics. It therefore forms a promising approach for applying GANs to more challenging tasks in the future.


title: Enhanced Modeling of Contingency Response in Security-constrained Optimal Power Flow

abstract: This paper provides an enhanced modeling of the contingency response that collectively reflects high-fidelity physical and operational characteristics of power grids. Integrating active and reactive power contingency responses into the security-constrained optimal power flow (SCOPF) problem is challenging, due to the nonsmoothness and nonconvexity of feasible sets in consequence of piece-wise curves representing generator characteristics. We introduce a continuously-differentiable model using functions that closely resemble PV/PQ switching and the generator contingency response. These models enforce physical and operational limits by optimally allocating active power imbalances among available generators and deciding the bus type to switch from the PV type to the PQ type. The efficacy of this method is numerically validated on the IEEE 30-bus, 300-bus, and 118-bus systems with 12, 10, and 100 contingencies, respectively.


title: The rotation of a sedimenting anisotropic particle in a linearly stratified ambient

abstract: We derive the torque on a spheroid of an arbitrary aspect ratio $\kappa$ sedimenting in a linearly stratified ambient. The analysis demarcates regions in parameter space corresponding to broadside-on and edgewise (longside-on) settling in the limit $Re, Ri_v \ll 1$, where $Re = \rho_0UL/\mu$ and $Ri_v =\gamma L^3g/\mu U$, the Reynolds and viscous Richardson numbers, respectively, are dimensionless measures of the importance of inertial and buoyancy forces relative to viscous ones. Here, $L$ is the spheroid semi-major axis, $U$ an appropriate settling velocity scale, $\mu$ the fluid viscosity, and $\gamma\,(>0)$ the (constant)\,density gradient characterizing the stably stratified ambient, with $\rho_0$ being the fluid density taken to be a constant within the Boussinesq framework. A reciprocal theorem formulation identifies three contributions to the torque: (1) an $O(Re)$ inertial contribution that already exists in a homogeneous ambient, and orients the spheroid broadside-on; (2) an $O(Ri_v)$ hydrostatic contribution due to the ambient linear stratification that also orients the spheroid broadside-on; and (3) a hydrodynamic contribution arising from the perturbation of the ambient stratification by the spheroid whose nature depends on $Pe$; $Pe = UL/D$ being the Peclet number with $D$ the diffusivity of the stratifying agent. For $Pe \gg 1$, the hydrodynamic contribution is $O(Ri_v^{\frac{2}{3}}$) in the Stokes stratification regime characterized by $Re \ll Ri_v^{\frac{1}{3}}$, and orients the spheroid edgewise regardless of $\kappa$. The differing orientation dependencies of the inertial and large-$Pe$ hydrodynamic stratification torques imply that the broadside-on and edgewise settling regimes are separated by two distinct $\kappa$-dependent critical curves in the $Ri_v/Re^{\frac{3}{2}}-\kappa$ plane. The predictions are consistent with recent experimental observations.


title: Efficient Scheduling of Data Augmentation for Deep Reinforcement Learning

abstract: In deep reinforcement learning (RL), data augmentation is widely considered as a tool to induce a set of useful priors about semantic consistency and improve sample efficiency and generalization performance. However, even when the prior is useful for generalization, distilling it to RL agent often interferes with RL training and degenerates sample efficiency. Meanwhile, the agent is forgetful of the prior due to the non-stationary nature of RL. These observations suggest two extreme schedules of distillation: (i) over the entire training; or (ii) only at the end. Hence, we devise a stand-alone network distillation method to inject the consistency prior at any time (even after RL), and a simple yet efficient framework to automatically schedule the distillation. Specifically, the proposed framework first focuses on mastering train environments regardless of generalization by adaptively deciding which {\it or no} augmentation to be used for the training. After this, we add the distillation to extract the remaining benefits for generalization from all the augmentations, which requires no additional new samples. In our experiments, we demonstrate the utility of the proposed framework, in particular, that considers postponing the augmentation to the end of RL training.


title: Optical back-action on the photothermal relaxation rate

abstract: Photothermal effects can alter the response of an optical cavity, for example, by inducing self-locking behavior or unstable anomalies. The consequences of these effects are often regarded as parasitic and generally cause limited operational performance of the cavity. Despite their importance, however, photothermal parameters are usually hard to characterize precisely. In this work we use an optical cavity strongly coupled to photothermal effects to experimentally observe an optical back-action on the photothermal relaxation rate. This effect, reminiscent of the radiation-pressure-induced optical spring effect in cavity optomechanical systems, uses optical detuning as a fine control to change the photothermal relaxation process. The photothermal relaxation rate of the system can be accordingly modified by more than an order of magnitude. This approach offers an opportunity to obtain precise in-situ estimations of the parameters of the cavity, in a way that is compatible with a wide range of optical resonator platforms. Through this back-action effect we are able to determine the natural photothermal relaxation rate and the effective thermal conductivity of the cavity mirrors with unprecedented resolution.


title: A Discrete-Time Switching System Analysis of Q-learning

abstract: This paper develops a novel control-theoretic framework to analyze the non-asymptotic convergence of Q-learning. We show that the dynamics of asynchronous Q-learning with a constant step-size can be naturally formulated as a discrete-time stochastic affine switching system. Moreover, the evolution of the Q-learning estimation error is over- and underestimated by trajectories of two simpler dynamical systems. Based on these two systems, we derive a new finite-time error bound of asynchronous Q-learning when a constant stepsize is used. Our analysis also sheds light on the overestimation phenomenon of Q-learning. We further illustrate and validate the analysis through numerical simulations.


title: Gradient estimates for singular $p$-Laplace type equations with measure data

abstract: We are concerned with interior and global gradient estimates for solutions to a class of singular quasilinear elliptic equations with measure data, whose prototype is given by the $p$-Laplace equation $-\Delta_p u=\mu$ with $p\in (1,2)$. The cases when $p\in \big(2-\frac 1 n,2\big)$ and $p\in \big(\frac{3n-2}{2n-1},2-\frac{1}{n}\big]$ were studied in [9] and [22], respectively. In this paper, we improve the results in [22] and address the open case when $p\in \big(1,\frac{3n-2}{2n-1}\big]$. Interior and global modulus of continuity estimates of the gradients of solutions are also established.


title: Towards Faithfulness in Open Domain Table-to-text Generation from an Entity-centric View

abstract: In open domain table-to-text generation, we notice that the unfaithful generation usually contains hallucinated content which can not be aligned to any input table record. We thus try to evaluate the generation faithfulness with two entity-centric metrics: table record coverage and the ratio of hallucinated entities in text, both of which are shown to have strong agreement with human judgements. Then based on these metrics, we quantitatively analyze the correlation between training data quality and generation fidelity which indicates the potential usage of entity information in faithful generation. Motivated by these findings, we propose two methods for faithful generation: 1) augmented training by incorporating the auxiliary entity information, including both an augmented plan-based model and an unsupervised model and 2) training instance selection based on faithfulness ranking. We show these approaches improve generation fidelity in both full dataset setting and few shot learning settings by both automatic and human evaluations.


title: Localization using Mobile Wireless Sensor Networks

abstract: Wireless Sensor Networks (WSNs) are groups of spatially distributed and dedicated autonomous sensors for monitoring (and recording) the physical conditions of the environment (and organizing the collected data at a central location). They have been a topic of interest due to their versatility and diverse capabilities despite having simple sensors measuring local quantities such as temperature, pH, or pressure. We delve into understanding how such networks can be utilized for localization, and propose a technique for improving conditions of living for animals and humans on the IIT Bombay campus.


title: Observation of strong and weak thermalization in a superconducting quantum processor

abstract: We experimentally study the ergodic dynamics of a 1D array of 12 superconducting qubits with a transverse field, and identify the regimes of strong and weak thermalization with different initial states. We observe convergence of the local observable to its thermal expectation value in the strong-thermalizaion regime. For weak thermalization, the dynamics of local observable exhibits an oscillation around the thermal value, which can only be attained by the time average. We also demonstrate that the entanglement entropy and concurrence can characterize the regimes of strong and weak thermalization. Our work provides an essential step towards a generic understanding of thermalization in quantum systems.


title: NODE-SELECT: A Graph Neural Network Based On A Selective Propagation Technique

abstract: While there exists a wide variety of graph neural networks (GNN) for node classification, only a minority of them adopt mechanisms that effectively target noise propagation during the message-passing procedure. Additionally, a very important challenge that significantly affects graph neural networks is the issue of scalability which limits their application to larger graphs. In this paper we propose our method named NODE-SELECT: an efficient graph neural network that uses subsetting layers which only allow the best sharing-fitting nodes to propagate their information. By having a selection mechanism within each layer which we stack in parallel, our proposed method NODE-SELECT is able to both reduce the amount noise propagated and adapt the restrictive sharing concept observed in real world graphs. Our NODE-SELECT significantly outperformed existing GNN frameworks in noise experiments and matched state-of-the art results in experiments without noise over different benchmark datasets.


title: $D\bar{D}^*$ scattering and $\chi_{c1}(3872)$ in nuclear matter

abstract: We study the behaviour of the $\chi_{c1}(3872)$, also known as $X(3872)$, in dense nuclear matter. We begin from a picture in vacuum of the $X(3872)$ as a purely molecular $(D \bar D^*-c.c.)$ state, generated as a bound state from a heavy-quark symmetry leading-order interaction between the charmed mesons, and analyze the $D \bar D^*$ scattering $T-$matrix ($T_{D \bar D^*}$) inside of the medium. Next, we consider also mixed-molecular scenarios and, in all cases, we determine the corresponding $X(3872)$ spectral function and the $D \bar D^*$ amplitude, with the mesons embedded in the dense environment. We find important nuclear corrections for $T_{D \bar D^*}$ and the pole position of the resonance, and discuss the dependence of these results on the $D \bar D^*$ molecular component in the $X(3872)$ wave-function. These predictions could be tested in the finite-density regime that can be accessed in the future CBM and PANDA experiments at FAIR.


title: Computation of categorical entropy via spherical functors

abstract: We study the relationship between the categorical entropy of the twist and cotwist functors along a spherical functor. In particular, we prove the categorical entropy of the twist functor coincides with that of the cotwist functor if the essential image of the right adjoint functor of the spherical functor contains a split-generator. We also see our results generalize the computations of the categorical entropy of spherical twists and $\mathbb{P}$-twists by Ouchi and Fan. As an application, we apply our results to the Gromov--Yomdin type conjecture by Kikuta--Takahashi.


title: Data-Driven Diverse Logistic Regression Ensembles

abstract: A novel framework for statistical learning is introduced which combines ideas from regularization and ensembling. This framework is applied to learn an ensemble of logistic regression models for high-dimensional binary classification. In the new framework the models in the ensemble are learned simultaneously by optimizing a multi-convex objective function. To enforce diversity between the models the objective function penalizes overlap between the models in the ensemble. Measures of diversity in classifier ensembles are used to show how our method learns the ensemble by exploiting the accuracy-diversity trade-off for ensemble models. In contrast to other ensembling approaches, the resulting ensemble model is fully interpretable as a logistic regression model, asymptotically consistent, and at the same time yields excellent prediction accuracy as demonstrated in an extensive simulation study and gene expression data applications. The models found by the proposed ensemble methodology can also reveal alternative mechanisms that can explain the relationship between the predictors and the response variable. An open-source compiled software library implementing the proposed method is briefly discussed.


title: Reduced-Order Models for Thermal Radiative Transfer Based on POD-Galerkin Method and Low-Order Quasidiffusion Equations

abstract: This paper presents a new technique for developing reduced-order models (ROMs) for nonlinear radiative transfer problems in high-energy density physics. The proper orthogonal decomposition (POD) of photon intensities is applied to obtain global basis functions for the Galerkin projection (POD-Galerkin) of the time-dependent multigroup Boltzmann transport equation (BTE) for photons. The POD-Galerkin solution of the BTE is used to determine the quasidiffusion (Eddington) factors that yield closures for the nonlinear system of (i) multilevel low-order quasidiffusion (VEF) equations and (ii) material energy balance equation. Numerical results are presented to demonstrate accuracy of the ROMs obtained with different low-rank approximations of intensities.


title: Flat-Bands-Enabled Triplet Excitonic Insulator in a Di-atomic Kagome Lattice

abstract: The excitonic insulator (EI) state is a strongly correlated many-body ground state, arising from an instability in the band structure towards exciton formation. We show that the flat valence and conduction bands of a semiconducting diatomic Kagome lattice, as exemplified in a superatomic graphene lattice, can possibly conspire to enable an interesting triplet EI state, based on density functional theory (DFT) calculations combined with many-body GW and Bethe-Salpeter Equation(BSE). Our results indicate that massive carriers in flat bands with highly localized electron and hole wavefunctions significantly reduce the screening and enhance the exchange interaction, leading to an unusually large triplet exciton binding energy (~1.1 eV) exceeding the GW band gap by ~0.2 eV and a large singlet-triplet splitting of ~0.4 eV. Our findings enrich once again the intriguing physics of flat bands and extend the scope of EI materials.


title: Moir\'e Imaging in Twisted Bilayer Graphene Aligned on Hexagonal Boron Nitride

abstract: Moir\'e superlattices (MSL) formed in angle-aligned bilayers of van der Waals materials have become a promising platform to realize novel two-dimensional electronic states. Angle-aligned trilayer structures can form two sets of MSLs which could potentially interfere with each other. In this work, we directly image the moir\'e patterns in both monolayer graphene aligned on hBN and twisted bilayer graphene aligned on hBN, using combined scanning microwave impedance microscopy and conductive atomic force microscopy. Correlation of the two techniques reveals the contrast mechanism for the achieved ultrahigh spatial resolution (<2 nm). We observe two sets of MSLs with different periodicities in the trilayer stack. The smaller MSL breaks the 6-fold rotational symmetry and exhibits abrupt discontinuities at the boundaries of the larger MSL. Using a rigid atomic-stacking model, we demonstrate that the hBN layer considerably modifies the MSL of twisted bilayer graphene. We further analyze its effect on the reciprocal space spectrum of the dual-moir\'e system.


title: Formalizing relations in type theory

abstract: Type theory plays an important role in foundations of mathematics as a framework for formalizing mathematics and a base for proof assistants providing semi-automatic proof checking and construction. Derivation of each theorem in type theory results in a formal term encapsulating the whole proof process. In this paper we use a variant of type theory, namely the Calculus of Constructions with Definitions, to formalize the standard theory of binary relations. This includes basic operations on relations, criteria for special properties of relations, invariance of these properties under the basic operations, equivalence relation, well-ordering, and transfinite induction. Definitions and proofs are presented as flag-style derivations.


title: Consistent Right-Invariant Fixed-Lag Smoother with Application to Visual Inertial SLAM

abstract: State estimation problems without absolute position measurements routinely arise in navigation of unmanned aerial vehicles, autonomous ground vehicles, etc., whose proper operation relies on accurate state estimates and reliable covariances. Unaware of absolute positions, these problems have immanent unobservable directions. Traditional causal estimators, however, usually gain spurious information on the unobservable directions, leading to over-confident covariance inconsistent with actual estimator errors. The consistency problem of fixed-lag smoothers (FLSs) has only been attacked by the first estimate Jacobian (FEJ) technique because of the complexity to analyze their observability property. But the FEJ has several drawbacks hampering its wide adoption. To ensure the consistency of a FLS, this paper introduces the right invariant error formulation into the FLS framework. To our knowledge, we are the first to analyze the observability of a FLS with the right invariant error. Our main contributions are twofold. As the first novelty, to bypass the complexity of analysis with the classic observability matrix, we show that observability analysis of FLSs can be done equivalently on the linearized system. Second, we prove that the inconsistency issue in the traditional FLS can be elegantly solved by the right invariant error formulation without artificially correcting Jacobians. By applying the proposed FLS to the monocular visual inertial simultaneous localization and mapping (SLAM) problem, we confirm that the method consistently estimates covariance similarly to a batch smoother in simulation and that our method achieved comparable accuracy as traditional FLSs on real data.


title: Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters

abstract: Recent works have demonstrated reasonable success of representation learning in hypercomplex space. Specifically, "fully-connected layers with Quaternions" (4D hypercomplex numbers), which replace real-valued matrix multiplications in fully-connected layers with Hamilton products of Quaternions, both enjoy parameter savings with only 1/4 learnable parameters and achieve comparable performance in various applications. However, one key caveat is that hypercomplex space only exists at very few predefined dimensions (4D, 8D, and 16D). This restricts the flexibility of models that leverage hypercomplex multiplications. To this end, we propose parameterizing hypercomplex multiplications, allowing models to learn multiplication rules from data regardless of whether such rules are predefined. As a result, our method not only subsumes the Hamilton product, but also learns to operate on any arbitrary nD hypercomplex space, providing more architectural flexibility using arbitrarily $1/n$ learnable parameters compared with the fully-connected layer counterpart. Experiments of applications to the LSTM and Transformer models on natural language inference, machine translation, text style transfer, and subject verb agreement demonstrate architectural flexibility and effectiveness of the proposed approach.


title: Leveraging Public Data for Practical Private Query Release

abstract: In many statistical problems, incorporating priors can significantly improve performance. However, the use of prior knowledge in differentially private query release has remained underexplored, despite such priors commonly being available in the form of public datasets, such as previous US Census releases. With the goal of releasing statistics about a private dataset, we present PMW^Pub, which -- unlike existing baselines -- leverages public data drawn from a related distribution as prior information. We provide a theoretical analysis and an empirical evaluation on the American Community Survey (ACS) and ADULT datasets, which shows that our method outperforms state-of-the-art methods. Furthermore, PMW^Pub scales well to high-dimensional data domains, where running many existing methods would be computationally infeasible.


title: Maximal dimension of groups of symmetries of homogeneous 2-nondegenerate CR structures of hypersurface type with a 1-dimensional Levi kernel

abstract: We prove that for every $n\geq 3$ the sharp upper bound for the dimension of the symmetry groups of homogeneous, 2-nondegenerate, $(2n+1)$-dimensional CR manifolds of hypersurface type with a $1$-dimensional Levi kernel is equal to $n^2+7$, and simultaneously establish the same result for a more general class of structures characterized by weakening the homogeneity condition. This supports Beloshapka's conjecture stating that hypersurface models with a maximal finite dimensional group of symmetries for a given dimension of the underlying manifold are Levi nondegenerate.


title: A new convergence analysis of two-level hierarchical basis methods

abstract: This paper is concerned with the convergence analysis of two-level hierarchical basis (TLHB) methods in a general setting, where the decomposition associated with two hierarchical component spaces is not required to be a direct sum. The TLHB scheme can be regarded as a combination of compatible relaxation and coarse-grid correction. Most of the previous works focus on the case of exact coarse solver, and the existing identity for the convergence factor of exact TLHB methods involves a tricky max-min problem. In this work, we present a new and purely algebraic analysis of TLHB methods, which gives a succinct identity for the convergence factor of exact TLHB methods. The new identity can be conveniently utilized to derive an optimal interpolation and analyze the influence of coarse space on the convergence factor. Moreover, we establish two-sided bounds for the convergence factor of TLHB methods with inexact coarse solver, which extend the existing TLHB theory.


title: Analyticity and Regge asymptotics in virtual Compton scattering on the nucleon

abstract: We test the consistency of the data on the nucleon structure functions with analyticity and the Regge asymptotics of the virtual Compton amplitude. By solving a functional extremal problem, we derive an optimal lower bound on the maximum difference between the exact amplitude and the dominant Reggeon contribution for energies $\nu$ above a certain high value $\nu_h(Q^2)$. Considering in particular the difference of the amplitudes $T_1^\inel(\nu, Q^2)$ for the proton and neutron, we find that the lower bound decreases in an impressive way when $\nu_h(Q^2)$ is increased, and represents a very small fraction of the magnitude of the dominant Reggeon. While the method cannot rule out the hypothesis of a fixed Regge pole, the results indicate that the data on the structure function are consistent with an asymptotic behaviour given by leading Reggeon contributions. We also show that the minimum of the lower bound as a function of the subtraction constant $S_1^\inel(Q^2)$ provides a reasonable estimate of this quantity, in a frame similar, but not identical to the Reggeon dominance hypothesis.


title: LambdaNetworks: Modeling Long-Range Interactions Without Attention

abstract: We present lambda layers -- an alternative framework to self-attention -- for capturing long-range interactions between an input and structured contextual information (e.g. a pixel surrounded by other pixels). Lambda layers capture such interactions by transforming available contexts into linear functions, termed lambdas, and applying these linear functions to each input separately. Similar to linear attention, lambda layers bypass expensive attention maps, but in contrast, they model both content and position-based interactions which enables their application to large structured inputs such as images. The resulting neural network architectures, LambdaNetworks, significantly outperform their convolutional and attentional counterparts on ImageNet classification, COCO object detection and COCO instance segmentation, while being more computationally efficient. Additionally, we design LambdaResNets, a family of hybrid architectures across different scales, that considerably improves the speed-accuracy tradeoff of image classification models. LambdaResNets reach excellent accuracies on ImageNet while being 3.2 - 4.4x faster than the popular EfficientNets on modern machine learning accelerators. When training with an additional 130M pseudo-labeled images, LambdaResNets achieve up to a 9.5x speed-up over the corresponding EfficientNet checkpoints.


title: Helioseismological determination of the subsurface spatial spectrum of solar convection: Demonstration using numerical simulations

abstract: Understanding convection is important in stellar physics, for example as an input in stellar evolution models. Helioseismic estimates of convective flow amplitudes in deeper regions of the solar interior disagree by orders of magnitude among themselves and with simulations. We aim to assess the validity of an existing upper limit of solar convective flow amplitudes at a depth of 0.96 solar radii obtained using time-distance helioseismology and several simplifying assumptions. We generated synthetic observations for convective flow fields from a magnetohydrodynamic simulation (MURaM) using travel-time sensitivity functions and a noise model. We compared the estimates of the flow with the actual values. For the scales of interest ($\ell<100$), we find that the current procedure for obtaining an upper limit gives the correct order of magnitude of the flow for the given flow fields. We also show that this estimate is not an upper limit in a strict sense because it underestimates the flow amplitude at the largest scales by a factor of about two because the scale dependence of the signal-to-noise ratio has to be taken into account. After correcting for this and after taking the dependence of the measurements on direction in Fourier space into account, we show that the obtained estimate is indeed an upper limit. We conclude that time-distance helioseismology is able to correctly estimate the order of magnitude (or an upper limit) of solar convective flows in the deeper interior when the vertical correlation function of the different flow components is known and the scale dependence of the signal-to-noise ratio is taken into account. We suggest that future work should include information from different target depths to better separate the effect of near-surface flows from those at greater depths. The measurements are sensitive to all three flow directions, which should be taken into account.


title: SWAD: Domain Generalization by Seeking Flat Minima

abstract: Domain generalization (DG) methods aim to achieve generalizability to an unseen target domain by using only training data from the source domains. Although a variety of DG methods have been proposed, a recent study shows that under a fair evaluation protocol, called DomainBed, the simple empirical risk minimization (ERM) approach works comparable to or even outperforms previous methods. Unfortunately, simply solving ERM on a complex, non-convex loss function can easily lead to sub-optimal generalizability by seeking sharp minima. In this paper, we theoretically show that finding flat minima results in a smaller domain generalization gap. We also propose a simple yet effective method, named Stochastic Weight Averaging Densely (SWAD), to find flat minima. SWAD finds flatter minima and suffers less from overfitting than does the vanilla SWA by a dense and overfit-aware stochastic weight sampling strategy. SWAD shows state-of-the-art performances on five DG benchmarks, namely PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet, with consistent and large margins of +1.6% averagely on out-of-domain accuracy. We also compare SWAD with conventional generalization methods, such as data augmentation and consistency regularization methods, to verify that the remarkable performance improvements are originated from by seeking flat minima, not from better in-domain generalizability. Last but not least, SWAD is readily adaptable to existing DG methods without modification; the combination of SWAD and an existing DG method further improves DG performances. Source code is available at https://github.com/khanrc/swad.


title: Factorizations of finite groups

abstract: A finite group $G$ is called $k$-factorizable if for any factorization $|G|=a_1\cdots a_k$ with $a_i>1$ there exist subsets $A_i$ of $G$ with $|A_i|=a_i$ such that $G=A_1\cdots A_k$. The main results are as follows. 1. For every integer $k\geq3$ there exist a finite group $G$ such that $G$ is not $k$-factorizable. 2. If a Sylow $2$-subgroup of a finite group $G$ is elementary abelian, all involutions of $G$ are conjugate, and the centralizer of every involution is the direct product of a Sylow $2$-subgroup of $G$ and a group of odd order. Then $G$ is not $3$-factorizable. 3. We give a complete list of not $k$-factorizable groups for some $k$ of order at most $100$.


title: Centroid Transformers: Learning to Abstract with Attention

abstract: Self-attention, as the key block of transformers, is a powerful mechanism for extracting features from the inputs. In essence, what self-attention does is to infer the pairwise relations between the elements of the inputs, and modify the inputs by propagating information between input pairs. As a result, it maps inputs to N outputs and casts a quadratic $O(N^2)$ memory and time complexity. We propose centroid attention, a generalization of self-attention that maps N inputs to M outputs $(M\leq N)$, such that the key information in the inputs are summarized in the smaller number of outputs (called centroids). We design centroid attention by amortizing the gradient descent update rule of a clustering objective function on the inputs, which reveals an underlying connection between attention and clustering. By compressing the inputs to the centroids, we extract the key information useful for prediction and also reduce the computation of the attention module and the subsequent layers. We apply our method to various applications, including abstractive text summarization, 3D vision, and image processing. Empirical results demonstrate the effectiveness of our method over the standard transformers.


title: On the Convergence and Sample Efficiency of Variance-Reduced Policy Gradient Method

abstract: Policy gradient (PG) gives rise to a rich class of reinforcement learning (RL) methods. Recently, there has been an emerging trend to accelerate the existing PG methods such as REINFORCE by the \emph{variance reduction} techniques. However, all existing variance-reduced PG methods heavily rely on an uncheckable importance weight assumption made for every single iteration of the algorithms. In this paper, a simple gradient truncation mechanism is proposed to address this issue. Moreover, we design a Truncated Stochastic Incremental Variance-Reduced Policy Gradient (TSIVR-PG) method, which is able to maximize not only a cumulative sum of rewards but also a general utility function over a policy's long-term visiting distribution. We show an $\tilde{\mathcal{O}}(\epsilon^{-3})$ sample complexity for TSIVR-PG to find an $\epsilon$-stationary policy. By assuming the overparameterizaiton of policy and exploiting the hidden convexity of the problem, we further show that TSIVR-PG converges to global $\epsilon$-optimal policy with $\tilde{\mathcal{O}}(\epsilon^{-2})$ samples.


title: Performance of dopamine modified 0.5(Ba0.7Ca0.3)TiO3-0.5Ba(Zr0.2Ti0.8)O3 filler in PVDF nanocomposite as flexible energy storage and harvester

abstract: We demonstrate the potential of dopamine modified 0.5(Ba0.7Ca0.3)TiO3-0.5Ba(Zr0.2Ti0.8)O3 filler incorporated poly-vinylidene fluoride (PVDF) composite prepared by solution cast method as both flexible energy storage and harvesting devices. The introduction of dopamine in filler surface functionalization acts as bridging elements between filler and polymer matrix and results in a better filler dispersion and an improved dielectric loss tangent (<0.02) along with dielectric permittivity ranges from 9 to 34 which is favorable for both energy harvesting and storage. Additionally, a significantly low DC conductivity (< 10-9 ohm-1cm-1) for all composites was achieved leading to an improved breakdown strength and charge accumulation capability. Maximum breakdown strength of 134 KV/mm and corresponding energy storage density 0.72 J/cm3 were obtained from the filler content 10 weight%. The improved energy harvesting performance was characterized by obtaining a maximum piezoelectric charge constant (d33) = 78 pC/N, and output voltage (Vout) = 0.84 V along with maximum power density of 3.46 microW/cm3 for the filler content of 10 wt%. Thus, the results show 0.5(Ba0.7Ca0.3)TiO3-0.5Ba(Zr0.2Ti0.8)O3/PVDF composite has the potential for energy storage and harvesting applications simultaneously that can significantly suppress the excess energy loss arises while utilizing different material.


title: Teacher-student learning for a binary perceptron with quantum fluctuations

abstract: We analysed the generalisation performance of a binary perceptron with quantum fluctuations using the replica method. An exponential number of local minima dominate the energy landscape of the binary perceptron. Local search algorithms often fail to identify the ground state of a binary perceptron. In this study, we considered the teacher-student learning method and computed the generalisation error of a binary perceptron with quantum fluctuations. Due to the quantum fluctuations, we can efficiently find robust solutions that have better generalisation performance than the classical model. We validated our theoretical results through quantum Monte Carlo simulations. We adopted the replica symmetry (RS) ansatz assumption and static approximation. The RS solutions are consistent with our simulation results, except for the relatively low strength of the transverse field and high pattern ratio. These deviations are caused by the violation of ergodicity and static approximation. After accounting for the deviation between the RS solutions and numerical results, the enhancement of generalisation performance with quantum fluctuations holds.


title: Smoothed Least-Laxity-First Algorithm for EV Charging

abstract: Adaptive charging can charge electric vehicles (EVs) at scale cost effectively, despite the uncertainty in EV arrivals. We formulate adaptive EV charging as a feasibility problem that meets all EVs' energy demands before their deadlines while satisfying constraints in charging rate and total charging power. We propose an online algorithm, smoothed least-laxity-first (sLLF), that decides the current charging rates without the knowledge of future arrivals and demands. We characterize the performance of the sLLF algorithm analytically and numerically. Numerical experiments with real-world data show that it has a significantly higher rate of feasible EV charging than several other existing EV charging algorithms. Resource augmentation framework is employed to assess the feasibility condition of the algorithm. The assessment shows that the sLLF algorithm achieves perfect feasibility with only a 0.07 increase in resources.


title: A pebble accretion model for the formation of the terrestrial planets in the Solar System

abstract: Pebbles of millimeter sizes are abundant in protoplanetary discs around young stars. Chondrules inside primitive meteorites - formed by melting of dust aggregate pebbles or in impacts between planetesimals - have similar sizes. The role of pebble accretion for terrestrial planet formation is nevertheless unclear. Here we present a model where inwards-drifting pebbles feed the growth of terrestrial planets. The masses and orbits of Venus, Earth, Theia (which later collided with the Earth to form the Moon) and Mars are all consistent with pebble accretion onto protoplanets that formed around Mars' orbit and migrated to their final positions while growing. The isotopic compositions of Earth and Mars are matched qualitatively by accretion of two generations of pebbles, carrying distinct isotopic signatures. Finally, we show that the water and carbon budget of Earth can be delivered by pebbles from the early generation before the gas envelope became hot enough to vaporise volatiles.


title: Pushing planets into an inner cavity by a resonant chain

abstract: Context. The orbital distribution of exoplanets indicates an accumulation of super-Earth sized planets close to their host stars in compact systems. When an inward disc-driven migration scenario is assumed for their formation, these planets could have been stopped and might have been parked at an inner edge of the disc, or be pushed through the inner disc cavity by a resonant chain. This topic has not been properly and extensively studied. Using numerical simulations, we investigate the possibility that the inner planets in a resonant chain can be pushed into the disc inner cavity by outer planets. We performed hydrodynamical and N-body simulations of planetary systems embedded in their nascent disc. The inner edge of the disc was represented in two different ways, resembling either a dead zone inner edge (DZ) or a disc inner boundary (IB). The main difference lies in the steepness of the surface density profile. The innermost planet always has a mass of 10 M Earth , with additional outer planets of equal or higher mass. A steeper profile is able to stop a chain of planets more efficiently than a shallower profile. The final configurations in our DZ models are usually tighter than in their IB counterparts, and therefore more prone to instability. We derive analytical expressions for the stopping conditions based on power equilibrium, and show that the final eccentricities result from torque equilibrium. For planets in thinner discs, we found, for the first time, clear signs for over-stable librations in the hydrodynamical simulations, leading to very compact systems. We also found that the popular N-body simulations may overestimate the number of planets in the disc inner cavity.


title: Validation and parameter optimization of a hybrid embedded/homogenized solid tumor perfusion model

abstract: The goal of this paper is to investigate the validity of a hybrid embedded/homogenized in-silico approach for modeling perfusion through solid tumors. The rationale behind this novel idea is that only the larger blood vessels have to be explicitly resolved while the smaller scales of the vasculature are homogenized. As opposed to typical discrete or fully-resolved 1D-3D models, the required data can be obtained with in-vivo imaging techniques since the morphology of the smaller vessels is not necessary. By contrast, the larger vessels, whose topology and structure is attainable non-invasively, are resolved and embedded as one-dimensional inclusions into the three-dimensional tissue domain which is modeled as a porous medium. A sound mortar-type formulation is employed to couple the two representations of the vasculature. We validate the hybrid model and optimize its parameters by comparing its results to a corresponding fully-resolved model based on several well-defined metrics. These tests are performed on a complex data set of three different tumor types with heterogeneous vascular architectures. The correspondence of the hybrid model in terms of mean representative elementary volume blood and interstitial fluid pressures is excellent with relative errors of less than 4%. Larger, but less important and explicable errors are present in terms of blood flow in the smaller, homogenized vessels. We finally discuss and demonstrate how the hybrid model can be further improved to apply it for studies on tumor perfusion and the efficacy of drug delivery.


title: A higher-multipole gravitational waveform model for an eccentric binary black holes based on the effective-one-body-numerical-relativity formalism

abstract: We construct a new factorized waveform including $(l,|m|)=(2,2),(2,1),(3,3),(4,4)$ modes based on effective-one-body (EOB) formalism, which is valid for spinning binary black holes (BBH) in general equatorial orbit. When combined with the dynamics of $\texttt{SEOBNRv4}$, the $(l,|m|)=(2,2)$ mode waveform generated by this new waveform can fit the original $\texttt{SEOBNRv4}$ waveform very well in the case of a quasi-circular orbit. We have calibrated our new waveform model to the Simulating eXtreme Spacetimes (SXS) catalog. The comparison is done for BBH with total mass in $(20,200)M_\odot$ using Advanced LIGO designed sensitivity. For the quasi-circular cases we have compared our $(2,2)$ mode waveforms to the 281 numerical relativity (NR) simulations of BBH along quasi-circular orbits. All of the matching factors are bigger than 98\%. For the elliptical cases, 24 numerical relativity simulations of BBH along an elliptic orbit are used. For each elliptical BBH system, we compare our modeled gravitational polarizations against the NR results for different combinations of the inclination angle, the initial orbit phase and the source localization in the sky. We use the the minimal matching factor respect to the inclination angle, the initial orbit phase and the source localization to quantify the performance of the higher modes waveform. We found that after introducing the high modes, the minimum of the minimal matching factor among the 24 tested elliptical BBHs increases from 90\% to 98\%. Following our previous $\texttt{SEOBNRE}$ waveform model, we call our new waveform model $\texttt{SEOBNREHM}$. Our $\texttt{SEOBNREHM}$ waveform model can match all tested 305 SXS waveforms better than 98\% including highly spinning ($\chi=0.99$) BBH, highly eccentric ($e\approx0.15$) BBH and large mass ratio ($q=10$) BBH.


title: Field-induced valence fluctuation in YbB$_{12}$

abstract: We performed high-magnetic-field ultrasonic experiments on YbB$_{12}$ up to 59 T to investigate the valence fluctuations in Yb ions. In zero field, the longitudinal elastic constant $C_{11}$, the transverse elastic constants $C_{44}$ and $\left( C_{11} - C_{12} \right)/2$, and the bulk modulus $C_\mathrm{B}$ show a hardening with a change of curvature at around 35 K indicating a small contribution of valence fluctuations to the elastic constants. When high magnetic fields are applied at low temperatures, $C_\mathrm{B}$ exhibits a softening above a field-induced insulator-metal transition signaling field-induced valence fluctuations. Furthermore, at elevated temperatures, the field-induced softening of $C_\mathrm{B}$ takes place at even lower fields and $C_\mathrm{B}$ decreases continuously with field. Our analysis using the multipole susceptibility based on a two-band model reveals that the softening of $C_\mathrm{B}$ originates from the enhancement of multipole-strain interaction in addition to the decrease of the insulator energy gap. This analysis indicates that field-induced valence fluctuations of Yb cause the instability of the bulk modulus $C_\mathrm{B}$.


title: Conserving Lattice Gauge Theory for Finite Systems

abstract: In this study I develop a novel action for lattice gauge theory for finite systems, which accommodates non-periodic boundary conditions, implements the proper integral form of Gauss' law and exhibits an inherently symmetric energy momentum tensor, all while realizing automatic ${\cal O}(a)$ improvement. Taking the modern summation-by-parts formulation for finite differences as starting point and combining it with insight from the finite volume strategies of computational electrodynamics I show how the concept of a conserving discretization can be realized for non-Abelian lattice gauge theory. Major steps in the derivation are illustrated using Abelian gauge theory as example.


title: A Vectored Fragmentation Metric for Elastic Optical Networks

abstract: When circuits are set up and dismantled dynamically in elastic optical networks, spectrum tends to become fragmented in the fiber links. The fragmentation limits the available path choices and may lead to significant blocking of connection requests. There are two types of fragmentation in the network spectrum in the links due to contiguity constraints and over the paths due to continuity. Study of fragmentation and its management is essential to operate the networks efficiently. This paper proposes a vectored fragmentation metric for characterizing the fragmentation, which covers both types of fragmentation. We discuss the characteristics of this metric in both transient and steady-state of the dynamic network. We also test the proposed metric for connection requests granularity range, arrival rates and holding times, to establish functionality of this metric. We also compare the link-based fragmentation metric with our Vectored Fragmentation Metric to understand the better representation.


title: The physical nature of the cosmological constant and the decoherence scale in a renormalization-group approach

abstract: In this paper we consider the nature of the cosmological constant as due by quantum fluctuations. Quantum fluctuations are generated at Planckian scales by noncommutative effects and watered down at larger scales up to a decoherence scale $L_D$ where classicality is reached. In particular, we formally depict the presence of the scale at $L_D$ by adopting a renormalization group approach. As a result, an analogy arises between the expression for the observed cosmological constant $\overline{\Lambda}$ generated by quantum fluctuations and the one expected by a renormalization group approach, provided that the renormalization scale $\mu$ is suitably chosen. In this framework, the decoherence scale $L_D$ is naturally identified with the value ${\mu}_D$, with $\hbar{\mu}_D$ representing the minimum allowed particle-momentum for our visible universe. Finally, by mimicking renormalization group approach, we present a technique to formally obtain a non-trivial infrared (IR) fixed point at $\mu=\mu_D$ in our model.


title: Rethinking Co-design of Neural Architectures and Hardware Accelerators

abstract: Neural architectures and hardware accelerators have been two driving forces for the progress in deep learning. Previous works typically attempt to optimize hardware given a fixed model architecture or model architecture given fixed hardware. And the dominant hardware architecture explored in this prior work is FPGAs. In our work, we target the optimization of hardware and software configurations on an industry-standard edge accelerator. We systematically study the importance and strategies of co-designing neural architectures and hardware accelerators. We make three observations: 1) the software search space has to be customized to fully leverage the targeted hardware architecture, 2) the search for the model architecture and hardware architecture should be done jointly to achieve the best of both worlds, and 3) different use cases lead to very different search outcomes. Our experiments show that the joint search method consistently outperforms previous platform-aware neural architecture search, manually crafted models, and the state-of-the-art EfficientNet on all latency targets by around 1% on ImageNet top-1 accuracy. Our method can reduce energy consumption of an edge accelerator by up to 2x under the same accuracy constraint, when co-adapting the model architecture and hardware accelerator configurations.


title: 3D-Space and the preferred basis cannot uniquely emerge from the quantum structure

abstract: Hilbert-Space Fundamentalism (HSF) states that the only fundamental structures are the quantum state vector and the Hamiltonian, and from them everything else emerge uniquely, including the 3D-space, a preferred basis, and a preferred factorization of the Hilbert space. In this article it is shown that whenever such a structure emerges from the Hamiltonian and the state vector alone, if it is physically relevant, it is not unique. Moreover, HSF leads to strange effects like "passive" travel in time and in alternative realities, realized simply by passive transformations of the Hilbert space. The results from this article affect all theories that adhere to HSF, whether they assume branching or state vector reduction (in particular the version of Everett's Interpretation coined by Carroll and Singh "Mad-dog Everettianism"), various proposals based on decoherence, proposals that aim to describe everything by the quantum structure alone, and proposals that spacetime emerges from a purely quantum theory of gravity.

categories: quant-ph math-ph math.MP physics.hist-ph


title: Supporting More Active Users for Massive Access via Data-assisted Activity Detection

abstract: Massive machine-type communication (mMTC) has been regarded as one of the most important use scenarios in the fifth generation (5G) and beyond wireless networks, which demands scalable access for a large number of devices. While grant-free random access has emerged as a promising mechanism for massive access, its potential has not been fully unleashed. Particularly, the two key tasks in massive access systems, namely, user activity detection and data detection, were handled separately in most existing studies, which ignored the common sparsity pattern in the received pilot and data signal. Moreover, error detection and correction in the payload data provide additional mechanisms for performance improvement. In this paper, we propose a data-assisted activity detection framework, which aims at supporting more active users by reducing the activity detection error, consisting of false alarm and missed detection errors. Specifically, after an initial activity detection step based on the pilot symbols, the false alarm users are filtered by applying energy detection for the data symbols; once data symbols of some active users have been successfully decoded, their effect in activity detection will be resolved via successive pilot interference cancellation, which reduces the missed detection error. Simulation results show that the proposed algorithm effectively increases the activity detection accuracy, and it is able to support $\sim 20\%$ more active users compared to a conventional method in some sample scenarios.


title: Sinkhorn Label Allocation: Semi-Supervised Classification via Annealed Self-Training

abstract: Self-training is a standard approach to semi-supervised learning where the learner's own predictions on unlabeled data are used as supervision during training. In this paper, we reinterpret this label assignment process as an optimal transportation problem between examples and classes, wherein the cost of assigning an example to a class is mediated by the current predictions of the classifier. This formulation facilitates a practical annealing strategy for label assignment and allows for the inclusion of prior knowledge on class proportions via flexible upper bound constraints. The solutions to these assignment problems can be efficiently approximated using Sinkhorn iteration, thus enabling their use in the inner loop of standard stochastic optimization algorithms. We demonstrate the effectiveness of our algorithm on the CIFAR-10, CIFAR-100, and SVHN datasets in comparison with FixMatch, a state-of-the-art self-training algorithm. Our code is available at https://github.com/stanford-futuredata/sinkhorn-label-allocation.


title: Reviews: Topological Distances and Losses for Brain Networks

abstract: Almost all statistical and machine learning methods in analyzing brain networks rely on distances and loss functions, which are mostly Euclidean or matrix norms. The Euclidean or matrix distances may fail to capture underlying subtle topological differences in brain networks. Further, Euclidean distances are sensitive to outliers. A few extreme edge weights may severely affect the distance. Thus it is necessary to use distances and loss functions that recognize topology of data. In this review paper, we survey various topological distance and loss functions from topological data analysis (TDA) and persistent homology that can be used in brain network analysis more effectively. Although there are many recent brain imaging studies that are based on TDA methods, possibly due to the lack of method awareness, TDA has not taken as the mainstream tool in brain imaging field yet. The main purpose of this paper is provide the relevant technical survey of these powerful tools that are immediately applicable to brain network data.