title: Using heterogeneity in semi-supervised transcription hypotheses to improve code-switched speech recognition

abstract: Modeling code-switched speech is an important problem in automatic speech recognition (ASR). Labeled code-switched data are rare, so monolingual data are often used to model code-switched speech. These monolingual data may be more closely matched to one of the languages in the code-switch pair. We show that such asymmetry can bias prediction toward the better-matched language and degrade overall model performance. To address this issue, we propose a semi-supervised approach for code-switched ASR. We consider the case of English-Mandarin code-switching, and the problem of using monolingual data to build bilingual "transcription models'' for annotation of unlabeled code-switched data. We first build multiple transcription models so that their individual predictions are variously biased toward either English or Mandarin. We then combine these biased transcriptions using confidence-based selection. This strategy generates a superior transcript for semi-supervised training, and obtains a 19% relative improvement compared to a semi-supervised system that relies on a transcription model built with only the best-matched monolingual data.


title: A Decade of Discoveries by the Daya Bay Reactor Neutrino Experiment

abstract: With the end of Daya Bay experimental operations in December 2020, I review the history, discoveries, measurements and impact of the Daya Bay reactor neutrino experiment in China.


title: Evolution of the energy efficiency of LHCb's real-time processing

abstract: The upgraded LHCb detector, due to start datataking in 2022, will have to process an average data rate of 4~TB/s in real time. Because LHCb's physics objectives require that the full detector information for every LHC bunch crossing is read out and made available for real-time processing, this bandwidth challenge is equivalent to that of the ATLAS and CMS HL-LHC software read-out, but deliverable five years earlier. Over the past six years, the LHCb collaboration has undertaken a bottom-up rewrite of its software infrastructure, pattern recognition, and selection algorithms to make them better able to efficiently exploit modern highly parallel computing architectures. We review the impact of this reoptimization on the energy efficiency of the real-time processing software and hardware which will be used for the upgrade of the LHCb detector. We also review the impact of the decision to adopt a hybrid computing architecture consisting of GPUs and CPUs for the real-time part of LHCb's future data processing. We discuss the implications of these results on how LHCb's real-time power requirements may evolve in the future, particularly in the context of a planned second upgrade of the detector.


title: Rheology of concentrated suspension of fibers with load dependent friction coefficient

abstract: We numerically investigate the effects of fiber aspect ratio, roughness, flexibility, and flow inertia on the rheology of concentrated suspensions. We perform direct numerical simulations modeling the fibers, suspended in an incompressible Newtonian fluid, as continuous flexible slender bodies obeying the Euler-Bernoulli beam equation. An immersed Boundary Method (IBM) is employed to solve for the motion of fibers. In concentrated suspensions, fibers come into contact due to the presence of asperities on their surface. We assume a normal load-dependent friction coefficient to model contact dynamics and friction, which successfully recovers the shear-thinning behaviour observed in experiments. First, we report the shear rate dependent behavior and the increase in the suspension viscosity with the increasing volume fraction of fibers, fiber roughness, and rigidity. The increase in the viscosity is stronger at a lower shear rate and finite inertia. Simulation results indicate that for the concentrated suspensions, contact stresses between fibers form the dominant contribution to the viscosity. Moreover, we find the first normal stress difference to be positive and to increase with the Reynolds number for flexible fibers. Lastly, we explore the divergence of viscosity for different aspect ratios and roughness of the fibers and predict the jamming volume fraction by fitting the data to the Maron-Pierce law. The jamming volume fraction decreases with increasing the aspect ratio and roughness. We conclude that the contact forces and interparticle friction become one of the crucial factors governing the rheology of flexible fiber suspensions at high concentrations.


title: Distributed Optimization with Global Constraints Using Noisy Measurements

abstract: We propose a new distributed optimization algorithm for solving a class of constrained optimization problems in which (a) the objective function is separable (i.e., the sum of local objective functions of agents), (b) the optimization variables of distributed agents, which are subject to nontrivial local constraints, are coupled by global constraints, and (c) only noisy observations are available to estimate (the gradients of) local objective functions. In many practical scenarios, agents may not be willing to share their optimization variables with others. For this reason, we propose a distributed algorithm that does not require the agents to share their optimization variables with each other; instead, each agent maintains a local estimate of the global constraint functions and share the estimate only with its neighbors. These local estimates of constraint functions are updated using a consensus-type algorithm, while the local optimization variables of each agent are updated using a first-order method based on noisy estimates of gradient. We prove that, when the agents adopt the proposed algorithm, their optimization variables converge with probability 1 to an optimal point of an approximated problem based on the penalty method.


title: Efficient (Soft) Q-Learning for Text Generation with Limited Good Data

abstract: Maximum likelihood estimation (MLE) is the predominant algorithm for training text generation models. This paradigm relies on direct supervision examples, which is not applicable to many emerging applications, such as generating adversarial attacks or generating prompts to control language models. Reinforcement learning (RL) on the other hand offers a more flexible solution by allowing users to plug in arbitrary task metrics as reward. Yet previous RL algorithms for text generation, such as policy gradient (on-policy RL) and Q-learning (off-policy RL), are often notoriously inefficient or unstable to train due to the large sequence space and the sparse reward received only at the end of sequences. In this paper, we introduce a new RL formulation for text generation from the soft Q-learning (SQL) perspective. It enables us to draw from the latest RL advances, such as path consistency learning, to combine the best of on-/off-policy updates, and learn effectively from sparse reward. We apply the approach to a wide range of novel text generation tasks, including learning from noisy/negative examples, adversarial attacks, and prompt generation. Experiments show our approach consistently outperforms both task-specialized algorithms and the previous RL methods.


title: Existence and multiplicity of solutions for $m(x)-$polyharmonic elliptic Kirchhoff type equations without Ambrosetti-Rabinowitz conditions

abstract: In this paper, we prove the existence of infinitely many solutions for a class of quasilinear elliptic $m(x)$-polyharmonic Kirchhoff equations where the nonlinear function has a quasicritical growth at infinity and without assuming the Ambrosetti and Rabinowitz type condition. The new aspect consists in employing the notion of a Schauder basis to verify the geometry of the symmetric mountain pass theorem. Furthermore, for the case $m(x)\equiv Const$, we introduce a positive quantity $\lambda_M$ similar to the first eigenvalue of the $m$-polyharmonic operator to find a mountain pass solution, and also to discuss the sublinear case under large growth conditions at infinity and at zero. Our results are an improvement and generalization of the corresponding results obtained by Colasuonno-Pucci (Nonlinear Analysis: Theory, Methods and Applications, $2011$) and Bae-Kim (Mathematical Methods in the Applied Sciences, $2020$).


title: Stochastic elliptic operators defined by non-gaussian random fields with uncertain spectrum

abstract: This paper present a construction and the analysis of a class of non-Gaussian positive-definite matrix-valued homogeneous random fields with uncertain spectral measure for stochastic elliptic operators. Then the stochastic elliptic boundary value problem in a bounded domain of the 3D-space is introduced and analyzed for stochastic homogenization.


title: An alternative axiomatic presentation of Nelson algebras

abstract: Nelson algebras are defined in [Diana Brignole and Ant\'onio Monteiro. Caract\'erisation des alg\`ebres de Nelson par des \'egalit\'es. {I}, {II}. Proc. Japan Acad., 43:279--283; 284--285, 1967.] in terms of the language $\langle \land,\lor,\to,\sim,1\rangle$. In 1962, Diana Brignole [Diana Brignole. Axiomatizaci\'on de un $N$-reticulado. Revista de la Uni\'on Matem\'atica Argentina, XXI(3):147--148, 1965.], solved the problem proposed by Antonio Monteiro, of giving an axiomatization of Nelson algebras in terms of the connectives $\rightarrowtail$, $\land$ and the constant $0=\sim 1$. In this work, we present for the first time a complete proof of this fact, and also show the dependence and independence of some of the axioms proposed by Brignole.


title: CathAI: Fully Automated Interpretation of Coronary Angiograms Using Neural Networks

abstract: Coronary heart disease (CHD) is the leading cause of adult death in the United States and worldwide, and for which the coronary angiography procedure is the primary gateway for diagnosis and clinical management decisions. The standard-of-care for interpretation of coronary angiograms depends upon ad-hoc visual assessment by the physician operator. However, ad-hoc visual interpretation of angiograms is poorly reproducible, highly variable and bias prone. Here we show for the first time that fully-automated angiogram interpretation to estimate coronary artery stenosis is possible using a sequence of deep neural network algorithms. The algorithmic pipeline we developed--called CathAI--achieves state-of-the art performance across the sequence of tasks required to accomplish automated interpretation of unselected, real-world angiograms. CathAI (Algorithms 1-2) demonstrated positive predictive value, sensitivity and F1 score of >=90% to identify the projection angle overall and >=93% for left or right coronary artery angiogram detection, the primary anatomic structures of interest. To predict obstructive coronary artery stenosis (>=70% stenosis), CathAI (Algorithm 4) exhibited an area under the receiver operating characteristic curve (AUC) of 0.862 (95% CI: 0.843-0.880). When externally validated in a healthcare system in another country, CathAI AUC was 0.869 (95% CI: 0.830-0.907) to predict obstructive coronary artery stenosis. Our results demonstrate that multiple purpose-built neural networks can function in sequence to accomplish the complex series of tasks required for automated analysis of real-world angiograms. Deployment of CathAI may serve to increase standardization and reproducibility in coronary stenosis assessment, while providing a robust foundation to accomplish future tasks for algorithmic angiographic interpretation.


title: Eavesdropper and Jammer Selection in Wireless Source Localization Networks

abstract: We consider a wireless source localization network in which a target node emits localization signals that are used by anchor nodes to estimate the target node position. In addition to target and anchor nodes, there can also exist eavesdropper nodes and jammer nodes which aim to estimate the position of the target node and to degrade the accuracy of localization, respectively. We first propose the problem of eavesdropper selection with the goal of optimally placing a given number of eavesdropper nodes to a subset of possible positions in the network to estimate the target node position as accurately as possible. As the performance metric, the Cramer-Rao lower bound (CRLB) related to the estimation of the target node position by eavesdropper nodes is derived, and its convexity and monotonicity properties are investigated. By relaxing the integer constraints, the eavesdropper selection problem is approximated by a convex optimization problem and algorithms are proposed for eavesdropper selection. Moreover, in the presence of parameter uncertainty, a robust version of the eavesdropper selection problem is developed. Then, the problem of jammer selection is proposed where the aim is to optimally place a given number of jammer nodes to a subset of possible positions for degrading the localization accuracy of the network as much as possible. A CRLB expression from the literature is used as the performance metric, and its concavity and monotonicity properties are derived. Also, a convex optimization problem and its robust version are derived after relaxation. Moreover, the joint eavesdropper and jammer selection problem is proposed with the goal of placing certain numbers of eavesdropper and jammer nodes to a subset of possible positions. Simulation results are presented to illustrate performance of the proposed algorithms.


title: Connecting wall modes and boundary zonal flows in rotating Rayleigh--B\'enard convection

abstract: Using direct numerical simulations, we study rotating Rayleigh-B\'enard convection in a cylindrical cell for a broad range of Rayleigh, Ekman, and Prandtl numbers from the onset of wall modes to the geostrophic regime, an extremely important one in geophysical and astrophysical contexts. We connect linear wall-mode states that occur prior to the onset of bulk convection with the boundary zonal flow that coexists with turbulent bulk convection in the geostrophic regime through the continuity of length and time scales and of convective heat transport. We quantitatively collapse drift frequency, boundary length, and heat transport data from numerous sources over many orders of magnitude in Rayleigh and Ekman numbers. Elucidating the heat transport contributions of wall modes and of the boundary zonal flow are critical for characterizing the properties of the geostrophic regime of rotating convection in finite, physical containers and is crucial for connecting the geostrophic regime of laboratory convection with geophysical and astrophysical systems.


title: Central limit theorem for bifurcating Markov chains under $L^{2}$-ergodic conditions

abstract: Bifurcating Markov chains (BMC) are Markov chains indexed by a full binary tree representing the evolution of a trait along a population where each individual has two children. We provide a central limit theorem for additive functionals of BMC under $L^2$-ergodic conditions with three different regimes. This completes the pointwise approach developed in a previous work. As application, we study the elementary case of symmetric bifurcating autoregressive process, which justify the non-trivial hypothesis considered on the kernel transition of the BMC. We illustrate in this example the phase transition observed in the fluctuations.


title: Fragility of Confounded Learning

abstract: We consider an observational learning model with exogenous public payoff shock. We show that confounded learning doesn't arise for almost all private signals and almost all shocks, even if players have sufficiently divergent preferences.


title: Interval Timing: Modeling the break-run-break pattern using start/stop threshold-less drift-diffusion model

abstract: Animal interval timing is often studied through the peak interval (PI) procedure. In this procedure, the animal is rewarded for the first response after a fixed delay from the stimulus onset, but on some trials, the stimulus remains and no reward is given. The common methods and models to analyse the response pattern describe it as break-run-break, a period of low rate response followed by rapid responding, followed by a low rate of response. The study of the pattern has found correlations between start, stop, and duration of the run period that hold across species and experiment. It is commonly assumed that in order to achieve the statistics with a pacemaker accumulator model it is necessary to have start and stop thresholds. In this paper we will develop a new model that varies response rate in relation to the likelihood of event occurrence, as opposed to a threshold, for changing the response rate. The new model reproduced the start and stop statistics that have been observed in 14 different PI experiments from 3 different papers. The developed model is also compared to the Time-adaptive Drift-diffusion Model (TDDM), the latest accumulator model subsuming the scalar expectancy theory (SET), on all 14 data-sets. The results show that it is unnecessary to have explicit start and stop thresholds or an internal equivalent to break-run-break states to reproduce the individual trials statistics and population behaviour and get the same break-run-break analysis results. The new model also produces more realistic individual trials compared to TDDM.


title: Learning Deep Morphological Networks with Neural Architecture Search

abstract: Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of non-linear operators are derivations of activation functions or pooling functions. Mathematical morphology is a branch of mathematics that provides non-linear operators for a variety of image processing problems. We investigate the utility of integrating these operations in an end-to-end deep learning framework in this paper. DNNs are designed to acquire a realistic representation for a particular job. Morphological operators give topological descriptors that convey salient information about the shapes of objects depicted in images. We propose a method based on meta-learning to incorporate morphological operators into DNNs. The learned architecture demonstrates how our novel morphological operations significantly increase DNN performance on various tasks, including picture classification and edge detection.


title: How to Test the Randomness from the Wireless Channel for Security?

abstract: We revisit the traditional framework of wireless secret key generation, where two parties leverage the wireless channel randomness to establish a secret key. The essence in the framework is to quantify channel randomness into bit sequences for key generation. Conducting randomness tests on such bit sequences has been a common practice to provide the confidence to validate whether they are random. Interestingly, despite different settings in the tests, existing studies interpret the results the same: passing tests means that the bit sequences are indeed random. In this paper, we investigate how to properly test the wireless channel randomness to ensure enough security strength and key generation efficiency. In particular, we define an adversary model that leverages the imperfect randomness of the wireless channel to search the generated key, and create a guideline to set up randomness testing and privacy amplification to eliminate security loss and achieve efficient key generation rate. We use theoretical analysis and comprehensive experiments to reveal that common practice misuses randomness testing and privacy amplification: (i) no security insurance of key strength, (ii) low efficiency of key generation rate. After revision by our guideline, security loss can be eliminated and key generation rate can be increased significantly.


title: Overcoming Domain Mismatch in Low Resource Sequence-to-Sequence ASR Models using Hybrid Generated Pseudotranscripts

abstract: Sequence-to-sequence (seq2seq) models are competitive with hybrid models for automatic speech recognition (ASR) tasks when large amounts of training data are available. However, data sparsity and domain adaptation are more problematic for seq2seq models than their hybrid counterparts. We examine corpora of five languages from the IARPA MATERIAL program where the transcribed data is conversational telephone speech (CTS) and evaluation data is broadcast news (BN). We show that there is a sizable initial gap in such a data condition between hybrid and seq2seq models, and the hybrid model is able to further improve through the use of additional language model (LM) data. We use an additional set of untranscribed data primarily in the BN domain for semisupervised training. In semisupervised training, a seed model trained on transcribed data generates hypothesized transcripts for unlabeled domain-matched data for further training. By using a hybrid model with an expanded language model for pseudotranscription, we are able to improve our seq2seq model from an average word error rate (WER) of 66.7% across all five languages to 29.0% WER. While this puts the seq2seq model at a competitive operating point, hybrid models are still able to use additional LM data to maintain an advantage.


title: Robust Inference for High-Dimensional Linear Models via Residual Randomization

abstract: We propose a residual randomization procedure designed for robust Lasso-based inference in the high-dimensional setting. Compared to earlier work that focuses on sub-Gaussian errors, the proposed procedure is designed to work robustly in settings that also include heavy-tailed covariates and errors. Moreover, our procedure can be valid under clustered errors, which is important in practice, but has been largely overlooked by earlier work. Through extensive simulations, we illustrate our method's wider range of applicability as suggested by theory. In particular, we show that our method outperforms state-of-art methods in challenging, yet more realistic, settings where the distribution of covariates is heavy-tailed or the sample size is small, while it remains competitive in standard, "well behaved" settings previously studied in the literature.


title: HUMAP: Hierarchical Uniform Manifold Approximation and Projection

abstract: Dimensionality reduction (DR) techniques help analysts understand patterns in high-dimensional spaces. These techniques, often represented by scatter plots, are employed in diverse science domains and facilitate similarity analysis among clusters and data samples. For datasets containing many granularities or when analysis follows the information visualization mantra, hierarchical DR techniques are the most suitable approach since they present major structures beforehand and details on demand. However, current hierarchical DR techniques are not fully capable of addressing literature problems because they do not preserve the projection mental map across hierarchical levels or are not suitable for most data types. This work presents HUMAP, a novel hierarchical dimensionality reduction technique designed to be flexible in preserving local and global structures and the mental map throughout hierarchical exploration. We provide empirical evidence of our technique's superiority compared with current hierarchical approaches and show two case studies to demonstrate its strengths.


title: Unbiased Sentence Encoder For Large-Scale Multi-lingual Search Engines

abstract: In this paper, we present a multi-lingual sentence encoder that can be used in search engines as a query and document encoder. This embedding enables a semantic similarity score between queries and documents that can be an important feature in document ranking and relevancy. To train such a customized sentence encoder, it is beneficial to leverage users search data in the form of query-document clicked pairs however, we must avoid relying too much on search click data as it is biased and does not cover many unseen cases. The search data is heavily skewed towards short queries and for long queries is small and often noisy. The goal is to design a universal multi-lingual encoder that works for all cases and covers both short and long queries. We select a number of public NLI datasets in different languages and translation data and together with user search data we train a language model using a multi-task approach. A challenge is that these datasets are not homogeneous in terms of content, size and the balance ratio. While the public NLI datasets are usually two-sentence based with the same portion of positive and negative pairs, the user search data can contain multi-sentence documents and only positive pairs. We show how multi-task training enables us to leverage all these datasets and exploit knowledge sharing across these tasks.


title: Incorporating Domain Knowledge into Health Recommender Systems using Hyperbolic Embeddings

abstract: In contrast to many other domains, recommender systems in health services may benefit particularly from the incorporation of health domain knowledge, as it helps to provide meaningful and personalised recommendations catering to the individual's health needs. With recent advances in representation learning enabling the hierarchical embedding of health knowledge into the hyperbolic Poincare space, this work proposes a content-based recommender system for patient-doctor matchmaking in primary care based on patients' health profiles, enriched by pre-trained Poincare embeddings of the ICD-9 codes through transfer learning. The proposed model outperforms its conventional counterpart in terms of recommendation accuracy and has several important business implications for improving the patient-doctor relationship.


title: Transition to strong coupling regime in hybrid plasmonic systems: Exciton-induced transparency and Fano interference

abstract: We present a microscopic model describing the transition to strong coupling regime for an emitter resonantly coupled to a surface plasmon in a metal-dielectric structure. We demonstrate that the shape of scattering spectra is determined by an interplay of two distinct mechanisms. First is the near-field coupling between the emitter and the plasmon mode which underpins energy exchange between the system components and gives rise to exciton-induced transparency minimum in scattering spectra prior the transition to strong coupling regime. The second mechanism is Fano interference between the plasmon dipole and the plasmon-induced emitter's dipole as the system interacts with the radiation field. We show that the Fano interference can strongly affect the overall shape of scattering spectra, leading to the inversion of spectral asymmetry that was recently reported in the experiment.


title: EPICURE Ensemble Pretrained Models for Extracting Cancer Mutations from Literature

abstract: To interpret the genetic profile present in a patient sample, it is necessary to know which mutations have important roles in the development of the corresponding cancer type. Named entity recognition is a core step in the text mining pipeline which facilitates mining valuable cancer information from the scientific literature. However, due to the scarcity of related datasets, previous NER attempts in this domain either suffer from low performance when deep learning based models are deployed, or they apply feature based machine learning models or rule based models to tackle this problem, which requires intensive efforts from domain experts, and limit the model generalization capability. In this paper, we propose EPICURE, an ensemble pre trained model equipped with a conditional random field pattern layer and a span prediction pattern layer to extract cancer mutations from text. We also adopt a data augmentation strategy to expand our training set from multiple datasets. Experimental results on three benchmark datasets show competitive results compared to the baseline models.


title: Gauge gravity vacuum in constraintless Clairaut-type formalism

abstract: The gauged Lorentz theory with torsion has been argued to have an effective theory whose non-trivial background is responsible for background gravitational curvature if torsion is treated as a quantum-mechanical variable against a background of constant curvature. We use the CDG decomposition to argue that such a background can be found without including torsion. Adapting our previously published Clairaut-based treatment of QCD, we go on to study the implications for second quantisation.


title: An Exponential Improvement on the Memorization Capacity of Deep Threshold Networks

abstract: It is well known that modern deep neural networks are powerful enough to memorize datasets even when the labels have been randomized. Recently, Vershynin (2020) settled a long standing question by Baum (1988), proving that \emph{deep threshold} networks can memorize $n$ points in $d$ dimensions using $\widetilde{\mathcal{O}}(e^{1/\delta^2}+\sqrt{n})$ neurons and $\widetilde{\mathcal{O}}(e^{1/\delta^2}(d+\sqrt{n})+n)$ weights, where $\delta$ is the minimum distance between the points. In this work, we improve the dependence on $\delta$ from exponential to almost linear, proving that $\widetilde{\mathcal{O}}(\frac{1}{\delta}+\sqrt{n})$ neurons and $\widetilde{\mathcal{O}}(\frac{d}{\delta}+n)$ weights are sufficient. Our construction uses Gaussian random weights only in the first layer, while all the subsequent layers use binary or integer weights. We also prove new lower bounds by connecting memorization in neural networks to the purely geometric problem of separating $n$ points on a sphere using hyperplanes.


title: Generalized kernel distance covariance in high dimensions: non-null CLTs and power universality

abstract: Distance covariance is a popular dependence measure for two random vectors $X$ and $Y$ of possibly different dimensions and types. Recent years have witnessed concentrated efforts in the literature to understand the distributional properties of the sample distance covariance in a high-dimensional setting, with an exclusive emphasis on the null case that $X$ and $Y$ are independent. This paper derives the first non-null central limit theorem for the sample distance covariance, and the more general sample (Hilbert-Schmidt) kernel distance covariance in high dimensions, primarily in the Gaussian case. The new non-null central limit theorem yields an asymptotically exact first-order power formula for the widely used generalized kernel distance correlation test of independence between $X$ and $Y$. The power formula in particular unveils an interesting universality phenomenon: the power of the generalized kernel distance correlation test is completely determined by $n\cdot \text{dcor}^2(X,Y)/\sqrt{2}$ in the high dimensional limit, regardless of a wide range of choices of the kernels and bandwidth parameters. Furthermore, this separation rate is also shown to be optimal in a minimax sense. The key step in the proof of the non-null central limit theorem is a precise expansion of the mean and variance of the sample distance covariance in high dimensions, which shows, among other things, that the non-null Gaussian approximation of the sample distance covariance involves a rather subtle interplay between the dimension-to-sample ratio and the dependence between $X$ and $Y$.


title: The Brachistochrone: An excellent problem for all levels of physics students

abstract: The classic brachistrochrone problem is standard material in intermediate mechanics. Many variations exist including some accessible to introductory students. While a quantitative solution isn't feasible in introductory classes, qualitative discussions can be very beneficial since kinematics, Newton's Laws, energy conservation and motion along curved trajectories all play a role. In this work, we describe an activity focusing on a qualitative understanding of the brachistochrone and examine the performance of freshmen, juniors and graduate students. The activity can be downloaded at https://w3.physics.arizona.edu/undergrad/teaching-resources .


title: Convergence of ASEP to KPZ with basic coupling of the dynamics

abstract: We prove an extension of a seminal result of Bertini and Giacomin. Namely we consider weakly asymmetric exclusion processes with several distinct initial data simultaneously, then run according to the basic coupling, and we show joint convergence to the solution of the KPZ equation with the same driving noise in the limiting equation. Along the way, we analyze fine properties of nontrivially coupled solutions-in-law of KPZ-type equations.


title: Targeted Data Acquisition for Evolving Negotiation Agents

abstract: Successful negotiators must learn how to balance optimizing for self-interest and cooperation. Yet current artificial negotiation agents often heavily depend on the quality of the static datasets they were trained on, limiting their capacity to fashion an adaptive response balancing self-interest and cooperation. For this reason, we find that these agents can achieve either high utility or cooperation, but not both. To address this, we introduce a targeted data acquisition framework where we guide the exploration of a reinforcement learning agent using annotations from an expert oracle. The guided exploration incentivizes the learning agent to go beyond its static dataset and develop new negotiation strategies. We show that this enables our agents to obtain higher-reward and more Pareto-optimal solutions when negotiating with both simulated and human partners compared to standard supervised learning and reinforcement learning methods. This trend additionally holds when comparing agents using our targeted data acquisition framework to variants of agents trained with a mix of supervised learning and reinforcement learning, or to agents using tailored reward functions that explicitly optimize for utility and Pareto-optimality.


title: Possibilities for an Aerial Biosphere in Temperate Sub Neptune-Sized Exoplanet Atmospheres

abstract: The search for signs of life through the detection of exoplanet atmosphere biosignature gases is gaining momentum. Yet, only a handful of rocky exoplanet atmospheres are suitable for observation with planned next-generation telescopes. To broaden prospects, we describe the possibilities for an aerial, liquid water cloud-based biosphere in the atmospheres of sub Neptune-sized temperate exoplanets, those receiving Earth-like irradiation from their host stars. One such planet is known (K2-18b) and other candidates are being followed up. Sub Neptunes are common and easier to study observationally than rocky exoplanets because of their larger sizes, lower densities, and extended atmospheres or envelopes. Yet, sub Neptunes lack any solid surface as we know it, so it is worthwhile considering whether their atmospheres can support an aerial biosphere. We review, synthesize, and build upon existing research. Passive microbial-like life particles must persist aloft in a region with liquid water clouds for long enough to metabolize, reproduce, and spread before downward transport to lower altitudes that may be too hot for life of any kind to survive. Dynamical studies are needed to flesh out quantitative details of life particle residence times. A sub Neptune would need to be a part of a planetary system with an unstable asteroid belt in order for meteoritic material to provide nutrients, though life would also need to efficiently reuse and recycle metals. The origin of life may be the most severe limiting challenge. Regardless of the uncertainties, we can keep an open mind to the search for biosignature gases as a part of general observational studies of sub Neptune exoplanets.


title: Dual-comb cavity ring-down spectroscopy

abstract: Cavity ring-down spectroscopy is a ubiquitous optical method used to study light-matter interactions with high resolution, sensitivity and accuracy. However, it has never been performed with the multiplexing advantages of direct frequency comb spectroscopy without sacrificing orders of magnitude of resolution. We present dual-comb cavity ring-down spectroscopy (DC-CRDS) based on the parallel heterodyne detection of ring-down signals with a local oscillator comb to yield absorption and dispersion spectra. These spectra are obtained from widths and positions of cavity modes. We present two approaches which leverage the dynamic cavity response to coherently or randomly driven changes in the amplitude or frequency of the probe field. Both techniques yield accurate spectra of methane - an important greenhouse gas and breath biomarker. The high sensitivity and accuracy of broadband DC-CRDS, shows promise for applications like studies of the structure and dynamics of large molecules, multispecies trace gas detection and isotopic composition.


title: Bivariate Polynomial Codes for Secure Distributed Matrix Multiplication

abstract: We consider the problem of secure distributed matrix multiplication (SDMM). Coded computation has been shown to be an effective solution in distributed matrix multiplication, both providing privacy against workers and boosting the computation speed by efficiently mitigating stragglers. In this work, we present a non-direct secure extension of the recently introduced bivariate polynomial codes. Bivariate polynomial codes have been shown to be able to further speed up distributed matrix multiplication by exploiting the partial work done by the stragglers rather than completely ignoring them while reducing the upload communication cost and/or the workers' storage's capacity needs. We show that, especially for upload communication or storage constrained settings, the proposed approach reduces the average computation time of SDMM compared to its competitors in the literature.


title: Learning Audio-Visual Dereverberation

abstract: Reverberation not only degrades the quality of speech for human perception, but also severely impacts the accuracy of automatic speech recognition. Prior work attempts to remove reverberation based on the audio modality only. Our idea is to learn to dereverberate speech from audio-visual observations. The visual environment surrounding a human speaker reveals important cues about the room geometry, materials, and speaker location, all of which influence the precise reverberation effects. We introduce Visually-Informed Dereverberation of Audio (VIDA), an end-to-end approach that learns to remove reverberation based on both the observed monaural sound and visual scene. In support of this new task, we develop a large-scale dataset SoundSpaces-Speech that uses realistic acoustic renderings of speech in real-world 3D scans of homes offering a variety of room acoustics. Demonstrating our approach on both simulated and real imagery for speech enhancement, speech recognition, and speaker identification, we show it achieves state-of-the-art performance and substantially improves over audio-only methods.


title: Finite-temperature Hatree-Fock-Bogoliubov theory for exciton-polaritons

abstract: Microcavity exciton-polaritons, known to exhibit non-equilibrium Bose condensation at high critical temperatures, can be also brought in thermal equilibrium with the surrounding medium and form a quantum degenerate Bose-Einstein distribution. It happens when their thermalization time in the regime of positive detunings -- or, alternatively, for high-finesse microcavities -- becomes shorter than their lifetime. Here we present the self-consistent finite-temperature Hartree-Fock-Bogoliubov description for such a system of polaritons, universally addressing the excitation spectrum, momentum-dependent interactions, condensate depletion, and the background population of dark excitons that contribute to the system's chemical potential. Employing the derived expressions, we discuss the implications for the Bogoliubov sound velocity, confirmed by existing experiments, and define the critical temperatures of (quasi-)condensation and the integral particle lifetime dependencies on the detuning. Large positive detunings are shown to provide conditions for the total lifetime reaching nanosecond timescales. This allows realization of thermodynamically-equilibrium polariton systems with Bose-Einstein condensate forming at temperatures as high as tens of Kelvin.


title: CoDERT: Distilling Encoder Representations with Co-learning for Transducer-based Speech Recognition

abstract: We propose a simple yet effective method to compress an RNN-Transducer (RNN-T) through the well-known knowledge distillation paradigm. We show that the transducer's encoder outputs naturally have a high entropy and contain rich information about acoustically similar word-piece confusions. This rich information is suppressed when combined with the lower entropy decoder outputs to produce the joint network logits. Consequently, we introduce an auxiliary loss to distill the encoder logits from a teacher transducer's encoder, and explore training strategies where this encoder distillation works effectively. We find that tandem training of teacher and student encoders with an inplace encoder distillation outperforms the use of a pre-trained and static teacher transducer. We also report an interesting phenomenon we refer to as implicit distillation, that occurs when the teacher and student encoders share the same decoder. Our experiments show 5.37-8.4% relative word error rate reductions (WERR) on in-house test sets, and 5.05-6.18% relative WERRs on LibriSpeech test sets.


title: Detailing the natural creation process of a single molecule MCB junction in the partially wet phase

abstract: A novel way to arrive at a single molecule junction in the partially wet phase is described. The fabrication of this device makes use of a natural drying process. Details are provided concerning the fabrication of the device and the related material choices. In addition a process description is provided with a step by step approach for creating the partially wet phase molecular MCB junction.


title: Unique sparse decomposition of low rank matrices

abstract: The problem of finding the unique low dimensional decomposition of a given matrix has been a fundamental and recurrent problem in many areas. In this paper, we study the problem of seeking a unique decomposition of a low rank matrix $Y\in \mathbb{R}^{p\times n}$ that admits a sparse representation. Specifically, we consider $Y = A X\in \mathbb{R}^{p\times n}$ where the matrix $A\in \mathbb{R}^{p\times r}$ has full column rank, with $r < \min\{n,p\}$, and the matrix $X\in \mathbb{R}^{r\times n}$ is element-wise sparse. We prove that this sparse decomposition of $Y$ can be uniquely identified, up to some intrinsic signed permutation. Our approach relies on solving a nonconvex optimization problem constrained over the unit sphere. Our geometric analysis for the nonconvex optimization landscape shows that any {\em strict} local solution is close to the ground truth solution, and can be recovered by a simple data-driven initialization followed with any second order descent algorithm. At last, we corroborate these theoretical results with numerical experiments.


title: Optical Wireless Satellite Networks versus Optical Fiber Terrestrial Networks: The Latency Perspective

abstract: Formed by using laser inter-satellite links (LISLs) among satellites in upcoming low Earth orbit and very low Earth orbit satellite constellations, optical wireless satellite networks (OWSNs), also known as free-space optical satellite networks, can provide a better alternative to existing optical fiber terrestrial networks (OFTNs) for long-distance inter-continental data communications. The LISLs operate at the speed of light in vacuum in space, which gives OWSNs a crucial advantage over OFTNs in terms of latency. In this paper, we employ the satellite constellation for Phase I of Starlink and LISLs between satellites to simulate an OWSN. Then, we compare the network latency of this OWSN and the OFTN under three different scenarios for long-distance inter-continental data communications. The results show that the OWSN performs better than the OFTN in all scenarios. It is observed that the longer the length of the inter-continental connection between the source and the destination, the better the latency improvement offered by the OWSN compared to OFTN.


title: The Noonday Argument: Fine-Graining, Indexicals, and the Nature of Copernican Reasoning

abstract: Typicality arguments attempt to use the Copernican Principle to draw conclusions about the cosmos and presently unknown conscious beings within it, including extraterrestrial intelligences (ETI). The most notorious is the Doomsday Argument, which purports to constrain humanity's future from its current lifespan alone. These arguments rest on a likelihood calculation that penalizes models in proportion to the number of distinguishable observers. I argue that such reasoning leads to solipsism, the belief that one is the only being in the world, and is therefore unacceptable. Using variants of the "Sleeping Beauty" thought experiment as a guide, I present a framework for evaluating observations in a large cosmos: Weighted Fine Graining (WFG). WFG requires the construction of specific models of physical outcomes and observations. Valid typicality arguments then emerge from the combinatorial properties of third-person physical microhypotheses. Indexical (observer-relative) facts do not directly constrain physical theories, but instead weight different provisional evaluations of credence. As indexical knowledge changes, the weights shift. I show that the self-applied Doomsday Argument fails in WFG, even though it can work for an external observer. I argue that the Copernican Principle does not let us apply self-observations to constrain ETIs.


title: Galactic Traversability: A New Concept for Extragalactic SETI

abstract: Interstellar travel in the Milky Way is commonly thought to be a long and dangerous enterprise, but are all galaxies so hazardous? I introduce the concept of galactic traversability to address this question. Stellar populations are one factor in traversability, with higher stellar densities and velocity dispersions aiding rapid spread across a galaxy. The interstellar medium (ISM) is another factor, as gas, dust grains, and cosmic rays (CRs) all pose hazards to starfarers. I review the current understanding of these components in different types of galaxies, and conclude that red quiescent galaxies without star formation have favorable traversability. Compact elliptical galaxies and globular clusters could be "super-traversable", because stars are packed tightly together and there are minimal ISM hazards. Overall, if the ISM is the major hindrance to interstellar travel, galactic traversability increases with cosmic time as gas fractions and star formation decline. Traversability is a consideration in extragalactic surveys for the search for extraterrestrial intelligence (SETI).


title: Improved upper bounds on the stabilizer rank of magic states

abstract: In this work we improve the runtime of recent classical algorithms for strong simulation of quantum circuits composed of Clifford and T gates. The improvement is obtained by establishing a new upper bound on the stabilizer rank of $m$ copies of the magic state $|T\rangle=\sqrt{2}^{-1}(|0\rangle+e^{i\pi/4}|1\rangle)$ in the limit of large $m$. In particular, we show that $|T\rangle^{\otimes m}$ can be exactly expressed as a superposition of at most $O(2^{\alpha m})$ stabilizer states, where $\alpha\leq 0.3963$, improving on the best previously known bound $\alpha \leq 0.463$. This furnishes, via known techniques, a classical algorithm which approximates output probabilities of an $n$-qubit Clifford + T circuit $U$ with $m$ uses of the T gate to within a given inverse polynomial relative error using a runtime $\mathrm{poly}(n,m)2^{\alpha m}$. We also provide improved upper bounds on the stabilizer rank of symmetric product states $|\psi\rangle^{\otimes m}$ more generally; as a consequence we obtain a strong simulation algorithm for circuits consisting of Clifford gates and $m$ instances of any (fixed) single-qubit $Z$-rotation gate with runtime $\text{poly}(n,m) 2^{m/2}$. We suggest a method to further improve the upper bounds by constructing linear codes with certain properties.


title: Fundamental Sensitivity Bounds for Quantum Enhanced Optical Resonance Sensors Based on Transmission and Phase Estimation

abstract: Quantum states of light can enable sensing configurations with sensitivities beyond the shot-noise limit (SNL). In order to better take advantage of available quantum resources and obtain the maximum possible sensitivity, it is necessary to determine fundamental sensitivity limits for different possible configurations for a given sensing system. Here, due to their wide applicability, we focus on optical resonance sensors, which detect a change in a parameter of interest through a resonance shift. We compare their fundamental sensitivity limits set by the quantum Cram\'er-Rao bound (QCRB) based on the estimation of changes in transmission or phase of a probing bright two-mode squeezed state (bTMSS) of light. We show that the fundamental sensitivity results from an interplay between the QCRB and the transfer function of the system. As a result, for a resonance sensor with a Lorentzian lineshape a phase-based scheme outperforms a transmission-based one for most of the parameter space; however, this is not the case for lineshapes with steeper slopes, such as higher order Butterworth lineshapes. Furthermore, such an interplay results in conditions under which the phase-based scheme provides a higher sensitivity than the transmission-based one but a smaller degree of quantum enhancement. We also study the effect of losses external to the sensor on the degree of quantum enhancement and show that for certain conditions probing with a classical state can provide a higher sensitivity than probing with a bTMSS. Finally, we discuss detection schemes, namely optimized intensity-difference and optimized homodyne detection, that can achieve the fundamental sensitivity limits even in the presence of external losses.


title: Can BERT Dig It? -- Named Entity Recognition for Information Retrieval in the Archaeology Domain

abstract: The amount of archaeological literature is growing rapidly. Until recently, these data were only accessible through metadata search. We implemented a text retrieval engine for a large archaeological text collection ($\sim 658$ Million words). In archaeological IR, domain-specific entities such as locations, time periods, and artefacts, play a central role. This motivated the development of a named entity recognition (NER) model to annotate the full collection with archaeological named entities. In this paper, we present ArcheoBERTje, a BERT model pre-trained on Dutch archaeological texts. We compare the model's quality and output on a Named Entity Recognition task to a generic multilingual model and a generic Dutch model. We also investigate ensemble methods for combining multiple BERT models, and combining the best BERT model with a domain thesaurus using Conditional Random Fields (CRF). We find that ArcheoBERTje outperforms both the multilingual and Dutch model significantly with a smaller standard deviation between runs, reaching an average F1 score of 0.735. The model also outperforms ensemble methods combining the three models. Combining ArcheoBERTje predictions and explicit domain knowledge from the thesaurus did not increase the F1 score. We quantitatively and qualitatively analyse the differences between the vocabulary and output of the BERT models on the full collection and provide some valuable insights in the effect of fine-tuning for specific domains. Our results indicate that for a highly specific text domain such as archaeology, further pre-training on domain-specific data increases the model's quality on NER by a much larger margin than shown for other domains in the literature, and that domain-specific pre-training makes the addition of domain knowledge from a thesaurus unnecessary.


title: Regularization of the Factorization Method applied to diffuse optical tomography

abstract: In this paper, we develop a new regularized version of the Factorization Method for positive operators mapping a complex Hilbert Space into it's dual space. The Factorization Method uses Picard's Criteria to define an indicator function to image an unknown region. In most applications, the data operator is compact which gives that the singular values can tend to zero rapidly which can cause numerical instabilities. The regularization of the Factorization Method presented here seeks to avoid the numerical instabilities in applying Picard's Criteria. This method allows one to image the interior structure of an object with little a priori information in a computationally simple and analytically rigorous way. Here we will focus on an application of this method to diffuse optical tomography where will prove that this method can be used to recover an unknown subregion from the Dirichlet-to-Neumann mapping. Numerical examples will be presented in two dimensions.


title: Fundamentals of Partial Rejection Sampling

abstract: Partial Rejection Sampling is an algorithmic approach to obtaining a perfect sample from a specified distribution. The objects to be sampled are assumed to be represented by a number of random variables. In contrast to classical rejection sampling, in which all variables are resampled until a feasible solution is found, partial rejection sampling aims at greater efficiency by resampling only a subset of variables that `go wrong'. Partial rejection sampling is closely related to Moser and Tardos' algorithmic version of the Lov\'asz Local Lemma, but with the additional requirement that a specified output distribution should be met. This article provides a largely self-contained account of the basic form of the algorithm and its analysis.


title: Rigidity and unlikely intersections for stable $p$-adic dynamical systems

abstract: Berger asked the question \enquote{To what extent the preperiodic points of a stable $p$-adic power series determines a stable $p$-adic dynamical system} ? In this work we have applied the preperiodic points of a stable $p$-adic power series in order to determine the corresponding stable $p$-adic dynamical system.


title: Cosimplicial meromorphic functions cohomology on complex manifolds

abstract: Developing ideas of \cite{Fei}, we introduce canonical cosimplicial cohomology of meromorphic functions for infinite-dimensional Lie algebra formal series with prescribed analytic behavior on domains of a complex manifold $M$. Graded differential cohomology of a sheaf of Lie algebras $\mathcal G$ via the cosimplicial cohomology of $\mathcal G$-formal series for any covering by Stein spaces on $M$ is computed. A relation between cosimplicial cohomology (on a special set of open domains of $M$) of formal series of an infinite-dimensional Lie algebra $\mathcal G$ and singular cohomology of auxiliary manifold associated to a $\mathcal G$-module is found. Finally, multiple applications in conformal field theory, deformation theory, and in the theory of foliations are proposed.


title: Cohomology of modular form connections on complex curves

abstract: We consider reduction cohomology of modular functions defined on complex curves via generalizations of holomorphic connections. The cohomology is explicitly found in terms of higher genus counterparts of elliptic functions as analytic continuations of solutions for functional equations. Examples of modular functions on various genera are provided.


title: Associative algebra twisted bundles over compact topological spaces

abstract: For the associative algebra $A(\mathfrak g)$ of an infinite-dimensional Lie algebra $\mathfrak g$, we introduce twisted fiber bundles over arbitrary compact topological spaces. Fibers of such bundles are given by elements of algebraic completion of the space of formal series in complex parameters, sections are provided by rational functions with prescribed analytic properties. Homotopical invariance as well as covariance in terms of trivial bundles of twisted $A(\mathfrak g)$-bundles is proven. Further applications of the paper's results useful for studies of the cohomology of infinite-dimensional Lie algebras on smooth manifolds, $K$-theory, as well as for purposes of conformal field theory, deformation theory, and the theory of foliations are mentioned.


title: Machine learning unveils composition-property relationships in chalcogenide glasses

abstract: Due to their unique optical and electronic functionalities, chalcogenide glasses are materials of choice for numerous microelectronic and photonic devices. However, to extend the range of compositions and applications, profound knowledge about composition-property relationships is necessary. To this end, we collected a large quantity of composition-property data on chalcogenide glasses from SciGlass database regarding glass transition temperature ($T_g$), Young's modulus ($E$), coefficient of thermal expansion (CTE), and refractive index ($n_D$). With these data, we induced predictive models using three machine learning algorithms: Random Forest, K-nearest Neighbors, and Classification and Regression Trees. Finally, the induced models were interpreted by computing the SHAP (SHapley Additive exPlanations) values of the chemical features, which revealed the key elements that significantly impacted the tested properties and quantified their impact. For instance, Ge and Ga increase $T_g$ and $E$ and decrease CTE (three properties that depend on bond strength), whereas Se has the opposite effect. Te, As, Tl, and Sb increase $n_D$ (which strongly depends on polarizability), whereas S, Ge, and P diminish it. Knowledge about the effect of each element on the glass properties is precious for semi-empirical compositional development trials or simulation-driven formulations. The induced models can be used to design novel chalcogenide glasses with required combinations of properties.


title: Hip to Be (Latin) Square: Maximal Period Sequences from Orthogonal Cellular Automata

abstract: Orthogonal Cellular Automata (OCA) have been recently investigated in the literature as a new approach to construct orthogonal Latin squares for cryptographic applications such as secret sharing schemes. In this paper, we consider OCA for a different cryptographic task, namely the generation of pseudorandom sequences. The idea is to iterate a dynamical system where the output of an OCA pair is fed back as a new set of coordinates on the superposed squares. The main advantage is that OCA ensure a certain amount of diffusion in the generated sequences, a property which is usually missing from traditional CA-based pseudorandom number generators. We study the problem of finding OCA pairs with maximal period by first performing an exhaustive search up to local rules of diameter $d=5$, and then focusing on the subclass of linear bipermutive rules. In this case, we characterize the periods of the sequences in terms of the order of the subgroup generated by an invertible Sylvester matrix. We finally devise an algorithm based on Lagrange's theorem to efficiently enumerate all linear OCA pairs of maximal period up to diameter $d=11$.


title: FedNILM: Applying Federated Learning to NILM Applications at the Edge

abstract: Non-intrusive load monitoring (NILM) helps disaggregate the household's main electricity consumption to energy usages of individual appliances, thus greatly cutting down the cost in fine-grained household load monitoring. To address the arisen privacy concern in NILM applications, federated learning (FL) could be leveraged for NILM model training and sharing. When applying the FL paradigm in real-world NILM applications, however, we are faced with the challenges of edge resource restriction, edge model personalization and edge training data scarcity. In this paper we present FedNILM, a practical FL paradigm for NILM applications at the edge client. Specifically, FedNILM is designed to deliver privacy-preserving and personalized NILM services to large-scale edge clients, by leveraging i) secure data aggregation through federated learning, ii) efficient cloud model compression via filter pruning and multi-task learning, and iii) personalized edge model building with unsupervised transfer learning. Our experiments on real-world energy data show that, FedNILM is able to achieve personalized energy disaggregation with the state-of-the-art accuracy, while ensuring privacy preserving at the edge client.


title: Optimization-friendly generic mechanisms without money

abstract: The goal of this paper is to develop a generic framework for converting modern optimization algorithms into mechanisms where inputs come from self-interested agents. We focus on aggregating preferences from $n$ players in a context without money. Special cases of this setting include voting, allocation of items by lottery, and matching. Our key technical contribution is a new meta-algorithm we call \apex (Adaptive Pricing Equalizing Externalities). The framework is sufficiently general to be combined with any optimization algorithm that is based on local search. We outline an agenda for studying the algorithm's properties and its applications. As a special case of applying the framework to the problem of one-sided assignment with lotteries, we obtain a strengthening of the 1979 result by Hylland and Zeckhauser on allocation via a competitive equilibrium from equal incomes (CEEI). The [HZ79] result posits that there is a (fractional) allocation and a set of item prices such that the allocation is a competitive equilibrium given prices. We further show that there is always a reweighing of the players' utility values such that running unit-demand VCG with reweighed utilities leads to a HZ-equilibrium prices. Interestingly, not all HZ competitive equilibria come from VCG prices. As part of our proof, we re-prove the [HZ79] result using only Brouwer's fixed point theorem (and not the more general Kakutani's theorem). This may be of independent interest.


title: Dust in the central parsecs of unobscured AGN: more challenges to the torus

abstract: A parsec-scale dusty torus is thought to be the cause of Active Galactic Nuclei (AGN) dichotomy in the 1/2 types, narrow/broad emission lines. In a previous work, on the basis of parsec-scale resolution infrared / optical dust maps it was found that dust filaments, few parsecs wide, several hundred parsecs long, were ubiquitous features crossing the centre of type 2 AGN, their optical thickness being sufficient to fully obscure the optical nucleus. This work presents the complementary view for type 1 and intermediate-type AGN. The same type of narrow, collimated, dust filaments are equally found at the centre of these AGN. The difference now resides in their location with respect to the nucleus, next to it but not crossing it, as it is the case in type 2, and their reduced optical thickness towards the centre, $A_V \lesssim 1.5 \rm{mag}$, insufficient to obscure at UV nucleus wavelengths. It is concluded that large scale, hundred pc to kpc long, dust filaments and lanes, reminiscent of those seen in the Milky Way, are a common ingredient to the central parsec of galaxies. Their optical thickness changes along their structure, in type 2 reaching optical depths high enough to obscure the nucleus in full. Their location with respect to the nucleus and increasing gradient in optical depth towards the centre could naturally lead to the canonical type 1/2 AGN classification, making these filaments to play the role of the torus. Dust filaments and lanes show equivalent morphologies in molecular gas. Available gas kinematic indicates mass inflows at rates $ < ~ 1 M\odot~ yr^{-1}$.


abstract: Explainable Artificial Intelligence (XAI) is a set of techniques that allows the understanding of both technical and non-technical aspects of Artificial Intelligence (AI) systems. XAI is crucial to help satisfying the increasingly important demand of \emph{trustworthy} Artificial Intelligence, characterized by fundamental characteristics such as respect of human autonomy, prevention of harm, transparency, accountability, etc. Within XAI techniques, counterfactual explanations aim to provide to end users a set of features (and their corresponding values) that need to be changed in order to achieve a desired outcome. Current approaches rarely take into account the feasibility of actions needed to achieve the proposed explanations, and in particular they fall short of considering the causal impact of such actions. In this paper, we present Counterfactual Explanations as Interventions in Latent Space (CEILS), a methodology to generate counterfactual explanations capturing by design the underlying causal relations from the data, and at the same time to provide feasible recommendations to reach the proposed profile. Moreover, our methodology has the advantage that it can be set on top of existing counterfactuals generator algorithms, thus minimising the complexity of imposing additional causal constrains. We demonstrate the effectiveness of our approach with a set of different experiments using synthetic and real datasets (including a proprietary dataset of the financial domain).


title: All-flavor constraints on nonstandard neutrino interactions and generalized matter potential with three years of IceCube DeepCore data

abstract: We report constraints on nonstandard neutrino interactions (NSI) from the observation of atmospheric neutrinos with IceCube, limiting all individual coupling strengths from a single dataset. Furthermore, IceCube is the first experiment to constrain flavor-violating and nonuniversal couplings simultaneously. Hypothetical NSI are generically expected to arise due to the exchange of a new heavy mediator particle. Neutrinos propagating in matter scatter off fermions in the forward direction with negligible momentum transfer. Hence the study of the matter effect on neutrinos propagating in the Earth is sensitive to NSI independently of the energy scale of new physics. We present constraints on NSI obtained with an all-flavor event sample of atmospheric neutrinos based on three years of IceCube DeepCore data. The analysis uses neutrinos arriving from all directions, with reconstructed energies between 5.6 GeV and 100 GeV. We report constraints on the individual NSI coupling strengths considered singly, allowing for complex phases in the case of flavor-violating couplings. This demonstrates that IceCube is sensitive to the full NSI flavor structure at a level competitive with limits from the global analysis of all other experiments. In addition, we investigate a generalized matter potential, whose overall scale and flavor structure are also constrained.


title: Counterfactual Explanations for Machine Learning: Challenges Revisited

abstract: Counterfactual explanations (CFEs) are an emerging technique under the umbrella of interpretability of machine learning (ML) models. They provide ``what if'' feedback of the form ``if an input datapoint were $x'$ instead of $x$, then an ML model's output would be $y'$ instead of $y$.'' Counterfactual explainability for ML models has yet to see widespread adoption in industry. In this short paper, we posit reasons for this slow uptake. Leveraging recent work outlining desirable properties of CFEs and our experience running the ML wing of a model monitoring startup, we identify outstanding obstacles hindering CFE deployment in industry.


title: ALMA 870 $\mu$m continuum observations of HD 100546. Evidence of a giant planet on a wide orbit

abstract: This paper reports on a new analysis of archival ALMA $870\,\mu$m dust continuum observations. Along with the previously observed bright inner ring ($r \sim 20-40\,$au), two addition substructures are evident in the new continuum image: a wide dust gap, $r \sim 40-150\,$au, and a faint outer ring ranging from $r \sim 150\,$au to $r \sim 250\,$au and whose presence was formerly postulated in low-angular-resolution ALMA cycle 0 observations but never before observed. Notably, the dust emission of the outer ring is not homogeneous, and it shows two prominent azimuthal asymmetries that resemble an eccentric ring with eccentricity $e = 0.07 $. The characteristic double-ring dust structure of HD 100546 is likely produced by the interaction of the disk with multiple giant protoplanets. This paper includes new smoothed-particle-hydrodynamic simulations with two giant protoplanets, one inside of the inner dust cavity and one in the dust gap. The simulations qualitatively reproduce the observations, and the final masses and orbital distances of the two planets in the simulations are 3.1 $M_{J}$ at 15 au and 8.5 $M_{J}$ at 110 au, respectively. The massive outer protoplanet substantially perturbs the disk surface density distribution and gas dynamics, producing multiple spiral arms both inward and outward of its orbit. This can explain the observed perturbed gas dynamics inward of 100 au as revealed by ALMA observations of CO. Finally, the reduced dust surface density in the $\sim 40-150\,$au dust gap can nicely clarify the origin of the previously detected H$_2$O gas and ice emission.


title: Pitfalls of Explainable ML: An Industry Perspective

abstract: As machine learning (ML) systems take a more prominent and central role in contributing to life-impacting decisions, ensuring their trustworthiness and accountability is of utmost importance. Explanations sit at the core of these desirable attributes of a ML system. The emerging field is frequently called ``Explainable AI (XAI)'' or ``Explainable ML.'' The goal of explainable ML is to intuitively explain the predictions of a ML system, while adhering to the needs to various stakeholders. Many explanation techniques were developed with contributions from both academia and industry. However, there are several existing challenges that have not garnered enough interest and serve as roadblocks to widespread adoption of explainable ML. In this short paper, we enumerate challenges in explainable ML from an industry perspective. We hope these challenges will serve as promising future research directions, and would contribute to democratizing explainable ML.


title: Kaizen: Continuously improving teacher using Exponential Moving Average for semi-supervised speech recognition

abstract: In this paper, we introduce the Kaizen framework that uses a continuously improving teacher to generate pseudo-labels for semi-supervised speech recognition (ASR). The proposed approach uses a teacher model which is updated as the exponential moving average (EMA) of the student model parameters. We demonstrate that it is critical for EMA to be accumulated with full-precision floating point. The Kaizen framework can be seen as a continuous version of the iterative pseudo-labeling approach for semi-supervised training. It is applicable for different training criteria, and in this paper we demonstrate its effectiveness for frame-level hybrid hidden Markov model-deep neural network (HMM-DNN) systems as well as sequence-level Connectionist Temporal Classification (CTC) based models. For large scale real-world unsupervised public videos in UK English and Italian languages the proposed approach i) shows more than 10% relative word error rate (WER) reduction over standard teacher-student training; ii) using just 10 hours of supervised data and a large amount of unsupervised data closes the gap to the upper-bound supervised ASR system that uses 650h or 2700h respectively.


title: RETRIEVE: Coreset Selection for Efficient and Robust Semi-Supervised Learning

abstract: Semi-supervised learning (SSL) algorithms have had great success in recent years in limited labeled data regimes. However, the current state-of-the-art SSL algorithms are computationally expensive and entail significant compute time and energy requirements. This can prove to be a huge limitation for many smaller companies and academic groups. Our main insight is that training on a subset of unlabeled data instead of entire unlabeled data enables the current SSL algorithms to converge faster, significantly reducing computational costs. In this work, we propose RETRIEVE, a coreset selection framework for efficient and robust semi-supervised learning. RETRIEVE selects the coreset by solving a mixed discrete-continuous bi-level optimization problem such that the selected coreset minimizes the labeled set loss. We use a one-step gradient approximation and show that the discrete optimization problem is approximately submodular, enabling simple greedy algorithms to obtain the coreset. We empirically demonstrate on several real-world datasets that existing SSL algorithms like VAT, Mean-Teacher, FixMatch, when used with RETRIEVE, achieve a) faster training times, b) better performance when unlabeled data consists of Out-of-Distribution (OOD) data and imbalance. More specifically, we show that with minimal accuracy degradation, RETRIEVE achieves a speedup of around $3\times$ in the traditional SSL setting and achieves a speedup of $5\times$ compared to state-of-the-art (SOTA) robust SSL algorithms in the case of imbalance and OOD data. RETRIEVE is available as a part of the CORDS toolkit: https://github.com/decile-team/cords.


title: Linear-Time Probabilistic Solutions of Boundary Value Problems

abstract: We propose a fast algorithm for the probabilistic solution of boundary value problems (BVPs), which are ordinary differential equations subject to boundary conditions. In contrast to previous work, we introduce a Gauss--Markov prior and tailor it specifically to BVPs, which allows computing a posterior distribution over the solution in linear time, at a quality and cost comparable to that of well-established, non-probabilistic methods. Our model further delivers uncertainty quantification, mesh refinement, and hyperparameter adaptation. We demonstrate how these practical considerations positively impact the efficiency of the scheme. Altogether, this results in a practically usable probabilistic BVP solver that is (in contrast to non-probabilistic algorithms) natively compatible with other parts of the statistical modelling tool-chain.


title: Semi-Implicit finite-difference methods to study the spin-orbit and coherently coupled spinor Bose-Einstein condensates

abstract: We develop time-splitting finite difference methods, using implicit Backward-Euler and semi-implicit Crank-Nicolson discretization schemes, to study the spin-orbit coupled spinor Bose Einstein condensates with coherent coupling in quasi-one and quasi-two-dimensional traps. The split equations involving kinetic energy and spin-orbit coupling operators are solved using either time-implicit Backward-Euler or semi-implicit Crank-Nicolson methods. We explicitly develop the method for pseudospin-1/2, spin-1, and spin-2 condensates. The results for ground states obtained with time-splitting Backward-Euler and Crank-Nicolson methods are in excellent agreement with time-splitting Fourier spectral method which is one of the popular methods to solve the mean-field models for spin-orbit coupled spinor condensates. We confirm the emergence of different phases in spin-orbit coupled pseudospin-1/2, spin-1, and spin-2 condensates with coherent coupling.


title: String Diagrammatic Electrical Circuit Theory

abstract: We develop a comprehensive string diagrammatic treatment of electrical circuits. Building on previous, limited case studies, we introduce controlled sources and meters as elements, and the impedance calculus, a powerful toolbox for diagrammatic reasoning on circuit diagrams. We demonstrate the power of our approach by giving idiomatic proofs of several textbook results, including the superposition theorem and Thevenin's theorem.


title: Reconstruction of singular and degenerate inclusions in Calder\'on's problem

abstract: We consider the reconstruction of the support of an unknown perturbation to a known conductivity coefficient in Calder\'on's problem. In a previous result by the authors on monotonicity-based reconstruction, the perturbed coefficient is allowed to simultaneously take the values $0$ and $\infty$ in some parts of the domain and values bounded away from $0$ and $\infty$ elsewhere. We generalise this result by allowing the unknown coefficient to be the restriction of an $A_2$-Muckenhoupt weight in parts of the domain, thereby including singular and degenerate behaviour in the governing equation. In particular, the coefficient may tend to $0$ and $\infty$ in a controlled manner, which goes beyond the standard setting of Calder\'on's problem. Our main result constructively characterises the outer shape of the support of such a general perturbation, based on a local Neumann-to-Dirichlet map defined on an open subset of the domain boundary.


title: Investigating Unprompted and Prompted Diagrams Generated by Physics MajorsDuring Problem Solving

abstract: Diagrams are ubiquitous in physics, especially in physics education and physics problem solving. Problem solvers may generate diagrams to orient to a scenario, to organize information, to directly extract an answer, or as a tool of communication. In this study, we interviewed 19 undergraduate and graduate physics majors, asking them to solve 18 multiple-choice physics problems -- with no prompting regarding diagrams -- and then six diagramming tasks of situations similar to six of the multiple-choice problems. By comparing spontaneously generated and prompted diagrams, we identify different diagramming elements and features used by physics majors acting towards different ends (\textit{i.e.,} in different epistemic frames). We found that different physical contexts impact how critical it is to draw an accurate diagram, and that the differences in diagramming between cohorts (\textit{e.g.}, between lower-division undergraduate and graduate students) seem to be smaller than the differences within a cohort. We also explore implications for teaching and research.


title: Combined active-passive heat transfer control using slotted fins and oscillation in turbulent flow: the cases of single cylinder and tube banks

abstract: In heat transfer augmenting methods such as radial fins, the heat transfer enhancement commonly leads to the drag force increment. In the present paper, slots are inserted over the fins to simultaneously reduce the drag coefficient. Turbulent convection heat transfer around a cylinder, as well as oscillating bundle of tubes including the slotted radial fins have been investigated. The governing equations are solved in two-dimension utilizing OpenFOAM software based on k-{\omega} SST closure model. The cases with various slot location, slot width, the number of the slots, the fin height, and oscillation frequencies are examined. In all cases, the Reynolds number is taken to be equal to 5000. Presence of three slots on the fins reduces the drag coefficient by 23% and augments the Nusselt number by 76%. In order to enhance the heat transfer from the bundle of tube, oscillation of tubes and utilization of the slotted fins are applied. The optimum situation occurs for a sample with the oscillating third column that shows 3% increment in heat transfer relative to that of the fixed case. This is while adding the slotted fins to the oscillating tube bank increases the heat transfer up to 2.5 times.


title: How does Heterophily Impact the Robustness of Graph Neural Networks? Theoretical Connections and Practical Implications

abstract: We bridge two research directions on graph neural networks (GNNs), by formalizing the relation between heterophily of node labels (i.e., connected nodes tend to have dissimilar labels) and the robustness of GNNs to adversarial attacks. Our theoretical and empirical analyses show that for homophilous graph data, impactful structural attacks always lead to reduced homophily, while for heterophilous graph data the change in the homophily level depends on the node degrees. These insights have practical implications for defending against attacks on real-world graphs: we deduce that separate aggregators for ego- and neighbor-embeddings, a design principle which has been identified to significantly improve prediction for heterophilous graph data, can also offer increased robustness to GNNs. Our comprehensive experiments show that GNNs merely adopting this design achieve improved empirical and certifiable robustness compared to the best-performing unvaccinated model. Additionally, combining this design with explicit defense mechanisms against adversarial attacks leads to an improved robustness with up to 18.33% performance increase under attacks compared to the best-performing vaccinated model.


title: Experiment on scalable multi-user twin-field quantum key distribution network

abstract: Twin-field quantum key distribution (TFQKD) systems have shown great promise for implementing practical long-distance secure quantum communication due to its measurement-device-independent nature and its ability to offer fundamentally superior rate-loss scaling than point-to-point QKD systems. A surge of research and development effort in the last two years has produced many variants of protocols and experimental demonstrations. In terms of hardware topology, TFQKD systems interfering quantum signals from two remotely phase-locked laser sources are in essence giant Mach-Zehnder interferometers (MZIs) requiring active phase stabilization. Such configurations are inherently unsuitable for a TFQKD network, where more than one user-pair share the common quantum measurement station, because it is practically extremely difficult, if not impossible, to stabilize MZIs of largely disparate path lengths, a situation that is inevitable in a multi-user-pair TFQKD network. On the other hand, Sagnac interferometer based TFQKD systems exploiting the inherent phase stability of the Sagnac ring can implement asymmetric TFQKD, and are therefore eminently suitable for implementing a TFQKD network. In this work, we experimentally demonstrate a proof-of-principle multi-user-pair Sagnac TFQKD network where three user pairs sharing the same measurement station can perform pair-wise TFQKD through time multiplexing, with channel losses up to 58 dB, and channel loss asymmetry up to 15 dB. In some cases, the secure key rates still beat the rate-loss bounds for point-to-point repeaterless QKD systems, even in this network configuration. It is to our knowledge the first multi-user-pair TFQKD network demonstration, an important step in advancing quantum communication network technologies.


title: The Flip Side of the Reweighted Coin: Duality of Adaptive Dropout and Regularization

abstract: Among the most successful methods for sparsifying deep (neural) networks are those that adaptively mask the network weights throughout training. By examining this masking, or dropout, in the linear case, we uncover a duality between such adaptive methods and regularization through the so-called "$\eta$-trick" that casts both as iteratively reweighted optimizations. We show that any dropout strategy that adapts to the weights in a monotonic way corresponds to an effective subquadratic regularization penalty, and therefore leads to sparse solutions. We obtain the effective penalties for several popular sparsification strategies, which are remarkably similar to classical penalties commonly used in sparse optimization. Considering variational dropout as a case study, we demonstrate similar empirical behavior between the adaptive dropout method and classical methods on the task of deep network sparsification, validating our theory.


title: Potato Crop Stress Identification in Aerial Images using Deep Learning-based Object Detection

abstract: Recent research on the application of remote sensing and deep learning-based analysis in precision agriculture demonstrated a potential for improved crop management and reduced environmental impacts of agricultural production. Despite the promising results, the practical relevance of these technologies for field deployment requires novel algorithms that are customized for analysis of agricultural images and robust to implementation on natural field imagery. The paper presents an approach for analyzing aerial images of a potato (Solanum tuberosum L.) crop using deep neural networks. The main objective is to demonstrate automated spatial recognition of healthy vs. stressed crop at a plant level. Specifically, we examine premature plant senescence resulting in drought stress on Russet Burbank potato plants. We propose a novel deep learning (DL) model for detecting crop stress, named Retina-UNet-Ag. The proposed architecture is a variant of Retina-UNet and includes connections from low-level semantic representation maps to the feature pyramid network. The paper also introduces a dataset of aerial field images acquired with a Parrot Sequoia camera. The dataset includes manually annotated bounding boxes of healthy and stressed plant regions. Experimental validation demonstrated the ability for distinguishing healthy and stressed plants in field images, achieving an average dice score coefficient (DSC) of 0.74. A comparison to related state-of-the-art DL models for object detection revealed that the presented approach is effective for this task. The proposed method is conducive toward the assessment and recognition of potato crop stress in aerial field images collected under natural conditions.


title: Flow Guided Transformable Bottleneck Networks for Motion Retargeting

abstract: Human motion retargeting aims to transfer the motion of one person in a "driving" video or set of images to another person. Existing efforts leverage a long training video from each target person to train a subject-specific motion transfer model. However, the scalability of such methods is limited, as each model can only generate videos for the given target subject, and such training videos are labor-intensive to acquire and process. Few-shot motion transfer techniques, which only require one or a few images from a target, have recently drawn considerable attention. Methods addressing this task generally use either 2D or explicit 3D representations to transfer motion, and in doing so, sacrifice either accurate geometric modeling or the flexibility of an end-to-end learned representation. Inspired by the Transformable Bottleneck Network, which renders novel views and manipulations of rigid objects, we propose an approach based on an implicit volumetric representation of the image content, which can then be spatially manipulated using volumetric flow fields. We address the challenging question of how to aggregate information across different body poses, learning flow fields that allow for combining content from the appropriate regions of input images of highly non-rigid human subjects performing complex motions into a single implicit volumetric representation. This allows us to learn our 3D representation solely from videos of moving people. Armed with both 3D object understanding and end-to-end learned rendering, this categorically novel representation delivers state-of-the-art image generation quality, as shown by our quantitative and qualitative evaluations.


title: On minimum $ (K_{1,r};k) $-vertex stable graphs on the exact number of vertices

abstract: A graph $ G $ is said to be $ (H;k) $-vertex stable if $ G $ contains a~subgraph isomorphic to $ H $ even after removing any $ k $ of its vertices alongside with their incident edges. We will denote by $ \text{stab}(H;k) $ the minimum size among sizes of all $ (H;k) $-vertex stable graphs. In this paper we consider a~case where the structure $ H $ is a~star graph $ K_{1,r} $ and the the number of vertices in $ G $ is exact, \ie equal to $ 1 + r + k $. We will show that under the above assumptions $ \text{stab}(K_{1,r};k) $ equals either $ \frac{1}{2}(k + 1)(2r + k) $, $ \frac{1}{2}\big((r + k)^{2} - 1\big) $ or $ \frac{1}{2}(r + k)^{2} $. Moreover, we will characterize all the extremal graphs.


title: Cohomology of Jacobi forms

abstract: We define and compute a cohomology of the space of Jacobi forms based on precise analogues of Zhu reduction formulas. A counterpart of the Bott-Segal theorem for the reduction cohomology of Jacobi forms on the torus is proven. It is shown that the reduction cohomology for Jacobi forms is given by the cohomology of $n$-point connections over a deformed vertex operator algebra bundle defined on the torus. The reduction cohomology for Jacobi forms for a vertex operator algebra is determined in terms of the space of analytical continuations of solutions to Knizhnik-Zamolodchikov equations.


title: On the unsteady and lineal translation of a sphere through a viscoelastic fluid

abstract: The unsteady, lineal translation of a solid spherical particle through viscoelastic fluids described by the Johnson-Segalman and Giesekus models is studied analytically. Solutions for the pressure and velocity fields as well as the force on the particle are expanded as a power series in the Weissenberg number. The momentum balance and constitutive equation are solved asymptotically for a steadily translating particle up to second order in the particle velocity, and rescaling of the pressure and velocity in the frequency domain is used to relate the solutions for steady lineal translation to those for unsteady lineal translation. The unsteady force at third order in the particle velocity is then calculated through application of the Lorentz reciprocal theorem, and it is shown that this weakly nonlinear contribution to the force can be expressed as part of a Volterra series. Through a series of examples, it is shown that a truncated representation of this Volterra series, which can be manipulated to describe the velocity in terms of an imposed force, is useful for analyzing specific time-dependent particle motions. Two examples studied using this relationship are the force on a particle suddenly set into motion and the velocity of a particle in response to a suddenly imposed steady force. Additionally, the weakly nonlinear response of particle captured by a harmonic trap moving lineally through the fluid is computed. This is an analog to active microrheology experiments, and can be used to explain how weakly nonlinear responses manifest in active microrheology experiments with spherical probes.


title: Spin-pure Stochastic-CASSCF via GUGA-FCIQMC applied to Iron Sulfur Clusters

abstract: In this work we demonstrate how to compute the one- and two-body reduced density matrices within the spin-adapted full configuration interaction quantum Monte Carlo (FCIQMC) method, which is based on the graphical unitary group approach (GUGA). This allows us to use GUGA-FCIQMC as a spin-pure configuration interaction (CI) eigensolver within the complete active space self-consistent field (CASSCF) procedure, and hence to stochastically treat active spaces far larger than conventional CI solvers whilst variationally relaxing orbitals for specific spin-pure states. We apply the method to investigate the spin-ladder in iron-sulfur dimer and tetramer model systems. We demonstrate the importance of the orbital relaxation by comparing the Heisenberg model magnetic coupling parameters from the CASSCF procedure to those from a CI-only procedure based on restricted open-shell Hartree-Fock orbitals. We show that orbital relaxation differentially stabilizes the lower spin states, thus enlarging the coupling parameters with respect to the values predicted by ignoring orbital relaxation effects. Moreover, we find that while CI eigenvalues are well fit by a simple bilinear Heisenberg Hamiltonian, the CASSCF eigenvalues exhibits deviations that necessitate the inclusion of biquadratic terms in the model Hamiltonian.


title: Natural transformations between induction and restriction on iterated wreath product of symmetric group of order $2$

abstract: Let $\mathbb{C}\mathsf{A}_n = \mathbb{C}[S_2\wr S_2 \wr\cdots \wr S_2]$ be the group algebra of $n$-step iterated wreath product. We prove some structural properties of $\mathsf{A}_n$ such as their centers, centralizers, right and double cosets. We apply these results to explicitly write down Mackey theorem for groups $\mathsf{A}_n$ and give a partial description of the natural transformations between induction and restriction functors on the representations of the iterated wreath product tower by computing certain hom spaces of the category of $\displaystyle \bigoplus_{m\geq 0}(\mathsf{A}_m, \mathsf{A}_n)-$bimodules. A complete description of the category is an open problem.


title: Fiber-full modules and a local freeness criterion for local cohomology modules

abstract: Let $R$ be a finitely generated positively graded algebra over a Noetherian local ring $B$, and $\mathfrak{m} = [R]_+$ be the graded irrelevant ideal of $R$. We provide a local criterion characterizing the $B$-freeness of all the local cohomology modules $\text{H}_\mathfrak{m}^i(M)$ of a finitely generated graded $R$-module $M$. We show that fiber-full modules are exactly the ones that satisfy this criterion. When we change $B$ by an arbitrary Noetherian ring $A$, we study the fiber-full locus of a module in $\text{Spec}(A)$: we show that the fiber-full locus is always an open subset of $\text{Spec}(A)$ and that it is dense when $A$ is generically reduced.


title: fybrrLink: Efficient QoS-aware Routing in SDN enabled Next-Gen Satellite Networks

abstract: Providing high-speed Internet service using satellite network has attracted researchers from both academia and industry mainly due to the characteristics of Low Earth Orbit (LEO) satellite networks such as global coverage, scalability, and lower transmission delay. With the recent advancements in the Software-Defined Network (SDN), implementation of SDN in Non-Terrestrial Networks (NTN) can help to achieve the set goals for 5G and beyond networks. Since satellite networks have a distinct architecture, some of the traditional protocols no longer remain useful. Therefore, to satisfy the diverse Quality of Service (QoS) requirements for a variety of applications, we propose a novel and centralized QoS-aware routing algorithm, called fybrrLink in which the global view of the network in SDN is utilized. We implement a modified Bresenham's algorithm and Dijkstra's algorithm to find the optimal path in a significantly reduced computation time. Also, taking advantage of the deterministic satellite constellation, we propose a flow rule transfer algorithm and a topology monitoring algorithm. Further, fybrrLink is evaluated with multiple NS3 simulations, and results confirm its supremacy over other state-of-the-art algorithms.


title: Boosting in the Presence of Massart Noise

abstract: We study the problem of boosting the accuracy of a weak learner in the (distribution-independent) PAC model with Massart noise. In the Massart noise model, the label of each example $x$ is independently misclassified with probability $\eta(x) \leq \eta$, where $\eta<1/2$. The Massart model lies between the random classification noise model and the agnostic model. Our main positive result is the first computationally efficient boosting algorithm in the presence of Massart noise that achieves misclassification error arbitrarily close to $\eta$. Prior to our work, no non-trivial booster was known in this setting. Moreover, we show that this error upper bound is best possible for polynomial-time black-box boosters, under standard cryptographic assumptions. Our upper and lower bounds characterize the complexity of boosting in the distribution-independent PAC model with Massart noise. As a simple application of our positive result, we give the first efficient Massart learner for unions of high-dimensional rectangles.


title: KL Guided Domain Adaptation

abstract: Domain adaptation is an important problem and often needed for real-world applications. In this problem, instead of i.i.d. training and testing datapoints, we assume that the source (training) data and the target (testing) data have different distributions. With that setting, the empirical risk minimization training procedure often does not perform well, since it does not account for the change in the distribution. A common approach in the domain adaptation literature is to learn a representation of the input that has the same (marginal) distribution over the source and the target domain. However, these approaches often require additional networks and/or optimizing an adversarial (minimax) objective, which can be very expensive or unstable in practice. To improve upon these marginal alignment techniques, in this paper, we first derive a generalization bound for the target loss based on the training loss and the reverse Kullback-Leibler (KL) divergence between the source and the target representation distributions. Based on this bound, we derive an algorithm that minimizes the KL term to obtain a better generalization to the target domain. We show that with a probabilistic representation network, the KL term can be estimated efficiently via minibatch samples without any additional network or a minimax objective. This leads to a theoretically sound alignment method which is also very efficient and stable in practice. Experimental results also suggest that our method outperforms other representation-alignment approaches.


title: On Declare MAX-SAT and a finite Herbrand Base for data-aware logs

abstract: This technical report provides some lightweight introduction motivating the definition of an alignment of log traces against Data-Aware Declare Models potentially containing correlation conditions. This technical report is only providing the intuition of the logical framework as a feasibility study for a future formalization and experiment section.