title: Adapted Caldeira-Leggett Model

abstract: We preset a variant of the Caldeira-Leggett (CL) model of a harmonic oscillator coupled to an environment. The CL model is a standard tool for studying the physics of decoherence. Our "adapted Caldeira-Leggett" (ACL) model is built in a finite Hilbert space which makes it suitable for numerical studies. Taking a numerical approach allows us to avoid the limitations of standard approximation schemes used with the CL model. We are able to evolve the ACL model in a fully reversible unitary manner, without the built-in time asymmetry and other assumptions that come with the master equation methods typically used. We have used the ACL model to study new topics in the field of decoherence and einselection where the full unitary evolution is essential to our work. Those results (reported in companion papers) include an examination of the relationship between einselection and the arrow of time, and studies of the very earliest stages of einselection. This paper provides details about the ACL model and our numerical methods. Our numerical approach makes it straightforward to explore and plot any property of the physical system. Thus we believe the examples and illustrations we present here may provide a helpful resource for those wishing to improve their familiarity with standard decoherence results, as well as those looking to probe the underpinnings of our companion papers. We expect the ACL model will be a useful tool for exploring additional phenomena that cannot be studied using traditional approximation schemes.


title: Between an $n$-ary and an $n{+}1$-ary near-unanimity term

abstract: We devise a condition strictly between the existence of an $n$-ary and an $n{+}1$-ary near-unanimity term. We evaluate exactly the distributivity and modularity levels implied by such a condition.


title: Exclusion statistics for particles with a discrete spectrum

abstract: We formulate and study the microscopic statistical mechanics of systems of particles with exclusion statistics in a discrete one-body spectrum. The statistical mechanics of these systems can be expressed in terms of effective single-level grand partition functions obeying a generalization of the standard thermodynamic exclusion statistics equation of state. We derive explicit expressions for the thermodynamic potential in terms of microscopic cluster coefficients and show that the mean occupation numbers of levels satisfy a nesting relation involving a number of adjacent levels determined by the exclusion parameter. We apply the formalism to the harmonic Calogero model and point out a relation with the Ramanujan continued fraction identity and appropriate generalizations.

categories: cond-mat.stat-mech hep-th math-ph math.MP


title: A test of the hadronic origin of $\gamma$-rays from blazars with up to month-later follow-up of IceCube Alerts with Imaging Air Cherenkov Telescopes

abstract: The sources of IceCube neutrinos are as yet unknown. The multi-messenger observation of their emission in $\gamma$-rays can be a guide to their identification, as exemplified by the case of TXS 0506+056. We suggest a new method of searching for $\gamma$-rays with Imaging Air Cherenkov Telescopes from sources in coincidence with possible astrophysical neutrinos. We propose that searches of $\gamma$-rays are extended, from the current practice of only a few days, to up to one month from a neutrino alert. We test this strategy on simulated sources modeled after the blazar \emph{TXS 0506+056-like}, emitting neutrinos and $\gamma$-rays via photohadronic interactions: the $\gamma$-rays are subsequently reprocessed in the VHE range. Using MAGIC as a benchmark example, we show that current Cherenkov Telescopes should be able to detect$\gamma$-ray counterparts to neutrino alerts with a rate of approximately one per year. It has been proposed that the high-energy diffuse neutrino flux can be explained by $\sim$ 5\% of all blazars flaring in neutrinos once every 10 years, with a neutrino luminosity similar to that of TXS 0506+056 during the 2014-2015 neutrino flare. The implementation of our strategy could lead, over a timescale of one or few years, either to the detection of this subclass of blazars contributing to the diffuse neutrino flux, or to a constraint on this model.


title: Fair Representations by Compression

abstract: Organizations that collect and sell data face increasing scrutiny for the discriminatory use of data. We propose a novel unsupervised approach to transform data into a compressed binary representation independent of sensitive attributes. We show that in an information bottleneck framework, a parsimonious representation should filter out information related to sensitive attributes if they are provided directly to the decoder. Empirical results show that the proposed method, \textbf{FBC}, achieves state-of-the-art accuracy-fairness trade-off. Explicit control of the entropy of the representation bit stream allows the user to move smoothly and simultaneously along both rate-distortion and rate-fairness curves. \end{abstract}


title: Bayes-optimal prediction with frequentist coverage control

abstract: This article illustrates how indirect or prior information can be optimally used to construct a prediction region that maintains a target frequentist coverage rate. If the indirect information is accurate, the volume of the prediction region is lower on average than that of other regions with the same coverage rate. Even if the indirect information is inaccurate, the resulting region still maintains the target coverage rate. Such a prediction region can be constructed for models that have a complete sufficient statistic, which includes many widely-used parametric and nonparametric models. Particular examples include a Bayes-optimal conformal prediction procedure that maintains a constant coverage rate across distributions in a nonparametric model, as well as a prediction procedure for the normal linear regression model that can utilize a regularizing prior distribution, yet maintain a frequentist coverage rate that is constant as a function of the model parameters and explanatory variables. No results in this article rely on asymptotic approximations.


title: Understanding and minimizing resonance frequency deviations on a 4-inch kilo-pixel kinetic inductance detector array

abstract: One of the advantages of kinetic inductance detectors is their intrinsic frequency domain multiplexing capability. However, fabrication imperfections usually give rise to resonance frequency deviations, which create frequency collision and limit the array yield. Here we study the resonance frequency deviation of a 4-inch kilo-pixel lumped-element kinetic inductance detector (LEKID) array using optical mapping. Using the measured resonator dimensions and film thickness, the fractional deviation can be explained within $\pm 25\times 10^{-3}$, whereas the residual deviation is due to variation of electric film properties. Using the capacitor trimming technique, the fractional deviation is decreased by a factor of 14. The yield of the trimming process is found to be 97%. The mapping yield, measured under a 110~K background, is improved from 69% to 76%, which can be further improved to 81% after updating our readout system. With the improvement in yield, the capacitor trimming technique may benefit future large-format LEKID arrays.


title: Generators and Relations for Un(Z[1/2,i])

abstract: Consider the universal gate set for quantum computing consisting of the gates X, CX, CCX, omega^dagger H, and S. All of these gates have matrix entries in the ring Z[1/2,i], the smallest subring of the complex numbers containing 1/2 and i. Amy, Glaudell, and Ross proved the converse, i.e., any unitary matrix with entries in Z[1/2,i] can be realized by a quantum circuit over the above gate set using at most one ancilla. In this paper, we give a finite presentation by generators and relations of U_n(Z[1/2,i]), the group of unitary nxn-matrices with entries in Z[1/2,i].


title: Observations and analysis of CH$^+$ vibrational emissions from the young, carbon-rich planetary nebula NGC 7027: a textbook example of chemical pumping

abstract: We discuss the detection of 14 rovibrational lines of CH$^+$, obtained with the iSHELL spectrograph on NASA's Infrared Telescope Facility (IRTF) on Maunakea. Our observations in the 3.49 - 4.13 $\mu$m spectral region, obtained with a 0.375" slit width that provided a spectral resolving power $\lambda/\Delta \lambda \sim 80,000$, have resulted in the unequivocal detection of the $R(0) - R(3)$ and $P(1)-P(10)$ transitions within the $v=1-0$ band of CH$^+$. The $R$-branch transitions are anomalously weak relative to the $P$-branch transitions, a behavior that is explained accurately by rovibronic calculations of the transition dipole moment reported in a companion paper (Changala et al. 2021). Nine infrared transitions of H$_2$ were also detected in these observations, comprising the $S(8)$, $S(9)$, $S(13)$ and $S(15)$ pure rotational lines; the $v=1-0$ $O(4) - O(7)$ lines, and the $v=2-1$ $O(5)$ line. We present a photodissociation region model, constrained by the CH$^+$ and H$_2$ line fluxes that we measured, that includes a detailed treatment of the excitation of CH$^+$ by inelastic collisions, optical pumping, and chemical ("formation") pumping. The latter process is found to dominate the excitation of the observed rovibrational lines of CH$^+$, and the model is remarkably successful in explaining both the absolute and relative strengths of the CH$^+$ and H$_2$ lines.


title: Anomalous intensities in the infrared emission of CH$^+$ explained by quantum nuclear motion and electric dipole calculations

abstract: The unusual infrared emission patterns of CH$^+$, recently detected in the planetary nebula NGC 7027, are examined theoretically with high-accuracy rovibrational wavefunctions and $ab$ $initio$ dipole moment curves. The calculated transition dipole moments quantitatively reproduce the observed $J$-dependent intensity variation, which is ascribed to underlying centrifugal distortion-induced interference effects. We discuss the implications of this anomalous behavior for astrochemical modeling of CH$^+$ production and excitation, and provide a simple expression to estimate the magnitude of this effect for other light diatomic molecules with small dipole derivatives.


title: Hyperonization in compact stars

abstract: We review the covariant density functional approach to the equation of state of the dense nuclear matter in compact stars. The main emphasis is on the hyperonization of the dense matter, and the role played by the $\Delta$-resonances. The implications of hyperonization for the astrophysics of compact stars, including the equation of state, composition, and stellar parameters are examined. The mass-radius relation and tidal deformabilities of static and rapidly rotating (Keplerian) configurations are discussed in some detail. We briefly touch upon some other recent developments involving hyperonization in hot hypernuclear matter at high- and low-densities.


title: The Cosmic Large-Scale Structure in X-rays (CLASSIX) Cluster Survey III: The Perseus-Pisces supercluster and the Southern Great Wall as traced by X-ray luminous galaxy clusters

abstract: The Perseus-Pisces supercluster is known as one of the largest structures in the nearby Universe that has been charted by the galaxy and galaxy cluster distributions. For the latter mostly clusters from the Abell catalogue have been used. Here we take a new approach to a quantitative characterisation of the Perseus-Pisces supercluster using a statistically complete sample of X-ray luminous galaxy groups and clusters from our CLASSIX galaxy cluster redshift survey. We used a friends-of-friends technique to construct the supercluster membership. We also studied the structure of the Southern Great Wall, which merges with the Perseus-Pisces supercluster with a slightly increased friends-of-friends linking length. In this work we discuss the geometric structure of the superclusters, compare the X-ray luminosity distribution of the members with that of the surroundings, and provide an estimate of the supercluster mass. These results establish Perseus-Pisces as the largest superstructure in the Universe at redshifts z <= 0.03. With the new data this supercluster extends through the zone of avoidance, which has also been indicated by some studies of the galaxy distribution by means of HI observations. We investigated whether the shapes of the member groups and clusters in X-rays are aligned with the major axis of the supercluster. We find no evidence for a pronounced alignment, except for the ellipticities of Perseus and AWM7, which are aligned with the separation vector of the two systems and weakly with the supercluster.


title: Targeted Deep Learning: Framework, Methods, and Applications

abstract: Deep learning systems are typically designed to perform for a wide range of test inputs. For example, deep learning systems in autonomous cars are supposed to deal with traffic situations for which they were not specifically trained. In general, the ability to cope with a broad spectrum of unseen test inputs is called generalization. Generalization is definitely important in applications where the possible test inputs are known but plentiful or simply unknown, but there are also cases where the possible inputs are few and unlabeled but known beforehand. For example, medicine is currently interested in targeting treatments to individual patients; the number of patients at any given time is usually small (typically one), their diagnoses/responses/... are still unknown, but their general characteristics (such as genome information, protein levels in the blood, and so forth) are known before the treatment. We propose to call deep learning in such applications targeted deep learning. In this paper, we introduce a framework for targeted deep learning, and we devise and test an approach for adapting standard pipelines to the requirements of targeted deep learning. The approach is very general yet easy to use: it can be implemented as a simple data-preprocessing step. We demonstrate on a variety of real-world data that our approach can indeed render standard deep learning faster and more accurate when the test inputs are known beforehand.


title: Constraining black hole feedback in galaxy clusters from X-ray power spectra

abstract: Jets launched by the supermassive black holes in the centers of cool-core clusters are the most likely heat source to solve the cooling flow problem. One way for this heating to occur is through generation of a turbulent cascade by jet-inflated bubbles. Measurements of the X-ray intensity power spectra show evidence of this cascade in different regions of the cluster, constraining the role of driving mechanisms. We analyze feedback simulations of the Perseus cluster to constrain the effect of the jet activity on the intensity fluctuations and kinematics of the cluster atmosphere. We find that, within the inner 60 kiloparsecs, the power spectra of the predicted surface brightness fluctuations are broadly consistent with those measured by Chandra and that even a single episode of jet activity can generate a long-lasting imprint on the intensity fluctuations in the innermost region of the cluster. AGN-driven motions within the same region approach the values reported by Hitomi during and right after the AGN episode. However, the line-of-sight velocity dispersion excited by the jet in simulations underpredicts the Hitomi measurement. This indicates that driving a volume-filling sustained level of turbulence requires several episodes of jet activity, and/or additional processes drive turbulence outside the 60-kpc sphere. This also suggests that sharp edges of the bubbles in the innermost region of the cluster contribute substantially to the intensity of fluctuations, consistent with the Perseus observations in the inner 30-kpc region. We discuss new diagnostics to decompose annular power spectra to constrain past episodes of jet activity.


title: The framework for a common origin of $\delta_{\rm CKM}$ and $\delta_{\rm PMNS}$

abstract: We analyse a possible connection between CP violations in the quark and lepton sectors, parametrised by the CKM and PMNS phases. If one assumes that CP breaking arises from complex Yukawa couplings, both in the quark and lepton sectors, the above connection is not possible in general, since Yukawa couplings in the two sectors have independent flavour structures. We show that both the CKM and PMNS phases can instead be generated by a vacuum phase in a class of two Higgs doublet models, and in this case a connection may be established. This scenario requires the presence of scalar FCNC at tree level, both in the quark and lepton sectors. The appearance of these FCNC is an obstacle and a blessing. An obstacle since one has to analyse which models are able to conform to the strict experimental limits on FCNC, both in the quark and lepton sectors. A blessing, because this class of models is falsifiable since FCNC arise at a level which can be probed experimentally in the near future, specially in the processes $h\to e^\pm\tau^\mp$ and $t\to h c$. The connection between CP violations in CKM and PMNS is explicitely illustrated in models with Minimal Flavour Violation.


title: How much telematics information do insurers need for claim classification?

abstract: It has been shown several times in the literature that telematics data collected in motor insurance help to better understand an insured's driving risk. Insurers that use this data reap several benefits, such as a better estimate of the pure premium, more segmented pricing and less adverse selection. The flip side of the coin is that collected telematics information is often sensitive and can therefore compromise policyholders' privacy. Moreover, due to their large volume, this type of data is costly to store and hard to manipulate. These factors, combined with the fact that insurance regulators tend to issue more and more recommendations regarding the collection and use of telematics data, make it important for an insurer to determine the right amount of telematics information to collect. In addition to traditional contract information such as the age and gender of the insured, we have access to a telematics dataset where information is summarized by trip. We first derive several features of interest from these trip summaries before building a claim classification model using both traditional and telematics features. By comparing a few classification algorithms, we find that logistic regression with lasso penalty is the most suitable for our problem. Using this model, we develop a method to determine how much information about policyholders' driving should be kept by an insurer. Using real data from a North American insurance company, we find that telematics data become redundant after about 3 months or 4,000 kilometers of observation, at least from a claim classification perspective.


title: Distribution dependent SDEs driven by additive continuous noise

abstract: We study distribution dependent stochastic differential equation driven by a continuous process, without any specification on its law, following the approach initiated in [16]. We provide several criteria for existence and uniqueness of solutions which go beyond the classical globally Lipschitz setting. In particular we show well-posedness of the equation, as well as almost sure convergence of the associated particle system, for drifts satisfying either Osgood-continuity, monotonicity, local Lipschitz or Sobolev differentiability type assumptions.


title: An Isometric Invariant of Quadratic Spaces over Finite Fields

abstract: Let $\mathbb{F}_{q}$ be the finite field with an odd prime power $q$. In this paper, we construct a new isometric invariant of combinatorial type on $(\mathbb{F}^{n}_{q},\text{dot}_{n})$, where $\text{dot}_{n}(\mathbf{x}):=x_{1}^{2}+\cdots+x_{n}^{2}$. Additionally, using counts from our new invariant, we give a new proof of Minkowski's formula on the size of spheres over finite fields. We also show which types of quadratic subspaces can be embedded in $(\mathbb{F}_{q}^{n},\text{dot}_{n})$.


title: Symmetry-driven graph neural networks

abstract: Exploiting symmetries and invariance in data is a powerful, yet not fully exploited, way to achieve better generalisation with more efficiency. In this paper, we introduce two graph network architectures that are equivariant to several types of transformations affecting the node coordinates. First, we build equivariance to any transformation in the coordinate embeddings that preserves the distance between neighbouring nodes, allowing for equivariance to the Euclidean group. Then, we introduce angle attributes to build equivariance to any angle preserving transformation - thus, to the conformal group. Thanks to their equivariance properties, the proposed models can be vastly more data efficient with respect to classical graph architectures, intrinsically equipped with a better inductive bias and better at generalising. We demonstrate these capabilities on a synthetic dataset composed of $n$-dimensional geometric objects. Additionally, we provide examples of their limitations when (the right) symmetries are not present in the data.


title: On the Usage of Psychophysiological Data in Software Engineering: An Extended Systematic Mapping Study

abstract: In recent years, many studies have applied wearable devices to capture psychophysiological data from software developers. However, the current literature lacks investigations that classify the studies and point out gaps to be explored. This article, therefore, seeks to present a comprehensive overview of the literature by classifying and creating a systematic map of the works. Besides, it seeks to pinpoint research gaps, challenges, and trends. Based on widely known guidelines, a systematic mapping of the literature was designed and run to answer eight research questions. After applying a careful filtering process, we selected 27 representative studies from a sample of 2,084 potentially relevant works retrieved from seven digital libraries. The main results are: a classification scheme of the published studies was produced; there is no predominance of the devices used to capture psychophysiological data; over 50% of the studies have explored indicators related to mental states and neural activity; and 80% have analyzed composite data to understand the cognitive load and in the context of understanding debugging programs and strategies. Our findings can benefit researchers and students by creating a systematic map of the literature, being a starting point for future research.


title: Rethinking Lifelong Sequential Recommendation with Incremental Multi-Interest Attention

abstract: Sequential recommendation plays an increasingly important role in many e-commerce services such as display advertisement and online shopping. With the rapid development of these services in the last two decades, users have accumulated a massive amount of behavior data. Richer sequential behavior data has been proven to be of great value for sequential recommendation. However, traditional sequential models fail to handle users' lifelong sequences, as their linear computational and storage cost prohibits them from performing online inference. Recently, lifelong sequential modeling methods that borrow the idea of memory networks from NLP are proposed to address this issue. However, the RNN-based memory networks built upon intrinsically suffer from the inability to capture long-term dependencies and may instead be overwhelmed by the noise on extremely long behavior sequences. In addition, as the user's behavior sequence gets longer, more interests would be demonstrated in it. It is therefore crucial to model and capture the diverse interests of users. In order to tackle these issues, we propose a novel lifelong incremental multi-interest self attention based sequential recommendation model, namely LimaRec. Our proposed method benefits from the carefully designed self-attention to identify relevant information from users' behavior sequences with different interests. It is still able to incrementally update users' representations for online inference, similarly to memory network based approaches. We extensively evaluate our method on four real-world datasets and demonstrate its superior performances compared to the state-of-the-art baselines.


title: Neutrino Oscillations at JUNO, the Born Rule, and Sorkin's Triple Path Interference

abstract: We argue that neutrino oscillations at JUNO offer a unique opportunity to study Sorkin's triple-path interference, which is predicted to be zero in canonical quantum mechanics by virtue of the Born rule. In particular, we compute the expected bounds on triple-path interference at JUNO and demonstrate that they are comparable to those already available from electromagnetic probes. Furthermore, the neutrino probe of the Born rule is much more direct due to an intrinsic independence from any boundary conditions, whereas such dependence on boundary conditions is always present in the case of electromagnetic probes. Thus, neutrino oscillations present an ideal probe of this aspect of the foundations of quantum mechanics.


title: On a possibility of transfer of asteroids from the 2:1 mean motion resonance with Jupiter to the Centaur zone

abstract: The paper analyses possible transfers of bodies from the main asteroid belt (MBA) to the Centaur region. The orbits of asteroids in the 2:1 mean motion resonance (MMR) with Jupiter are analysed. We selected the asteroids that are in resonant orbits with e > 0.3 whose absolute magnitudes H do not exceed 16m. The total number of the orbits amounts to 152. Numerical calculations were performed to evaluate the evolution of the orbits over 100,000-year time interval with projects for the future. Six bodies are found to have moved from the 2:1 commensurability zone to the Centaur population. The transfer time of these bodies to the Centaur zone ranges from 4,600 to 70,000 yr. Such transfers occur after orbits leave the resonance and the bodies approach Jupiter. Where after reaching sufficient orbital eccentricities bodies approach a terrestrial planet, their orbits go out of the MMR. Accuracy estimations are carried out to confirm the possible asteroid transfers to the Centaur region.


title: Distribution dependent SDEs driven by additive fractional Brownian motion

abstract: We study distribution dependent stochastic differential equations with irregular, possibly distributional drift, driven by an additive fractional Brownian motion of Hurst parameter $H\in (0,1)$. We establish strong well-posedness under a variety of assumptions on the drift; these include the choice $$B(\cdot,\mu) = f\ast\mu(\cdot) + g(\cdot),\quad f,g\in B^\alpha_{\infty,\infty}, \quad \alpha>1-1/2H,$$ thus extending the results by Catellier and Gubinelli [9] to the distribution dependent case. The proofs rely on some novel stability estimates for singular SDEs driven by fractional Brownian motion and the use of Wasserstein distances.


title: Controllable Abstractive Dialogue Summarization with Sketch Supervision

abstract: In this paper, we aim to improve abstractive dialogue summarization quality and, at the same time, enable granularity control. Our model has two primary components and stages: 1) a two-stage generation strategy that generates a preliminary summary sketch serving as the basis for the final summary. This summary sketch provides a weakly supervised signal in the form of pseudo-labeled interrogative pronoun categories and key phrases extracted using a constituency parser. 2) A simple strategy to control the granularity of the final summary, in that our model can automatically determine or control the number of generated summary sentences for a given dialogue by predicting and highlighting different text spans from the source text. Our model achieves state-of-the-art performance on the largest dialogue summarization corpus SAMSum, with as high as 50.79 in ROUGE-L score. In addition, we conduct a case study and show competitive human evaluation results and controllability to human-annotated summaries.


title: TransCamP: Graph Transformer for 6-DoF Camera Pose Estimation

abstract: Camera pose estimation or camera relocalization is the centerpiece in numerous computer vision tasks such as visual odometry, structure from motion (SfM) and SLAM. In this paper we propose a neural network approach with a graph transformer backbone, namely TransCamP, to address the camera relocalization problem. In contrast with prior work where the pose regression is mainly guided by photometric consistency, TransCamP effectively fuses the image features, camera pose information and inter-frame relative camera motions into encoded graph attributes and is trained towards the graph consistency and accuracy instead, yielding significantly higher computational efficiency. By leveraging graph transformer layers with edge features and enabling tensorized adjacency matrix, TransCamP dynamically captures the global attention and thus endows the pose graph with evolving structures to achieve improved robustness and accuracy. In addition, optional temporal transformer layers actively enhance the spatiotemporal inter-frame relation for sequential inputs. Evaluation of the proposed network on various public benchmarks demonstrates that TransCamP outperforms state-of-the-art approaches.


title: Are Privacy Dashboards Good for End Users? Evaluating User Perceptions and Reactions to Google's My Activity (Extended Version)

abstract: Privacy dashboards and transparency tools help users review and manage the data collected about them online. Since 2016, Google has offered such a tool, My Activity, which allows users to review and delete their activity data from Google services. We conducted an online survey with $n = 153$ participants to understand if Google's My Activity, as an example of a privacy transparency tool, increases or decreases end-users' concerns and benefits regarding data collection. While most participants were aware of Google's data collection, the volume and detail was surprising, but after exposure to My Activity, participants were significantly more likely to be both less concerned about data collection and to view data collection more beneficially. Only $25\,\%$ indicated that they would change any settings in the My Activity service or change any behaviors. This suggests that privacy transparency tools are quite beneficial for online services as they garner trust with their users and improve their perceptions without necessarily changing users' behaviors. At the same time, though, it remains unclear if such transparency tools actually improve end user privacy by sufficiently assisting or motivating users to change or review data collection settings.


title: Phenomenological implications of modified loop cosmologies: an overview

abstract: In this paper, we first provide a brief review of the effective dynamics of two recently well-studied models of modified loop quantum cosmologies (mLQCs), which arise from different regularizations of the Hamiltonian constraint and show the robustness of a generic resolution of the big bang singularity, replaced by a quantum bounce due to non-perturbative Planck scale effects. As in loop quantum cosmology (LQC), in these modified models the slow-roll inflation happens generically. We consider the cosmological perturbations following the dressed and hybrid approaches and clarify some subtle issues regarding the ambiguity of the extension of the effective potential of the scalar perturbations across the quantum bounce, and the choice of initial conditions. Both of the modified regularizations yield primordial power spectra that are consistent with current observations for the Starobinsky potential within the framework of either the dressed or the hybrid approach. But differences in primordial power spectra are identified among the mLQCs and LQC. In addition, for mLQC-I, striking differences arise between the dressed and hybrid approaches in the infrared and oscillatory regimes. While the differences between the two modified models can be attributed to differences in the Planck scale physics, the permissible choices of the initial conditions and the differences between the two perturbation approaches have been reported for the first time. All these differences, due to either the different regularizations or the different perturbation approaches in principle can be observed in terms of non-Gaussianities.


title: Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation

abstract: Self-attention has become increasingly popular in a variety of sequence modeling tasks from natural language processing to recommendation, due to its effectiveness. However, self-attention suffers from quadratic computational and memory complexities, prohibiting its applications on long sequences. Existing approaches that address this issue mainly rely on a sparse attention context, either using a local window, or a permuted bucket obtained by locality-sensitive hashing (LSH) or sorting, while crucial information may be lost. Inspired by the idea of vector quantization that uses cluster centroids to approximate items, we propose LISA (LInear-time Self Attention), which enjoys both the effectiveness of vanilla self-attention and the efficiency of sparse attention. LISA scales linearly with the sequence length, while enabling full contextual attention via computing differentiable histograms of codeword distributions. Meanwhile, unlike some efficient attention methods, our method poses no restriction on casual masking or sequence length. We evaluate our method on four real-world datasets for sequential recommendation. The results show that LISA outperforms the state-of-the-art efficient attention methods in both performance and speed; and it is up to 57x faster and 78x more memory efficient than vanilla self-attention.


title: The Evaluation of Rating Systems in Team-based Battle Royale Games

abstract: Online competitive games have become a mainstream entertainment platform. To create a fair and exciting experience, these games use rating systems to match players with similar skills. While there has been an increasing amount of research on improving the performance of these systems, less attention has been paid to how their performance is evaluated. In this paper, we explore the utility of several metrics for evaluating three popular rating systems on a real-world dataset of over 25,000 team battle royale matches. Our results suggest considerable differences in their evaluation patterns. Some metrics were highly impacted by the inclusion of new players. Many could not capture the real differences between certain groups of players. Among all metrics studied, normalized discounted cumulative gain (NDCG) demonstrated more reliable performance and more flexibility. It alleviated most of the challenges faced by the other metrics while adding the freedom to adjust the focus of the evaluations on different groups of players.


title: Accelerating Neural ODEs Using Model Order Reduction

abstract: Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are memory-efficient to train, process time-series naturally and incorporate knowledge of physical systems into deep learning models. However, the practical applications of Neural ODEs are limited due to long inference times, because the outputs of the embedded ODE layers are computed numerically with differential equation solvers that can be computationally demanding. Here we show that mathematical model order reduction methods can be used for compressing and accelerating Neural ODEs by accurately simulating the continuous nonlinear dynamics in low-dimensional subspaces. We implement our novel compression method by developing Neural ODEs that integrate the necessary subspace-projection and interpolation operations as layers of the neural network. We validate our approach by comparing it to neuron pruning and SVD-based weight truncation methods from the literature in image and time-series classification tasks. The methods are evaluated by acceleration versus accuracy when adjusting the level of compression. On this spectrum, we achieve a favourable balance over existing methods by using model order reduction when compressing a convolutional Neural ODE. In compressing a recurrent Neural ODE, SVD-based weight truncation yields good performance. Based on our results, our integration of model order reduction with Neural ODEs can facilitate efficient, dynamical system-driven deep learning in resource-constrained applications.


title: Classification of Brain Tumours in MR Images using Deep Spatiospatial Models

abstract: A brain tumour is a mass or cluster of abnormal cells in the brain, which has the possibility of becoming life-threatening because of its ability to invade neighbouring tissues and also form metastases. An accurate diagnosis is essential for successful treatment planning and magnetic resonance imaging is the principal imaging modality for diagnostic of brain tumours and their extent. Deep Learning methods in computer vision applications have shown significant improvement in recent years, most of which can be credited to the fact that a sizeable amount of data is available to train models on, and the improvements in the model architectures yielding better approximations in a supervised setting. Classifying tumours using such deep learning methods has made significant progress with the availability of open datasets with reliable annotations. Typically those methods are either 3D models, which use 3D volumetric MRIs or even 2D models considering each slice separately. However, by treating the slice spatial dimension separately, spatiotemporal models can be employed as spatiospatial models for this task. These models have the capabilities of learning specific spatial and temporal relationship, while reducing computational costs. This paper uses two spatiotemporal models, ResNet (2+1)D and ResNet Mixed Convolution, to classify different types of brain tumours. It was observed that both these models performed superior to the pure 3D convolutional model, ResNet18. Furthermore, it was also observed that pre-training the models on a different, even unrelated dataset before training them for the task of tumour classification improves the performance. Finally, Pre-trained ResNet Mixed Convolution was observed to be the best model in these experiments, achieving a macro F1-score of 0.93 and a test accuracy of 96.98\%, while at the same time being the model with the least computational cost.


title: An Elementary System of Axioms for Euclidean Geometry based on Symmetry Principles

abstract: In this article, I develop an elementary system of axioms for Euclidean geometry. On one hand, the system is based on the symmetry principles which express our a priori ignorant approach to space: all places are the same to us (the homogeneity of space), all directions are the same to us (the isotropy of space) and all units of length we use to create geometric figures are the same to us (the scale invariance of space). On the other hand, through the process of algebraic simplification, this system of axioms directly provides Weyl's system of axioms for Euclidean geometry. The system of axioms, together with its a priori interpretation, offers new views to philosophy and pedagogy of mathematics: (i) it supports the thesis that Euclidean geometry is a priori, (ii) it supports the thesis that in modern mathematics the Weyl's system of axioms is dominant to Euclid's system because it reflects the a priori underlying symmetries, (iii) it gives a new and promising approach to learn geometry which, through the Weyl's system of axioms, leads from the essential geometric symmetry principles of the mathematical nature directly to modern mathematics.


title: Task-Guided Inverse Reinforcement Learning Under Partial Information

abstract: We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has access to full information about the environment. We remove this assumption by developing an algorithm for IRL in partially observable Markov decision processes (POMDPs). The algorithm addresses several limitations of existing techniques that do not take the information asymmetry between the expert and the learner into account. First, it adopts causal entropy as the measure of the likelihood of the expert demonstrations as opposed to entropy in most existing IRL techniques, and avoids a common source of algorithmic complexity. Second, it incorporates task specifications expressed in temporal logic into IRL. Such specifications may be interpreted as side information available to the learner a priori in addition to the demonstrations and may reduce the information asymmetry. Nevertheless, the resulting formulation is still nonconvex due to the intrinsic nonconvexity of the so-called forward problem, i.e., computing an optimal policy given a reward function, in POMDPs. We address this nonconvexity through sequential convex programming and introduce several extensions to solve the forward problem in a scalable manner. This scalability allows computing policies that incorporate memory at the expense of added computational cost yet also outperform memoryless policies. We demonstrate that, even with severely limited data, the algorithm learns reward functions and policies that satisfy the task and induce a similar behavior to the expert by leveraging the side information and incorporating memory into the policy.


title: Learning Neuro-Symbolic Relational Transition Models for Bilevel Planning

abstract: In robotic domains, learning and planning are complicated by continuous state spaces, continuous action spaces, and long task horizons. In this work, we address these challenges with Neuro-Symbolic Relational Transition Models (NSRTs), a novel class of models that are data-efficient to learn, compatible with powerful robotic planning methods, and generalizable over objects. NSRTs have both symbolic and neural components, enabling a bilevel planning scheme where symbolic AI planning in an outer loop guides continuous planning with neural models in an inner loop. Experiments in four robotic planning domains show that NSRTs can be learned after only tens or hundreds of training episodes, and then used for fast planning in new tasks that require up to 60 actions and involve many more objects than were seen during training. Video: https://tinyurl.com/chitnis-nsrts


title: Distribution-free inference for regression: discrete, continuous, and in between

abstract: In data analysis problems where we are not able to rely on distributional assumptions, what types of inference guarantees can still be obtained? Many popular methods, such as holdout methods, cross-validation methods, and conformal prediction, are able to provide distribution-free guarantees for predictive inference, but the problem of providing inference for the underlying regression function (for example, inference on the conditional mean $\mathbb{E}[Y|X]$) is more challenging. In the setting where the features $X$ are continuously distributed, recent work has established that any confidence interval for $\mathbb{E}[Y|X]$ must have non-vanishing width, even as sample size tends to infinity. At the other extreme, if $X$ takes only a small number of possible values, then inference on $\mathbb{E}[Y|X]$ is trivial to achieve. In this work, we study the problem in settings in between these two extremes. We find that there are several distinct regimes in between the finite setting and the continuous setting, where vanishing-width confidence intervals are achievable if and only if the effective support size of the distribution of $X$ is smaller than the square of the sample size.


title: Radiative properties of rubidium atoms trapped in solid neon and parahydrogen

abstract: It is known from ensemble measurements that rubidium atoms trapped in solid parahydrogen have favorable properties for quantum sensing of magnetic fields. To use a single rubidium atom as a quantum sensor requires a technique capable of efficiently measuring the internal state of a single atom, such as laser-induced fluorescence. In this work we search for laser-induced fluorescence from ensembles of rubidium atoms trapped in solid parahydrogen and, separately, in solid neon. In parahydrogen we find no evidence of fluorescence over the range explored, and place upper limits on the radiative branching ratio. In neon, we observe laser induced fluorescence, measure the spectrum of the emitted light, and measure the excited state lifetime in the matrix. Bleaching of atoms from the excitation light is also reported.


title: On the Bias Against Inductive Biases

abstract: Borrowing from the transformer models that revolutionized the field of natural language processing, self-supervised feature learning for visual tasks has also seen state-of-the-art success using these extremely deep, isotropic networks. However, the typical AI researcher does not have the resources to evaluate, let alone train, a model with several billion parameters and quadratic self-attention activations. To facilitate further research, it is necessary to understand the features of these huge transformer models that can be adequately studied by the typical researcher. One interesting characteristic of these transformer models is that they remove most of the inductive biases present in classical convolutional networks. In this work, we analyze the effect of these and more inductive biases on small to moderately-sized isotropic networks used for unsupervised visual feature learning and show that their removal is not always ideal.


title: UCPhrase: Unsupervised Context-aware Quality Phrase Tagging

abstract: Identifying and understanding quality phrases from context is a fundamental task in text mining. The most challenging part of this task arguably lies in uncommon, emerging, and domain-specific phrases. The infrequent nature of these phrases significantly hurts the performance of phrase mining methods that rely on sufficient phrase occurrences in the input corpus. Context-aware tagging models, though not restricted by frequency, heavily rely on domain experts for either massive sentence-level gold labels or handcrafted gazetteers. In this work, we propose UCPhrase, a novel unsupervised context-aware quality phrase tagger. Specifically, we induce high-quality phrase spans as silver labels from consistently co-occurring word sequences within each document. Compared with typical context-agnostic distant supervision based on existing knowledge bases (KBs), our silver labels root deeply in the input domain and context, thus having unique advantages in preserving contextual completeness and capturing emerging, out-of-KB phrases. Training a conventional neural tagger based on silver labels usually faces the risk of overfitting phrase surface names. Alternatively, we observe that the contextualized attention maps generated from a transformer-based neural language model effectively reveal the connections between words in a surface-agnostic way. Therefore, we pair such attention maps with the silver labels to train a lightweight span prediction model, which can be applied to new input to recognize (unseen) quality phrases regardless of their surface names or frequency. Thorough experiments on various tasks and datasets, including corpus-level phrase ranking, document-level keyphrase extraction, and sentence-level phrase tagging, demonstrate the superiority of our design over state-of-the-art pre-trained, unsupervised, and distantly supervised methods.


title: Sharp bounds on $p$-norms for sums of independent uniform random variables, $0 < p < 1$

abstract: We provide a sharp lower bound on the $p$-norm of a sum of independent uniform random variables in terms of its variance when $0 < p < 1$. We address an analogous question for $p$-R\'enyi entropy for $p$ in the same range.


title: Gotta Go Fast When Generating Data with Score-Based Models

abstract: Score-based (denoising diffusion) generative models have recently gained a lot of success in generating realistic and diverse data. These approaches define a forward diffusion process for transforming data to noise and generate data by reversing it (thereby going from noise to data). Unfortunately, current score-based models generate data very slowly due to the sheer number of score network evaluations required by numerical SDE solvers. In this work, we aim to accelerate this process by devising a more efficient SDE solver. Existing approaches rely on the Euler-Maruyama (EM) solver, which uses a fixed step size. We found that naively replacing it with other SDE solvers fares poorly - they either result in low-quality samples or become slower than EM. To get around this issue, we carefully devise an SDE solver with adaptive step sizes tailored to score-based generative models piece by piece. Our solver requires only two score function evaluations, rarely rejects samples, and leads to high-quality samples. Our approach generates data 2 to 10 times faster than EM while achieving better or equal sample quality. For high-resolution images, our method leads to significantly higher quality samples than all other methods tested. Our SDE solver has the benefit of requiring no step size tuning.


title: Specification tests for GARCH processes

abstract: This paper develops tests for the correct specification of the conditional variance function in GARCH models when the true parameter may lie on the boundary of the parameter space. The test statistics considered are of Kolmogorov-Smirnov and Cram\'{e}r-von Mises type, and are based on a certain empirical process marked by centered squared residuals. The limiting distributions of the test statistics are not free from (unknown) nuisance parameters, and hence critical values cannot be tabulated. A novel bootstrap procedure is proposed to implement the tests; it is shown to be asymptotically valid under general conditions, irrespective of the presence of nuisance parameters on the boundary. The proposed bootstrap approach is based on shrinking of the parameter estimates used to generate the bootstrap sample toward the boundary of the parameter space at a proper rate. It is simple to implement and fast in applications, as the associated test statistics have simple closed form expressions. A simulation study demonstrates that the new tests: (i) have excellent finite sample behavior in terms of empirical rejection probabilities under the null as well as under the alternative; (ii) provide a useful complement to existing procedures based on Ljung-Box type approaches. Two data examples are considered to illustrate the tests.


title: Bhasacitra: Visualising the dialect geography of South Asia

abstract: We present Bhasacitra, a dialect mapping system for South Asia built on a database of linguistic studies of languages of the region annotated for topic and location data. We analyse language coverage and look towards applications to typology by visualising example datasets. The application is not only meant to be useful for feature mapping, but also serves as a new kind of interactive bibliography for linguists of South Asian languages.


title: Rethinking Noisy Label Models: Labeler-Dependent Noise with Adversarial Awareness

abstract: Most studies on learning from noisy labels rely on unrealistic models of i.i.d. label noise, such as class-conditional transition matrices. More recent work on instance-dependent noise models are more realistic, but assume a single generative process for label noise across the entire dataset. We propose a more principled model of label noise that generalizes instance-dependent noise to multiple labelers, based on the observation that modern datasets are typically annotated using distributed crowdsourcing methods. Under our labeler-dependent model, label noise manifests itself under two modalities: natural error of good-faith labelers, and adversarial labels provided by malicious actors. We present two adversarial attack vectors that more accurately reflect the label noise that may be encountered in real-world settings, and demonstrate that under our multimodal noisy labels model, state-of-the-art approaches for learning from noisy labels are defeated by adversarial label attacks. Finally, we propose a multi-stage, labeler-aware, model-agnostic framework that reliably filters noisy labels by leveraging knowledge about which data partitions were labeled by which labeler, and show that our proposed framework remains robust even in the presence of extreme adversarial label noise.


title: Support vector machines and linear regression coincide with very high-dimensional features

abstract: The support vector machine (SVM) and minimum Euclidean norm least squares regression are two fundamentally different approaches to fitting linear models, but they have recently been connected in models for very high-dimensional data through a phenomenon of support vector proliferation, where every training example used to fit an SVM becomes a support vector. In this paper, we explore the generality of this phenomenon and make the following contributions. First, we prove a super-linear lower bound on the dimension (in terms of sample size) required for support vector proliferation in independent feature models, matching the upper bounds from previous works. We further identify a sharp phase transition in Gaussian feature models, bound the width of this transition, and give experimental support for its universality. Finally, we hypothesize that this phase transition occurs only in much higher-dimensional settings in the $\ell_1$ variant of the SVM, and we present a new geometric characterization of the problem that may elucidate this phenomenon for the general $\ell_p$ case.


title: The Concept of Truth

abstract: On the basis of elementary thinking about language functioning, a solution of truth paradoxes is given and a corresponding semantics of a truth predicate is founded. It is shown that it is precisely the two-valued description of the maximal intrinsic fixed point of the strong Kleene three-valued semantics.


abstract: Usually, it is difficult to determine the scale and aspect ratio of anchors for anchor-based object detection methods. Current state-of-the-art object detectors either determine anchor parameters according to objects' shape and scale in a dataset, or avoid this problem by utilizing anchor-free methods, however, the former scheme is dataset-specific and the latter methods could not get better performance than the former ones. In this paper, we propose a novel anchor augmentation method named AADI, which means Augmenting Anchors by the Detector Itself. AADI is not an anchor-free method, instead, it can convert the scale and aspect ratio of anchors from a continuous space to a discrete space, which greatly alleviates the problem of anchors' designation. Furthermore, AADI is a learning-based anchor augmentation method, but it does not add any parameters or hyper-parameters, which is beneficial for research and downstream tasks. Extensive experiments on COCO dataset demonstrate the effectiveness of AADI, specifically, AADI achieves significant performance boosts on many state-of-the-art object detectors (eg. at least +2.4 box AP on Faster R-CNN, +2.2 box AP on Mask R-CNN, and +0.9 box AP on Cascade Mask R-CNN). We hope that this simple and cost-efficient method can be widely used in object detection. Code and models are available at https://github.com/WanXiaopei/aadi.


title: Degree centrality and root finding in growing random networks

abstract: We consider growing random networks $\{\mathcal G_n\}_{n \ge 1}$ where, at each time, a new vertex attaches itself to a collection of existing vertices via a fixed number $m \ge 1$ of edges, with probability proportional to an attachment function $f$ of their degree. It was shown in \cite{BBpersistence} that such network models exhibit two regimes: (i) the persistent regime, corresponding to $\sum_{i=1}^{\infty}f(i)^{-2} < \infty$, where the top $K$ maximal degree vertices fixate over time for any given $K$, and (ii) the non-persistent regime, with $\sum_{i=1}^{\infty}f(i)^{-2} = \infty$, where the identities of these vertices keep changing infinitely often over time. We develop root finding algorithms using the empirical degree structure and local network information based on a snapshot of such a network at some large time. In the persistent regime, the algorithm is purely based on degree centrality, that is, for a given error tolerance $\varepsilon \in (0,1)$, there exists $K_{\varepsilon}$ such that for any $n \ge 1$, the confidence set for the root in $\mathcal G_n$, which contains the root with probability at least $1 - \varepsilon$, consists of the top $K_{\varepsilon}$ maximal degree vertices. In particular, the size of the confidence set is stable in the network size. Upper and lower bounds on $K_{\varepsilon}$ are explicitly characterized in terms of the error tolerance $\varepsilon$ and the attachment function $f$. In the non-persistent regime, for an appropriate choice of $r_n \rightarrow \infty$ at a rate much smaller than the diameter of the network, the neighborhood of radius $r_n$ around the maximal degree vertex is shown to contain the root with high probability, and a size estimate for this set is obtained. It is shown that, when $f(k) = k^{\alpha}, k \ge 1,$ for any $\alpha \in (0,1/2]$, this size grows at a smaller rate than any positive power of the network size.


title: Cloud Collectives: Towards Cloud-aware Collectives forML Workloads with Rank Reordering

abstract: ML workloads are becoming increasingly popular in the cloud. Good cloud training performance is contingent on efficient parameter exchange among VMs. We find that Collectives, the widely used distributed communication algorithms, cannot perform optimally out of the box due to the hierarchical topology of datacenter networks and multi-tenancy nature of the cloudenvironment.In this paper, we present Cloud Collectives , a prototype that accelerates collectives by reordering theranks of participating VMs such that the communication pattern dictated by the selected collectives operation best exploits the locality in the network.Collectives is non-intrusive, requires no code changes nor rebuild of an existing application, and runs without support from cloud providers. Our preliminary application of Cloud Collectives on allreduce operations in public clouds results in a speedup of up to 3.7x in multiple microbenchmarks and 1.3x in real-world workloads of distributed training of deep neural networks and gradient boosted decision trees using state-of-the-art frameworks.


title: Improved Convergence Rate for a Distributed Two-Time-Scale Gradient Method under Random Quantization

abstract: We study the so-called distributed two-time-scale gradient method for solving convex optimization problems over a network of agents when the communication bandwidth between the nodes is limited, and so information that is exchanged between the nodes must be quantized. Our main contribution is to provide a novel analysis, resulting to an improved convergence rate of this method as compared to the existing works. In particular, we show that the method converges at a rate $O(log_2 k/\sqrt k)$ to the optimal solution, when the underlying objective function is strongly convex and smooth. The key technique in our analysis is to consider a Lyapunov function that simultaneously captures the coupling of the consensus and optimality errors generated by the method.


title: MusE GAs FLOw and Wind (MEGAFLOW) VIII. Discovery of a MgII emission halo probed by a quasar sightline

abstract: Using deep (11.2hr) VLT/MUSE data from the MEGAFLOW survey, we report the first detection of extended MgII emission from a galaxy's halo that is probed by a quasar sightline. The MgII $\lambda\lambda$ 2796,2803 emission around the $z = 0.702$ galaxy ($\log(M_*/\mathrm{M_\odot}) = 10.05^{+0.15}_{-0.11}$) is detected out to $\approx$25 kpc from the central galaxy and covers $1.0\times10^3$ kpc$^2$ above a surface brightness of $14\times10^{-19} \mathrm{erg} \mathrm{s}^{-1} \mathrm{cm}^{-2}\,\mathrm{arcsec}^{-2}$ ($2 \sigma$; integrated over 1200 km s$^{-1}$ =19A and averaged over $1.5 \;\mathrm{arcsec}^2$). The MgII emission around this highly inclined galaxy ($\simeq$75 deg) is strongest along the galaxy's projected minor axis, consistent with the MgII gas having been ejected from the galaxy into a bi-conical structure. The quasar sightline, which is aligned with the galaxy's minor axis, shows strong MgII $\lambda$2796 absorption (EW$_0$ = 1.8A) at an impact parameter of 39kpc from the galaxy. Comparing the kinematics of both the emission and the absorption - probed with VLT/UVES -, to the expectation from a simple toy model of a bi-conical outflow, we find good consistency when assuming a relatively slow outflow ($v_\mathrm{out}= 130\;\mathrm{km}\,\mathrm{s}^{-1}$). We investigate potential origins of the extended MgII emission using simple toy models. With continuum scattering models we encounter serious difficulties in explaining the luminosity of the MgII halo and in reconciling density estimates from emission and absorption. Instead, we find that shocks might be a more viable source to power the extended MgII (and non-resonant [OII]) emission.


title: Influence of sampling on the convergence rates of greedy algorithms for parameter-dependent random variables

abstract: The main focus of this article is to provide a mathematical study of the algorithm proposed in \cite{boyaval2010variance} where the authors proposed a variance reduction technique for the computation of parameter-dependent expectations using a reduced basis paradigm. We study the effect of Monte-Carlo sampling on the theoretical properties of greedy algorithms. In particular, using concentration inequalities for the empirical measure in Wasserstein distance proved in \cite{fournier2015rate}, we provide sufficient conditions on the number of samples used for the computation of empirical variances at each iteration of the greedy procedure to guarantee that the resulting method algorithm is a weak greedy algorithm with high probability. These theoretical results are not fully practical and we therefore propose a heuristic procedure to choose the number of Monte-Carlo samples at each iteration, inspired from this theoretical study, which provides satisfactory results on several numerical test cases.


title: Least Redundant Gated Recurrent Neural Network

abstract: Recurrent neural networks are important tools for sequential data processing. However, they are notorious for problems regarding their training. Challenges include capturing complex relations between consecutive states and stability and efficiency of training. In this paper, we introduce a recurrent neural architecture called Deep Memory Update (DMU). It is based on updating the previous memory state with a deep transformation of the lagged state and the network input. The architecture is able to learn to transform its internal state using any nonlinear function. Its training is stable and fast due to relating its learning rate to the size of the module. Even though DMU is based on standard components, experimental results presented here confirm that it can compete with and often outperform state-of-the-art architectures such as Long Short-Term Memory, Gated Recurrent Units, and Recurrent Highway Networks.


title: Variational Inference for Latent Space Models for Dynamic Networks

abstract: Latent space models are popular for analyzing dynamic network data. We propose a variational approach to estimate the model parameters as well as the latent positions of the nodes in the network. The variational approach is much faster than Markov chain Monte Carlo algorithms, and is able to handle large networks. Theoretical properties of the variational Bayes risk of the proposed procedure are provided. We apply the variational method and latent space model to simulated data as well as real data to demonstrate its performance.


title: Galerkin Neural Networks: A Framework for Approximating Variational Equations with Error Control

abstract: We present a new approach to using neural networks to approximate the solutions of variational equations, based on the adaptive construction of a sequence of finite-dimensional subspaces whose basis functions are realizations of a sequence of neural networks. The finite-dimensional subspaces are then used to define a standard Galerkin approximation of the variational equation. This approach enjoys a number of advantages, including: the sequential nature of the algorithm offers a systematic approach to enhancing the accuracy of a given approximation; the sequential enhancements provide a useful indicator for the error that can be used as a criterion for terminating the sequential updates; the basic approach is largely oblivious to the nature of the partial differential equation under consideration; and, some basic theoretical results are presented regarding the convergence (or otherwise) of the method which are used to formulate basic guidelines for applying the method.


title: Weighted Training for Cross-Task Learning

abstract: In this paper, we introduce Target-Aware Weighted Training (TAWT), a weighted training algorithm for cross-task learning based on minimizing a representation-based task distance between the source and target tasks. We show that TAWT is easy to implement, is computationally efficient, requires little hyperparameter tuning, and enjoys non-asymptotic learning-theoretic guarantees. The effectiveness of TAWT is corroborated through extensive experiments with BERT on four sequence tagging tasks in natural language processing (NLP), including part-of-speech (PoS) tagging, chunking, predicate detection, and named entity recognition (NER). As a byproduct, the proposed representation-based task distance allows one to reason in a theoretically principled way about several critical aspects of cross-task learning, such as the choice of the source data and the impact of fine-tuning.


title: DEWPython: A Python Implementation of the Deep Earth Water Model and Application to Ocean Worlds

abstract: There are two main methods of calculating the thermodynamic properties of water and solutes: mass action (including the Helgeson-Kirkham-Flowers (HKF) equations of state and model) and Gibbs free energy minimization (e.g. Leal et al., 2016). However, in certain regions of pressure and temperature the HKF model inaccurately predicts the speciation and concentration of solutes (e.g. Miron et al., 2019). The Deep Earth Water (DEW) model uses a series of HKF-type equations to calculate the properties of water and solute concentrations at high temperatures (373 - 1473 K) and pressures (0.1 - 6 GPa) (e.g. Huang and Sverjensky, 2019; Pan et al., 2013; Sverjensky et al., 2014). The DEW model is synthesized in an Excel spreadsheet and calculates Gibbs energies of formation, equilibrium constants, and standard volume changes for reactions. Here we present an object-oriented Python implementation of the DEW model, called DEWPython. Our model expands on DEW by increasing model efficiency, streamlining the input process, and incorporating SUPCRT in-line. Additionally, our model builds in minerals and aqueous species from the thermodynamic database slop16.dat (Boyer, 2019) which would normally be calculated separately. We also present a set of reactions relevant to icy ocean world interiors calculated with the DEWPython. The favorability of these reactions indicates likely formation of certain organic species under extreme pressures relevant to ocean worlds.


title: Reinforcement Learning for on-line Sequence Transformation

abstract: A number of problems in the processing of sound and natural language, as well as in other areas, can be reduced to simultaneously reading an input sequence and writing an output sequence of generally different length. There are well developed methods that produce the output sequence based on the entirely known input. However, efficient methods that enable such transformations on-line do not exist. In this paper we introduce an architecture that learns with reinforcement to make decisions about whether to read a token or write another token. This architecture is able to transform potentially infinite sequences on-line. In an experimental study we compare it with state-of-the-art methods for neural machine translation. While it produces slightly worse translations than Transformer, it outperforms the autoencoder with attention, even though our architecture translates texts on-line thereby solving a more difficult problem than both reference methods.


title: Ray-based inversion accounting for scattering for biomedical ultrasound computed tomography

abstract: An efficient and accurate image reconstruction algorithm for ultrasound tomography (UST) is described and demonstrated, which can recover accurate sound speed distribution from acoustic time series measurements made in soft tissue. The approach is based on a second-order iterative minimisation of the difference between the measurements and a model based on a ray-approximation to the heterogeneous Green's function. It overcomes the computational burden of full-wave solvers while avoiding the drawbacks of time-of-flight methods. Through the use of a second-order iterative minimisation scheme, applied stepwise from low to high frequencies, the effects of scattering are incorporated into the inversion.


title: Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning

abstract: Despite recent advances in its theoretical understanding, there still remains a significant gap in the ability of existing PAC-Bayesian theories on meta-learning to explain performance improvements in the few-shot learning setting, where the number of training examples in the target tasks is severely limited. This gap originates from an assumption in the existing theories which supposes that the number of training examples in the observed tasks and the number of training examples in the target tasks follow the same distribution, an assumption that rarely holds in practice. By relaxing this assumption, we develop two PAC-Bayesian bounds tailored for the few-shot learning setting and show that two existing meta-learning algorithms (MAML and Reptile) can be derived from our bounds, thereby bridging the gap between practice and PAC-Bayesian theories. Furthermore, we derive a new computationally-efficient PACMAML algorithm, and show it outperforms existing meta-learning algorithms on several few-shot benchmark datasets.


title: Latticed $k$-Induction with an Application to Probabilistic Programs

abstract: We revisit two well-established verification techniques, $k$-induction and bounded model checking (BMC), in the more general setting of fixed point theory over complete lattices. Our main theoretical contribution is latticed $k$-induction, which (i) generalizes classical $k$-induction for verifying transition systems, (ii) generalizes Park induction for bounding fixed points of monotonic maps on complete lattices, and (iii) extends from naturals $k$ to transfinite ordinals $\kappa$, thus yielding $\kappa$-induction. The lattice-theoretic understanding of $k$-induction and BMC enables us to apply both techniques to the fully automatic verification of infinite-state probabilistic programs. Our prototypical implementation manages to automatically verify non-trivial specifications for probabilistic programs taken from the literature that - using existing techniques - cannot be verified without synthesizing a stronger inductive invariant first.


title: Pressure-induced structural transitions triggering dimensional crossover in lithium purple bronze Li0.9M6O17

abstract: At ambient pressure, lithium molybdenum purple bronze (Li0.9Mo6O17) is a quasi-one dimensional solid in which the anisotropic crystal structure and the linear dispersion of the underlying bands produced by electronic correlations possibly bring about a rare experimental realization of Tomomaga-Luttinger liquid physics. It is also the sole member of the broader purple molybdenum bronzes family where a Peierls instability has not been identified at low temperatures. The present study reports a pressure-induced series of phase transitions between 0 and 12 GPa. These transitions are strongly reflected in infrared spectroscopy, Raman spectroscopy, and x-ray diffraction. The most dramatic effect seen in optical conductivity is the metallization of the c-axis, concomitant to the decrease of conductivity along the b-axis. This indicates that high pressure drives the material away from its quasi-one dimensional behavior at ambient pressure. While the first pressure-induced structure of the series is resolved, the identification of the underlying mechanisms driving the dimensional change in the physics remains a challenge.


title: Seeking echoes of circumstellar disks in Kepler light curves

abstract: Light echoes of flares on active stars offer the opportunity for direct detection of circumstellar dust. We revisit the problem of identifying faint echoes in post-flare light curves, focusing on debris disks from on-going planet formation. Starting with simulations, we develop an algorithm for estimating the radial extent and total mass from disk echo profiles. We apply this algorithm to light curves from over 2,100 stars observed by NASA's Kepler mission, selected for multiple, short-lived flares in either the long-cadence or short-cadence data sets. While flux uncertainties in light curves from individual stars preclude useful mass limits on circumstellar disks, catalog-averaged light curves yield constraints on disk mass that are comparable to estimates from known debris disks. The average mass in micron- to millimeter-sized dust around the Kepler stars cannot exceed 10% of an Earth mass in exo-Kuiper belts or 10% of a Lunar mass in the terrestrial zone. We group stars according to IR excess, based on WISE W1-W3 color, as an indicator for the presence of circumstellar dust. The mass limits are greater for stars with strong IR excess, a hint that echoes are lurking not far beneath the noise in post-flare light curves. With increased sensitivity, echo detection will let time-domain astronomy complement spectroscopic and direct-imaging studies in mapping how, when, and where planets form.


title: An Attention Free Transformer

abstract: We introduce Attention Free Transformer (AFT), an efficient variant of Transformers that eliminates the need for dot product self attention. In an AFT layer, the key and value are first combined with a set of learned position biases, the result of which is multiplied with the query in an element-wise fashion. This new operation has a memory complexity linear w.r.t. both the context size and the dimension of features, making it compatible to both large input and model sizes. We also introduce AFT-local and AFT-conv, two model variants that take advantage of the idea of locality and spatial weight sharing while maintaining global connectivity. We conduct extensive experiments on two autoregressive modeling tasks (CIFAR10 and Enwik8) as well as an image recognition task (ImageNet-1K classification). We show that AFT demonstrates competitive performance on all the benchmarks, while providing excellent efficiency at the same time.


title: Large, moderate deviations principle and $\alpha$-limit for the 2D Stochastic LANS-$\alpha$

abstract: In this paper we consider the Lagrangian Averaged Navier-Stokes Equations, also known as, LANS-$\alpha$ Navier-Stokes model on the two dimensional torus. We assume that the noise is a cylindrical Wiener process and its coefficient is multiplied by $\sqrt{\alpha}$. We then study through the lenses of the large and moderate deviations principle the behaviour of the trajectories of the solutions of the stochastic system as $\alpha$ goes to 0. Instead of giving two separate proofs of the two deviations principles we present a unifying approach to the proof of the LDP and MDP and express the rate function in term of the unique solution of the Navier-Stokes equations. Our proof is based on the weak convergence approach to large deviations principle. As a by-product of our analysis we also prove that the solutions of the stochastic LANS-$\alpha$ model converge in probability to the solutions of the deterministic Navier-Stokes equations.


title: Reinforcement Learning reveals fundamental limits on the mixing of active particles

abstract: The control of far-from-equilibrium physical systems, including active materials, has emerged as an important area for the application of reinforcement learning (RL) strategies to derive control policies for physical systems. In active materials, non-linear dynamics and long-range interactions between particles prohibit closed-form descriptions of the system's dynamics and prevent explicit solutions to optimal control problems. Due to fundamental challenges in solving for explicit control strategies, RL has emerged as an approach to derive control strategies for far-from-equilibrium active matter systems. However, an important open question is how the mathematical structure and the physical properties of the active matter systems determine the tractability of RL for learning control policies. In this work, we show that RL can only find good strategies to the canonical active matter task of mixing for systems that combine attractive and repulsive particle interactions. Using mathematical results from dynamical systems theory, we relate the availability of both interaction types with the existence of hyperbolic dynamics and the ability of RL to find homogeneous mixing strategies. In particular, we show that for drag-dominated translational-invariant particle systems, hyperbolic dynamics and, therefore, mixing requires combining attractive and repulsive interactions. Broadly, our work demonstrates how fundamental physical and mathematical properties of dynamical systems can enable or constrain reinforcement learning-based control.


title: Smaller Is Better: An Analysis of Instance Quantity/Quality Trade-off in Rehearsal-based Continual Learning

abstract: The design of machines and algorithms capable of learning in a dynamically changing environment has become an increasingly topical problem with the increase of the size and heterogeneity of data available to learning systems. As a consequence, the key issue of Continual Learning has become that of addressing the stability-plasticity dilemma of connectionist systems, as they need to adapt their model without forgetting previously acquired knowledge. Within this context, rehearsal-based methods i.e., solutions in where the learner exploits memory to revisit past data, has proven to be very effective, leading to performance at the state-of-the-art. In our study, we propose an analysis of the memory quantity/quality trade-off adopting various data reduction approaches to increase the number of instances storable in memory. In particular, we investigate complex instance compression techniques such as deep encoders, but also trivial approaches such as image resizing and linear dimensionality reduction. Our findings suggest that the optimal trade-off is severely skewed toward instance quantity, where rehearsal approaches with several heavily compressed instances easily outperform state-of-the-art approaches with the same amount of memory at their disposal. Further, in high memory configurations, deep approaches extracting spatial structure combined with extreme resizing (of the order of $8\times8$ images) yield the best results, while in memory-constrained configurations where deep approaches cannot be used due to their memory requirement in training, Extreme Learning Machines (ELM) offer a clear advantage.


title: Data Acquisition for Improving Machine Learning Models

abstract: The vast advances in Machine Learning over the last ten years have been powered by the availability of suitably prepared data for training purposes. The future of ML-enabled enterprise hinges on data. As such, there is already a vibrant market offering data annotation services to tailor sophisticated ML models. In this paper, we present research on the practical problem of obtaining data in order to improve the accuracy of ML models. We consider an environment in which consumers query for data to enhance the accuracy of their models and data providers who possess data make them available for training purposes. We first formalize this interaction process laying out the suitable framework and associated parameters for data exchange. We then propose two data acquisition strategies that consider a trade-off between exploration during which we obtain data to learn about the distribution of a provider's data and exploitation during which we optimize our data inquiries utilizing the gained knowledge. In the first strategy, Estimation and Allocation, we utilize queries to estimate the utilities of various predicates while learning about the distribution of the provider's data; then we proceed to the allocation stage in which we utilize those learned utility estimates to inform our data acquisition decisions. The second algorithmic proposal, named Sequential Predicate Selection, utilizes a sampling strategy to explore the distribution of the provider's data, adaptively investing more resources to parts of the data space that are statistically more promising to improve overall model accuracy. We present a detailed experimental evaluation of our proposals utilizing a variety of ML models and associated real data sets exploring all applicable parameters of interest. We identify trade-offs and highlight the relative benefits of each algorithm to further optimize model accuracy.


title: Efficient and robust multi-task learning in the brain with modular latent primitives

abstract: Biological agents do not have infinite resources to learn new things. For this reason, a central aspect of human learning is the ability to recycle previously acquired knowledge in a way that allows for faster, less resource-intensive acquisition of new skills. In spite of that, how neural networks in the brain leverage existing knowledge to learn new computations is not well understood. In this work, we study this question in artificial recurrent neural networks (RNNs) trained on a corpus of commonly used neuroscience tasks. Combining brain-inspired inductive biases we call functional and structural, we propose a system that learns new tasks by building on top of pre-trained latent dynamics organised into separate recurrent modules. These modules, acting as prior knowledge acquired previously through evolution or development, are pre-trained on the statistics of the full corpus of tasks so as to be independent and maximally informative. The resulting model, we call a Modular Latent Primitives (MoLaP) network, allows for learning multiple tasks while keeping parameter counts, and updates, low. We also show that the skills acquired with our approach are more robust to a broad range of perturbations compared to those acquired with other multi-task learning strategies, and that generalisation to new tasks is facilitated. This work offers a new perspective on achieving efficient multi-task learning in the brain, illustrating the benefits of leveraging pre-trained latent dynamical primitives.


title: Electric Field Control of Chirality

abstract: Polar textures have attracted significant attention in recent years as a promising analog to spin-based textures in ferromagnets. Here, using optical second harmonic generation based circular dichroism, we demonstrate deterministic and reversible control of chirality over mesoscale regions in ferroelectric vortices using an applied electric field. The microscopic origins of the chirality, the pathway during the switching, and the mechanism for electric-field control are described theoretically via phase-field modeling and second-principles simulations, and experimentally by examination of the microscopic response of the vortices under an applied field. The emergence of chirality from the combination of non-chiral materials and subsequent control of the handedness with an electric field has far-reaching implications for new electronics based on chirality as a field controllable order parameter.


title: MixerGAN: An MLP-Based Architecture for Unpaired Image-to-Image Translation

abstract: While attention-based transformer networks achieve unparalleled success in nearly all language tasks, the large number of tokens (pixels) found in images coupled with the quadratic activation memory usage makes them prohibitive for problems in computer vision. As such, while language-to-language translation has been revolutionized by the transformer model, convolutional networks remain the de facto solution for image-to-image translation. The recently proposed MLP-Mixer architecture alleviates some of the computational issues associated with attention-based networks while still retaining the long-range connections that make transformer models desirable. Leveraging this memory-efficient alternative to self-attention, we propose a new exploratory model in unpaired image-to-image translation called MixerGAN: a simpler MLP-based architecture that considers long-distance relationships between pixels without the need for expensive attention mechanisms. Quantitative and qualitative analysis shows that MixerGAN achieves competitive results when compared to prior convolutional-based methods.


title: Goal Misgeneralization in Deep Reinforcement Learning

abstract: We study goal misgeneralization, a type of out-of-distribution generalization failure in reinforcement learning (RL). Goal misgeneralization failures occur when an RL agent retains its capabilities out-of-distribution yet pursues the wrong goal. For instance, an agent might continue to competently avoid obstacles, but navigate to the wrong place. In contrast, previous works have typically focused on capability generalization failures, where an agent fails to do anything sensible at test time. We formalize this distinction between capability and goal generalization, provide the first empirical demonstrations of goal misgeneralization, and present a partial characterization of its causes.


title: Superfluid transition and specific heat of the 2D x-y model: Monte Carlo simulation

abstract: We present results of large-scale Monte Carlo simulations of the 2D classical x-y model on the square lattice. We obtain high accuracy results for the superfluid fraction and for the specific heat as a function of temperature, for systems of linear size L up to 4096. Our estimate for the superfluid transition temperature is consistent with those furnished in all previous studies. The specific heat displays a well-defined peak, whose shape and position are independent of the size of the lattice for L > 256, within the statistical uncertainties of our calculations. The implications of these results on the interpretation of experiments on adsorbed thin films of He-4 are discussed.


title: Necessary and Sufficient Conditions for Stability of Discrete-Time Switched Linear Systems with Ranged Dwell Time

abstract: This paper deals with the stability analysis problem of discrete-time switched linear systems with ranged dwell time. A novel concept called L-switching-cycle is proposed, which contains sequences of multiple activation cycles satisfying the prescribed ranged dwell time constraint. Based on L-switching-cycle, two sufficient conditions are proposed to ensure the global uniform asymptotic stability of discrete-time switched linear systems. It is noted that two conditions are equivalent in stability analysis with the same $L$-switching-cycle. These two sufficient conditions can be viewed as generalizations of the clock-dependent Lyapunov and multiple Lyapunov function methods, respectively. Furthermore, it has been proven that the proposed L-switching-cycle can eventually achieve the nonconservativeness in stability analysis as long as a sufficiently long L-switching-cycle is adopted. A numerical example is provided to illustrate our theoretical results.


title: Asymptotically Optimal Bandits under Weighted Information

abstract: We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a normalized power profile and receives a Gaussian vector as outcome, where the unknown variance of each sample is inversely proportional to the power allocated to that arm. The reward corresponds to a linear combination of the power profile and the outcomes, resembling a linear bandit. By spreading the power, the agent can choose to collect information much faster than in a traditional multi-armed bandit at the price of reducing the accuracy of the samples. This setup is fundamentally different from that of a linear bandit -- the regret is known to scale as $\Theta(\sqrt{T})$ for linear bandits, while in this setup the agent receives a much more detailed feedback, for which we derive a tight $\log(T)$ problem-dependent lower-bound. We propose a Thompson-Sampling-based strategy, called Weighted Thompson Sampling (\WTS), that designs the power profile as its posterior belief of each arm being the best arm, and show that its upper bound matches the derived logarithmic lower bound. Finally, we apply this strategy to a problem of control and system identification, where the goal is to estimate the maximum gain (also called $\mathcal{H}_\infty$-norm) of a linear dynamical system based on batches of input-output samples.


title: Towards More Equitable Question Answering Systems: How Much More Data Do You Need?

abstract: Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through translation and cross-lingual transfer. In this project, we take a step back and study which approaches allow us to take the most advantage of existing resources in order to produce QA systems in many languages. Specifically, we perform extensive analysis to measure the efficacy of few-shot approaches augmented with automatic translations and permutations of context-question-answer pairs. In addition, we make suggestions for future dataset development efforts that make better use of a fixed annotation budget, with a goal of increasing the language coverage of QA datasets and systems. Code and data for reproducing our experiments are available here: https://github.com/NavidRajabi/EMQA.


title: Visualizing Representations of Adversarially Perturbed Inputs

abstract: It has been shown that deep learning models are vulnerable to adversarial attacks. We seek to further understand the consequence of such attacks on the intermediate activations of neural networks. We present an evaluation metric, POP-N, which scores the effectiveness of projecting data to N dimensions under the context of visualizing representations of adversarially perturbed inputs. We conduct experiments on CIFAR-10 to compare the POP-2 score of several dimensionality reduction algorithms across various adversarial attacks. Finally, we utilize the 2D data corresponding to high POP-2 scores to generate example visualizations.


title: About Explicit Variance Minimization: Training Neural Networks for Medical Imaging With Limited Data Annotations

abstract: Self-supervised learning methods for computer vision have demonstrated the effectiveness of pre-training feature representations, resulting in well-generalizing Deep Neural Networks, even if the annotated data are limited. However, representation learning techniques require a significant amount of time for model training, with most of the time spent on precise hyper-parameter optimization and selection of augmentation techniques. We hypothesized that if the annotated dataset has enough morphological diversity to capture the diversity of the general population, as is common in medical imaging due to conserved similarities of tissue morphology, the variance error of the trained model is the dominant component of the Bias-Variance Trade-off. Therefore, we proposed the Variance Aware Training (VAT) method that exploits this data property by introducing the variance error into the model loss function, thereby, explicitly regularizing the model. Additionally, we provided a theoretical formulation and proof of the proposed method to aid interpreting the approach. Our method requires selecting only one hyper-parameter and matching or improving the performance of state-of-the-art self-supervised methods while achieving an order of magnitude reduction in the GPU training time. We validated VAT on three medical imaging datasets from diverse domains and for various learning objectives. These included a Magnetic Resonance Imaging (MRI) dataset for the heart semantic segmentation (MICCAI 2017 ACDC challenge), fundus photography dataset for ordinary regression of diabetic retinopathy progression (Kaggle 2019 APTOS Blindness Detection challenge), and classification of histopathologic scans of lymph node sections (PatchCamelyon dataset). Our code is available at https://github.com/DmitriiShubin/Variance-Aware-Training.


title: Robust Sample-Based Output-Feedback Path Planning

abstract: We propose a novel approach for sampling-based and control-based motion planning that combines a representation of the environment obtained via a modified version of optimal Rapidly-exploring Random Trees (RRT*), with landmark-based output-feedback controllers obtained via Control Lyapunov Functions, Control Barrier Functions, and robust Linear Programming. Our solution inherits many benefits of RRT*-like algorithms, such as the ability to implicitly handle arbitrarily complex obstacles, and asymptotic optimality. Additionally, it extends planning beyond the discrete nominal paths, as feedback controllers can correct deviations from such paths, and are robust to discrepancies between the map used for planning and the real environment. We test our algorithms first in simulations and then in experiments, testing the robustness of the approach to practical conditions, such as deformations of the environment, mismatches in the dynamical model of the robot, and measurements acquired with a camera with a limited field of view.


title: Towards optimally abstaining from prediction with OOD test examples

abstract: A common challenge across all areas of machine learning is that training data is not distributed like test data, due to natural shifts, "blind spots," or adversarial examples; such test examples are referred to as out-of-distribution (OOD) test examples. We consider a model where one may abstain from predicting, at a fixed cost. In particular, our transductive abstention algorithm takes labeled training examples and unlabeled test examples as input, and provides predictions with optimal prediction loss guarantees. The loss bounds match standard generalization bounds when test examples are i.i.d. from the training distribution, but add an additional term that is the cost of abstaining times the statistical distance between the train and test distribution (or the fraction of adversarial examples). For linear regression, we give a polynomial-time algorithm based on Celis-Dennis-Tapia optimization algorithms. For binary classification, we show how to efficiently implement it using a proper agnostic learner (i.e., an Empirical Risk Minimizer) for the class of interest. Our work builds on a recent abstention algorithm of Goldwasser, Kalais, and Montasser (2020) for transductive binary classification.


title: Assessing the intelligibility of vocoded speech using a remote testing framework

abstract: Over the past year, remote speech intelligibility testing has become a popular and necessary alternative to traditional in-person experiments due to the need for physical distancing during the COVID-19 pandemic. A remote framework was developed for conducting speech intelligibility tests with normal hearing listeners. In this study, subjects used their personal computers to complete sentence recognition tasks in anechoic and reverberant listening environments. The results obtained using this remote framework were compared with previously collected in-lab results, and showed higher levels of speech intelligibility among remote study participants than subjects who completed the test in the laboratory.


title: Logic of paradoxes in classical set theories

abstract: Set theoretical paradoxes have a common root -- lack of understanding of why some multitudes are not sets. Why some multitudes of objects of thought cannot themselves be objects of thought? Moreover, it is a logical truth that such multitudes do exist. However we do not understand this logical truth so well as we understand, for example, the logical truth $\forall x \ x=x$. In this paper, we formulate a logical truth which we call the productivity principle. Bertrand Rusell was the first one to formulate this principle, but in a restricted form and with a different purpose. The principle explicates a logical mechanism that lies behind paradoxical multitudes and is understandable as well as any simple logical truth. However, it does not explain the concept of set. It only sets logical bounds of the concept within the framework of the classical two-valued $\in$ - language. The principle behaves as a logical regulator of any theory we formulate to explain and describe sets. It provides tools to identify paradoxical classes inside the theory. We show how the known paradoxical classes follow from the productivity principle and how the principle gives us a uniform way to generate new paradoxical classes. In the case of $ZFC$ set theory, the productivity principle shows that the limitation of size principles are of a restrictive nature and that they do not explain which classes are sets. The productivity principle, as a logical regulator, can have a definite heuristic role in the development of a consistent set theory. We sketch such a theory -- the cumulative cardinal theory of sets.