title: Hierarchical Relation-Guided Type-Sentence Alignment for Long-Tail Relation Extraction with Distant Supervision

abstract: Distant supervision uses triple facts in knowledge graphs to label a corpus for relation extraction, leading to wrong labeling and long-tail problems. Some works use the hierarchy of relations for knowledge transfer to long-tail relations. However, a coarse-grained relation often implies only an attribute (e.g., domain or topic) of the distant fact, making it hard to discriminate relations based solely on sentence semantics. One solution is resorting to entity types, but open questions remain about how to fully leverage the information of entity types and how to align multi-granular entity types with sentences. In this work, we propose a novel model to enrich distantly-supervised sentences with entity types. It consists of (1) a pairwise type-enriched sentence encoding module injecting both context-free and -related backgrounds to alleviate sentence-level wrong labeling, and (2) a hierarchical type-sentence alignment module enriching a sentence with the triple fact's basic attributes to support long-tail relations. Our model achieves new state-of-the-art results in overall and long-tail performance on benchmarks.


title: Dual Behavior Regularized Reinforcement Learning

abstract: Reinforcement learning has been shown to perform a range of complex tasks through interaction with an environment or collected leveraging experience. However, many of these approaches presume optimal or near optimal experiences or the presence of a consistent environment. In this work we propose dual, advantage-based behavior policy based on counterfactual regret minimization. We demonstrate the flexibility of this approach and how it can be adapted to online contexts where the environment is available to collect experiences and a variety of other contexts. We demonstrate this new algorithm can outperform several strong baseline models in different contexts based on a range of continuous environments. Additional ablations provide insights into how our dual behavior regularized reinforcement learning approach is designed compared with other plausible modifications and demonstrates its ability to generalize.


title: Regularize! Don't Mix: Multi-Agent Reinforcement Learning without Explicit Centralized Structures

abstract: We propose using regularization for Multi-Agent Reinforcement Learning rather than learning explicit cooperative structures called {\em Multi-Agent Regularized Q-learning} (MARQ). Many MARL approaches leverage centralized structures in order to exploit global state information or removing communication constraints when the agents act in a decentralized manner. Instead of learning redundant structures which is removed during agent execution, we propose instead to leverage shared experiences of the agents to regularize the individual policies in order to promote structured exploration. We examine several different approaches to how MARQ can either explicitly or implicitly regularize our policies in a multi-agent setting. MARQ aims to address these limitations in the MARL context through applying regularization constraints which can correct bias in off-policy out-of-distribution agent experiences and promote diverse exploration. Our algorithm is evaluated on several benchmark multi-agent environments and we show that MARQ consistently outperforms several baselines and state-of-the-art algorithms; learning in fewer steps and converging to higher returns.


title: On the well-posedness of a nonlinear diffusive SIR epidemic model

abstract: This work considers an extension of the SIR equations from epidemiology that includes a spatial variable. This model, referred to as the Kermack-McKendrick equations (KM), is a pair of diffusive partial differential equations, and methods developed for the Navier-Stokes equations and models of fluid dynamics are adapted to prove that KM is well-posed in the homogenous Sobolev spaces with exponent $0 \le s <2$.


title: The Unbounded Denominators Conjecture

abstract: We prove the unbounded denominators conjecture in the theory of noncongruence modular forms for finite index subgroups of SL_2(Z). Our result includes also Mason's generalization of the original conjecture to the setting of vector-valued modular forms, thereby supplying a new path to the congruence property in rational conformal field theory. The proof involves a new arithmetic holonomicity bound of a potential-theoretic flavor, together with Nevanlinna's second main theorem, the congruence subgroup property of SL_2(Z[1/p]), and a close description of the Fuchsian uniformization D(0,1)/\Gamma_N of the Riemann surface C \setminus \mu_N.


title: Online Distributed Trajectory Planning for Quadrotor Swarm with Feasibility Guarantee using Linear Safe Corridor

abstract: This paper presents a new online multi-agent trajectory planning algorithm that guarantees to generate safe, dynamically feasible trajectories in a cluttered environment. The proposed algorithm utilizes a linear safe corridor (LSC) to formulate the distributed trajectory optimization problem with only feasible constraints, so it does not resort to slack variables or soft constraints to avoid optimization failure. We adopt a priority-based goal planning method to prevent the deadlock without an additional procedure to decide which robot to yield. The proposed algorithm can compute the trajectories for 60 agents on average 15.5 ms per agent with an Intel i7 laptop and shows a similar flight distance and distance compared to the baselines based on soft constraints. We verified that the proposed method can reach the goal without deadlock in both the random forest and the indoor space, and we validated the safety and operability of the proposed algorithm through a real flight test with ten quadrotors in a maze-like environment.


title: Dilations for operator-valued quantum measures

abstract: This paper concerns the dilations of Banach space operator-valued quantum measures. While the recently developed general dilation theory can lead to a projection (idempotent) valued dilation for any quantum measure over the projection lattice for a von Neumann algebra that dose not contain type $I_{2}$ direct summand, such a dilation does not necessarily guarantee the preservation of countable additivity of the quantum measure. So it remain an open question whether every countably additive $B(X)$-valued quantum measure can be dilated to a countably additive projection-valued measure.The main purpose of this paper is to prove that such a dilation can be constructed if one of the following two conditions is satisfied: (i) the underling Banach space $X = \ell_{p}$ $(1\leq p < 2$) or it has Schur property, (ii) the quantum measure has bounded $p$-variation for some $ 1\leq p < \infty $. All of these were achieved by establishing a non-commutative version of a minimal dilation theory on the so-called elementary dilation space equipping with an appropriate dilation norm. In particular, the newly introduced $p$-variation norm on the elementary dilation space allows us to prove that every operator-valued quantum measure with bounded $p$-variation has a projection-valued quantum measure dilation that preserves the boundedness of the $p$-variation.


title: Composite Likelihood for Stochastic Migration Model with Unobserved Factor

abstract: We introduce the conditional Maximum Composite Likelihood (MCL) estimation method for the stochastic factor ordered Probit model of credit rating transitions of firms. This model is recommended for internal credit risk assessment procedures in banks and financial institutions under the Basel III regulations. Its exact likelihood function involves a high-dimensional integral, which can be approximated numerically before maximization. However, the estimated migration risk and required capital tend to be sensitive to the quality of this approximation, potentially leading to statistical regulatory arbitrage. The proposed conditional MCL estimator circumvents this problem and maximizes the composite log-likelihood of the factor ordered Probit model. We present three conditional MCL estimators of different complexity and examine their consistency and asymptotic normality when n and T tend to infinity. The performance of these estimators at finite T is examined and compared with a granularity-based approach in a simulation study. The use of the MCL estimator is also illustrated in an empirical application.


title: "Don't Downvote A\$\$\$\$\$\$s!!": An Exploration of Reddit's Advice Communities

abstract: Advice forums are a crowdsourced way to reinforce cultural norms and moral behavior. Sites like Reddit contain massive amounts of natural language human interaction, with rules and norms unique to each individual subreddit community. To explore this data, we created a dataset with top 1000 posts from each of two such forums, r/AmItheAsshole and r/relationships, and extracted natural language features including sentiment, similarity, word frequency, and demographics using both algorithmic and manual methods. Further, we developed a method to extract demographic information from the subreddits, examined how the post authors' self-disclosures reflect the unique communities in which their posts are shared, and discussed how the authors' language use choices might be related to broader social patterns. We observed some differences between the subreddits in terms of word frequency, demographics disclosure, and gendered language. In general, both subreddits had more female posters than male, and posters tended to use more words about their opposite gender than the same. Gender-diverse posters were uncommon. Implications for future research include a more careful, inclusive focus on identity and disclosure and how that interacts with advice-seeking behavior in online communities.


title: Binding of curvature-inducing proteins onto tethered vesicles

abstract: A tethered vesicle, which consists of a cylindrical membrane tube and a spherical vesicle, is produced by a mechanical force that is experimentally imposed by optical tweezers and a micropipette. This tethered vesicle is employed for examining the curvature sensing of curvature-inducing proteins. In this study, we clarify how the binding of proteins with a laterally isotropic spontaneous curvature senses and generates the membrane curvatures of the tethered vesicle using mean-field theory and meshless membrane simulation. The force-dependence curves of the protein density in the membrane tube and the tube curvature are reflection symmetric and point symmetric, respectively, from the force point, in which the tube has a sensing curvature. The bending rigidity and spontaneous curvature of the bound proteins can be estimated from these force-dependence curves. First-order transitions can occur between low and high protein densities in the tube at both low and high force amplitudes. The simulation results of the homogeneous phases agree very well with the theoretical predictions. In addition, beaded-necklace-like tubes with microphase separation are found in the simulation.


title: Improving Fairness for Data Valuation in Horizontal Federated Learning

abstract: Federated learning is an emerging decentralized machine learning scheme that allows multiple data owners to work collaboratively while ensuring data privacy. The success of federated learning depends largely on the participation of data owners. To sustain and encourage data owners' participation, it is crucial to fairly evaluate the quality of the data provided by the data owners and reward them correspondingly. Federated Shapley value, recently proposed by Wang et al. [Federated Learning, 2020], is a measure for data value under the framework of federated learning that satisfies many desired properties for data valuation. However, there are still factors of potential unfairness in the design of federated Shapley value because two data owners with the same local data may not receive the same evaluation. We propose a new measure called completed federated Shapley value to improve the fairness of federated Shapley value. The design depends on completing a matrix consisting of all the possible contributions by different subsets of the data owners. It is shown under mild conditions that this matrix is approximately low-rank by leveraging concepts and tools from optimization. Both theoretical analysis and empirical evaluation verify that the proposed measure does improve fairness in many circumstances.


title: Model-Free Safety-Critical Control for Robotic Systems

abstract: This paper presents a framework for the safety-critical control of robotic systems, when safety is defined on safe regions in the configuration space. To maintain safety, we synthesize a safe velocity based on control barrier function theory without relying on a -- potentially complicated -- high-fidelity dynamical model of the robot. Then, we track the safe velocity with a tracking controller. This culminates in model-free safety critical control. We prove theoretical safety guarantees for the proposed method. Finally, we demonstrate that this approach is application-agnostic. We execute an obstacle avoidance task with a Segway in high-fidelity simulation, as well as with a Drone and a Quadruped in hardware experiments.


title: A framework for benchmarking uncertainty in deep regression

abstract: We propose a framework for the assessment of uncertainty quantification in deep regression. The framework is based on regression problems where the regression function is a linear combination of nonlinear functions. Basically, any level of complexity can be realized through the choice of the nonlinear functions and the dimensionality of their domain. Results of an uncertainty quantification for deep regression are compared against those obtained by a statistical reference method. The reference method utilizes knowledge of the underlying nonlinear functions and is based on a Bayesian linear regression using a reference prior. Reliability of uncertainty quantification is assessed in terms of coverage probabilities, and accuracy through the size of calculated uncertainties. We illustrate the proposed framework by applying it to current approaches for uncertainty quantification in deep regression. The flexibility, together with the availability of a reference solution, makes the framework suitable for defining benchmark sets for uncertainty quantification.


title: Tests for Group-Specific Heterogeneity in High-Dimensional Factor Models

abstract: Standard high-dimensional factor models assume that the comovements in a large set of variables could be modeled using a small number of latent factors that affect all variables. In many relevant applications in economics and finance, heterogenous comovements specific to some known groups of variables naturally arise, and reflect distinct cyclical movements within those groups. This paper develops two new statistical tests that can be used to investigate whether there is evidence supporting group-specific heterogeneity in the data. The first test statistic is designed for the alternative hypothesis of group-specific heterogeneity appearing in at least one pair of groups; the second is for the alternative of group-specific heterogeneity appearing in all pairs of groups. We show that the second moment of factor loadings changes across groups when heterogeneity is present, and use this feature to establish the theoretical validity of the tests. We also propose and prove the validity of a permutation approach for approximating the asymptotic distributions of the two test statistics. The simulations and the empirical financial application indicate that the proposed tests are useful for detecting group-specific heterogeneity.


title: Cosets of free field algebras via arc spaces

abstract: Using the invariant theory of arc spaces, we find minimal strong generating sets for certain cosets of affine vertex algebras inside free field algebras that are related to classical Howe duality. These results have several applications. First, for any vertex algebra $\mathcal V$, we have a surjective homomorphism of differential algebras $\mathbb{C}[J_{\infty}(X_{\mathcal V})] \rightarrow \text{gr}^F(\mathcal V)$; equivalently, the singular support of $\mathcal V$ is a closed subscheme of the arc space of the associated scheme $X_{\mathcal V}$. We give many new examples of classically free vertex algebras (i.e., this map is an isomorphism), including $L_k(\mathfrak{sp}_{2n})$ for all positive integers $n$ and $k$. We also give new examples where the kernel of this map is nontrivial but is finitely generated as a differential ideal. Next, we prove a coset realization of the subregular ${\mathcal W}$-algebra of $\mathfrak{sl}_n$ at critical level that was previously conjectured by Creutzig, Gao, and the first author. Finally, we give some new level-rank dualities involving affine vertex superalgebras.


title: On Infinite Families of Narrow-Sense Antiprimitive BCH Codes Admitting 3-Transitive Automorphism Groups and their Consequences

abstract: The Bose-Chaudhuri-Hocquenghem (BCH) codes are a well-studied subclass of cyclic codes that have found numerous applications in error correction and notably in quantum information processing. A subclass of attractive BCH codes is the narrow-sense BCH codes over the Galois field $\mathrm{GF}(q)$ with length $q+1$, which are closely related to the action of the projective general linear group of degree two on the projective line. This paper aims to study some of the codes within this class and specifically narrow-sense antiprimitive BCH codes (these codes are also linear complementary duals (LCD) codes that have interesting practical recent applications in cryptography, among other benefits). We shall use tools and combine arguments from algebraic coding theory, combinatorial designs, and group theory (group actions, representation theory of finite groups, etc.) to investigate narrow-sense antiprimitive BCH Codes and extend results from the recent literature. Notably, the dimension, the minimum distance of some $q$-ary BCH codes with length $q+1$, and their duals are determined in this paper. The dual codes of the narrow-sense antiprimitive BCH codes derived in this paper include almost MDS codes. Furthermore, the classification of $\mathrm{PGL} (2, p^m)$-invariant codes over $\mathrm{GF} (p^h)$ is completed. As an application of this result, the $p$-ranks of all incidence structures invariant under the projective general linear group $\mathrm{ PGL }(2, p^m)$ are determined. Furthermore, infinite families of narrow-sense BCH codes admitting a $3$-transitive automorphism group are obtained. Via these BCH codes, a coding-theory approach to constructing the Witt spherical geometry designs is presented. The BCH codes proposed in this paper are good candidates for permutation decoding, as they have a relatively large group of automorphisms.


title: Object Tracking by Jointly Exploiting Frame and Event Domain

abstract: Inspired by the complementarity between conventional frame-based and bio-inspired event-based cameras, we propose a multi-modal based approach to fuse visual cues from the frame- and event-domain to enhance the single object tracking performance, especially in degraded conditions (e.g., scenes with high dynamic range, low light, and fast-motion objects). The proposed approach can effectively and adaptively combine meaningful information from both domains. Our approach's effectiveness is enforced by a novel designed cross-domain attention schemes, which can effectively enhance features based on self- and cross-domain attention schemes; The adaptiveness is guarded by a specially designed weighting scheme, which can adaptively balance the contribution of the two domains. To exploit event-based visual cues in single-object tracking, we construct a large-scale frame-event-based dataset, which we subsequently employ to train a novel frame-event fusion based model. Extensive experiments show that the proposed approach outperforms state-of-the-art frame-based tracking methods by at least 10.4% and 11.9% in terms of representative success rate and precision rate, respectively. Besides, the effectiveness of each key component of our approach is evidenced by our thorough ablation study.


title: Macroscopic limits of chaotic eigenfunctions

abstract: We give an overview of the interplay between the behavior of high energy eigenfunctions of the Laplacian on a compact Riemannian manifold and the dynamical properties of the geodesic flow on that manifold. This includes the Quantum Ergodicity theorem, the Quantum Unique Ergodicity conjecture, entropy bounds, and uniform lower bounds on mass of eigenfunctions. The above results belong to the domain of quantum chaos and use microlocal analysis, which is a theory behind the classical/quantum, or particle/wave, correspondence in physics. We also discuss the toy model of quantum cat maps and the challenges it poses for Quantum Unique Ergodicity.


title: Hybrid Beamforming for RIS-Aided Communications: Fitness Landscape Analysis and Niching Genetic Algorithm

abstract: Reconfigurable Intelligent Surface (RIS) is a revolutionizing approach to provide cost-effective yet energy-efficient communications. The transmit beamforming of the base station (BS) and discrete phase shifts of the RIS are jointly optimized to provide high quality of service. However, existing works ignore the high dependence between the large number of phase shifts and estimate them separately, consequently, easily getting trapped into local optima. To investigate the number and distribution of local optima, we conduct a fitness landscape analysis on the sum rate maximization problems. Two landscape features, the fitness distribution correlation and autocorrelation, are employed to investigate the ruggedness of landscape. The investigation results indicate that the landscape exhibits a rugged, multi-modal structure, i.e., has many local peaks, particularly in the cases with large-scale RISs. To handle the multi-modal landscape structure, we propose a novel niching genetic algorithm to solve the sum rate maximization problem. Particularly, a niching technique, nearest-better clustering, is incorporated to partition the population into several neighborhood species, thereby locating multiple local optima and enhance the global search ability. We also present a minimum species size to further improve the convergence speed. Simulation results demonstrate that our method achieves significant capacity gains compared to existing algorithms, particularly in the cases with large-scale RISs.


title: Combining Learning and Control for Data-driven Approaches of Cyber-Physical Systems

abstract: Cyber-physical systems (CPS), in most instances, represent systems of systems with an informationally decentralized structure such as emerging mobility systems, networked control systems, sustainable manufacturing, smart power grids, power systems, mobility markets, social media platforms, cooperation of robots, and internet of things. To optimize the operation of such systems, we typically assume an ideal model. Such model-based control approaches cannot effectively facilitate optimal solutions with performance guarantees due to the discrepancy between the model and the actual CPS. On the other hand, in most CPS there is a large volume of data with a dynamic nature which is added to the system gradually in real time and not altogether in advance. Thus, traditional supervised learning approaches cannot always facilitate robust solutions using data derived offline. By contrast, applying reinforcement learning approaches directly to the actual CPS might impose significant implications on the safety and robust operation of the system. The overarching goal of the Information and Decision Science (IDS) Lab is to investigate how to circumvent these challenges by developing data-driven system approaches at the intersection of learning and control. The emphasis is on how to improve energy efficiency and reduce greenhouse gas emissions in applications related to emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, sociotechnical systems, and smart cities, and thus contribute to the health of the planet.


title: Enabling particle applications for exascale computing platforms

abstract: The Exascale Computing Project (ECP) is invested in co-design to assure that key applications are ready for exascale computing. Within ECP, the Co-design Center for Particle Applications (CoPA) is addressing challenges faced by particle-based applications across four sub-motifs: short-range particle-particle interactions (e.g., those which often dominate molecular dynamics (MD) and smoothed particle hydrodynamics (SPH) methods), long-range particle-particle interactions (e.g., electrostatic MD and gravitational N-body), particle-in-cell (PIC) methods, and linear-scaling electronic structure and quantum molecular dynamics (QMD) algorithms. Our crosscutting co-designed technologies fall into two categories: proxy applications (or apps) and libraries. Proxy apps are vehicles used to evaluate the viability of incorporating various types of algorithms, data structures, and architecture-specific optimizations and the associated trade-offs; examples include ExaMiniMD, CabanaMD, CabanaPIC, and ExaSP2. Libraries are modular instantiations that multiple applications can utilize or be built upon; CoPA has developed the Cabana particle library, PROGRESS/BML libraries for QMD, and the SWFFT and fftMPI parallel FFT libraries. Success is measured by identifiable lessons learned that are translated either directly into parent production application codes or into libraries, with demonstrated performance and/or productivity improvement. The libraries and their use in CoPA's ECP application partner codes are also addressed.


title: Knowledge-Enhanced Evidence Retrieval for Counterargument Generation

abstract: Finding counterevidence to statements is key to many tasks, including counterargument generation. We build a system that, given a statement, retrieves counterevidence from diverse sources on the Web. At the core of this system is a natural language inference (NLI) model that determines whether a candidate sentence is valid counterevidence or not. Most NLI models to date, however, lack proper reasoning abilities necessary to find counterevidence that involves complex inference. Thus, we present a knowledge-enhanced NLI model that aims to handle causality- and example-based inference by incorporating knowledge graphs. Our NLI model outperforms baselines for NLI tasks, especially for instances that require the targeted inference. In addition, this NLI model further improves the counterevidence retrieval system, notably finding complex counterevidence better.


title: Mesons and Baryons: Parity Partners

abstract: We calculate masses of light and heavy mesons as well as baryons of negative parity containing $u,d,s,c$ and $b$ quarks. It is an extension of our previous work where we had studied the positive parity baryons. We adopt a quark-diquark picture of baryons where the diquarks are non-pointlike with a finite spatial extension. The mathematical foundation for this analysis is implemented through a symmetry-preserving Schwinger-Dyson equations treatment of a vector-vector contact interaction, which preserves key features of quantum chromodynamics, such as confinement, chiral symmetry breaking, axial vector Ward-Takahashi identity and low-energy Goldberger-Treiman relations. This treatment simultaneously describes mesons and provides attractive correlations for diquarks in the $\overline{3}$ representation. Employing this model, we compute the spectrum and masses of all spin-1/2 and spin-3/2 baryons of negative parity, supplementing our earlier evaluation of positive parity baryons, containing 1, 2 or 3 heavy quarks. In the process, we calculate masses of a multitude of mesons and corresponding diquarks. Wherever possible, we make comparisons of our results with known experimental observations as well as theoretical predictions of several models and approaches including lattice quantum chromodynamics, finding satisfactory agreement. We also make predictions for heavier states not yet observed in the experiment.


title: A simple transcendental travelling wave solution and stability study for the thermophoretic motion with variable heat transmission factors on substrate-supported grapheme sheet

abstract: Manually tailored wrinkled graphene sheets hold great promise in fabricating smart solid-state devices. In this paper, we employ an energy method to transform the original third-order partial differential equation (pde), i.e. Eq. (1) into the first-order pde, i.e. Eq. (8) for the thermophoretic motion of substrate-supported graphene sheets, which can be solved in terms of semi-group and transcendental solutions. Unlike soliton solutions derived using other more sophisticated techniques [9, 23], the present transcendental solution can be easily solved numerically and provides physical insights. Most importantly, we verify that the formation of various forms for wrinkling wave solutions can be determined by the evolution of equilibrium points for Eq. (1). This sheds a light on modifying the heat sources in order to control the configuration of wrinkle waves that has not been previously addressed.


title: On the Noise Stability and Robustness of Adversarially Trained Networks on NVM Crossbars

abstract: Applications based on Deep Neural Networks (DNNs) have grown exponentially in the past decade. To match their increasing computational needs, several Non-Volatile Memory (NVM) crossbar based accelerators have been proposed. Recently, researchers have shown that apart from improved energy efficiency and performance, such approximate hardware also possess intrinsic robustness for defense against adversarial attacks. Prior works quantified this intrinsic robustness for vanilla DNNs trained on unperturbed inputs. However, adversarial training of DNNs is the benchmark technique for robustness, and sole reliance on intrinsic robustness of the hardware may not be sufficient. In this work, we explore the design of robust DNNs through the amalgamation of adversarial training and intrinsic robustness of NVM crossbar-based analog hardware. First, we study the noise stability of such networks on unperturbed inputs and observe that internal activations of adversarially trained networks have lower Signal-to-Noise Ratio (SNR), and are sensitive to noise compared to vanilla networks. As a result, they suffer on average 2x performance degradation due to the approximate computations on analog hardware. Noise stability analyses show the instability of adversarially trained DNNs. On the other hand, for adversarial images generated using Square Black Box attacks, ResNet-10/20 adversarially trained on CIFAR-10/100 display a robustness gain of 20-30%. For adversarial images generated using Projected-Gradient-Descent (PGD) White-Box attacks, adversarially trained DNNs present a 5-10% gain in robust accuracy due to underlying NVM crossbar when $\epsilon_{attack}$ is greater than $\epsilon_{train}$. Our results indicate that implementing adversarially trained networks on analog hardware requires careful calibration between hardware non-idealities and $\epsilon_{train}$ for optimum robustness and performance.


title: Model-Based Approach for Measuring the Fairness in ASR

abstract: The issue of fairness arises when the automatic speech recognition (ASR) systems do not perform equally well for all subgroups of the population. In any fairness measurement studies for ASR, the open questions of how to control the nuisance factors, how to handle unobserved heterogeneity across speakers, and how to trace the source of any word error rate (WER) gap among different subgroups are especially important - if not appropriately accounted for, incorrect conclusions will be drawn. In this paper, we introduce mixed-effects Poisson regression to better measure and interpret any WER difference among subgroups of interest. Particularly, the presented method can effectively address the three problems raised above and is very flexible to use in practical disparity analyses. We demonstrate the validity of proposed model-based approach on both synthetic and real-world speech data.


title: Room-temperature biphoton source with a spectral brightness near the ultimate limit

abstract: The biphotons, generated from a hot atomic vapor via the process of spontaneous four-wave mixing (SFWM), have the following merits: stable and tunable frequencies as well as linewidth. Such merits are very useful in the applications of long-distance quantum communication. However, the hot-atom SFWM biphoton sources previously had far lower values of generation rate per linewidth, i.e., spectral brightness, as compared with the sources of biphotons generated by the spontaneous parametric down conversion (SPDC) process. Here, we report a hot-atom SFWM source of biphotons with a linewidth of 960 kHz and a generation rate of 3.7$\times$ $10^5$ pairs/s. The high generation rate, together with the narrow linewidth, results in a spectral brightness of 3.8$\times$ $10^5$ pairs/s/MHz, which is 17 times of the previous best result with atomic vapors and also better than all known results with all kinds of media. The all-copropagating scheme together with a large optical depth (OD) of the atomic vapor is the key improvement, enabling the achieved spectral brightness to be about one quarter of the ultimate limit. Furthermore, this biphoton source had a signal-to-background ratio (SBR) of 2.7, which violated the Cauchy-Schwartz inequality for classical light by about 3.6 folds. Although an increasing spectral brightness usually leads to a decreasing SBR, our systematic study indicates that both of the present spectral brightness and SBR can be enhanced by further increasing the OD. This work demonstrates a significant advancement and provides useful knowledge in the quantum technology using photons.


title: Ontology-based n-ball Concept Embeddings Informing Few-shot Image Classification

abstract: We propose a novel framework named ViOCE that integrates ontology-based background knowledge in the form of $n$-ball concept embeddings into a neural network based vision architecture. The approach consists of two components - converting symbolic knowledge of an ontology into continuous space by learning n-ball embeddings that capture properties of subsumption and disjointness, and guiding the training and inference of a vision model using the learnt embeddings. We evaluate ViOCE using the task of few-shot image classification, where it demonstrates superior performance on two standard benchmarks.


title: Development of a Tracklet Extraction Engine

abstract: An efficient algorithm is required to extract moving objects (asteroids, satellites, and space debris) from enormous data with advances in observational instruments. We have developed an algorithm, tracee, to swiftly detect points aligned as a line segment from a three-dimensional space. The algorithm consists of two steps; First, construct a k-nearest neighbor graph of given points, and then extract colinear line segments by grouping. The proposed algorithm is robust against distractors and works properly even when line segments are crossed. While the algorithm is originally developed for moving object detection, it can be used for other purposes.


title: An Improved Scheduling Algorithm for Traveling Tournament Problem with Maximum Trip Length Two

abstract: The Traveling Tournament Problem(TTP) is a combinatorial optimization problem where we have to give a scheduling algorithm which minimizes the total distance traveled by all the participating teams of a double round-robin tournament maintaining given constraints. Most of the instances of this problem with more than ten teams are still unsolved. By definition of the problem the number of teams participating has to be even. There are different variants of this problem depending on the constraints. In this problem, we consider the case where number of teams is a multiple of four and a team can not play more than two consecutive home or away matches. Our scheduling algorithm gives better result than the existing best result for number of teams less or equal to 32.


title: Positive Radial Solutions for an Iterative System of Nonlinear Elliptic Equations in an Annulus

abstract: This paper deals with the existence of positive radial solutions to the iterative system of nonlinear elliptic equations of the form $$ \begin{aligned} \triangle{\mathtt{u}_{{\dot{\iota}} }}-\frac{(\mathtt{N}-2)^2r_0^{2\mathtt{N}-2}}{\vert x\vert^{2\mathtt{N}-2}}\mathtt{u}_{\dot{\iota}} +\ell(\vert x\vert)\mathtt{g}_{{\dot{\iota}} }(\mathtt{u}_{{\dot{\iota}} +1})=0,~\mathtt{R}_1<\vert x\vert<\mathtt{R}_2, \end{aligned} $$ where ${\dot{\iota}} \in\{1,2,3,\cdot\cdot\cdot,\mathtt{n}\},$ $ \mathtt{u}_1= \mathtt{u}_{\mathtt{n}+1},$ $\triangle{\mathtt{u}}=\mathtt{div}(\triangledown \mathtt{u}),$ $\mathtt{N}>2,$ $\ell=\prod_{i=1}^{m}\ell_i,$ each $\ell_i:(r_0,+\infty)\to(0,+\infty)$ is continuous, $r^{\mathtt{N}-1}\ell$ is integrable, and $\mathtt{g}_{\dot{\iota}} :[0,+\infty)\to\mathbb{R}$ is continuous, by an application of various fixed point theorems in a Banach space. Further, we also establish uniqueness of solution to the addressed system by using Rus's theorem in a complete metric space.


title: Resonance frequency of different interfacial modes and steady streaming by a slug trapped at one end of a millichannel

abstract: Active micropumping and micromixing using oscillating bubbles form the basis for various Lab-on-chip applications. Acoustically excited oscillatory bubbles are commonly used in active particle sorting, micropumping, micromixing, ultrasonic imaging, cell lysis and rotation. For efficient micromixing, the system must be operated at its resonant frequency where amplitude of oscillation is maximum. This ensures that high-intensity cavitation microstreaming is generated. In this work, we determine the resonant frequencies for the different surface modes of oscillation of a rectangular gas slug confined at one end of a millichannel using perturbation techniques and matched asymptotic expansions. We explicitly specify the oscillation frequency of the interface and compute the surface mode amplitudes from the interface deformation. This oscillatory flow field at the leading order is also determined. The effect of aspect ratio of gas slug on observable streaming is analysed. The predictions of surface modes from perturbation theory are validated with simulations of the system done in ANSYS Fluent.


title: Channel Estimation in MIMO Systems with One-bit Spatial Sigma-delta ADCs

abstract: This paper focuses on channel estimation in single-user and multi-user MIMO systems with multi-antenna base stations equipped with 1-bit spatial sigma-delta analog-to-digital converters (ADCs). A careful selection of the quantization voltage level and phase shift used in the feedback loop of 1-bit sigma-delta ADCs is critical to improve its effective resolution. We first develop a quantization noise model for 1-bit spatial sigma-delta ADCs. Using the developed noise model, we then present a two-step channel estimation algorithm to estimate a multipath channel parameterized by the gains, angles of arrival (AoAs), and angles of departure (AoDs). Specifically, in the first step, the AoAs and path gains are estimated using uplink pilots, which excite all the angles uniformly. Next, in the second step, the AoDs are estimated by progressively refining uplink beams through a recursive bisection procedure. For this algorithm, we propose a technique to select the quantization voltage level and phase shift. Through numerical simulations, we demonstrate that with the proposed parametric channel estimation algorithm, MIMO systems with 1-bit spatial sigma-delta ADCs perform significantly better than those with regular 1-bit ADCs and are on par with MIMO systems with high-resolution ADCs.


title: The Variety of Projection of a Tree-Prikry Forcing

abstract: We study which $\kappa$-distributive forcing notions of size $\kappa$ can be embedded into tree Prikry forcing notions with $\kappa$-complete ultrafilters under various large cardinal assumptions. An alternative formulation -- can the filter of dense open subsets of a $\kappa$-distributive forcing notion of size $\kappa$ be extended to a $\kappa$-complete ultrafilter.


title: The Bessel Line Ensemble

abstract: In this paper, we construct the Bessel line ensemble, a countable collection of continuous random curves. This line ensemble is stationary under horizontal shifts with the Bessel point process as its one-time marginal. Its finite dimensional distributions are given by the extended Bessel kernel. Furthermore, it enjoys a novel resampling invariance with respect to non-intersecting squared Bessel bridges. The Bessel line ensemble is constructed by extracting the hard edge scaling limit of a collection of independent squared Bessel processes starting at the origin and never being conditioned to intersect. This process is also known as the Dyson Bessel process, and it arises as the evolution of the eigenvalues of the Laguerre unitary ensemble with i.i.d. complex Brownian entries.


title: Simple and Efficient Unpaired Real-world Super-Resolution using Image Statistics

abstract: Learning super-resolution (SR) network without the paired low resolution (LR) and high resolution (HR) image is difficult because direct supervision through the corresponding HR counterpart is unavailable. Recently, many real-world SR researches take advantage of the unpaired image-to-image translation technique. That is, they used two or more generative adversarial networks (GANs), each of which translates images from one domain to another domain, \eg, translates images from the HR domain to the LR domain. However, it is not easy to stably learn such a translation with GANs using unpaired data. In this study, we present a simple and efficient method of training of real-world SR network. To stably train the network, we use statistics of an image patch, such as means and variances. Our real-world SR framework consists of two GANs, one for translating HR images to LR images (degradation task) and the other for translating LR to HR (SR task). We argue that the unpaired image translation using GANs can be learned efficiently with our proposed data sampling strategy, namely, variance matching. We test our method on the NTIRE 2020 real-world SR dataset. Our method outperforms the current state-of-the-art method in terms of the SSIM metric as well as produces comparable results on the LPIPS metric.


title: Probing Quantum Gravity with Imaging Atmospheric Cherenkov Telescopes

abstract: High energy photons from astrophysical sources are unique probes for some predictions of candidate theories of Quantum Gravty (QG). In particular, imaging atmospheric Cherenkov telescopes (IACTs) are instruments optimised for astronomical observations in the energy range spanning from a few tens of GeV to ~100 TeV, which makes them excellent instruments to search for effects of QG. In this article, we will review QG effects which can be tested with IACTs, most notably the Lorentz invariance violation and its consequences. It is often represented and modelled with photon dispersion relation modified by introducing energy-dependent terms. We will describe the analysis methods employed in the different studies, allowing for careful discussion and comparison of the results obtained with IACTs for more than two decades. Loosely following historical development of the field, we will observe how the analysis methods were refined and improved over time, and analyse why some studies were more sensitive than others. Finally, we will discuss the future of the field, presenting ideas for improving the analysis sensitivity and directions in which the research could develop.


title: Mind the Gap: Reimagining an Interactive Programming Course for the Synchronous Hybrid Classroom

abstract: COVID-19 has significantly affected universities, forcing many courses to be delivered entirely online. As countries bring the pandemic under control, a potential way to safely resume some face-to-face teaching is the synchronous hybrid classroom, in which physically and remotely attending students are taught simultaneously. This comes with challenges, however, including the risk that remotely attending students perceive a 'gap' between their engagement and that of their physical peers. In this experience report, we describe how an interactive programming course was adapted to hybrid delivery in a way that mitigated this risk. Our solution centred on the use of a professional communication platform - Slack - to equalise participation opportunities and to facilitate peer learning. Furthermore, to mitigate 'Zoom fatigue', we implemented a semi-flipped classroom, covering concepts in videos and using shorter lessons to consolidate them. Finally, we critically reflect on the results of a student survey and our own experiences of implementing the solution.


title: Efficient Urban-scale Point Clouds Segmentation with BEV Projection

abstract: Point clouds analysis has grasped researchers' eyes in recent years, while 3D semantic segmentation remains a problem. Most deep point clouds models directly conduct learning on 3D point clouds, which will suffer from the severe sparsity and extreme data processing load in urban-scale data. To tackle the challenge, we propose to transfer the 3D point clouds to dense bird's-eye-view projection. In this case, the segmentation task is simplified because of class unbalance reduction and the feasibility of leveraging various 2D segmentation methods. We further design an attention-based fusion network that can conduct multi-modal learning on the projected images. Finally, the 2D out are remapped to generate 3D semantic segmentation results. To demonstrate the benefits of our method, we conduct various experiments on the SensatUrban dataset, in which our model presents competitive evaluation results (61.17% mIoU and 91.37% OverallAccuracy). We hope our work can inspire further exploration in point cloud analysis.


title: Adversarial Training with Contrastive Learning in NLP

abstract: For years, adversarial training has been extensively studied in natural language processing (NLP) settings. The main goal is to make models robust so that similar inputs derive in semantically similar outcomes, which is not a trivial problem since there is no objective measure of semantic similarity in language. Previous works use an external pre-trained NLP model to tackle this challenge, introducing an extra training stage with huge memory consumption during training. However, the recent popular approach of contrastive learning in language processing hints a convenient way of obtaining such similarity restrictions. The main advantage of the contrastive learning approach is that it aims for similar data points to be mapped close to each other and further from different ones in the representation space. In this work, we propose adversarial training with contrastive learning (ATCL) to adversarially train a language processing task using the benefits of contrastive learning. The core idea is to make linear perturbations in the embedding space of the input via fast gradient methods (FGM) and train the model to keep the original and perturbed representations close via contrastive learning. In NLP experiments, we applied ATCL to language modeling and neural machine translation tasks. The results show not only an improvement in the quantitative (perplexity and BLEU) scores when compared to the baselines, but ATCL also achieves good qualitative results in the semantic level for both tasks without using a pre-trained model.


title: Towards Representation Learning for Atmospheric Dynamics

abstract: The prediction of future climate scenarios under anthropogenic forcing is critical to understand climate change and to assess the impact of potentially counter-acting technologies. Machine learning and hybrid techniques for this prediction rely on informative metrics that are sensitive to pertinent but often subtle influences. For atmospheric dynamics, a critical part of the climate system, no well established metric exists and visual inspection is currently still often used in practice. However, this "eyeball metric" cannot be used for machine learning where an algorithmic description is required. Motivated by the success of intermediate neural network activations as basis for learned metrics, e.g. in computer vision, we present a novel, self-supervised representation learning approach specifically designed for atmospheric dynamics. Our approach, called AtmoDist, trains a neural network on a simple, auxiliary task: predicting the temporal distance between elements of a randomly shuffled sequence of atmospheric fields (e.g. the components of the wind field from reanalysis or simulation). The task forces the network to learn important intrinsic aspects of the data as activations in its layers and from these hence a discriminative metric can be obtained. We demonstrate this by using AtmoDist to define a metric for GAN-based super resolution of vorticity and divergence. Our upscaled data matches both visually and in terms of its statistics a high resolution reference closely and it significantly outperform the state-of-the-art based on mean squared error. Since AtmoDist is unsupervised, only requires a temporal sequence of fields, and uses a simple auxiliary task, it has the potential to be of utility in a wide range of applications.


title: DECORAS: detection and characterization of radio-astronomical sources using deep learning

abstract: We present DECORAS, a deep learning based approach to detect both point and extended sources from Very Long Baseline Interferometry (VLBI) observations. Our approach is based on an encoder-decoder neural network architecture that uses a low number of convolutional layers to provide a scalable solution for source detection. In addition, DECORAS performs source characterization in terms of the position, effective radius and peak brightness of the detected sources. We have trained and tested the network with images that are based on realistic Very Long Baseline Array (VLBA) observations at 20 cm. Also, these images have not gone through any prior de-convolution step and are directly related to the visibility data via a Fourier transform. We find that the source catalog generated by DECORAS has a better overall completeness and purity, when compared to a traditional source detection algorithm. DECORAS is complete at the 7.5$\sigma$ level, and has an almost factor of two improvement in reliability at 5.5$\sigma$. We find that DECORAS can recover the position of the detected sources to within 0.61 $\pm$ 0.69 mas, and the effective radius and peak surface brightness are recovered to within 20 per cent for 98 and 94 per cent of the sources, respectively. Overall, we find that DECORAS provides a reliable source detection and characterization solution for future wide-field VLBI surveys.


title: Making the Most of Parallel Composition in Differential Privacy

abstract: We show that the `optimal' use of the parallel composition theorem corresponds to finding the size of the largest subset of queries that `overlap' on the data domain, a quantity we call the \emph{maximum overlap} of the queries. It has previously been shown that a certain instance of this problem, formulated in terms of determining the sensitivity of the queries, is NP-hard, but also that it is possible to use graph-theoretic algorithms, such as finding the maximum clique, to approximate query sensitivity. In this paper, we consider a significant generalization of the aforementioned instance which encompasses both a wider range of differentially private mechanisms and a broader class of queries. We show that for a particular class of predicate queries, determining if they are disjoint can be done in time polynomial in the number of attributes. For this class, we show that the maximum overlap problem remains NP-hard as a function of the number of queries. However, we show that efficient approximate solutions exist by relating maximum overlap to the clique and chromatic numbers of a certain graph determined by the queries. The link to chromatic number allows us to use more efficient approximate algorithms, which cannot be done for the clique number as it may underestimate the privacy budget. Our approach is defined in the general setting of $f$-differential privacy, which subsumes standard pure differential privacy and Gaussian differential privacy. We prove the parallel composition theorem for $f$-differential privacy. We evaluate our approach on synthetic and real-world data sets of queries. We show that the approach can scale to large domain sizes (up to $10^{20000}$), and that its application can reduce the noise added to query answers by up to 60\%.


title: Active Information Acquisition under Arbitrary Unknown Disturbances

abstract: Trajectory optimization of sensing robots to actively gather information of targets has received much attention in the past. It is well-known that under the assumption of linear Gaussian target dynamics and sensor models the stochastic Active Information Acquisition problem is equivalent to a deterministic optimal control problem. However, the above-mentioned assumptions regarding the target dynamic model are limiting. In real-world scenarios, the target may be subject to disturbances whose models or statistical properties are hard or impossible to obtain. Typical scenarios include abrupt maneuvers, jumping disturbances due to interactions with the environment, anomalous misbehaviors due to system faults/attacks, etc. Motivated by the above considerations, in this paper we consider targets whose dynamic models are subject to arbitrary unknown inputs whose models or statistical properties are not assumed to be available. In particular, with the aid of an unknown input decoupled filter, we formulate the sensor trajectory planning problem to track evolution of the target state and analyse the resulting performance for both the state and unknown input evolution tracking. Inspired by concepts of Reduced Value Iteration, a suboptimal solution that expands a search tree via Forward Value Iteration with informativeness-based pruning is proposed. Concrete suboptimality performance guarantees for tracking both the state and the unknown input are established. Numerical simulations of a target tracking example are presented to compare the proposed solution with a greedy policy.


title: Instability of Holographic Superfuids in Optical Lattice

abstract: The instability of superfluids in optical lattice has been investigated using the holographic model. The static and steady flow solutions are numerically obtained from the static equations of motion and the solutions are described as Bloch waves with different Bloch wave vector $k$. Based on these Bloch waves, the instability is investigated at two levels. At the linear perturbation level, we show that there is a critical $k_{c}$ above which the superflow is unstable. At the fully nonlinear level, the intermediate state and final state of unstable superflow are identified through numerical simulation of the full equations of motion. The results show that during the time evolution, the unstable superflow will undergo a chaotic state, where solitons will appear and disappear. The system will settle down to a stable state with $k<k_{c}$ eventually, with a smaller current and a larger condensate.


title: Shock Physics in Warm Dense Matter--a quantum hydrodynamics perspective

abstract: Warm dense matter (WDM)--an exotic, highly compressed state of matter between solid and plasma phases is of high current interest, in particular for astrophysics and inertial confinement fusion. For the latter, in particular the propagation of compression shocks is crucial. The main unknown in the shock propagation in WDM is the behavior of the electrons since they are governed by correlations, quantum and spin effects that need to be accounted for simultaneously. Here we describe the shock dynamics of the warm dense electron gas using a quantum hydrodynamic model. From the numerical hydrodynamic simulations we observe that the quantum Bohm pressure induces shear force which weakens the formation and strength of the shock. This is confirmed by the theoretical analysis of the early stage of the shock formation. Our theoretical and numerical analysis allows us to identify characteristic dimensionless shock propagation parameters at which the effect of the Bohm force is important.


title: On the convergence and applications of the inertial-like method for null-point problems

abstract: In this paper, we propose two novel inertial-like algorithms for solving the split common null point problem (SCNPP) with respect to set-valued maximal operators. The features of the presented algorithm are using new inertial structure (i.e, the design of the new inertial-like method does neither involve computation of the norm of the difference between $x_n$ and $x_{n-1}$ in advance, nor need to consider the special value of the inertial parameter $\theta_n$ to make the condition $\sum_{n=1}^\infty \alpha_n\|x_n-x_{n-1}\|^2<\infty$ valid) and the selection of the step-sizes does not need prior knowledge of operator norms. Numerical experiments are presented to illustrate the performance of the algorithms.


title: Towards robustness under occlusion for face recognition

abstract: In this paper, we evaluate the effects of occlusions in the performance of a face recognition pipeline that uses a ResNet backbone. The classifier was trained on a subset of the CelebA-HQ dataset containing 5,478 images from 307 classes, to achieve top-1 error rate of 17.91%. We designed 8 different occlusion masks which were applied to the input images. This caused a significant drop in the classifier performance: its error rate for each mask became at least two times worse than before. In order to increase robustness under occlusions, we followed two approaches. The first is image inpainting using the pre-trained pluralistic image completion network. The second is Cutmix, a regularization strategy consisting of mixing training images and their labels using rectangular patches, making the classifier more robust against input corruptions. Both strategies revealed effective and interesting results were observed. In particular, the Cutmix approach makes the network more robust without requiring additional steps at the application time, though its training time is considerably longer. Our datasets containing the different occlusion masks as well as their inpainted counterparts are made publicly available to promote research on the field.


title: Superionic states formation in group III oxides irradiated with ultrafast lasers

abstract: A number of group III-metal oxides are studied via density functional theory in order to establish a possibility of nonthermal transition of these materials into a superionic state. Atomic and electronic properties of the materials are analyzed during the transitions to acquire insights into physical mechanisms guiding such transformations. This knowledge is then used to suggest a criterion allowing to predict the possibility of such transitions without employing computationally heavy methods.


title: Finding $K$ dissimilar paths using integer linear formulations

abstract: While finding a path between two nodes is the basis for several applications, the need for alternative paths also may have various motivations. For instance, this can be of interest for ensuring reliability in a telecommunications network, for reducing the consequences of possible accidents in the transportation of hazardous materials, or to decrease the risk of robberies in money distribution. Each of these applications has particular characteristics, but they all have the common purpose of searching for a set of paths which are as dissimilar as possible with respect to the nodes/arcs that compose them. In this work we present linear integer programming formulations for finding $K$ dissimilar paths, with the main goal of preventing the overlap of arcs in the paths for a given integer $K$. The different formulations are tested for randomly generated general networks and for grid networks. The obtained results are compared in terms of the solutions' dissimilarity and of the run time. Two of the new formulations are able to find 10 paths with better average and minimum dissimilarity values than an iterative approach in the literature, in less than 20 seconds, for random networks with 500 nodes and 5000 arcs.


title: Embedding Model Based Fast Meta Learning for Downlink Beamforming Adaptation

abstract: This paper studies the fast adaptive beamforming for the multiuser multiple-input single-output downlink. Existing deep learning-based approaches assume that training and testing channels follow the same distribution which causes task mismatch, when the testing environment changes. Although meta learning can deal with the task mismatch, it relies on labelled data and incurs high complexity in the pre-training and fine tuning stages. We propose a simple yet effective adaptive framework to solve the mismatch issue, which trains an embedding model as a transferable feature extractor, followed by fitting the support vector regression. Compared to the existing meta learning algorithm, our method does not necessarily need labelled data in the pre-training and does not need fine-tuning of the pre-trained model in the adaptation. The effectiveness of the proposed method is verified through two well-known applications, i.e., the signal to interference plus noise ratio balancing problem and the sum rate maximization problem. Furthermore, we extend our proposed method to online scenarios in non-stationary environments. Simulation results demonstrate the advantages of the proposed algorithm in terms of both performance and complexity. The proposed framework can also be applied to general radio resource management problems.


title: Non-ideal self-gravity and cosmology: the importance of correlations in the dynamics of the large-scale structures of the Universe

abstract: Inspired by the statistical mechanics of an ensemble of interacting particles (BBGKY hierarchy), we propose to account for small-scale inhomogeneities in self-gravitating astrophysical fluids by deriving a non-ideal Virial theorem and non-ideal Navier-Stokes equations using a decomposition of the gravitational force into a near- and far-field component. These equations involve the pair radial distribution function (similar to the two-point correlation function), similarly to the interaction energy and equation of state in liquids. Small-scale correlations lead to a non-ideal amplification of the gravitational interaction energy, whose omission leads to a missing mass problem, e.g., in galaxies and galaxy clusters. We also propose an extension of the Friedmann equations in the non-ideal regime. We estimate the non-ideal amplification factor of the gravitational interaction energy of the baryons to lie between 5 and 20, potentially explaining the observed value of the Hubble parameter. Within this framework, the acceleration of the expansion emerges naturally because of the increasing number of sub-structures induced by gravitational collapse, which increases their contribution to the total gravitational energy. A simple estimate predicts a non-ideal deceleration parameter qni~-1;this is potentially the first determination of the observed value based on an intuitively physical argument. We suggest that correlations and gravitational interactions could produce a transition to a viscous regime that can lead to flat rotation curves. This transition could also explain the dichotomy between (Keplerian) LSB elliptical galaxy and (non-Keplerian) spiral galaxy rotation profiles. Overall, our results demonstrate that non-ideal effects induced by inhomogeneities must be taken into account in order to properly determine the gravitational dynamics of galaxies and the larger scale universe.


title: Relaxed Conditions for Parameterized Linear Matrix Inequality in the Form of Double Sum

abstract: The aim of this study is to investigate less conservative conditions for a parameterized linear matrix inequality (PLMI) expressed in the form of a double convex sum. This type of PLMI frequently appears in T-S fuzzy control system analysis and design problems. In this letter, we derive new, less conservative linear matrix inequalities (LMIs) for the PLMI by employing the proposed sum relaxation method based on Young's inequality. The derived LMIs are proven to be less conservative than the existing conditions related to this topic in the literature. The proposed technique is applicable to various stability analysis and control design problems for T-S fuzzy systems, which are formulated as solving the PLMIs in the form of a double convex sum. Furthermore, examples is provided to illustrate the reduced conservatism of the derived LMIs.


title: Constrained School Choice with Incomplete Information

abstract: School choice is the two-sided matching market where students (on one side) are to be matched with schools (on the other side) based on their mutual preferences. The classical algorithm to solve this problem is the celebrated deferred acceptance procedure, proposed by Gale and Shapley. After both sides have revealed their mutual preferences, the algorithm computes an optimal stable matching. Most often in practice, notably when the process is implemented by a national clearinghouse and thousands of schools enter the market, there is a quota on the number of applications that a student can submit: students have to perform a partial revelation of their preferences, based on partial information on the market. We model this situation by drawing each student type from a publicly known distribution and study Nash equilibria of the corresponding Bayesian game. We focus on symmetric equilibria, in which all students play the same strategy. We show existence of these equilibria in the general case, and provide two algorithms to compute such equilibria under additional assumptions, including the case where schools have identical preferences over students.


title: Low-resolution Human Pose Estimation

abstract: Human pose estimation has achieved significant progress on images with high imaging resolution. However, low-resolution imagery data bring nontrivial challenges which are still under-studied. To fill this gap, we start with investigating existing methods and reveal that the most dominant heatmap-based methods would suffer more severe model performance degradation from low-resolution, and offset learning is an effective strategy. Established on this observation, in this work we propose a novel Confidence-Aware Learning (CAL) method which further addresses two fundamental limitations of existing offset learning methods: inconsistent training and testing, decoupled heatmap and offset learning. Specifically, CAL selectively weighs the learning of heatmap and offset with respect to ground-truth and most confident prediction, whilst capturing the statistical importance of model output in mini-batch learning manner. Extensive experiments conducted on the COCO benchmark show that our method outperforms significantly the state-of-the-art methods for low-resolution human pose estimation.


title: Taylor bubble motion in stagnant and flowing liquids in vertical pipes. Part I: Steady-states

abstract: Taylor bubbles are a feature of the slug flow regime in gas-liquid flows in vertical pipes. Their dynamics exhibits a number of transitions such as symmetry-breaking in the bubble shape and wake when rising in downward-flowing and stagnant liquids, respectively, as well as breakup in sufficiently turbulent environments. Motivated by the need to examine the stability of a Taylor bubble in liquids, a systematic numerical study of a steadily-moving Taylor bubble in stagnant and flowing liquids is carried out, characterised by a dimensionless inverse viscosity ($Nf$), and E\"{o}tv\"{o}s ($Eo$), and Froude ($Fr$) numbers based on the centreline liquid velocity, using a Galerkin finite-element method. A boundary-fitted domain is used to examine the dependence of the steady bubble shape on a wide range of $Nf$ and $Eo$. Our analysis of the bubble nose and bottom curvatures shows that the intervals $Eo = \left[ 20,30 \right)$ and $Nf=\left[60,80 \right)$ are the limits below which surface tension and viscosity, respectively, have a strong influence on the bubble shape. In the interval $Eo = \left(60,100 \right]$, all bubble features studied are weakly-dependent on surface tension. This is Part I of a two-part publication in which its companion paper (Abubakar & Matar, 2021) reports the results of a linear stability analysis of the steady-states discussed herein.


title: Wellbeing supportive design -- Research-based guidelines for supporting psychological wellbeing in user experience

abstract: While human beings have a right to digital experiences that support, rather than diminish, their psychological wellbeing, technology designers lack research-based practices for ensuring psychological needs are met. To help address this gap, we draw on findings from over 30 years of research in psychology (specifically, self-determination theory) that has identified contextual factors shown to support psychological wellbeing. We translate these findings into a list of 15 heuristics and 30 design strategies to provide technology makers with theoretically grounded, research-based, and actionable ways to support wellbeing in user experience.


title: Generalized Poincar\'e Orthogonality: A New Approach to POLSAR Data Analysis

abstract: In this paper we outline a new approach to the analysis of polarimetric synthetic aperture (POLSAR) data. Here we exploit target orthogonality as a multi-dimensional extension of wave orthogonality, familiar on the Poincar\'e sphere. We first show how to formulate a general basis for a complex orthogonal scattering space using a generalization of the Poincar\'e formulation, and then show how to optimize the backscattered signal in this space for both monostatic and bistatic radar systems. We illustrate application of the new approach, first to ship detection, using data collected off the north-west of Scotland and then land-use applications in a mixed scene around Glasgow, Scotland, both using L-band ALOS-2 POLSAR data.


title: Duality of the Principle of Least Action: A New Formulation of Classical Mechanics

abstract: A dual formalism for Lagrange multipliers is developed. The formalism is used to minimize an action function $S(q_2,q_1,T)$ without any dynamical input other than that $S$ is convex. All the key equations of analytical mechanics -- the Hamilton-Jacobi equation, the generating functions for canonical transformations, Hamilton's equations of motion and $S$ as the time integral of the Lagrangian -- emerge as simple consequences. It appears that to a large extent, analytical mechanics is simply a footnote to the most basic problem in the calculus of variations: that the shortest distance between two points is a straight line.


title: Data-driven turbulence modeling in separated flows considering physical mechanism analysis

abstract: Accurate simulation of turbulent flow with separation is an important but challenging problem. In this paper, a data-driven Reynolds-averaged turbulence modeling approach, field inversion and machine learning is implemented to modify the Spalart-Allmaras model separately on three cases, namely, the S809 airfoil, a periodic hill and the GLC305 airfoil with ice shape 944. Field inversion based on a discrete adjoint method is used to quantify the model-form uncertainty with limited experimental data. An artificial neural network is trained to predict the model corrections with local flow features to extract generalized modeling knowledge. Physical knowledge of the nonequilibrium turbulence in the separating shear layer is considered when setting the prior model uncertainty. The results show that the model corrections from the field inversion demonstrate strong consistency with the underlying physical mechanism of nonequilibrium turbulence. The quantity of interest from the observation data can be reproduced with relatively high accuracy by the augmented model. In addition, the validation in similar flow conditions shows a certain extent of generalization ability.


title: Taylor bubble motion in stagnant and flowing liquids in vertical pipes. Part II: Linear stability analysis

abstract: In this study, we examine the linear stability of an axisymmetric Taylor bubble moving steadily in a flowing liquid enclosed in a circular tube. Linearisation is performed about axisymmetric base states obtained in Part I of this study by Abubakar and Matar (2021). The stability is characterised by the dimensionless inverse viscosity $\left( Nf \right)$, E\"{o}tv\"{o}s $\left( Eo \right)$, and Froude numbers $\left( U_m \right)$, the latter being based on the centreline liquid velocity. The analysis shows that there exist regions of $(Nf,Eo,U_m)$ space within which the bubble is unstable and assumes an asymmetric shape. To elucidate the mechanisms underlying the instability, an energy budget analysis is carried out which reveals that perturbation growth is driven by the bubble pressure for $Eo \geq 100$, and by the tangential interfacial stress for $Eo < 100$. Examples of the asymmetric bubble shapes and their associated flow fields are also provided near the onset of instability for a wide range of $Nf$, $Eo$, and $U_m$.


title: A Central Limit Theorem for Linear Combinations of Logarithms of Dirichlet $L$-functions

abstract: The purpose of this paper is to generalize our earlier work on the logarithm of the Riemann zeta-function to linear combinations of logarithms of primitive Dirichlet $L$-functions with constant real coefficients. Under the assumption of suitable hypotheses, we prove that as $T\to \infty $, a sequence of the form $(a_1\log|L(\rho,\chi_n)|+\dots+a_1\log|L(\rho,\chi_n)|)$ has an approximate Gaussian distribution with mean $0$ and variance $ \tfrac{1}{2}\big({a_1}^2+\dots+{a_n}^2 \big)\log\log T$. Here $a_1, \dots, a_n \in \mathbb{R}$, each of the $\chi_i$ is a primitive Dirichlet character modulo $M_i$ with $M_i\leq T$, and $0< \operatorname{Im}\rho \leq T$ where $\rho$ runs over nontrivial zeros of the zeta-function. From the proof of this result, we also derive the independence of the distributions of sequences $(\log|L(\rho,\chi_1)|), \dots, (\log|L(\rho,\chi_n)|)$ provided that they are suitably normalized.


title: Probing Dark Contents in Globular Clusters With Timing Effects of Pulsar Acceleration

abstract: We investigate pulsar timing residuals due to the coupling effect of the pulsar transverse acceleration and the R$\rm{\ddot{o}}$mer delay. The effect is relatively small and usually negligible. Only for pulsars in globular clusters, it is possibly important. The maximum residual amplitude, which is from the pulsar near the surface of the core of the cluster, is about tens nanoseconds, and may hardly be identified for most of the globular clusters currently. However, an intermediate-mass black hole in the centre of a cluster can increase apparently the timing residual magnitudes. Particularly for the pulsars in the innermost core region, their residual magnitudes may be significant. The high-magnitude residuals, which above critical lines of each cluster, are strong evidences for the presence of a black hole or dark remnants of comparable total mass in the centre of the cluster. We also explored the timing effects of line-of-sight accelerations for the pulsars. The distribution of measured line-of-sight accelerations are simulated with a Monte Carlo method. A two-dimensional Kolmogorov-Smirnov tests are performed to reexamine the consistency of distributions of the simulated and reported data for various values of parameters of the clusters. It is shown that the structure parameters of Terzan 5 can be well constrained by comparing the distribution of measured line-of-sight accelerations with the distributions from Monte Carlo simulations. We provide that the cluster has an upper limit on the central black hole/dark remnant mass of $ \sim 6000 M_{\odot} $.


title: Double-RIS Versus Single-RIS Aided Systems: Tensor-Based MIMO Channel Estimation and Design Perspectives

abstract: Reconfigurable intelligent surfaces (RISs) have been proposed recently as new technology to tune the wireless propagation channels in real-time. However, most of the current works assume single-RIS (S-RIS)-aided systems, which can be limited in some application scenarios where a transmitter might need a multi-RIS-aided channel to communicate with a receiver. In this paper, we consider a double-RIS (D-RIS)-aided MIMO system and propose an alternating least-squared-based channel estimation method by exploiting the Tucker2 tensor structure of the received signals. Using the proposed method, the cascaded MIMO channel parts can be estimated separately, up to trivial scaling factors. Compared with the S-RIS systems, we show that if the RIS elements of a S-RIS system are distributed carefully between the two RISs in a D-RIS system, the training overhead can be reduced and the estimation accuracy can also be increased. Therefore, D-RIS systems can be seen as an appealing approach to further increase the coverage, capacity, and efficiency of future wireless networks compared to S-RIS systems.


title: Almost-complex invariants of families of six-dimensional solvmanifolds

abstract: We compute almost-complex invariants $h^{p,0}_{\overline\partial}$, $h^{p,0}_{\text{Dol}}$ and almost-Hermitian invariants $h^{p,0}_{\bar\delta}$ on families of almost-K\"ahler and almost-Hermitian $6$-dimensional solvmanifolds. Finally, as a consequence of almost-K\"ahler identities we provide an obstruction to the existence of a symplectic structure on a given compact almost-complex manifold. Notice that, when $(X,J,g,\omega)$ is a compact almost Hermitian manifold of real dimension greater than four, not much is known concerning the numbers $h^{p,q}_{\overline\partial}$.


title: Exact solutions of nonlinear dynamical equations for large-amplitude atomic vibrations in arbitrary monoatomic chains with fixed ends

abstract: Intermode interactions in one-dimensional nonlinear periodic structures have been studied by many authors, starting with the classical work by Fermi, Pasta, and Ulam (FPU) in the middle of the last century. However, symmetry selection rules for the energy transfer between nonlinear vibrational modes of different symmetry, which lead to the possibility of excitation of some bushes of such modes, were not revealed. Each bush determines an exact solution of nonlinear dynamical equations of the considered system. The collection of modes of a given bush does not change in time, while there is a continuous energy exchange between these modes. Bushes of nonlinear normal modes (NNMs) are constructed with the aid of group-theoretical methods and therefore they can exist for the case of large amplitude atomic vibrations and for any type of interatomic interactions. In most publications, bushes of NNMs or similar dynamical objects in one-dimensional systems are investigated under periodic boundary conditions. In this paper, we present a detailed study of the bushes of NNMs in monoatomic chains for the case of fixed boundary conditions, which sheds light on a series of new properties of the intermode interactions in such systems. We prove some theorems that justify a method for constructing bushes of NNMs by continuation of conventional normal modes to the case of large atomic oscillations. Our study was carried out for FPU chains, for the chains with the Lennard-Jones interatomic potential, as well as for the carbon chains (carbynes) in the framework of the density functional theory. For one-dimensional bushes (Rosenberg nonlinear normal modes), the amplitude-frequency diagrams are presented and the possibility of their modulational instability is briefly discussed. We also argue in favor of the fact that our methods and main results are valid for any monoatomic chain.


title: The Jet-Disk Coupling of Seyfert Galaxies from a Complete Hard X-ray Sample

abstract: We analyze the jet-disk coupling for different subsamples from a complete hard X-ray Seyfert sample to study the coupling indices and their relation to accretion rate. The results are: (1) the power-law coupling index ranges from nearly unity (linear correlation) for radio-loud Seyferts to significantly less than unity for radio-quiet ones. This declining trend of coupling index also holds from larger sources to compact ones; (2) the Seyferts with intermediate to high accretion rate (Eddington ratio $\lambda\sim$ 0.001 to 0.3) show a linear jet-disk coupling, but it shallows from near to super Eddington ($\lambda\sim$ 0.3 to 10), and the former is more radio loud than the latter; (3) the Seyfert 1s are slightly steeper than the Seyfert 2s, in the jet-disk correlation. In the linear coupling regime, the ratio of jet efficiency to radiative efficiency ($\eta/\varepsilon$) is nearly invariant, but in low accretion or super accretion regime, $\eta/\varepsilon$ varies with $\lambda$ in our model. We note that a radio-active cycle of accretion-dominated active galactic nuclei would be: from a weaker jet-disk coupling in $\lambda<0.001$ for low luminosity Seyferts, to a linear coupling in $0.001<\lambda<0.3$ for radio-loud luminous Seyferts and powerful radio galaxies/quasars, and to a weaker coupling in $0.3<\lambda<10$ ones.


title: A Framework for Institutional Risk Identification using Knowledge Graphs and Automated News Profiling

abstract: Organizations around the world face an array of risks impacting their operations globally. It is imperative to have a robust risk identification process to detect and evaluate the impact of potential risks before they materialize. Given the nature of the task and the current requirements of deep subject matter expertise, most organizations utilize a heavily manual process. In our work, we develop an automated system that (a) continuously monitors global news, (b) is able to autonomously identify and characterize risks, (c) is able to determine the proximity of reaching triggers to determine the distance from the manifestation of the risk impact and (d) identifies organization's operational areas that may be most impacted by the risk. Other contributions also include: (a) a knowledge graph representation of risks and (b) relevant news matching to risks identified by the organization utilizing a neural embedding model to match the textual description of a given risk with multi-lingual news.


title: Approximate Conditional Sampling for Pattern Detection in Weighted Networks

abstract: Assessing the statistical significance of network patterns is crucial for understanding whether such patterns indicate the presence of interesting network phenomena, or whether they simply result from less interesting processes, such as nodal-heterogeneity. Typically, significance is computed with reference to a null model. While there has been extensive research into such null models for unweighted graphs, little has been done for the weighted case. This article suggests a null model for weighted graphs. The model fixes node strengths exactly, and approximately fixes node degrees. A novel MCMC algorithm is proposed for sampling the model, and its stochastic stability is considered. We show empirically that the model compares favorably to alternatives, particularly when network patterns are subtle. We show how the algorithm can be used to evaluate the statistical significance of community structure.


title: What BERT Based Language Models Learn in Spoken Transcripts: An Empirical Study

abstract: Language Models (LMs) have been ubiquitously leveraged in various tasks including spoken language understanding (SLU). Spoken language requires careful understanding of speaker interactions, dialog states and speech induced multimodal behaviors to generate a meaningful representation of the conversation. In this work, we propose to dissect SLU into three representative properties:conversational (disfluency, pause, overtalk), channel (speaker-type, turn-tasks) and ASR (insertion, deletion,substitution). We probe BERT based language models (BERT, RoBERTa) trained on spoken transcripts to investigate its ability to understand multifarious properties in absence of any speech cues. Empirical results indicate that LM is surprisingly good at capturing conversational properties such as pause prediction and overtalk detection from lexical tokens. On the downsides, the LM scores low on turn-tasks and ASR errors predictions. Additionally, pre-training the LM on spoken transcripts restrain its linguistic understanding. Finally, we establish the efficacy and transferability of the mentioned properties on two benchmark datasets: Switchboard Dialog Act and Disfluency datasets.


title: Magnetic helicity, weak solutions and relaxation of ideal MHD

abstract: We revisit the issue of conservation of magnetic helicity and the Woltjer-Taylor relaxation theory in magnetohydrodynamics in the context of weak solutions. We introduce a relaxed system for the ideal MHD system, which decouples the effects of hydrodynamic turbulence such as the appearance of a Reynolds stress term from the magnetic helicity conservation in a manner consistent with observations in plasma turbulence. As by-products we answer two open questions in the field: We show the sharpness of the $L^3$ integrability condition for magnetic helicity conservation and provide turbulent bounded solutions for MHD dissipating energy and cross helicity but with (arbitrary) constant magnetic helicity.


title: Cohomology of generalized Dold spaces

abstract: Let $(X,J) $ be an almost complex manifold with a (smooth) involution $\sigma:X\to X$ such that fix($\sigma$) is non-empty. Assume that $\sigma$ is a complex conjugation, i.e, the differential of $\sigma$ anti-commutes with $J$. The space $P(m,X):=\mathbb{S}^m\times X/\!\sim$ where $(v,x)\sim (-v,\sigma(x))$ was referred to as a generalized Dold manifold. The above definition admits an obvious generalization to a much wider class of spaces where $X, S$ are arbitrary topological spaces. The resulting space $P(S,X)$ will be called a generalized Dold space. When $S$ and $X$ are CW complexes satisfying certain natural requirements, we obtain a CW-structure on $P(S,X)$. Under certain further hypotheses, we determine the mod $2$ cohomology groups of $P(S,X)$. We determine the $\mathbb Z_2$-cohomology algebra when $X$ is (i) a torus manifold whose torus orbit space is a homology polytope, (ii) a complex flag manifold. One of the main tools is the Stiefel-Whitney class formula for vector bundles over $P(S,X)$ associated to $\sigma$-conjugate complex bundles over $X$ when the $S$ is a paracompact Hausdorff topological space, extending the validity of the formula, obtained earlier by Nath and Sankaran, in the case of generalized Dold manifolds.


title: A link between the steepest descent method and fixed-point iterations

abstract: We will make a link between the steepest descent method for an unconstrained minimisation problem and fixed-point iterations for its Euler-Lagrange equation. In this context, we shall rediscover the preconditioned nonlinear conjugate gradient method for the discretised problem. The benefit of the link between the two methods will be illustrated by a numerical experiment.


title: Quantum Interference Transport in two-dimensional Semi-Dirac Semimetals

abstract: Semi-Dirac semimetals have received enthusiastic research both theoretically and experimentally in the recent years. Due to the anisotropic dispersion, its physical properties are highly direction-dependent. In this work we employ the Feynman diagrammatic perturbation theory to study the transport properties in quantum diffusive regime. The magneto-conductivity with quantum interference corrections is derived, which demonstrate the weak localization effect in the semi-Dirac semimetal. Furthermore, the origin of anomalous Hall conductivity is also clarified, where both the intrinsic and side-jump contributions vanish and only the skew-scattering gives rise to non-zero transverse conductivity. The conductance fluctuations in both mesoscopic and quantum diffusive regimes are investigated in detail. Our work provides theoretical predictions for transport experiments, which can be examined by conductivity measurements at sufficiently low temperature.


title: Central configurations on the plane with $N$ heavy and $k$ light bodies

abstract: We study the problem of planar central configurations with $N$ heavy bodies and $k$ bodies with arbitrary small masses. We derive the equation which describe the limit of light masses going to zero, which can be seen as the equation for central configurations in the anisotropic plane. Using computer rigorous computations we compute all central configurations for $N=2$ and $k=3,4$ and for the derived limit problem. We show that the results are consistent.


title: Salinity and sodicity can cause hysteresis in soil hydraulic conductivity

abstract: Soil salinization and sodification can cause detrimental effects to soil structure, with important implications to irrigated agriculture. Knowledge of the extent to which degradation in soil structure due to salinization and sodification is reversible is still lacking, however. The objective of our study is to examine the effects of the history of solute composition on the degree of reversibility in saturated hydraulic conductivity (Ksat). We systematically investigate the effects of salinity (electrolyte concentration) and sodicity (sodium adsorption ratio) on Ksat, for three soils of varying clay content. The soil column experiments yielded hysteresis graphs, in which Ksat does not go back to its original values after initial decay. We developed indices to quantify the degree of Ksat degradation and reversibility, and found that contrary to our expectations, high susceptibility to degradation does not always correlate with low capability of rehabilitation. Measurements of soil swelling helped us discern when degradation was mainly caused by swelling or clay dispersion. Our findings underscore the need of understanding hysteresis caused by salinity and sodicity, aiming at a better management of agricultural soils for sustainable long-term use.


title: Nipah virus vector sequences in COVID-19 patient samples sequenced by the Wuhan Institute of Virology

abstract: We report the detection of Nipah virus in an infectious clone format, a BSL4-level pathogen and CDC-designated Bioterrorism Agent, in raw RNA-Seq sequencing reads deposited by the Wuhan Institute of Virology (WIV) produced from five December 2019 patients infected with SARS-CoV-2. Research involving Nipah infectious clones has never been reported to have occured at the WIV. These patient samples have been previously reported to contain reads from several other viruses: Influenza A, Spodoptera frugiperda rhabdovirus and Nipah. Previous authors have interpreted the presence of these virus sequences as indicative of co-infections of the patients in question by these pathogens or laboratory contamination. However, our analysis shows that NiV genes are encapsulated in synthetic vectors, which we infer was for assembly of a NiV infectious clone. In particular, we document the finding of internal N, P-V-W-C and L protein coding sequences as well as coverage of the G and F genes. Furthermore, the format of Hepatitis D virus ribozyme and T7 terminator downstream of the 5-prime end of the NiV sequence is consistent with truncation required at the end of the genome for a full length infectious clone. This indicates that research at WIV was being conducted on an assembled NiV infectious clone. Contamination of patient sequencing reads by an infectious NiV clone of the highly pathogenic Bangladesh strain could indicate a significant breach of BSL-4 protocols. We call on WIV to explain the purpose of this research on infectious clones of Nipah Virus, the full chronology of this work, and to explain how and at what stage of sample preparation this contamination occurred.


title: HPTQ: Hardware-Friendly Post Training Quantization

abstract: Neural network quantization enables the deployment of models on edge devices. An essential requirement for their hardware efficiency is that the quantizers are hardware-friendly: uniform, symmetric, and with power-of-two thresholds. To the best of our knowledge, current post-training quantization methods do not support all of these constraints simultaneously. In this work, we introduce a hardware-friendly post training quantization (HPTQ) framework, which addresses this problem by synergistically combining several known quantization methods. We perform a large-scale study on four tasks: classification, object detection, semantic segmentation and pose estimation over a wide variety of network architectures. Our extensive experiments show that competitive results can be obtained under hardware-friendly constraints.


title: Maximal digraphs whose Hermitian spectral radius is at most $2$

abstract: We classify maximal digraphs whose Hermitian spectral radius is at most $2$.


title: Do Long-Range Language Models Actually Use Long-Range Context?

abstract: Language models are generally trained on short, truncated input sequences, which limits their ability to use discourse-level information present in long-range context to improve their predictions. Recent efforts to improve the efficiency of self-attention have led to a proliferation of long-range Transformer language models, which can process much longer sequences than models of the past. However, the ways in which such models take advantage of the long-range context remain unclear. In this paper, we perform a fine-grained analysis of two long-range Transformer language models (including the \emph{Routing Transformer}, which achieves state-of-the-art perplexity on the PG-19 long-sequence LM benchmark dataset) that accept input sequences of up to 8K tokens. Our results reveal that providing long-range context (i.e., beyond the previous 2K tokens) to these models only improves their predictions on a small set of tokens (e.g., those that can be copied from the distant context) and does not help at all for sentence-level prediction tasks. Finally, we discover that PG-19 contains a variety of different document types and domains, and that long-range context helps most for literary novels (as opposed to textbooks or magazines).


title: Float, borosilicate and tellurites as cover glasses in Si photovoltaics: optical properties and performances under sunlight

abstract: One of the most significant materials in a solar panel is the glass, which provides transparency, UV protection as well as mechanical and chemical resistance. In this work, we describe the production of prototypes of four solar modules made using borosilicate, zinc-tellurite, Pr$^{3+}$ doped zinc-tellurite, and float glass as cover materials. The performance of these prototypes was evaluated under a solar simulator, and a device was developed to monitor all prototypes under real conditions. A comparison between indoor and outdoor measurements shows that outdoor results are fundamental to evaluate the performance of modified solar modules as the ones considered in this study. In addition, we demonstrate the fundamental role played by the refractive index of cover glasses in the performance of the prototypes, and discuss how this feature could be explored to achieve enhanced devices, as well as other benefits that may arise from this field of research.


title: Theory of the Magnon Parametron

abstract: The 'magnon parametron' is a ferromagnetic particle that is parametrically excited by microwaves in a cavity. Above a certain threshold of the microwave power, a bistable steady state emerges that forms an effective Ising spin. We calculate the dynamics of the magnon parametron as a function of microwave power, applied magnetic field and temperature for the interacting magnon system, taking into account thermal and quantum fluctuations. We predict three dynamical phases, viz. a stable Ising spin, telegraph noise of thermally activated switching, and an intermediate regime that at lower temperatures is quantum correlated with significant distillible magnon entanglement. These three regimes of operation are attractive for alternative computing schemes.


title: Architecture of Hierarchical Stellar Systems and their Formation

abstract: Accumulation of new data on stellar hierarchical systems and the progress in numerical simulations of their formation open the door to genetic classification of these systems, where properties of a certain group (family) of objects are tentatively related to their formation mechanisms and early evolution. A short review of the structure and statistical trends of known stellar hierarchies is given. Like binaries, they can be formed by the disk and core fragmentation events happening sequentially or simultaneously and followed by the evolution of masses and orbits driven by continuing accretion of gas and dynamical interactions between stars. Several basic formation scenarios are proposed and associated qualitatively with the architecture of real systems, although quantitative predictions for these scenarios are still pending. The general trend of increasing orbit alignment with decreasing system size points to the critical role of the accretion-driven orbit migration, which also explains the typically comparable masses of stars belonging to the same system. The architecture of some hierarchies bears imprints of chaotic dynamical interactions. Characteristic features of each family are illustrated by several real systems.