title: Adversarial Attacks on Black Box Video Classifiers: Leveraging the Power of Geometric Transformations

abstract: When compared to the image classification models, black-box adversarial attacks against video classification models have been largely understudied. This could be possible because, with video, the temporal dimension poses significant additional challenges in gradient estimation. Query-efficient black-box attacks rely on effectively estimated gradients towards maximizing the probability of misclassifying the target video. In this work, we demonstrate that such effective gradients can be searched for by parameterizing the temporal structure of the search space with geometric transformations. Specifically, we design a novel iterative algorithm Geometric TRAnsformed Perturbations (GEO-TRAP), for attacking video classification models. GEO-TRAP employs standard geometric transformation operations to reduce the search space for effective gradients into searching for a small group of parameters that define these operations. This group of parameters describes the geometric progression of gradients, resulting in a reduced and structured search space. Our algorithm inherently leads to successful perturbations with surprisingly few queries. For example, adversarial examples generated from GEO-TRAP have better attack success rates with ~73.55% fewer queries compared to the state-of-the-art method for video adversarial attacks on the widely used Jester dataset. Overall, our algorithm exposes vulnerabilities of diverse video classification models and achieves new state-of-the-art results under black-box settings on two large datasets. Code is available here: https://github.com/sli057/Geo-TRAP


title: HoloBoard: a Large-format Immersive Teaching Board based on pseudo HoloGraphics

abstract: In this paper, we present HoloBoard, an interactive large-format pseudo-holographic display system for lecture-based classes. With its unique properties of immersive visual display and transparent screen, we designed and implemented a rich set of novel interaction techniques like immersive presentation, role-play, and lecturing behind the scene that is potentially valuable for lecturing in class. We conducted a controlled experimental study to compare a HoloBoard class with a normal class by measuring students' learning outcomes and three dimensions of engagement (i.e., behavioral, emotional, and cognitive engagement). We used pre-/post- knowledge tests and multimodal learning analytics to measure students' learning outcomes and learning experiences. Results indicated that the lecture-based class utilizing HoloBoard lead to slightly better learning outcomes and a significantly higher level of student engagement. Given the results, we discussed the impact of HoloBoard as an immersive media in the classroom setting and suggest several design implications for deploying HoloBoard in immersive teaching practices.


title: Attention Augmented Convolutional Transformer for Tabular Time-series

abstract: Time-series classification is one of the most frequently performed tasks in industrial data science, and one of the most widely used data representation in the industrial setting is tabular representation. In this work, we propose a novel scalable architecture for learning representations from tabular time-series data and subsequently performing downstream tasks such as time-series classification. The representation learning framework is end-to-end, akin to bidirectional encoder representations from transformers (BERT) in language modeling, however, we introduce novel masking technique suitable for pretraining of time-series data. Additionally, we also use one-dimensional convolutions augmented with transformers and explore their effectiveness, since the time-series datasets lend themselves naturally for one-dimensional convolutions. We also propose a novel timestamp embedding technique, which helps in handling both periodic cycles at different time granularity levels, and aperiodic trends present in the time-series data. Our proposed model is end-to-end and can handle both categorical and continuous valued inputs, and does not require any quantization or encoding of continuous features.


title: On bases and the dimensions of twisted centralizer codes

abstract: Alahmadi et al. ["Twisted centralizer codes", \emph{Linear Algebra and its Applications} {\bf 524} (2017) 235-249.] introduced the notion of twisted centralizer codes, $\mathcal{C}_{\mathbb{F}_q}(A,\gamma),$ defined as \[ \mathcal{C}_{\mathbb{F}_q}(A,\gamma)=\lbrace X \in \mathbb{F}_q^{n \times n}:~\ AX=\gamma XA\rbrace, \] for $A \in \mathbb{F}_q^{n \times n},$ and $\gamma \in \mathbb{F}_q.$ Moreover, Alahmadi et al. ["On the dimension of twisted centralizer codes", \emph{Finite Fields and Their Applications} {\bf 48} (2017) 43-59.] also investigated the dimension of such codes and obtained upper and lower bounds for the dimension, and the exact value of the dimension only for cyclic or diagonalizable matrices $A.$ Generalizing and sharpening Alahmadi et al.'s results, in this paper, we determine the exact value of the dimension as well as provide an algorithm to construct an explicit basis of the codes for any given matrix $A.$


title: When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpoint

abstract: There has been a surge of works bridging MCMC sampling and optimization, with a specific focus on translating non-asymptotic convergence guarantees for optimization problems into the analysis of Langevin algorithms in MCMC sampling. A conspicuous distinction between the convergence analysis of Langevin sampling and that of optimization is that all known convergence rates for Langevin algorithms depend on the dimensionality of the problem, whereas the convergence rates for optimization are dimension-free for convex problems. Whether a dimension independent convergence rate can be achieved by Langevin algorithm is thus a long-standing open problem. This paper provides an affirmative answer to this problem for large classes of either Lipschitz or smooth convex problems with normal priors. By viewing Langevin algorithm as composite optimization, we develop a new analysis technique that leads to dimension independent convergence rates for such problems.


title: Acceleration of Solar Energetic Particles by the shock of Interplanetary Coronal Mass Ejection

abstract: Interplanetary Coronal Mass Ejection (ICME) shocks are known to accelerate particles and contribute significantly to Solar Energetic Particle (SEP) events. We have performed Magnetohydrodynamic-Particle in Cell (MHD-PIC) simulations of ICME shocks to understand the acceleration mechanism. These shocks vary in Alfv\'enic Mach numbers as well as in magnetic field orientations (parallel \& quasi-perpendicular). We find that Diffusive Shock Acceleration (DSA) plays a significant role in accelerating particles in a parallel ICME shock. In contrast, Shock Drift Acceleration (SDA) plays a pivotal role in a quasi-perpendicular shock. High-Mach shocks are seen to accelerate particles more efficiently. Our simulations suggest that background turbulence and local particle velocity distribution around the shock can indirectly hint at the acceleration mechanism. Our results also point towards a few possible \textit{in situ} observations that could validate our understanding of the topic.


title: The High Latitude Spectroscopic Survey on the Nancy Grace Roman Space Telescope

abstract: The Nancy Grace Roman Space Telescope will conduct a High Latitude Spectroscopic Survey (HLSS) over a large volume at high redshift, using the near-IR grism (1.0-1.93 $\mu$m, $R=435-865$) and the 0.28 deg$^2$ wide field camera. We present a reference HLSS which maps 2000 deg$^2$ and achieves an emission line flux limit of 10$^{-16}$ erg/s/cm$^2$ at 6.5$\sigma$, requiring $\sim$0.6 yrs of observing time. We summarize the flowdown of the Roman science objectives to the science and technical requirements of the HLSS. We construct a mock redshift survey over the full HLSS volume by applying a semi-analytic galaxy formation model to a cosmological N-body simulation, and use this mock survey to create pixel-level simulations of 4 deg$^2$ of HLSS grism spectroscopy. We find that the reference HLSS would measure $\sim$ 10 million H$\alpha$ galaxy redshifts that densely map large scale structure at $z=1-2$ and 2 million [OIII] galaxy redshifts that sparsely map structures at $z=2-3$. We forecast the performance of this survey for measurements of the cosmic expansion history with baryon acoustic oscillations and the growth of large scale structure with redshift space distortions. We also study possible deviations from the reference design, and find that a deep HLSS at $f_{\rm line}>7\times10^{-17}$erg/s/cm$^2$ over 4000 deg$^2$ (requiring $\sim$1.5 yrs of observing time) provides the most compelling stand-alone constraints on dark energy from Roman alone. This provides a useful reference for future optimizations. The reference survey, simulated data sets, and forecasts presented here will inform community decisions on the final scope and design of the Roman HLSS.


title: Traffic control Management System and Collision Avoidance System

abstract: Many road accidents occur due to drivers failing to read sign board due to various reasons. Especially at night, the tiredness of driver reduces his perception to small things like speed limit of sign the board, curve ahead sign board. For the smooth movement of ambulance in cities during traffic, is to create an IOT device to detect sign boards and also able to com-municate with the traffic light and makes way for ambulance. Implementation is done by detecting sign boards and measuring speed of vehicle using arduino and RF transmitter which transmits the specific beep sound to specific type of application like speed breaker, school zone etc. The vehicle also contains RF receiver and arduino, which starts receiving the beep sound when near to sign board. After receiving the code, arduino starts measuring the current speed of vehicle and if the speed is above recommended speed then it starts gives alert. If the vehicle speed is not reduced even after the alert then the vehicle will auto break. With the help of this Traffic Management System (TMS), we can record the number of users who do not reduce vehicle speed even when prompted by the system alerts.


title: The Artificial Scientist: Logicist, Emergentist, and Universalist Approaches to Artificial General Intelligence

abstract: We attempt to define what is necessary to construct an Artificial Scientist, explore and evaluate several approaches to artificial general intelligence (AGI) which may facilitate this, conclude that a unified or hybrid approach is necessary and explore two theories that satisfy this requirement to some degree.


title: Does Domain Change the Opinion of Individuals on Human Values? A Preliminary Investigation on eHealth Apps End-users

abstract: The elicitation of end-users' human values - such as freedom, honesty, transparency, etc. - is important in the development of software systems. We carried out two preliminary Q-studies to understand (a) the general human value opinion types of eHealth applications (apps) end-users (b) the eHealth domain human value opinion types of eHealth apps end-users (c) whether there are differences between the general and eHealth domain opinion types. Our early results show three value opinion types using generic value instruments: (1) fun-loving, success-driven and independent end-user, (2) security-conscious, socially-concerned, and success-driven end-user, and (3) benevolent, success-driven, and conformist end-user Our results also show two value opinion types using domain-specific value instruments: (1) security-conscious, reputable, and honest end-user, and (2) success-driven, reputable and pain-avoiding end-user. Given these results, consideration should be given to domain context in the design and application of values elicitation instruments.


title: Hierarchical Primitive Composition: Simultaneous Activation of Skills with Inconsistent Action Dimensions in Multiple Hierarchies

abstract: Deep reinforcement learning has shown its effectiveness in various applications, providing a promising direction for solving tasks with high complexity. However, naively applying classical RL for learning a complex long-horizon task with a single control policy is inefficient. Thus, policy modularization tackles this problem by learning a set of modules that are mapped to primitives and properly orchestrating them. In this study, we further expand the discussion by incorporating simultaneous activation of the skills and structuring them into multiple hierarchies in a recursive fashion. Moreover, we sought to devise an algorithm that can properly orchestrate the skills with different action spaces via multiplicative Gaussian distributions, which highly increases the reusability. By exploiting the modularity, interpretability can also be achieved by observing the modules that are used in the new task if each of the skills is known. We demonstrate how the proposed scheme can be employed in practice by solving a pick and place task with a 6 DoF manipulator, and examine the effects of each property from ablation studies.


title: Thinking Fast and Slow in AI: the Role of Metacognition

abstract: AI systems have seen dramatic advancement in recent years, bringing many applications that pervade our everyday life. However, we are still mostly seeing instances of narrow AI: many of these recent developments are typically focused on a very limited set of competencies and goals, e.g., image interpretation, natural language processing, classification, prediction, and many others. Moreover, while these successes can be accredited to improved algorithms and techniques, they are also tightly linked to the availability of huge datasets and computational power. State-of-the-art AI still lacks many capabilities that would naturally be included in a notion of (human) intelligence. We argue that a better study of the mechanisms that allow humans to have these capabilities can help us understand how to imbue AI systems with these competencies. We focus especially on D. Kahneman's theory of thinking fast and slow, and we propose a multi-agent AI architecture where incoming problems are solved by either system 1 (or "fast") agents, that react by exploiting only past experience, or by system 2 (or "slow") agents, that are deliberately activated when there is the need to reason and search for optimal solutions beyond what is expected from the system 1 agent. Both kinds of agents are supported by a model of the world, containing domain knowledge about the environment, and a model of "self", containing information about past actions of the system and solvers' skills.


title: Compression, The Fermi Paradox and Artificial Super-Intelligence

abstract: The following briefly discusses possible difficulties in communication with and control of an AGI (artificial general intelligence), building upon an explanation of The Fermi Paradox and preceding work on symbol emergence and artificial general intelligence. The latter suggests that to infer what someone means, an agent constructs a rationale for the observed behaviour of others. Communication then requires two agents labour under similar compulsions and have similar experiences (construct similar solutions to similar tasks). Any non-human intelligence may construct solutions such that any rationale for their behaviour (and thus the meaning of their signals) is outside the scope of what a human is inclined to notice or comprehend. Further, the more compressed a signal, the closer it will appear to random noise. Another intelligence may possess the ability to compress information to the extent that, to us, their signals would appear indistinguishable from noise (an explanation for The Fermi Paradox). To facilitate predictive accuracy an AGI would tend to more compressed representations of the world, making any rationale for their behaviour more difficult to comprehend for the same reason. Communication with and control of an AGI may subsequently necessitate not only human-like compulsions and experiences, but imposed cognitive impairment.


title: Intermediately subcritical branching process in random environment: the initial stage of the evolution

abstract: We consider branching process evolving in i.i.d. random environment. It is assumed that the process is intermediately subcritical. We investigate the initial stage of the evolution of the process given its survival for a long time.


title: A Linear Response relation for perturbations in compact stars and the classical Einstein-Langevin formalism

abstract: We give a linear response relation for perturbations in relativistic stars and classify them in terms of implicit and induced perturbations. The focus in this article is on the induced perturbations which may arise due to internal sources in dense matter compact objects. Based on the linear response relation, an Einstein Langevin equation is given and its solutions for a simple case are obtained in closed analytical form as a first exercise. Our results show how perturbations in relativistic stars can arise due to a cumulative effect of mesoscopic scale fluctuations in the dense matter fluids, which otherwise seem to be screened off at hydrodynamic scales due to averaging. We discuss the relevance of such a framework and its potential towards building up a theme of research in asteroseismology using a first principles approach.


title: Variants of the Domination Number for Flower Snarks

abstract: We consider the flower snarks, a widely studied infinite family of 3--regular graphs. For the Flower snark $J_n$ on $4n$ vertices, it is trivial to show that the domination number of $J_n$ is equal to $n$. However, results are more difficult to determine for variants of domination. The Roman domination, weakly convex domination, and convex domination numbers have been determined for flower snarks in previous works. We add to this literature by determining the independent domination, 2-domination, total domination, connected domination, upper domination, secure Domination and weak Roman domination numbers for flower snarks.


title: Truth-Conditional Captioning of Time Series Data

abstract: In this paper, we explore the task of automatically generating natural language descriptions of salient patterns in a time series, such as stock prices of a company over a week. A model for this task should be able to extract high-level patterns such as presence of a peak or a dip. While typical contemporary neural models with attention mechanisms can generate fluent output descriptions for this task, they often generate factually incorrect descriptions. We propose a computational model with a truth-conditional architecture which first runs small learned programs on the input time series, then identifies the programs/patterns which hold true for the given input, and finally conditions on only the chosen valid program (rather than the input time series) to generate the output text description. A program in our model is constructed from modules, which are small neural networks that are designed to capture numerical patterns and temporal information. The modules are shared across multiple programs, enabling compositionality as well as efficient learning of module parameters. The modules, as well as the composition of the modules, are unobserved in data, and we learn them in an end-to-end fashion with the only training signal coming from the accompanying natural language text descriptions. We find that the proposed model is able to generate high-precision captions even though we consider a small and simple space of module types.


title: Deep reinforcement learning for guidewire navigation in coronary artery phantom

abstract: In percutaneous intervention for treatment of coronary plaques, guidewire navigation is a primary procedure for stent delivery. Steering a flexible guidewire within coronary arteries requires considerable training, and the non-linearity between the control operation and the movement of the guidewire makes precise manipulation difficult. Here, we introduce a deep reinforcement learning(RL) framework for autonomous guidewire navigation in a robot-assisted coronary intervention. Using Rainbow, a segment-wise learning approach is applied to determine how best to accelerate training using human demonstrations with deep Q-learning from demonstrations (DQfD), transfer learning, and weight initialization. `State' for RL is customized as a focus window near the guidewire tip, and subgoals are placed to mitigate a sparse reward problem. The RL agent improves performance, eventually enabling the guidewire to reach all valid targets in `stable' phase. Our framework opens anew direction in the automation of robot-assisted intervention, providing guidance on RL in physical spaces involving mechanical fatigue.


title: Effects of the non-Markovianity and non-Gaussianity of active environmental noises on engine performance

abstract: An active environment is a reservoir containing \emph{active} materials, such as bacteria and Janus particles. Given the self-propelled motion of these materials, powered by chemical energy, an active environment has unique, nonequilibrium environmental noise. Recently, studies on engines that harvest energy from active environments have attracted a great deal of attention because the theoretical and experimental findings indicate that these engines outperform conventional ones. Studies have explored the features of active environments essential for outperformance, such as the non-Gaussian or non-Markovian nature of the active noise. However, these features have not yet been systematically investigated in a general setting. Therefore, we systematically study the effects of the non-Gaussianity and non-Markovianity of active noise on engine performance. We show that non-Gaussianity is irrelevant to the performance of an engine driven by {any linear force (including a harmonic trap) regardless of time dependency}, whereas non-Markovianity is relevant. However, for a system driven by a general nonlinear force, both non-Gaussianity and non-Markovianity enhance engine performance. Also, the memory effect of an active reservoir should be considered when fabricating a cyclic engine.


title: Dataset: Large-scale Urban IoT Activity Data for DDoS Attack Emulation

abstract: As IoT deployments grow in scale for applications such as smart cities, they face increasing cyber-security threats. In particular, as evidenced by the famous Mirai incident and other ongoing threats, large-scale IoT device networks are particularly susceptible to being hijacked and used as botnets to launch distributed denial of service (DDoS) attacks. Real large-scale datasets are needed to train and evaluate the use of machine learning algorithms such as deep neural networks to detect and defend against such DDoS attacks. We present a dataset from an urban IoT deployment of 4060 nodes describing their spatio-temporal activity under benign conditions. We also provide a synthetic DDoS attack generator that injects attack activity into the dataset based on tunable parameters such as number of nodes attacked and duration of attack. We discuss some of the features of the dataset. We also demonstrate the utility of the dataset as well as our synthetic DDoS attack generator by using them for the training and evaluation of a simple multi-label feed-forward neural network that aims to identify which nodes are under attack and when.


title: Short-term precipitation prediction using deep learning

abstract: Accurate weather prediction is essential for many aspects of life, notably the early warning of extreme weather events such as rainstorms. Short-term predictions of these events rely on forecasts from numerical weather models, in which, despite much improvement in the past decades, outstanding issues remain concerning model uncertainties, and increasing demands for computation and storage resources. In recent years, the advance of deep learning offers a viable alternative approach. Here, we show that a 3D convolutional neural network using a single frame of meteorology fields as input is capable of predicting the precipitation spatial distribution. The network is developed based on 39-years (1980-2018) data of meteorology and daily precipitation over the contiguous United States. The results bring fundamental advancements in weather prediction. First, the trained network alone outperforms the state-of-the-art weather models in predicting daily total precipitation, and the superiority of the network extends to forecast leads up to 5 days. Second, combining the network predictions with the weather-model forecasts significantly improves the accuracy of model forecasts, especially for heavy-precipitation events. Third, the millisecond-scale inference time of the network facilitates large ensemble predictions for further accuracy improvement. These findings strongly support the use of deep-learning in short-term weather predictions.


title: Global Heisenberg scaling in noisy and practical phase estimation

abstract: Heisenberg scaling characterizes the ultimate precision of parameter estimation enabled by quantum mechanics, which represents an important quantum advantage of both theoretical and technological interest. Here, we study the attainability of strong, global notions of Heisenberg scaling in the fundamental problem of phase estimation, from a practical standpoint. A main message of this work is an asymptotic noise "threshold" for global Heisenberg scaling. We first demonstrate that Heisenberg scaling is fragile to noises in the sense that it cannot be achieved in the presence of phase damping noise with strength above a stringent scaling in the system size. Nevertheless, we show that when the noise does not exceed this threshold, the global Heisenberg scaling in terms of limiting distribution (which we highlight as a practically important figure of merit) as well as average error can indeed be achieved. Furthermore, we provide a practical adaptive protocol using one qubit only, which achieves global Heisenberg scaling in terms of limiting distribution under such noise.


title: Tits Alternative for 2-dimensional CAT(0) complexes

abstract: We prove the Tits Alternative for groups acting on $2$-dimensional $\mathrm{CAT}(0)$ complexes with a bound on the order of the cell stabilisers.


title: RF Lens Antenna Array-Based One-Shot Coarse Pointing for Hybrid RF/FSO Communications

abstract: Because of its high directivity, free-space optical (FSO) communication offers a number of advantages. It can, however, give rise to major system difficulties concerning alignment between two terminals. During the link-acquisition step (a.k.a. coarse pointing), a ground station can be prevented from acquiring optical links due to pointing errors and insufficient information about unmanned aerial vehicle locations. We propose, in this letter, a radio-frequency (RF) lens antenna array to increase the performance of coarse pointing in hybrid RF/FSO communications. The proposed algorithm using a novel closed-form angle estimator, compared to conventional methods, reduces the minimum outage probability by over a thousand times.


title: On an infinite family of generalized PBIBDs

abstract: We consider a generalization of the notion of partially balanced incomplete block designs (PBIBDs), by relaxing the requirement that the underlying association scheme be commutative. An infinite family of such generalizations is constructed, one for each prime power $q$ congruent to $1$ modulo $4$.


title: Cellular Network Radio Propagation Modeling with Deep Convolutional Neural Networks

abstract: Radio propagation modeling and prediction is fundamental for modern cellular network planning and optimization. Conventional radio propagation models fall into two categories. Empirical models, based on coarse statistics, are simple and computationally efficient, but are inaccurate due to oversimplification. Deterministic models, such as ray tracing based on physical laws of wave propagation, are more accurate and site specific. But they have higher computational complexity and are inflexible to utilize site information other than traditional global information system (GIS) maps. In this article we present a novel method to model radio propagation using deep convolutional neural networks and report significantly improved performance compared to conventional models. We also lay down the framework for data-driven modeling of radio propagation and enable future research to utilize rich and unconventional information of the site, e.g. satellite photos, to provide more accurate and flexible models.


title: A penalty scheme to solve constrained non-convex optimization problems in $BV(\Omega)$

abstract: We investigate non-convex optimization problems in $BV(\Omega)$ with two-sided pointwise inequality constraints. We propose a regularization and penalization method to numerically solve the problem. Under certain conditions, weak limit points of iterates are stationary for the original problem. In addition, we prove optimality conditions for the original problem that contain Lagrange multipliers to the inequality constraints. Numerical experiments confirm the theoretical findings.


title: Nonlinear effects of instantaneous and delayed state dependence in a delayed feedback loop

abstract: We study a scalar, first-order delay differential equation (DDE) with instantaneous and state-dependent delayed feedback, which itself may be delayed. The state dependence introduces nonlinearity into an otherwise linear system. We investigate the ensuing nonlinear dynamics with the case of instantaneous state dependence as our starting point. We present the bifurcation diagram in the parameter plane of the two feedback strengths showing how periodic orbits bifurcate from a curve of Hopf bifurcations and disappear along a curve where both period and amplitude grow beyond bound as the orbits become saw-tooth shaped. We then `switch on' the delay within the state-dependent feedback term, reflected by a parameter $b>0$. Our main conclusion is that the new parameter $b$ has an immediate effect: as soon as $b>0$ the bifurcation diagram for $b=0$ changes qualitatively and, specifically, the nature of the limiting saw-tooth shaped periodic orbits changes. Moreover, we show $-$ numerically and through center manifold analysis $-$ that a degeneracy at $b=1/3$ of an equilibrium with a double real eigenvalue zero leads to a further qualitative change and acts as an organizing center for the bifurcation diagram. Our results demonstrate that state dependence in delayed feedback terms may give rise to new dynamics and, moreover, that the observed dynamics may change significantly when the state-dependent feedback depends on past states of the system. This is expected to have implications for models arising in different application contexts, such as models of human balancing and conceptual climate models of delayed action oscillator type.


title: Inverse Kinematics and Dexterous Workspace Formulation for 2-Segment Continuum Robots with Inextensible Segments

abstract: The inverse kinematics (IK) problem of continuum robots has been investigated in depth in the past decades. Under the constant-curvature bending assumption, closed-form IK solution has been obtained for continuum robots with variable segment lengths. Attempting to close the gap towards a complete solution, this paper presents an efficient solution for the IK problem of 2-segment continuum robots with one or two inextensible segments (a.k.a, constant segment lengths). Via representing the robot's shape as piecewise line segments, the configuration variables are separated from the IK formulation such that solving a one-variable nonlinear equation leads to the solution of the entire IK problem. Furthermore, an in-depth investigation of the boundaries of the dexterous workspace of the end effector caused by the configuration variables limits as well as the angular velocity singularities of the continuum robots was established. This dexterous workspace formulation, which is derived for the first time to the best of the authors' knowledge, is particularly useful to find the closest orientation to a target pose when the target orientation is out of the dexterous workspace. In the comparative simulation studies between the proposed method and the Jacobian-based IK method involving 500,000 cases, the proposed variable separation method solved 100% of the IK problems with much higher computational efficiency.


title: Data Augmentation Approaches in Natural Language Processing: A Survey

abstract: As an effective strategy, data augmentation (DA) alleviates data scarcity scenarios where deep learning techniques may fail. It is widely applied in computer vision then introduced to natural language processing and achieves improvements in many tasks. One of the main focuses of the DA methods is to improve the diversity of training data, thereby helping the model to better generalize to unseen testing data. In this survey, we frame DA methods into three categories based on the diversity of augmented data, including paraphrasing, noising, and sampling. Our paper sets out to analyze DA methods in detail according to the above categories. Further, we also introduce their applications in NLP tasks as well as the challenges. Some helpful resources are provided in the appendix.


title: The Rescaled Polya Urn and the Wright-Fisher process with mutation

abstract: In [arXiv:1906.10951 (forthcoming on Advances in Applied Probability),arXiv:2011.05933 (published on PLOS ONE)] the authors introduce, study and apply a new variant of the Eggenberger-Polya urn, called the "Rescaled" Polya urn, which, for a suitable choice of the model parameters, is characterized by the following features: (i) a "local" reinforcement, i.e. a reinforcement mechanism mainly based on the last observations, (ii) a random persistent fluctuation of the predictive mean, and (iii) a long-term almost sure convergence of the empirical mean to a deterministic limit, together with a chi-squared goodness of fit result for the limit probabilities. In this work, motivated by some empirical evidences in [arXiv:2011.05933 (published on PLOS ONE)], we show that the multidimensional Wright-Fisher diffusion with mutation can be obtained as a suitable limit of the predictive means associated to a family of rescaled Polya urns


title: Flexing infinite frameworks with applications to braced Penrose tilings

abstract: A planar framework -- a graph together with a map of its vertices to the plane -- is flexible if it allows a continuous deformation preserving the distances between adjacent vertices. Extending a recent previous result, we prove that a connected graph with a countable vertex set can be realized as a flexible framework if and only if it has a so-called NAC-coloring. The tools developed to prove this result are then applied to frameworks where every 4-cycle is a parallelogram, and countably infinite graphs with $n$-fold rotational symmetry. With this, we determine a simple combinatorial characterization that determines whether the 1-skeleton of a Penrose rhombus tiling with a given set of braced rhombi will have a flexible motion, and also whether the motion will preserve 5-fold rotational symmetry.


title: On the rational approximation to $p$-adic Thue--Morse numbers

abstract: Let $p$ be a prime number and $\xi$ an irrational $p$-adic number. Its multiplicative irrationality exponent ${{\mu^{\times}}} (\xi)$ is the supremum of the real numbers ${{\mu^{\times}}}$ for which the inequality $$ |b \xi - a|_{p} \leq | a b |^{- {{\mu^{\times}}} / 2} $$ has infinitely many solutions in nonzero integers $a, b$. We show that ${{\mu^{\times}}} (\xi)$ can be expressed in terms of a new exponent of approximation attached to a sequence of rational numbers defined in terms of $\xi$. We establish that ${{\mu^{\times}}} ({{\xi_{{\bf t}, p}}}) = 3$, where ${{\xi_{{\bf t}, p}}}$ is the $p$-adic number $1 - p - p^2 + p^3 - p^4 + \ldots$, whose sequence of digits is given by the Thue--Morse sequence over $\{-1, 1\}$.


title: Hypernetworks for Continual Semi-Supervised Learning

abstract: Learning from data sequentially arriving, possibly in a non i.i.d. way, with changing task distribution over time is called continual learning. Much of the work thus far in continual learning focuses on supervised learning and some recent works on unsupervised learning. In many domains, each task contains a mix of labelled (typically very few) and unlabelled (typically plenty) training examples, which necessitates a semi-supervised learning approach. To address this in a continual learning setting, we propose a framework for semi-supervised continual learning called Meta-Consolidation for Continual Semi-Supervised Learning (MCSSL). Our framework has a hypernetwork that learns the meta-distribution that generates the weights of a semi-supervised auxiliary classifier generative adversarial network $(\textit{Semi-ACGAN})$ as the base network. We consolidate the knowledge of sequential tasks in the hypernetwork, and the base network learns the semi-supervised learning task. Further, we present $\textit{Semi-Split CIFAR-10}$, a new benchmark for continual semi-supervised learning, obtained by modifying the $\textit{Split CIFAR-10}$ dataset, in which the tasks with labelled and unlabelled data arrive sequentially. Our proposed model yields significant improvements in the continual semi-supervised learning setting. We compare the performance of several existing continual learning approaches on the proposed continual semi-supervised learning benchmark of the Semi-Split CIFAR-10 dataset.


title: ASR Rescoring and Confidence Estimation with ELECTRA

abstract: In automatic speech recognition (ASR) rescoring, the hypothesis with the fewest errors should be selected from the n-best list using a language model (LM). However, LMs are usually trained to maximize the likelihood of correct word sequences, not to detect ASR errors. We propose an ASR rescoring method for directly detecting errors with ELECTRA, which is originally a pre-training method for NLP tasks. ELECTRA is pre-trained to predict whether each word is replaced by BERT or not, which can simulate ASR error detection on large text corpora. To make this pre-training closer to ASR error detection, we further propose an extended version of ELECTRA called phone-attentive ELECTRA (P-ELECTRA). In the pre-training of P-ELECTRA, each word is replaced by a phone-to-word conversion model, which leverages phone information to generate acoustically similar words. Since our rescoring method is optimized for detecting errors, it can also be used for word-level confidence estimation. Experimental evaluations on the Librispeech and TED-LIUM2 corpora show that our rescoring method with ELECTRA is competitive with conventional rescoring methods with faster inference. ELECTRA also performs better in confidence estimation than BERT because it can learn to detect inappropriate words not only in fine-tuning but also in pre-training.


title: KKT Conditions, First-Order and Second-Order Optimization, and Distributed Optimization: Tutorial and Survey

abstract: This is a tutorial and survey paper on Karush-Kuhn-Tucker (KKT) conditions, first-order and second-order numerical optimization, and distributed optimization. After a brief review of history of optimization, we start with some preliminaries on properties of sets, norms, functions, and concepts of optimization. Then, we introduce the optimization problem, standard optimization problems (including linear programming, quadratic programming, and semidefinite programming), and convex problems. We also introduce some techniques such as eliminating inequality, equality, and set constraints, adding slack variables, and epigraph form. We introduce Lagrangian function, dual variables, KKT conditions (including primal feasibility, dual feasibility, weak and strong duality, complementary slackness, and stationarity condition), and solving optimization by method of Lagrange multipliers. Then, we cover first-order optimization including gradient descent, line-search, convergence of gradient methods, momentum, steepest descent, and backpropagation. Other first-order methods are explained, such as accelerated gradient method, stochastic gradient descent, mini-batch gradient descent, stochastic average gradient, stochastic variance reduced gradient, AdaGrad, RMSProp, and Adam optimizer, proximal methods (including proximal mapping, proximal point algorithm, and proximal gradient method), and constrained gradient methods (including projected gradient method, projection onto convex sets, and Frank-Wolfe method). We also cover non-smooth and $\ell_1$ optimization methods including lasso regularization, convex conjugate, Huber function, soft-thresholding, coordinate descent, and subgradient methods. Then, we explain second-order methods including Newton's method for unconstrained, equality constrained, and inequality constrained problems....


title: Gell-Mann-Low criticality in neural networks

abstract: Criticality is deeply related to optimal computational capacity. The lack of a renormalized theory of critical brain dynamics, however, so far limits insights into this form of biological information processing to mean-field results. These methods neglect a key feature of critical systems: the interaction between degrees of freedom across all length scales, which allows for complex nonlinear computation. We present a renormalized theory of a prototypical neural field theory, the stochastic Wilson-Cowan equation. We compute the flow of couplings, which parameterize interactions on increasing length scales. Despite similarities with the Kardar-Parisi-Zhang model, the theory is of a Gell-Mann-Low type, the archetypal form of a renormalizable quantum field theory. Here, nonlinear couplings vanish, flowing towards the Gaussian fixed point, but logarithmically slowly, thus remaining effective on most scales. We show this critical structure of interactions to implement a desirable trade-off between linearity, optimal for information storage, and nonlinearity, required for computation.


title: Enhanced Sensitivity of Degenerate System Made of Two Unstable Resonators Coupled by Gyrator Operating at an Exceptional Point

abstract: We demonstrate that a circuit comprising two unstable LC resonators coupled via a gyrator supports an exceptional point of degeneracy (EPD) with purely real eigenfrequency. Each of the two resonators includes either a capacitor or an inductor with a negative value, showing purely imaginary resonance frequency when not coupled to the other via the gyrator. With external perturbation imposed on the system, we show analytically that the resonance frequency response of the circuit follows the square-root dependence on perturbation, leading to possible sensor applications. Furthermore, the effect of small losses in the resonators is investigated, and we show that losses lead to instability. In addition, the EPD occurrence and sensitivity are demonstrated by showing that the relevant Puiseux fractional power series expansion describes the eigenfrequency bifurcation near the EPD. The EPD has the great potential to enhance the sensitivity of a sensing system by orders of magnitude. Making use of the EPD in the gyrator-based circuit, our results pave the way to realize a new generation of high-sensitive sensors to measure small physical or chemical perturbations.


title: Social Co-OS: Cyber-Human Social Co-Operating System

abstract: The novel concept of a Cyber-Human Social System (CHSS) and a diverse and pluralistic 'mixed-life society' is proposed, wherein cyber and human societies commit to each other. This concept enhances the Cyber-Physical System (CPS), which is associated with the current Society 5.0, a social vision realised through the fusion of cyber (virtual) and physical (real) spaces following information society (Society 4.0 and Industry 4.0). Moreover, the CHSS enhances the Human-CPS, the Human-in-the-Loop CPS (HiLCPS), and the Cyber-Human System by intervening in individual behaviour pro-socially and supporting consensus building. As a form of architecture that embodies the CHSS concept, the Cyber-Human Social Co-Operating System (Social Co-OS) that combines cyber and human societies is shown. In this architecture, the cyber and human systems cooperate through the fast loop (operation and administration) and slow loop (consensus and politics). Furthermore, the technical content and current implementation of the basic functions of the Social Co-OS are described. These functions consist of individual behavioural diagnostics, interventions in the fast loop, group decision diagnostics and consensus building in the slow loop. Subsequently, this system will contribute to mutual aid communities and platform cooperatives.


title: Further Extensions of the Gr\"{o}tzsch Theorem

abstract: The Gr\"{o}tzsch Theorem states that every triangle-free planar graph admits a proper $3$-coloring. Among many of its generalizations, the one of Gr\"{u}nbaum and Aksenov, giving $3$-colorability of planar graphs with at most three triangles, is perhaps the most known. A lot of attention was also given to extending $3$-colorings of subgraphs to the whole graph. In this paper, we consider $3$-colorings of planar graphs with at most one triangle. Particularly, we show that precoloring of any two non-adjacent vertices and precoloring of a face of length at most $4$ can be extended to a $3$-coloring of the graph. Additionally, we show that for every vertex of degree at most $3$, a precoloring of its neighborhood with the same color extends to a $3$-coloring of the graph. The latter result implies an affirmative answer to a conjecture on adynamic coloring. All the presented results are tight.


title: DeepEdge: A Deep Reinforcement Learning based Task Orchestrator for Edge Computing

abstract: The improvements in the edge computing technology pave the road for diversified applications that demand real-time interaction. However, due to the mobility of the end-users and the dynamic edge environment, it becomes challenging to handle the task offloading with high performance. Moreover, since each application in mobile devices has different characteristics, a task orchestrator must be adaptive and have the ability to learn the dynamics of the environment. For this purpose, we develop a deep reinforcement learning based task orchestrator, DeepEdge, which learns to meet different task requirements without needing human interaction even under the heavily-loaded stochastic network conditions in terms of mobile users and applications. Given the dynamic offloading requests and time-varying communication conditions, we successfully model the problem as a Markov process and then apply the Double Deep Q-Network (DDQN) algorithm to implement DeepEdge. To evaluate the robustness of DeepEdge, we experiment with four different applications including image rendering, infotainment, pervasive health, and augmented reality in the network under various loads. Furthermore, we compare the performance of our agent with the four different task offloading approaches in the literature. Our results show that DeepEdge outperforms its competitors in terms of the percentage of satisfactorily completed tasks.


title: Mobile authentication of copy detection patterns: how critical is to know fakes?

abstract: Protection of physical objects against counterfeiting is an important task for the modern economies. In recent years, the high-quality counterfeits appear to be closer to originals thanks to the rapid advancement of digital technologies. To combat these counterfeits, an anti-counterfeiting technology based on hand-crafted randomness implemented in a form of copy detection patterns (CDP) is proposed enabling a link between the physical and digital worlds and being used in various brand protection applications. The modern mobile phone technologies make the verification process of CDP easier and available to the end customers. Besides a big interest and attractiveness, the CDP authentication based on the mobile phone imaging remains insufficiently studied. In this respect, in this paper we aim at investigating the CDP authentication under the real-life conditions with the codes printed on an industrial printer and enrolled via a modern mobile phone under the regular light conditions. The authentication aspects of the obtained CDP are investigated with respect to the four types of copy fakes. The impact of fakes' type used for training of authentication classifier is studied in two scenarios: (i) supervised binary classification under various assumptions about the fakes and (ii) one-class classification under unknown fakes. The obtained results show that the modern machine-learning approaches and the technical capacity of modern mobile phones allow to make the CDP authentication under unknown fakes feasible with respect to the considered types of fakes and code design.


title: Thermal transport of the frustrated spin-chain mineral linarite: Magnetic heat transport and strong spin-phonon scattering

abstract: The mineral linarite (PbCuSO$_4$(OH)$_2$) forms a monoclinic structure where a sequence of Cu(OH)$_2$ units forms a spin-$\frac{1}{2}$ chain. Competing ferromagnetic nearest-neighbor ($J_1$) and antiferromagnetic next-nearest-neighbor interactions ($J_2$) in this quasi-one-dimensional spin structure imply magnetic frustration and lead to magnetic ordering below $T_N =$2.8 K in a mutliferroic elliptical spin-spiral ground state. Upon the application of a magnetic field along the spin-chain direction, distinct magnetically ordered phases can be induced. We studied the thermal conductivity $\kappa$ in this material across the magnetic phase diagram as well as in the paramagnetic regime in the temperature ranges 0.07-1 K and 9-300 K. We found that in linarite the heat is carried mainly by phonons but shows a peculiar non-monotonic behavior in field. In particular, $\kappa$ is highly suppressed at the magnetic phase boundaries, indicative of strong scattering of the phonons off critical magnetic fluctuations. Even at temperatures far above the magnetically ordered phases, the phononic thermal conductivity is reduced due to scattering off magnetic fluctuations. The mean free path due to spin-phonon scattering ($l_{\text{spin-phonon}}$) was determined as function of temperature. A power law behavior was observed mainly above 0.5 K indicating the thermal activation of spin fluctuations. In the critical regime close to the saturation field, $l_{\text{spin-phonon}}$ shows a $1/T$ dependence. Furthermore, a magnon thermal transport channel was verified in the helical magnetic phase. We estimate a magnon mean free path which corresponds to about 1000 lattice spacings.


title: Social physics

abstract: Recent decades have seen a rise in the use of physics methods to study different societal phenomena. This development has been due to physicists venturing outside of their traditional domains of interest, but also due to scientists from other disciplines taking from physics the methods that have proven so successful throughout the 19th and the 20th century. Here we dub this field 'social physics' and pay our respect to intellectual mavericks who nurtured it to maturity. We do so by reviewing the current state of the art. Starting with a set of topics that are at the heart of modern human societies, we review research dedicated to urban development and traffic, the functioning of financial markets, cooperation as the basis for our evolutionary success, the structure of social networks, and the integration of intelligent machines into these networks. We then shift our attention to a set of topics that explore potential threats to society. These include criminal behaviour, large-scale migrations, epidemics, environmental challenges, and climate change. We end the coverage of each topic with promising directions for future research. Based on this, we conclude that the future for social physics is bright. Physicists studying societal phenomena are no longer a curiosity, but rather a force to be reckoned with. Notwithstanding, it remains of the utmost importance that we continue to foster constructive dialogue and mutual respect at the interfaces of different scientific disciplines.


title: Generation of Nonreciprocity of Gapless Spin Waves by Chirality Injection

abstract: In chiral magnets with intrinsic inversion symmetry breaking, it has been known that two spin waves moving in opposite directions can propagate at different velocities, exhibiting a phenomenon called magnetochiral nonreciprocity which allows for realizations of certain spin logic devices such as a spin-wave diode. Here, we theoretically demonstrate that the spin-wave nonreciprocity can occur without intrinsic bulk chirality in certain magnets including easy-cone ferromagnets and easy-cone antiferromagnetic. Specifically, we show that nonlocal injection of a spin current from proximate normal metals to easy-cone magnets engenders a non-equilibrium chiral spin texture, on top of which spin waves exhibit nonreciprocity proportional to the injected spin current. One notable feature of the discovered nonreciprocal spin waves is its gapless nature, which can lead to a large thermal rectification effect at sufficiently low temperatures. We envision that nonlocal electric injection of chirality into otherwise nonchiral magnets may serve as a versatile route to realize electrically controllable magnetochiral phenomena in a wide class of materials.


title: Preprocessing for Outerplanar Vertex Deletion: An Elementary Kernel of Quartic Size

abstract: In the $\mathcal{F}$-Minor-Free Deletion problem one is given an undirected graph $G$, an integer $k$, and the task is to determine whether there exists a vertex set $S$ of size at most $k$, so that $G-S$ contains no graph from the finite family $\mathcal{F}$ as a minor. It is known that whenever $\mathcal{F}$ contains at least one planar graph, then $\mathcal{F}$-Minor-Free Deletion admits a polynomial kernel, that is, there is a polynomial-time algorithm that outputs an equivalent instance of size $k^{\mathcal{O}(1)}$ [Fomin, Lokshtanov, Misra, Saurabh; FOCS 2012]. However, this result relies on non-constructive arguments based on well-quasi-ordering and does not provide a concrete bound on the kernel size. We study the Outerplanar Deletion problem, in which we want to remove at most $k$ vertices from a graph to make it outerplanar. This is a special case of $\mathcal{F}$-Minor-Free Deletion for the family $\mathcal{F} = \{K_4, K_{2,3}\}$. The class of outerplanar graphs is arguably the simplest class of graphs for which no explicit kernelization size bounds are known. By exploiting the combinatorial properties of outerplanar graphs we present elementary reduction rules decreasing the size of a graph. This yields a constructive kernel with $\mathcal{O}(k^4)$ vertices and edges. As a corollary, we derive that any minor-minimal obstruction to having an outerplanar deletion set of size $k$ has $\mathcal{O}(k^4)$ vertices and edges.


title: Isoperimetric Bounds for Lower Order Eigenvalues

abstract: New isoperimetric inequalities for lower order eigenvalues of the Laplacian on closed hypersurfaces, of the biharmonic Steklov problems and of the Wentzell-Laplace on bounded domains in a Euclidean space are proven. Some open questions for further study are also proposed.


title: Three-wall piston-cylinder type pressure cell for muon-spin rotation/relaxation experiments

abstract: A three-wall piston-cylinder type high pressure cell for muon-spin rotation/relaxation experiments was designed, manufactured, tested and commissioned. The outer cylinder of the cell body is made from MP35N and the middle and the inner cylinders are made from NiCrAl nonmagnetic alloys. The mechanical design and performance of the pressure cell are evaluated and optimised using finite-element analysis. The outcomes of the experimental testing closely match the modelling results. The high-pressure cell is shown to reach pressures of up to 3.3 GPa at ambient temperature, corresponding to 3.0 GPa at low temperatures, without irreversible damage.

categories: cond-mat.other cond-mat.mtrl-sci cond-mat.str-el cond-mat.supr-con


title: Emerging trends and collaboration patterns unveil the scientific production in blockchain technology: A bibliometric and network analysis from 2014-2020

abstract: Significant attention in the financial industry has paved the way for blockchain technology to spread across other industries, resulting in a plethora of literature on the subject. This study approaches the subject through bibliometrics and network analysis of 6790 records extracted from the Web of Science from 2014-2020 based on blockchain. This study asserts (i) the impact of open access publication on the growth and visibility of literature, (ii) the collaboration patterns and impact of team size on collaboration, (iii) the ranking of countries based on their national and international collaboration, and (iv) the major themes in the literature through thematic analysis. Based on the significant momentum gained by the blockchain, the trend of open access publications has increased 1.5 times than no open access in 2020. This analysis articulates the numerous potentials of blockchain literature and its adoption by various countries and their authors. China and the USA are the top leaders in the field and applied blockchain more with smart contracts, supply chain, and internet of things. Also, results show that blockchain has attracted the attention of less than 1% of authors who have contributed to multiple works on the blockchain and authors also preferred to work in teams smaller in size.


title: Permute Me Softly: Learning Soft Permutations for Graph Representations

abstract: Graph neural networks (GNNs) have recently emerged as a dominant paradigm for machine learning with graphs. Research on GNNs has mainly focused on the family of message passing neural networks (MPNNs). Similar to the Weisfeiler-Leman (WL) test of isomorphism, these models follow an iterative neighborhood aggregation procedure to update vertex representations, and they next compute graph representations by aggregating the representations of the vertices. Although very successful, MPNNs have been studied intensively in the past few years. Thus, there is a need for novel architectures which will allow research in the field to break away from MPNNs. In this paper, we propose a new graph neural network model, so-called $\pi$-GNN which learns a "soft" permutation (i.e., doubly stochastic) matrix for each graph, and thus projects all graphs into a common vector space. The learned matrices impose a "soft" ordering on the vertices of the input graphs, and based on this ordering, the adjacency matrices are mapped into vectors. These vectors can be fed into fully-connected or convolutional layers to deal with supervised learning tasks. In case of large graphs, to make the model more efficient in terms of running time and memory, we further relax the doubly stochastic matrices to row stochastic matrices. We empirically evaluate the model on graph classification and graph regression datasets and show that it achieves performance competitive with state-of-the-art models.


title: A New Multivariate Predictive Model for Stock Returns

abstract: One of the most important studies in finance is to find out whether stock returns could be predicted. This research aims to create a new multivariate model, which includes dividend yield, earnings-to-price ratio, book-to-market ratio as well as consumption-wealth ratio as explanatory variables, for future stock returns predictions. The new multivariate model will be assessed for its forecasting performance using empirical analysis. The empirical analysis is performed on S&P500 quarterly data from Quarter 1, 1952 to Quarter 4, 2019 as well as S&P500 monthly data from Month 12, 1920 to Month 12, 2019. Results have shown this new multivariate model has predictability for future stock returns. When compared to other benchmark models, the new multivariate model performs the best in terms of the Root Mean Squared Error (RMSE) most of the time.


title: Semianalytical Approach for Sky Localization of Gravitational Waves

abstract: Rapid sky localization of gravitational wave sources is crucial to enable prompt electromagnetic follow-ups. In this article, we present a novel semianalytical approach for sky localization of gravitational waves from compact binary coalescences. We use the Bayesian framework with an analytical approximation to the prior distributions for a given astrophysical model. We derive a semianalytical solution to the posterior distribution of source directions. This method only requires one-fold numerical integral that marginalizes over the merger time, compared to the five-fold numerical integration otherwise needed in the Bayesian localization method. The performance of the method is demonstrated using a set of binary neutron stars (BNS) injections on Gaussian noise using LIGO-Virgo's design and O2 sensitivity. We find the median of 90% confidence area in O2 sensitivity to be $\mathcal{O}(10^2) ~\mathrm{deg}^2$, comparable to that of the existing LIGO-Virgo online localization method Bayestar and parameter estimation toolkit LALInference. In the end, we apply this method to localize the BNS event GW170817 and find the 50% (90%) confidence region of 11 $\mathrm{deg}^2$ (50 $\mathrm{deg}^2$). The detected optical counterpart of GW170817 resides within our 50% confidence area.


title: Direct numerical simulation of a moist cough flow using Eulerian approximation for liquid droplets

abstract: The COVID-19 pandemic has inspired several studies on the fluid dynamics of respiratory events. Here, we propose a computational approach in which respiratory droplets are coarse-grained into an Eulerian liquid field advected by the fluid streamlines. A direct numerical simulation is carried out for a moist cough using a closure model for space-time dependence of the evaporation time scale. Estimates of the Stokes number are provided, for the initial droplet size of $10 \mu$m, which are found to be <<1 thereby justifying the neglect of droplet inertia. Several of the important features of the moist-cough flow reported in the literature using Lagrangian tracking methods have been accurately captured using our scheme. Some new results are presented, including the evaporation time for a "mild" cough, a saturation-temperature diagram and a favourable correlation between the vorticity and liquid fields. The present approach is particularly useful for studying the long-range transmission of virus-laden droplets.


title: Extracting Major Topics of COVID-19 Related Tweets

abstract: With the outbreak of the Covid-19 virus, the activity of users on Twitter has significantly increased. Some studies have investigated the hot topics of tweets in this period; however, little attention has been paid to presenting and analyzing the spatial and temporal trends of Covid-19 topics. In this study, we use the topic modeling method to extract global topics during the nationwide quarantine periods (March 23 to June 23, 2020) on Covid-19 tweets. We implement the Latent Dirichlet Allocation (LDA) algorithm to extract the topics and then name them with the "reopening", "death cases", "telecommuting", "protests", "anger expression", "masking", "medication", "social distance", "second wave", and "peak of the disease" titles. We additionally analyze temporal trends of the topics for the whole world and four countries. By analyzing the graphs, fascinating results are obtained from altering users' focus on topics over time.


title: Braess Paradox in a quantum network

abstract: Dietrich Braess while working on traffic modelling, noticed that traffic flow in a network can be worsened by adding extra edges to an existing network. This seemingly counterintuitive phenomenon is known as the Braess paradox. We consider a quantum network, where edges represent shared entangled states between spatially separated parties(nodes). The goal is to entangle two previously uncorrelated nodes using entanglement swappings. The amount of entanglement between the distant nodes is quantified by the average concurrence of the states established, as a result of the entanglement swappings. We then introduce an additional edge of maximally entangled Bell states in the network. We show that the introduction of the additional maximally entangled states to this network leads to lower concurrence between the two previously un-correlated nodes. Thus we demonstrate the occurrence of a phenomenon in a quantum network that is analogous to the Braess' paradox in traffic networks.


title: On the Properties of Error Patterns in the Constant Lee Weight Channel

abstract: The problem of scalar multiplication applied to vectors is considered in the Lee metric. Unlike in other metrics, the Lee weight of a vector may be increased or decreased by the product with a nonzero, nontrivial scalar. This problem is of particular interest for cryptographic applications, like for example Lee metric code-based cryptosystems, since an attacker may use scalar multiplication to reduce the Lee weight of the error vector and thus to reduce the complexity of the corresponding generic decoder. The scalar multiplication problem is analyzed in the asymptotic regime. Furthermore, the construction of a vector with constant Lee weight using integer partitions is analyzed and an efficient method for drawing vectors of constant Lee weight uniformly at random from the set of all such vectors is given.


title: Salient features of the optimised PyCBC IMBH search

abstract: Matched-filter based PyCBC searches have successfully detected $\sim \mathcal{O}(50)$ compact binary merger signals in the LIGO-Virgo data. While most PyCBC searches have been designed to detect stellar-mass binaries, we present here a new search that is optimised to detect short-duration \ac{GW} signals emitted by intermediate-mass black hole mergers. When applied to the first half of the third observation run data, the optimised search re-identified the \ac{IMBH} binary event, GW190521, with a false alarm rate of 1 in 727 yrs, significantly lower than the previous PyCBC search result of 1 in 0.94 yr. Analysis of simulated signals from \ac{IMBH} binaries with generically spinning components shows an increase in sensitivity by a factor of 1.2 to 3 over previous PyCBC searches.


title: Frequency Aware Face Hallucination Generative Adversarial Network with Semantic Structural Constraint

abstract: In this paper, we address the issue of face hallucination. Most current face hallucination methods rely on two-dimensional facial priors to generate high resolution face images from low resolution face images. These methods are only capable of assimilating global information into the generated image. Still there exist some inherent problems in these methods; such as, local features, subtle structural details and missing depth information in final output image. Present work proposes a Generative Adversarial Network (GAN) based novel progressive Face Hallucination (FH) network to address these issues present among current methods. The generator of the proposed model comprises of FH network and two sub-networks, assisting FH network to generate high resolution images. The first sub-network leverages on explicitly adding high frequency components into the model. To explicitly encode the high frequency components, an auto encoder is proposed to generate high resolution coefficients of Discrete Cosine Transform (DCT). To add three dimensional parametric information into the network, second sub-network is proposed. This network uses a shape model of 3D Morphable Models (3DMM) to add structural constraint to the FH network. Extensive experimentation results in the paper shows that the proposed model outperforms the state-of-the-art methods.


title: Fractal dimensions in the Gromov--Hausdorff space

abstract: In this paper, we first show that for all four non-negative real numbers, there exists a Cantor ultrametric space whose Hausdorff dimension, packing dimension, upper box dimension, and Assouad dimension are equal to given four numbers, respectively. Next, by constructing topological embeddings of an arbitrary compact metrizable space into the Gromov--Hausdorff space using a direct sum of metrics spaces, we prove that the set of all compact metric spaces possessing prescribed topological dimension, and four dimensions explained above, and the set of all compact ultrametric spaces are path-connected and have infinite topological dimension. This observation on ultrametrics provides another proof of Qiu's theorem stating that the ratio of the Archimedean and non-Archimedean Gromov--Hausdorff distances is unbounded.


title: Simultaneous Information and Energy Transmission with Finite Constellations

abstract: In this paper, the fundamental limits on the rates at which information and energy can be simultaneously transmitted over an additive white Gaussian noise channel are studied under the following assumptions: $(a)$ the channel is memoryless; $(b)$ the number of channel input symbols (constellation size) and block length are finite; and $(c)$ the decoding error probability (DEP) and the energy outage probability (EOP) are bounded away from zero. In particular, it is shown that the limits on the maximum information and energy transmission rates; and the minimum DEP and EOP, are essentially set by the type induced by the code used to perform the transmission. That is, the empirical frequency with which each channel input symbol appears in the codewords. Using this observation, guidelines for optimal constellation design for simultaneous energy and information transmission are presented.


title: Employing Deep Learning for Detection of Gravitational Waves from Compact Binary Coalescences

abstract: The matched filtering paradigm is the mainstay of gravitational wave (GW) searches from astrophysical coalescing compact binaries. The compact binary coalescence (CBC) search pipelines perform the matched filter between the GW detector's data and a large set of analytical waveforms. However, the computational cost of performing matched filter is very high as the required number of the analytical waveforms is also high. Recently, various deep learning-based methods have been deployed to identify a GW signal in the detector output as an alternative to computationally expensive matched filtering techniques. In past work, the researchers have considered the detection of GW signal mainly as a classification problem, in which they train the deep learning-based architecture by considering the noise and the GW signal as two different classes. However, in this work, for the first time, we have combined the Convolutional Neural Network (CNN) and matched filter methods to reduce the computational cost of the search by reducing the number of matched filtering operations. We have implemented the CNN based architecture not only for classification of the signal but also to identify the location of the signal in the intrinsic parameter space. Identifying the location in which the detected signal lies enables us to perform the matched filter operations between the data and the analytical waveforms generated for the smaller region of the parameter space only - thereby reducing the computational cost of the search. We demonstrate our method for two-dimensional parameter space for stellar to high mass binary black hole systems. In particular, we are able to classify between pure noise and noisy BBH signals with 99% accuracy. Further, the detected signals have been sub-classified into patches in mass components with an average accuracy > 97%


title: Exceptional point induced unidirectional radiation from non-Hermitian plasmonic structures

abstract: Non-Hermitian (NH) photonics has attracted considerable attention from researchers owing to exotic properties that originate from the parity-time ($\mathcal{PT}$) phase transition and exceptional points (EPs). To date, the $\mathcal{PT}$ phase transition, EPs, and circling around EPs have been investigated in many photonic systems. However, few studies focused on the singular nature of the EP eigenstates of the Hamiltonian matrices. Moreover, the switching of an EP eigenstate based on the sign of the coupling constant and its manifestation in physical phenomena have not yet been investigated. In this paper, we propose and numerically demonstrate a unidirectional radiation phenomena manifested by the formation of Huygens dipoles using the singular EP eigenstates in coupled plasmonic systems. Two types of EPs corresponding to positive and negative signs of the coupling constants are realized using dipole-dipole coupling. We show that the Huygens dipole is formed at the EP condition and its radiation direction can be controlled by choosing the sign of the coupling. The unique photonic functionality, which originates directly from the singular eigenstate at the EP uncovers a new aspect of NH photonic physics and devices.


title: The zeros of certain Fourier transforms:Improvements of P\'olya's results

abstract: As for the Fourier transforms of positive and integrable functions supported in the unit interval, we make a list of improvements for P\'olya's results on the distribution of their positive zeros and give new sufficient conditions under which those zeros are simple and regularly distributed. As an application, we take the two-parameter family of beta probability density functions defined by \begin{equation*} f(t)= \frac{1}{B(\alpha, \beta)}\, (1-t)^{\alpha-1} t^{\beta-1},\quad 0<t<1, \end{equation*} where $\,\alpha>0,\,\beta>0,$ and specify the distribution of zeros of the associated Fourier transforms for some region of $(\alpha, \beta)$ in the first quadrant which turns out to be much larger than the region where P\'olya's results are applicable.


title: Jacobi-type algorithms for homogeneous polynomial optimization on Stiefel manifolds with applications to tensor approximations

abstract: This paper mainly studies the gradient-based Jacobi-type algorithms to maximize two classes of homogeneous polynomials with orthogonality constraints, and establish their convergence properties. For the first class of homogeneous polynomials subject to a constraint on a Stiefel manifold, we reformulate it as an optimization problem on a unitary group, which makes it possible to apply the gradient-based Jacobi-type (Jacobi-G) algorithm. Then, if the subproblem can always be represented as a quadratic form, we establish the global convergence of Jacobi-G under any one of three conditions. The convergence result for the first condition is an easy extension of the result in [Usevich et al. SIOPT 2020], while other two conditions are new ones. This algorithm and the convergence properties apply to the well-known joint approximate symmetric tensor diagonalization. For the second class of homogeneous polynomials subject to constraints on the product of Stiefel manifolds, we reformulate it as an optimization problem on the product of unitary groups, and then develop a new gradient-based multi-block Jacobi-type (Jacobi-MG) algorithm to solve it. We establish the global convergence of Jacobi-MG under any one of the above three conditions, if the subproblem can always be represented as a quadratic form. This algorithm and the convergence properties are suitable to the well-known joint approximate tensor diagonalization. As the proximal variants of Jacobi-G and Jacobi-MG, we also propose the Jacobi-GP and Jacobi-MGP algorithms, and establish their global convergence without any further condition. Some numerical results are provided indicating the efficiency of the proposed algorithms.


title: Cooling low-dimensional electron systems into the microkelvin regime

abstract: Two-dimensional electron gases (2DEGs) with high mobility, engineered in semiconductor heterostructures host a variety of ordered phases arising from strong correlations, which emerge at sufficiently low temperatures. The 2DEG can be further controlled by surface gates to create quasi-one dimensional systems, with potential spintronic applications. Here we address the long-standing challenge of cooling such electrons to below 1$\,$mK, potentially important for identification of topological phases and spin correlated states. The 2DEG device was immersed in liquid $^3$He, cooled by the nuclear adiabatic demagnetization of copper. The temperature of the 2D electrons was inferred from the electronic noise in a gold wire, connected to the 2DEG by a metallic ohmic contact. With effective screening and filtering, we demonstrate a temperature of 0.9$\,\pm\,$0.1$\,$mK, with scope for significant further improvement. This platform is a key technological step, paving the way to observing new quantum phenomena, and developing new generations of nanoelectronic devices exploiting correlated electron states.


title: Hyperbolically symmetric versions of Lemaitre-Tolman-Bondi spacetimes

abstract: We study fluid distributions endowed with hyperbolical symmetry, which share many common features with Lemaitre-Tolman-Bondi (LTB) solutions (e.g. they are geodesic, shearing, non--conformally flat and the energy density is inhomogeneous). As such they may be considered as hyperbolically symmetric versions of LTB, with spherical symmetry replaced by hyperbolical symmetry. We start by considering pure dust models, and afterwards we extend our analysis to dissipative models with anisotropic pressure. In the former case the complexity factor is necessarily non-vanishing, whereas in the latter cases models with vanishing complexity factor are found. The remarkable fact is that all solutions satisfying the vanishing complexity condition are necessarily non-dissipative and satisfy the stiff equation of state.


title: Deep Neural Networks and Tabular Data: A Survey

abstract: Heterogeneous tabular data are the most commonly used form of data and are essential for numerous critical and computationally demanding applications. On homogeneous data sets, deep neural networks have repeatedly shown excellent performance and have therefore been widely adopted. However, their adaptation to tabular data for inference or data generation tasks remains challenging. To facilitate further progress in the field, this work provides an overview of state-of-the-art deep learning methods for tabular data. We categorize these methods into three groups: data transformations, specialized architectures, and regularization models. For each of these groups, our work offers a comprehensive overview of the main approaches. Moreover, we discuss deep learning approaches for generating tabular data, and we also provide an overview over strategies for explaining deep models on tabular data. Thus, our first contribution is to address the main research streams and existing methodologies in the mentioned areas, while highlighting relevant challenges and open research questions. Our second contribution is to provide an empirical comparison of traditional machine learning methods with eleven deep learning approaches across five popular real-world tabular data sets of different sizes and with different learning objectives. Our results, which we have made publicly available as competitive benchmarks, indicate that algorithms based on gradient-boosted tree ensembles still mostly outperform deep learning models on supervised learning tasks, suggesting that the research progress on competitive deep learning models for tabular data is stagnating. To the best of our knowledge, this is the first in-depth overview of deep learning approaches for tabular data; as such, this work can serve as a valuable starting point to guide researchers and practitioners interested in deep learning with tabular data.


title: De-rendering Stylized Texts

abstract: Editing raster text is a promising but challenging task. We propose to apply text vectorization for the task of raster text editing in display media, such as posters, web pages, or advertisements. In our approach, instead of applying image transformation or generation in the raster domain, we learn a text vectorization model to parse all the rendering parameters including text, location, size, font, style, effects, and hidden background, then utilize those parameters for reconstruction and any editing task. Our text vectorization takes advantage of differentiable text rendering to accurately reproduce the input raster text in a resolution-free parametric format. We show in the experiments that our approach can successfully parse text, styling, and background information in the unified model, and produces artifact-free text editing compared to a raster baseline.


title: Plant-Protein-Enabled Biodegradable Triboelectric Nanogenerator for Sustainable Agriculture

abstract: As the use of triboelectric nanogenerators (TENGs) increases, the generation of related electronic waste has been a major challenge. Therefore, the development of environmentally friendly, biodegradable, and low-cost TENGs must be prioritized. Having discovered that plant proteins, by-products of grain processing, possess excellent triboelectric properties, we explore these properties by evaluating the protein structure. The proteins are recycled to fabricate triboelectric layers, and the triboelectric series according to electrical properties is determined for the first time. Using a special structure design, we construct a plant-protein-enabled biodegradable TENG by integrating a polylactic acid film, which is used as a new type of mulch film to construct a growth-promoting system that generates space electric fields for agriculture. Thus, from the plant protein to the crop, a sustainable recycling loop is implemented. Using bean seedlings as a model to confirm the feasibility of the mulch film, we further use it in the cultivation of greenhouse vegetables. Experimental results demonstrate the applicability of the proposed plant-protein-enabled biodegradable TENG in sustainable agriculture.


title: A Weight of Evidence approach to classify nanomaterials according to the EU Classification, Labelling and Packaging regulation criteria

abstract: In the context of the EU Horizon 2020 GRACIOUS project, we proposed a quantitative Weight of Evidence (WoE) approach for hazard classification of nanomaterials (NMs). This approach is based on the requirements of the European Regulation on Classification, Labelling and Packaging of Substances and Mixtures (the CLP Regulation), which implements the United Nations' Globally Harmonized System of Classification and Labelling of Chemicals (UN GHS) in the European Union. The goal of this WoE methodology is to facilitate classification of NMs according to CLP criteria, following the decision trees defined in ECHA's CLP regulatory guidance. The proposed methodology involves the following stages: (1) collection of data for different NMs related to the endpoint of interest: each study related to each NM is referred as a Line of Evidence (LoE); (2) computation of weighted scores for each LoE: each LoE is weighted by a score calculated based on agreed data quality and completeness criteria defined in the GRACIOUS project; (3) comparison and integration of the weighed LoEs for each NM: A Monte Carlo resampling approach is adopted to quantitatively and probabilistically integrate the weighted evidence; and (4) assignment of each NM to a hazard class: according to the results, each NM is assigned to one of the classes defined by the CLP regulation. Furthermore, to facilitate the integration and the classification of the weighted LoEs, an R tool was developed. Finally, the approach was tested against an endpoint relevant to CLP (Aquatic Toxicity) using data retrieved from the eNanoMapper database, results obtained were consistent to results in ECHA registration dossiers and in recent literature


title: Validation scheme for solar coronal models -- constraints from multi-perspective observations in EUV and white-light

abstract: Context: In this paper we present a validation scheme to investigate the quality of coronal magnetic field models, which is based upon comparisons with observational data from multiple sources. Aims: Many of these coronal models may use a range of initial parameters that produce a large number of physically reasonable field configurations. However, that does not mean that these results are reliable and comply with the observations. With an appropriate validation scheme the quality of a coronal model can be assessed. Methods: The validation scheme is developed on the example of the EUropean Heliospheric FORecasting Information Asset (EUHFORIA) coronal model. For observational comparison we use EUV and white-light data to detect coronal features on the surface (open magnetic field areas) and off-limb (streamer and loop) structures from multiple perspectives (Earth view and the Solar Terrestrial Relations Observatory - STEREO). The validation scheme can be applied to any coronal model that produces magnetic field line topology. Results: We show its applicability by using that validation scheme on a large set of model configurations, which can be efficiently reduced to an ideal set of parameters that matches best with observational data. Conclusions: We conclude that by using a combined empirical visual classification with a mathematical scheme of topology metrics a very efficient and rather objective quality assessment for coronal models can be performed.


title: Combining Physics and Deep Learning to learn Continuous-Time Dynamics Models

abstract: Deep learning has been widely used within learning algorithms for robotics. One disadvantage of deep networks is that these networks are black-box representations. Therefore, the learned approximations ignore the existing knowledge of physics or robotics. Especially for learning dynamics models, these black-box models are not desirable as the underlying principles are well understood and the standard deep networks can learn dynamics that violate these principles. To learn dynamics models with deep networks that guarantee physically plausible dynamics, we introduce physics-inspired deep networks that combine first principles from physics with deep learning. We incorporate Lagrangian mechanics within the model learning such that all approximated models adhere to the laws of physics and conserve energy. Deep Lagrangian Networks (DeLaN) parametrize the system energy using two networks. The parameters are obtained by minimizing the squared residual of the Euler-Lagrange differential equation. Therefore, the resulting model does not require specific knowledge of the individual system, is interpretable, and can be used as a forward, inverse, and energy model. Previously these properties were only obtained when using system identification techniques that require knowledge of the kinematic structure. We apply DeLaN to learning dynamics models and apply these models to control simulated and physical rigid body systems. The results show that the proposed approach obtains dynamics models that can be applied to physical systems for real-time control. Compared to standard deep networks, the physics-inspired models learn better models and capture the underlying structure of the dynamics.


title: Investigating the Impact of Pre-trained Language Models on Dialog Evaluation

abstract: Recently, there is a surge of interest in applying pre-trained language models (Pr-LM) in automatic open-domain dialog evaluation. Pr-LMs offer a promising direction for addressing the multi-domain evaluation challenge. Yet, the impact of different Pr-LMs on the performance of automatic metrics is not well-understood. This paper examines 8 different Pr-LMs and studies their impact on three typical automatic dialog evaluation metrics across three different dialog evaluation benchmarks. Specifically, we analyze how the choice of Pr-LMs affects the performance of automatic metrics. Extensive correlation analyses on each of the metrics are performed to assess the effects of different Pr-LMs along various axes, including pre-training objectives, dialog evaluation criteria, model size, and cross-dataset robustness. This study serves as the first comprehensive assessment of the effects of different Pr-LMs on automatic dialog evaluation.


title: Clustered star formation at early evolutionary stages. Physical and chemical analysis of the young star-forming regions ISOSS J22478+6357 and ISOSS J23053+5953

abstract: We aim to characterize the physical and chemical properties of fragmented cores during the earliest evolutionary stages in the very young star-forming regions ISOSS J22478+6357 and ISOSS J23053+5953. NOEMA 1.3 mm data are used in combination with archival mid- and far-infrared observations to construct and fit the SEDs of individual fragmented cores. The radial density profiles are inferred from the 1.3 mm continuum visibility profiles and the radial temperature profiles are estimated from H2CO rotation temperature maps. Molecular column densities are derived with the line fitting tool XCLASS. The physical and chemical properties are combined by applying the physical-chemical model MUSCLE in order to constrain the chemical timescales of a few line-rich cores. The morphology and spatial correlations of the molecular emission are analyzed using the HOG method. The mid-infrared data show that both regions contain a cluster of young stellar objects. Bipolar molecular outflows are observed in the CO 2-1 transition toward the strong mm cores indicating protostellar activity. We find strong molecular emission of SO, SiO, H2CO, and CH3OH in locations which are not associated with the mm cores. These shocked knots can be either associated with the bipolar outflows or, in the case of ISOSS J23053+5953, with a colliding flow that creates a large shocked region between the mm cores. The mean chemical timescale of the cores is lower (20 000 yr) compared to that of the sources of the more evolved CORE sample (60 000 yr). With the HOG method, we find that the spatial emission of species tracing the extended emission and of shock-tracing molecules are well correlated within transitions of these groups.


title: The size-Ramsey number of cubic graphs

abstract: We show that the size-Ramsey number of any cubic graph with $n$ vertices is $O(n^{8/5})$, improving a bound of $n^{5/3 + o(1)}$ due to Kohayakawa, R\"{o}dl, Schacht, and Szemer\'{e}di. The heart of the argument is to show that there is a constant $C$ such that a random graph with $C n$ vertices where every edge is chosen independently with probability $p \geq C n^{-2/5}$ is with high probability Ramsey for any cubic graph with $n$ vertices. This latter result is best possible up to the constant.


title: Dispersive and dissipative coupling of photon Bose-Einstein condensates

abstract: The synchronization of coherent states of light has long been an important subject of basic research and technology. Recently, a new concept for analog computers has emerged where this synchronization process can be exploited to solve computationally hard problems - potentially faster and more energy-efficient than what can be achieved with conventional computer technology today. The unit cell of such systems consists of two coherent centers that are coupled to one another in a controlled manner. Here, we experimentally characterize and analyze the synchronization process of two photon Bose-Einstein condensates, which are coupled to one another, either dispersively or dissipatively. We show that both types of coupling are robust against a detuning of the condensate frequencies and show similar time constants in establishing mutual coherence. Significant differences between these couplings arise in the behaviour of the condensate populations under imbalanced optical pumping. The combination of these two types of coupling extends the class of physical models that can be investigated using analog simulations.


title: Random matrices in service of ML footprint: ternary random features with no performance loss

abstract: In this article, we investigate the spectral behavior of random features kernel matrices of the type ${\bf K} = \mathbb{E}_{{\bf w}} \left[\sigma\left({\bf w}^{\sf T}{\bf x}_i\right)\sigma\left({\bf w}^{\sf T}{\bf x}_j\right)\right]_{i,j=1}^n$, with nonlinear function $\sigma(\cdot)$, data ${\bf x}_1, \ldots, {\bf x}_n \in \mathbb{R}^p$, and random projection vector ${\bf w} \in \mathbb{R}^p$ having i.i.d. entries. In a high-dimensional setting where the number of data $n$ and their dimension $p$ are both large and comparable, we show, under a Gaussian mixture model for the data, that the eigenspectrum of ${\bf K}$ is independent of the distribution of the i.i.d.(zero-mean and unit-variance) entries of ${\bf w}$, and only depends on $\sigma(\cdot)$ via its (generalized) Gaussian moments $\mathbb{E}_{z\sim \mathcal N(0,1)}[\sigma'(z)]$ and $\mathbb{E}_{z\sim \mathcal N(0,1)}[\sigma''(z)]$. As a result, for any kernel matrix ${\bf K}$ of the form above, we propose a novel random features technique, called Ternary Random Feature (TRF), that (i) asymptotically yields the same limiting kernel as the original ${\bf K}$ in a spectral sense and (ii) can be computed and stored much more efficiently, by wisely tuning (in a data-dependent manner) the function $\sigma$ and the random vector ${\bf w}$, both taking values in $\{-1,0,1\}$. The computation of the proposed random features requires no multiplication, and a factor of $b$ times less bits for storage compared to classical random features such as random Fourier features, with $b$ the number of bits to store full precision values. Besides, it appears in our experiments on real data that the substantial gains in computation and storage are accompanied with somewhat improved performances compared to state-of-the-art random features compression/quantization methods.


title: DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT

abstract: Self-supervised speech representation learning methods like wav2vec 2.0 and Hidden-unit BERT (HuBERT) leverage unlabeled speech data for pre-training and offer good representations for numerous speech processing tasks. Despite the success of these methods, they require large memory and high pre-training costs, making them inaccessible for researchers in academia and small companies. Therefore, this paper introduces DistilHuBERT, a novel multi-task learning framework to distill hidden representations from a HuBERT model directly. This method reduces HuBERT's size by 75% and 73% faster while retaining most performance in ten different tasks. Moreover, DistilHuBERT required little training time and data, opening the possibilities of pre-training personal and on-device SSL models for speech.


title: Inferring Hidden Structures in Random Graphs

abstract: We study the two inference problems of detecting and recovering an isolated community of \emph{general} structure planted in a random graph. The detection problem is formalized as a hypothesis testing problem, where under the null hypothesis, the graph is a realization of an Erd\H{o}s-R\'{e}nyi random graph $\mathcal{G}(n,q)$ with edge density $q\in(0,1)$; under the alternative, there is an unknown structure $\Gamma_k$ on $k$ nodes, planted in $\mathcal{G}(n,q)$, such that it appears as an \emph{induced subgraph}. In case of a successful detection, we are concerned with the task of recovering the corresponding structure. For these problems, we investigate the fundamental limits from both the statistical and computational perspectives. Specifically, we derive lower bounds for detecting/recovering the structure $\Gamma_k$ in terms of the parameters $(n,k,q)$, as well as certain properties of $\Gamma_k$, and exhibit computationally unbounded optimal algorithms that achieve these lower bounds. We also consider the problem of testing in polynomial-time. As is customary in many similar structured high-dimensional problems, our model undergoes an "easy-hard-impossible" phase transition and computational constraints can severely penalize the statistical performance. To provide an evidence for this phenomenon, we show that the class of low-degree polynomials algorithms match the statistical performance of the polynomial-time algorithms we develop.

categories: cs.DS cs.IT cs.LG math.IT math.ST stat.TH


title: Density-Driven Resistance Response in $MnS_{2}$: Theory

abstract: A colossal insulator-to-metal transition in high-spin pyrite phase of $MnS_{2}$ has been experimentally observed \cite{colomns2}. There are two possibilities behind this colossal insulator-to-metal transition: (1) migration of $Mn$ electrons to unoccupied $S^{2-}_{2}$ antibonding states under pressure which leads to conducting ligand states and hence metallic transition, and (2) possibility of band crossing transition. We have analyzed this experimental obervation theoretically using a toy statistical model and found that the transition is due to the migration of electrons from the transition metal ions to the ligand sites (i.e. the possibility (1)). The calculated resistivity compares well with the experimental data within the fitting parameters of the model.