title: Remote Anomaly Detection in Industry 4.0 Using Resource-Constrained Devices

abstract: A central use case for the Internet of Things (IoT) is the adoption of sensors to monitor physical processes, such as the environment and industrial manufacturing processes, where they provide data for predictive maintenance, anomaly detection, or similar. The sensor devices are typically resource-constrained in terms of computation and power, and need to rely on cloud or edge computing for data processing. However, the capacity of the wireless link and their power constraints limit the amount of data that can be transmitted to the cloud. While this is not problematic for the monitoring of slowly varying processes such as temperature, it is more problematic for complex signals such as those captured by vibration and acoustic sensors. In this paper, we consider the specific problem of remote anomaly detection based on signals that fall into the latter category over wireless channels with resource-constrained sensors. We study the impact of source coding on the detection accuracy with both an anomaly detector based on Principal Component Analysis (PCA) and one based on an autoencoder. We show that the coded transmission is beneficial when the signal-to-noise ratio (SNR) of the channel is low, while uncoded transmission performs best in the high SNR regime.


title: Role of Externally Provided Randomness in Stochastic Teams and Zero-sum Team Games

abstract: Stochastic team decision problem is extensively studied in literature and the existence of optimal solution is obtained in recent literature. The value of information in statistical problem and decision theory is classical problem. Much of earlier does not qualitatively describe role of externally provided private and common randomness in stochastic team problem and team vs team zero sum game. In this paper, we study the role of extrenally provided private or common randomness in stochastic team decision. We make observation that the randomness independent of environment does not benefit either team but randomness dependent on environment benefit teams and decreases the expected cost function. We also studied LQG team game with special information structure on private or common randomness. We extend these study to problem team vs team zero sum game. We show that if a game admits saddle point solution, then private or common randomness independent of environment does not benefit either team. We also analyze the scenario when a team with having more information than other team which is dependent on environment and game has saddle point solution, then team with more information benefits. This is also illustrated numerically for LQG team vs team zero sum game. Finally, we show for discrete team vs team zero sum game that private randomness independent of environment benefits team when there is no saddle point condition. Role of common randomness is discussed for discrete game.


title: Regular vectors and bi-Lipschitz trivial stratifications in o-minimal structures

abstract: These notes focus on the Lipschitz geometry of sets that are definable in o-minimal structures (expanding the real field). We show that every set which is definable in a polynomially bounded o-minimal structure admits a stratification which is locally definably bi-Lipschitz trivial along the strata. This result is obtained as a byproduct of two foregoing results of the author. The first one asserts that, given a family definable in an o-minimal structure, there is a regular vector, up to a definable family of bi-Lipschitz homeomorphisms. The second one is a bi-Lipschitz version of the famous Hardt's theorem. We give proofs of these two theorems that avoid the use of the real spectrum. The article recalls the basic facts and the results about Lipschitz geometry that are needed to understand the proofs, providing references.


title: Photometric Objects Around Cosmic Webs (PAC) Delineated in a Spectroscopic survey. II. Morphology, Color and Size Dependences of the Stellar-halo Mass Relation for Massive Galaxies

abstract: In this paper, we report a robust measurement of the morphology, color and galaxy size dependences of the stellar-halo mass relation (SHMR) at the high mass end ($10^{11.3}{\rm M_{\odot}}<M_{\star}<10^{11.7}{\rm M_{\odot}}$) at redshift $z_s\sim0.6$ (Throughout the paper, we use $z_s$ for redshift, $z$ for the z-band magnitude.). Applying our method, Photometric objects Around Cosmic webs (PAC), developed in a previous work to CMASS and HSC-SSP observations, we measure the excess surface density ($\bar{n}_2w_p(r_p)$) of satellites around massive central galaxies with different morphologies indicated by S\'ersic index $n$. We find that more compact (larger $n$) central galaxies are surrounded by more satellites. With the abundance matching method, we estimate halo mass for the central galaxies, and find that halo mass is increased monotonically with $n$, solid evidence for a morphology dependence of SHMR. Specifically, our results show that the most compact galaxies ($n>6$) have the halo mass around 5.5 times larger than the disk galaxies ($n<2$). Similarly, using the effective radius $R_e$ and the rest-frame $u-r$ color, we find that red (large) galaxies reside in halos that are in average $2.6$ ($2.3$) times more massive than those hosting blue (small) galaxies.


title: Sampling the X-ray transform on simple surfaces

abstract: We study the problem of proper discretizing and sampling issues related to geodesic X-ray transforms on simple surfaces, and illustrate the theory on simple geodesic disks of constant curvature. Given a notion of band limit on a function, we provide the minimal sampling rates of its X-ray transform for a faithful reconstruction. In Cartesian sampling, we quantify the quality of a sampling scheme depending on geometric parameters of the surface (e.g. curvature and boundary curvature), and the coordinate system used to represent the space of geodesics. When aliasing happens, we explain how to predict the location, orientation and frequency of the artifacts.


title: Detecting Damage Building Using Real-time Crowdsourced Images and Transfer Learning

abstract: After significant earthquakes, we can see images posted on social media platforms by individuals and media agencies owing to the mass usage of smartphones these days. These images can be utilized to provide information about the shaking damage in the earthquake region both to the public and research community, and potentially to guide rescue work. This paper presents an automated way to extract the damaged building images after earthquakes from social media platforms such as Twitter and thus identify the particular user posts containing such images. Using transfer learning and ~6500 manually labelled images, we trained a deep learning model to recognize images with damaged buildings in the scene. The trained model achieved good performance when tested on newly acquired images of earthquakes at different locations and ran in near real-time on Twitter feed after the 2020 M7.0 earthquake in Turkey. Furthermore, to better understand how the model makes decisions, we also implemented the Grad-CAM method to visualize the important locations on the images that facilitate the decision.


title: Spectral estimates of dynamically-defined and amenable operator families

abstract: For dynamically-defined operator families, the Hausdorff distance of the spectra is estimated by the distance of the underlying dynamical systems while the group is amenable. We prove that if the group has strict polynomial growth and both the group action and the coefficients are Lipschitz continuous, then the spectral estimate has a square root behavior or, equivalently, the spectrum map is $ \frac{1}{2} $-H\"older continuous. We prove the behavior can be improved resulting in the spectrum map being Lipschitz continuous if the coefficients are locally-constant. In 1990, the square root behavior was established for the Almost Mathieu Operator or, more generally, the quasiperiodic operators with Lipschitz continuous potentials. Our results extend the square root behavior to a bigger class of operators such as (magnetic) discrete Schr\"odinger operators with finite range and with Lipschitz continuous coefficients.


title: Circular motion of particle around Schwarzschild-MOG black hole

abstract: In this note, we have analyzed the circular motion of test particles around the Schwarzschild-MOG black hole. First, we have studied the shadow cast by the spherical symmetric black hole within MOG gravity. It has been shown that due to the effect of MOG both the photonspere and shadow of the black hole increase. We have also shown that the characteristic radii of massive particles circularly orbiting around the Schwarzschild-MOG black hole, namely, the innermost stable circular orbits (ISCO) and marginally bound orbits are greater than that in pure Schwarzschild one. Assuming a black hole in the external uniform magnetic field we have studied the structure of the electromagnetic field. We have shown that the magnetic field behaves like non-uniform in the vicinity of the Schwarzschild-MOG black hole and field lines become denser. Finally, we investigated charged particles' motion around the Schwarzschild-MOG black hole in the presence of an external magnetic field and shown that the ISCO position for charged particle is always less than one for neutral particles.


title: Music Sentiment Transfer

abstract: Music sentiment transfer is a completely novel task. Sentiment transfer is a natural evolution of the heavily-studied style transfer task, as sentiment transfer is rooted in applying the sentiment of a source to be the new sentiment for a target piece of media; yet compared to style transfer, sentiment transfer has been only scantily studied on images. Music sentiment transfer attempts to apply the high level objective of sentiment transfer to the domain of music. We propose CycleGAN to bridge disparate domains. In order to use the network, we choose to use symbolic, MIDI, data as the music format. Through the use of a cycle consistency loss, we are able to create one-to-one mappings that preserve the content and realism of the source data. Results and literature suggest that the task of music sentiment transfer is more difficult than image sentiment transfer because of the temporal characteristics of music and lack of existing datasets.


title: Diurnal variations of resting-state fMRI data: A graph-based analysis

abstract: Circadian rhythms synchronize a variety of physiological processes ranging from neural activity and hormone secretion to sleep cycles and feeding habits. Despite significant diurnal variation, time-of-day (TOD) is rarely recorded or analyzed in human brain research. Moreover, sleep-wake patterns, diurnal preferences, and daytime alertness vary across individuals, known as sleep chronotypes. Here, we performed graph-theory network analysis on resting-state functional MRI (rs-fMRI) data to explore topological differences in whole-brain functional networks between morning and evening sessions (TOD effect), and between extreme morning-type and evening-type chronotypes. To that end, 62 individuals (31 extreme morning, 31 evening-type) underwent two fMRI sessions: about 1 hour after the wake-up time (morning), and 10 hours thereafter, scheduled in accord with their declared habitual sleep-wake pattern. TOD significantly altered functional connectivity (FC) patterns, but there was no significant difference in chronotypic categories. Compared to the morning session, we found relatively increased small-worldness, modularity, assortativity, and synchronization in the evening session, indicating more efficient functional topology. Local measures were changed during the day predominantly across the areas involved in somatomotor, ventral attention, as well as default mode networks. Also, connectivity and hub analyses showed that the somatomotor, ventral attention, and visual networks are the most densely-connected brain areas in both sessions, respectively, with the first being more active in the evening session and the two latter in the morning session. Collectively, these findings suggest TOD can impact classic analyses used in human neuroimaging such as functional connectivity, and should be recorded and included in the analysis of functional neuroimaging data.


title: Updated sensitivity of DUNE in 3+1 scenario with far and near detectors

abstract: In this paper we present the updated physics sensitivity of DUNE in presence of a light sterile neutrino with both far and near detectors. In the previous studies, the sensitivities were obtained using the configuration of DUNE as described in the conceptual design report (CDR). In this article, we consider the configuration of DUNE as given in the technical design report (TDR) and study the capability of this experiment to constrain the sterile mixing parameters as well as its capability to measure the standard oscillation parameters in 3+1 scenario. Our results show that in 3+1 scenario, the sensitivity of DUNE to measure the mass hierarchy, octant and CP violation deteriorates if we only consider the far detector. However, a combined analysis of far and near detector improves the sensitivity.


title: Quasi-probabilities of work and heat in an open quantum system

abstract: We discuss an approach to determine averages of the work, dissipated heat and variation of internal energy of an open quantum system driven by an external classical field. These quantities are measured by coupling the quantum system to a quantum detector at different times. This approach allows us to preserve the full quantum features of the evolution. From the measured phase, we are able to obtain a quasi-characteristic function and a quasi-probability density function for the corresponding observables. Despite the fact that these quasi-probability density functions are not the results of direct measurements, they reproduce the expected value of the physical quantities. Analogously to the Wigner function, the negative regions of these quasi-probability density functions are directly related to pure quantum processes which are not interpretable in classical terms. We use this feature to show that in the limit of strong dissipation, the quantum features vanish and interpret this as the emergence of the classical limit of the energy exchange process. Our analysis explains and confirms the behavior observed in recent experiments performed on IBMQ devices [1]. The possibility to discriminate between classical and quantum features makes the proposed approach an excellent tool to determine if, and in which conditions, quantum effects can be exploited to increase the efficiency in an energy exchange process at the quantum level.


title: Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents

abstract: Communication between embodied AI agents has received increasing attention in recent years. Despite its use, it is still unclear whether the learned communication is interpretable and grounded in perception. To study the grounding of emergent forms of communication, we first introduce the collaborative multi-object navigation task CoMON. In this task, an oracle agent has detailed environment information in the form of a map. It communicates with a navigator agent that perceives the environment visually and is tasked to find a sequence of goals. To succeed at the task, effective communication is essential. CoMON hence serves as a basis to study different communication mechanisms between heterogeneous agents, that is, agents with different capabilities and roles. We study two common communication mechanisms and analyze their communication patterns through an egocentric and spatial lens. We show that the emergent communication can be grounded to the agent observations and the spatial structure of the 3D environment. Video summary: https://youtu.be/kLv2rxO9t0g


title: HyperCube: Implicit Field Representations of Voxelized 3D Models

abstract: Recently introduced implicit field representations offer an effective way of generating 3D object shapes. They leverage implicit decoder trained to take a 3D point coordinate concatenated with a shape encoding and to output a value which indicates whether the point is outside the shape or not. Although this approach enables efficient rendering of visually plausible objects, it has two significant limitations. First, it is based on a single neural network dedicated for all objects from a training set which results in a cumbersome training procedure and its application in real life. More importantly, the implicit decoder takes only points sampled within voxels (and not the entire voxels) which yields problems at the classification boundaries and results in empty spaces within the rendered mesh. To solve the above limitations, we introduce a new HyperCube architecture based on interval arithmetic network, that enables direct processing of 3D voxels, trained using a hypernetwork paradigm to enforce model convergence. Instead of processing individual 3D samples from within a voxel, our approach allows to input the entire voxel (3D cube) represented with its convex hull coordinates, while the target network constructed by a hypernet assigns it to an inside or outside category. As a result our HyperCube model outperforms the competing approaches both in terms of training and inference efficiency, as well as the final mesh quality.


title: Toward SMT-Based Refinement Types in Agda

abstract: Dependent types offer great versatility and power, but developing proofs with them can be tedious and requires considerable human guidance. We propose to integrate Satisfiability Modulo Theories (SMT)-based refinement types into the dependently-typed language Agda in an effort to ease some of the burden of programming with dependent types and combine the strengths of the two approaches to mechanized theorem proving.


title: Quantifying Nations Exposure to Traffic Observation and Selective Tampering

abstract: Almost all popular Internet services are hosted in a select set of countries, forcing other nations to rely on international connectivity to access them. We infer instances where traffic towards a large portion of a country is serviced by a small number of Autonomous Systems, and, therefore, may be exposed to observation or selective tampering. We introduce the Country-level Transit Influence (CTI) metric to quantify the significance of a given AS on the international transit service of a particular country. By studying the CTI values for the top ASes in each country, we find that 32 nations have transit ecosystems that render them particularly exposed, with traffic destined to over 40% of their IP addresses privy to a single AS. In the nations where we are able to validate our findings with in-country operators, we obtain 83% accuracy on average. In the countries we examine, CTI reveals two classes of networks that play a particularly prominent role: submarine cable operators and state-owned ASes.


title: Directionality Reinforcement Learning to Operate Multi-Agent System without Communication

abstract: This paper establishes directionality reinforcement learning (DRL) technique to propose the complete decentralized multi-agent reinforcement learning method which can achieve cooperation based on each agent's learning: no communication and no observation. Concretely, DRL adds the direction "agents have to learn to reach the farthest goal among reachable ones" to learning agents to operate the agents cooperatively. Furthermore, to investigate the effectiveness of the DRL, this paper compare Q-learning agent with DRL with previous learning agent in maze problems. Experimental results derive that (1) DRL performs better than the previous method in terms of the spending time, (2) the direction makes agents learn yielding action for others, and (3) DRL suggests achieving multiagent learning with few costs for any number of agents.


title: Terahertz nanospectroscopy of plasmon polaritons for the evaluation of doping in quantum devices

abstract: Terahertz (THz) waves are a highly sensitive probe of free carrier concentrations in semiconducting materials. However, most experiments operate in the far-field, which precludes the observation of nanoscale features that affect the material response. Here, we demonstrate the use of nanoscale THz plasmon polaritons as an indicator of surface quality in prototypical quantum devices properties. Using THz near-field hyperspectral measurements, we observe polaritonic features in doped silicon near a metal-semiconductor interface. The presence of the THz surface plasmon polariton indicates the existence of a thin film doped layer on the device. Using a multilayer extraction procedure utilising vector calibration, we quantitatively probe the doped surface layer and determine its thickness and complex permittivity. The recovered multilayer characteristics match the dielectric conditions necessary to support the THz surface plasmon polariton. Applying these findings to superconducting resonators, we show that etching of this doped layer leads to an increase of the quality factor as determined by cryogenic measurements. This study demonstrates that THz scattering-type scanning near-field optical microscopy (s-SNOM) is a promising diagnostic tool for characterization of surface dielectric properties of quantum devices.


title: Quantifying Cognitive Factors in Lexical Decline

abstract: We adopt an evolutionary view on language change in which cognitive factors (in addition to social ones) affect the fitness of words and their success in the linguistic ecosystem. Specifically, we propose a variety of psycholinguistic factors -- semantic, distributional, and phonological -- that we hypothesize are predictive of lexical decline, in which words greatly decrease in frequency over time. Using historical data across three languages (English, French, and German), we find that most of our proposed factors show a significant difference in the expected direction between each curated set of declining words and their matched stable words. Moreover, logistic regression analyses show that semantic and distributional factors are significant in predicting declining words. Further diachronic analysis reveals that declining words tend to decrease in the diversity of their lexical contexts over time, gradually narrowing their 'ecological niches'.


title: Nonparametric inference about mean functionals of nonignorable nonresponse data without identifying the joint distribution

abstract: We consider identification and inference about mean functionals of observed covariates and an outcome variable subject to nonignorable missingness. By leveraging a shadow variable, we establish a necessary and sufficient condition for identification of the mean functional even if the full data distribution is not identified. We further characterize a necessary condition for $\sqrt{n}$-estimability of the mean functional. This condition naturally strengthens the identifying condition, and it requires the existence of a function as a solution to a representer equation that connects the shadow variable to the mean functional. Solutions to the representer equation may not be unique, which presents substantial challenges for nonparametric estimation and standard theories for nonparametric sieve estimators are not applicable here. We construct a consistent estimator for the solution set and then adapt the theory of extremum estimators to find from the estimated set a consistent estimator for an appropriately chosen solution. The estimator is asymptotically normal, locally efficient and attains the semiparametric efficiency bound under certain regularity conditions. We illustrate the proposed approach via simulations and a real data application on home pricing.


title: Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification

abstract: The speech representations learned from large-scale unlabeled data have shown better generalizability than those from supervised learning and thus attract a lot of interest to be applied for various downstream tasks. In this paper, we explore the limits of speech representations learned by different self-supervised objectives and datasets for automatic speaker verification (ASV), especially with a well-recognized SOTA ASV model, ECAPA-TDNN [1], as a downstream model. The representations from all hidden layers of the pre-trained model are firstly averaged with learnable weights and then fed into the ECAPA-TDNN as input features. The experimental results on Voxceleb dataset show that the weighted average representation is significantly superior to FBank, a conventional handcrafted feature for ASV. Our best single system achieves 0.537%, 0.569%, and 1.180% equal error rate (EER) on the three official trials of VoxCeleb1, separately. Accordingly, the ensemble system with three pre-trained models can further improve the EER to 0.479%, 0.536% and 1.023%. Among the three evaluation trials, our best system outperforms the winner system [2] of the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC2021) on the VoxCeleb1-E trial.


title: Countable Tensor Products of Hermite Spaces and Spaces of Gaussian Kernels

abstract: In recent years finite tensor products of reproducing kernel Hilbert spaces (RKHSs) of Gaussian kernels on the one hand and of Hermite spaces on the other hand have been considered in tractability analysis of multivariate problems. In the present paper we study countably infinite tensor products for both types of spaces. We show that the incomplete tensor product in the sense of von Neumann may be identified with an RKHS whose domain is a proper subset of the sequence space $\mathbb{R}^\mathbb{N}$. Moreover, we show that each tensor product of spaces of Gaussian kernels having square-summable shape parameters is isometrically isomorphic to a tensor product of Hermite spaces; the corresponding isomorphism is given explicitly, respects point evaluations, and is also an $L^2$-isometry. This result directly transfers to the case of finite tensor products. Furthermore, we provide regularity results for Hermite spaces of functions of a single variable.


title: Synthesizing quasi-bound states in the continuum in epsilon-near-zero layered materials

abstract: Bound states in the continuum (BIC) are highly confined, nonradiative modes that can exist in open structures, despite their potential compatibility and coupling with the radiation spectrum, and may give rise to resonances with arbitrarily large lifetimes. Here, we study this phenomenon in layered materials featuring epsilon-near-zero constituents. Specifically, we outline a systematic procedure to synthesize quasi-BIC resonances at given frequency, incidence angle and polarization, and investigate the role of certain critical parameters in establishing the quality factor of the resonances. Moreover, we also provide an insightful phenomenological interpretation in terms of the recently introduced concept of "photonic doping", and study the effects of the unavoidable material loss and dispersion. Our results indicate the possibility to synthesize sharp resonances, for both transversely magnetic and electric polarizations, which are of potential interest for a variety of nanophotonics scenarios, including light trapping, optical sensing and thermal radiation.


title: We've had this conversation before: A Novel Approach to Measuring Dialog Similarity

abstract: Dialog is a core building block of human natural language interactions. It contains multi-party utterances used to convey information from one party to another in a dynamic and evolving manner. The ability to compare dialogs is beneficial in many real world use cases, such as conversation analytics for contact center calls and virtual agent design. We propose a novel adaptation of the edit distance metric to the scenario of dialog similarity. Our approach takes into account various conversation aspects such as utterance semantics, conversation flow, and the participants. We evaluate this new approach and compare it to existing document similarity measures on two publicly available datasets. The results demonstrate that our method outperforms the other approaches in capturing dialog flow, and is better aligned with the human perception of conversation similarity.


title: BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control Communications

abstract: Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common challenge is speech activity detection (SAD) and speaker diarization (SD). In the failure condition, two or more segments remain in the same recording, jeopardizing the overall performance. We propose a system that combines SAD and a BERT model to perform speaker change detection and speaker role detection (SRD) by chunking ASR transcripts, i.e., SD with a defined number of speakers together with SRD. The proposed model is evaluated on real-life public ATC databases. Our BERT SD model baseline reaches up to 10% and 20% token-based Jaccard error rate (JER) in public and private ATC databases. We also achieved relative improvements of 32% and 7.7% in JERs and SD error rate (DER), respectively, compared to VBx, a well-known SD system.


title: Dynamics of translational and rotational thermalization of AlF molecules via collisions with cryogenic helium

abstract: We investigated helium-mediated translational and rotational thermalization of the aluminum monofluoride (AlF) molecule at cryogenic temperatures via a new $ab \ initio$ potential energy surface (PES) and quantum multichannel scattering theory. Our examination of the elastic and rotationally inelastic channels revealed that helium is an efficient quencher of AlF at temperatures relevant to buffer gas cooling experiments ($\sim1$ mK to $10$ K). We also showed that this conclusion is robust against possible inaccuracies of the PES.


title: Delay-Sensitive and Power-Efficient Quality Control of Dynamic Video Streaming using Adaptive Super-Resolution

abstract: In a decade, the adaptive quality control of video streaming and the super-resolution (SR) technique have been deeply explored. As edge devices improved to have exceptional processing capability than ever before, streaming users can enhance the received image quality to allow the transmitter to compress the images to save its power or pursue network efficiency. In this sense, this paper proposes a novel dynamic video streaming algorithm that adaptively compresses video chunks at the transmitter and separately enhances the quality at the receiver using SR. In order to allow transmission of video chunks with different compression levels and control of the computation burden, we present the adaptive SR network which is optimized by minimizing the weighted sum of losses extracted from different layer outputs. for dynamic video streaming. In addition, we jointly orchestrate video delivery and resource usage, and the proposed video delivery scheme balances the tradeoff well among the average video quality, the queuing delay, buffering time, transmit power, and computation power. Simulation results show that the proposed scheme pursues the quality-of-services (QoS) of the video streaming better than the adaptive quality control without the cooperation of the transmitter and the receiver and the non-adaptive SR network.


title: Two-body collapse model for self-gravitating flow of dark matter and generalized stable clustering hypothesis for pairwise velocity

abstract: Analytical tools are extremely hard to find for non-linear gravitational collpase. Only a few simple but powerful tools exist so far. Two examples are the spherical collapse model (SCM) and stable clustering hypothesis (SCH). We present a new analytical tool, a two-body collapse model (TBCM), that plays the same fundamental role as harmonic oscillator in dynamics. For convenience, TBCM is formulated for gravity with any potential exponent $n$ in a static background with a fixed damping ($n$=-1 for Newtonian gravity). The competition between gravity, expanding background (or damping), and angular momentum classifies two-body collapse into: 1) free fall collapse, where free fall time is greater if same system starts to collapse at earlier time; 2) equilibrium collapse that persists longer in time, whose perturbative solutions lead to power-law evolution of system energy and momentum. Two critical values $\beta_{s1}=1$ and $\beta_{s2}=1/3\pi$ are identified that quantifies the competition between damping and gravity. Value $\beta_{s2}$ only exists for discrete values of potential exponent $n=(2-6m)/(1+3m)=$ -1,-10/7... for integer $m$. Critical density ratio ($\Delta_c=18\pi^2$) is obtained for $n$=-1 that is consistent with SCM. TBCM predicts angular velocity $\propto Hr^{-3/2}$ for two-body system of size $r$. The isothermal density is a result of extremely fast mass accretion. TBCM is able to demonstrate SCH, i.e. mean pairwise velocity (first moment) $\langle\Delta u\rangle=-Hr$. A generalized SCH is developed for higher order moments $\langle\Delta u^{2m+1}\rangle=-(2m+1)\langle\Delta u^{2m}\rangle Hr$ that is validated by N-body simulation. Energy evolution in TBCM is independent of particle mass and energy equipartition does not apply. TBCM can be considered as a non-radial SCM. Both models predict the same critical density ratio, while TBCM contains much richer information.


title: Quantum cosmology with third quantisation

abstract: We review the canonical quantisation of the geometry of the spacetime in the cases of a simply and a non-simply connected manifold. In the former, we analyse the information contained in the solutions of the Wheeler-DeWitt equation and interpret them in terms of the customary boundary conditions that are typically imposed on the semiclassical wave functions. In particular, we review three different paradigms for the quantum creation of a homogeneous and isotropic universe. For the quantisation of a non-simply connected manifold the best framework is the so-called third quantisation formalism, in which the wave function of the universe is seen as a field that propagates in the space of Riemannian $3$-geometries, which turns out to be isomorphic to a (part of a) $1+5$ Minkowski spacetime. Thus, the quantisation of the wave function follows the customary formalism of a quantum field theory. A general review of the formalism is given and it is analysed the creation of the universes, their initial expansion and the appearance of matter after inflation. These features are presented in more detail in the case of a homogeneous and isotropic universe. The main conclusion in both cases is that the most natural way in which the universes should be created is in entangled universe-antiuniverse pairs.


title: Invariant densities for random continued fractions

abstract: We continue the study of random continued fraction expansions, generated by random application of the Gauss and the R\'enyi backward continued fraction maps. We show that this random dynamical system admits a unique absolutely continuous invariant measure with smooth density.


title: Model and Measurements of an Optical Stack for Broadband Visible to Near-IR Absorption in TiN KIDs

abstract: Typical materials for optical Kinetic Inductance Detetectors (KIDs) are metals with a natural absorption of 30-50% in the visible and near-infrared. To reach high absorption efficiencies (90-100%) the KID must be embedded in an optical stack. We show an optical stack design for a 60 nm TiN film. The optical stack is modeled as sections of transmission lines, where the parameters for each section are related to the optical properties of each layer. We derive the complex permittivity of the TiN film from a spectral ellipsometry measurement. The designed optical stack is optimised for broadband absorption and consists of, from top (illumination side) to bottom: 85 nm SiOx, 60 nm TiN, 23 nm of SiOx, and a 100 nm thick Al mirror. We show the modeled absorption and reflection of this stack, which has >80% absorption from 400 nm to 1550 nm and near-unity absorption for 500 nm to 800 nm. We measure transmission and reflection of this stack with a commercial spectrophotometer. The results are in good agreement with the model.


title: Groups of piecewise isometric permutations of lattice points or finitary rearrangements of tessellations

abstract: Through the glasses of didactic reduction: We consider a (periodic) tessellation $\Delta$ of either Euclidean or hyperbolic $n$-space $M$. By a piecewise isometric rearrangement of $\Delta$ we mean the process of cutting $M$ along corank-1 tile-faces into finitely many convex polyhedral pieces, and rearranging the pieces to a new tight covering of the tessellation $\Delta$. Such a rearrangement defines a permutation of the (centers of the) tiles of $\Delta$, and we are interested in the group $PI(\Delta)$ of all piecewise isometric rearrangements of $\Delta$. In this paper we offer: a) An illustration of piecewise isometric rearrangements in the visually attractive hyperbolic plane, b) an explanation how this is related to Richard Thompson's groups, c) a chapter on the structure of the group pei$(\mathbb Z^n)$ of all piecewise Euclidean rearrangements of the standard tessellation of $\mathbb R^n$ by unit-cubes, and d) results on the finiteness properties of some subgroups of pei$(\mathbb Z^n)$.


title: Learning Discrete Representations via Constrained Clustering for Effective and Efficient Dense Retrieval

abstract: Dense Retrieval (DR) has achieved state-of-the-art first-stage ranking effectiveness. However, the efficiency of most existing DR models is limited by the large memory cost of storing dense vectors and the time-consuming nearest neighbor search (NNS) in vector space. Therefore, we present RepCONC, a novel retrieval model that learns discrete Representations via CONstrained Clustering. RepCONC jointly trains dual-encoders and the Product Quantization (PQ) method to learn discrete document representations and enables fast approximate NNS with compact indexes. It models quantization as a constrained clustering process, which requires the document embeddings to be uniformly clustered around the quantization centroids and supports end-to-end optimization of the quantization method and dual-encoders. We theoretically demonstrate the importance of the uniform clustering constraint in RepCONC and derive an efficient approximate solution for constrained clustering by reducing it to an instance of the optimal transport problem. Besides constrained clustering, RepCONC further adopts a vector-based inverted file system (IVF) to support highly efficient vector search on CPUs. Extensive experiments on two popular ad-hoc retrieval benchmarks show that RepCONC achieves better ranking effectiveness than competitive vector quantization baselines under different compression ratio settings. It also substantially outperforms a wide range of existing retrieval models in terms of retrieval effectiveness, memory efficiency, and time efficiency.


title: Free Streaming Length of Axion-Like Particle After Oscillon/ I-ball Decays

abstract: Axion-like particles (ALPs) are pseudoscalar bosons predicted by string theory. The ALPs have a shallower potential than a quadratic one, which induces the instability and can form the solitonic object called oscillon/I-ball. Although the lifetime of oscillons can be very long for some type of potentials, they finally decay until the present. We perform the numerical lattice simulations to investigate the decay process of oscillons and evaluate the averaged momentum of ALPs emitted from the oscillon decay. It is found that, if oscillons decay in the early universe, the free-streaming length of ALPs becomes too long to explain the small-scale observations of the matter power spectrum. We show that oscillons with long lifetimes can change the density fluctuations on small scales, which leads to stringent constraints on the ALP mass and the oscillon lifetime.


title: Large positive magnetoresistance in photocarrier doping potassium tantalites in the extreme quantum limit

abstract: We report on a high-field magnetotransport study of KTaO3 single crystals. This material is a promising candidate to study in the extreme quantum limit (EQL). By photocarrier doping with 360 nm light, we have observed a significant positive, non-saturating, and linear magnetoresistance at low temperatures accompanied by a vanishing Hall coefficient. When cooled down to 10 K and subjected to a magnetic field of 12 T, the value of magnetoresistance of KTaO3 (100) is increased by as much as 433%. Such behavior can be attributed to all electrons occupying only the lowest Landau level in the EQL. In this state, a quantum magnetoresistance is produced. This result provides novel insights into the next generation of magnetic devices based on complex materials and adds a new family of materials with positive magnetoresistance.


title: Aspect-driven User Preference and News Representation Learning for News Recommendation

abstract: News recommender systems are essential for helping users to efficiently and effectively find out those interesting news from a large amount of news. Most of existing news recommender systems usually learn topic-level representations of users and news for recommendation, and neglect to learn more informative aspect-level features of users and news for more accurate recommendation. As a result, they achieve limited recommendation performance. Aiming at addressing this deficiency, we propose a novel Aspect-driven News Recommender System (ANRS) built on aspect-level user preference and news representation learning. Here, news aspect is fine-grained semantic information expressed by a set of related words, which indicates specific aspects described by the news. In ANRS, news aspect-level encoder and user aspect-level encoder are devised to learn the fine-grained aspect-level representations of user's preferences and news characteristics respectively, which are fed into click predictor to judge the probability of the user clicking the candidate news. Extensive experiments are done on the commonly used real-world dataset MIND, which demonstrate the superiority of our method compared with representative and state-of-the-art methods.


title: Note on stability and holographic subregion complexity

abstract: We study holographic subregion complexity in a spatially anisotropic field theory, which expresses a confinement-deconfinement phase transition. Its holographic dual is a five-dimensional anisotropic holographic model characterized by a Van der Waals-like phase transition between small and large black holes. We propose a new interpretation from the informational perspective to determine the stable and unstable thermodynamically solutions. According to this proposal, the states which need (more) less information to be specified characterize the (un) stable solutions. We similarly offer an interpretation to determine the stable and unstable solutions based on the resource of a computational machine, such that the solutions are (un) stable if computational resource (decreases) increases with the increase of temperature. We observe that the effect of anisotropy on holographic subregion complexity is decreasing. This decreasing effect can be interpreted by considering a whole closed system consisting of the state and its environment in which the complexity of the mixed state decreases and complexity of the environment increases.


title: Information Theoretic Structured Generative Modeling

abstract: R\'enyi's information provides a theoretical foundation for tractable and data-efficient non-parametric density estimation, based on pair-wise evaluations in a reproducing kernel Hilbert space (RKHS). This paper extends this framework to parametric probabilistic modeling, motivated by the fact that R\'enyi's information can be estimated in closed-form for Gaussian mixtures. Based on this special connection, a novel generative model framework called the structured generative model (SGM) is proposed that makes straightforward optimization possible, because costs are scale-invariant, avoiding high gradient variance while imposing less restrictions on absolute continuity, which is a huge advantage in parametric information theoretic optimization. The implementation employs a single neural network driven by an orthonormal input appended to a single white noise source adapted to learn an infinite Gaussian mixture model (IMoG), which provides an empirically tractable model distribution in low dimensions. To train SGM, we provide three novel variational cost functions, based on R\'enyi's second-order entropy and divergence, to implement minimization of cross-entropy, minimization of variational representations of $f$-divergence, and maximization of the evidence lower bound (conditional probability). We test the framework for estimation of mutual information and compare the results with the mutual information neural estimation (MINE), for density estimation, for conditional probability estimation in Markov models as well as for training adversarial networks. Our preliminary results show that SGM significantly improves MINE estimation in terms of data efficiency and variance, conventional and variational Gaussian mixture models, as well as the performance of generative adversarial networks.


title: Effect of Overdispersion of Lethal Lesions on Cell Survival Curves

abstract: We explore the effects of overdispersed DNA lesion distribution on the shapes of cell surviving curves of mammalian cells exposed to hadrons at various doses. To provide a theoretical framework in resolving discrepancies between experimental data and Linear-quadratic (LQ)model predictions, we employ a non-Poisson distribution of lethal lesions together with non-homologous end-joining (NHEJ) pathway of double-strand break (DSB) repair. A negative binomial (NB)distribution is used to study the effect of the overdispersion on the shapes and possible reduction of dose-response curvature at high doses. The error distribution is customized to include an adjustable parameter so that the overdispersion parameter of NB is not constant but depends on the mean of the distribution. The trends in predicted cell survival responses are compared with the experimental data in low and high dose regions at various LET values for proton, helium, and carbon ions. The cell survival responses calculated by the present method reveal straightening of survival curves at high doses. This suggests that the overdispersion causes the cell survival dose-response to approximate log-linear behaviour at high doses. Comparison of the cell survival predictions with the Particle Irradiation Data Ensemble (PIDE) shows that the NB model provides better fits to the experimental data following low and intermediate doses. Whereas the model predictions are not validated at tiny and very high doses, nonetheless, the presented approach provides insight into underlying microscopic mechanisms which may help to improve the radiobiological responses along the dose-response curves and resolve discrepancies between experimental data and current cell survival models.


title: Uplink Performance of Cell-Free Massive MIMO Over Spatially Correlated Rician Fading Channels

abstract: We consider a practical cell-free massive multiple-input-multiple-output (MIMO) system with multi-antenna access points (APs) and spatially correlated Rician fading channels. The significant phase-shift of the line-of-sight component induced by the user equipment movement is modeled randomly. Furthermore, we investigate the uplink spectral efficiency (SE) with maximum ratio (MR)/local minimum mean squared error (L-MMSE) combining and optimal large-scale fading decoding based on the phase-aware MMSE, phase-aware element-wise MMSE and linear MMSE (LMMSE) estimators. Then new closed-form SE expressions with MR combining are derived. Numerical results validate our derived expressions and show that the SE benefits from the spatial correlation. It is important to observe that the performance gap between L-MMSE and MR combining increases with the number of antennas per AP and the SE of the LMMSE estimator is lower than that of other estimators due to the lack of phase-shifts knowledge.


title: Zero-bias Deep Neural Network for Quickest RF Signal Surveillance

abstract: The Internet of Things (IoT) is reshaping modern society by allowing a decent number of RF devices to connect and share information through RF channels. However, such an open nature also brings obstacles to surveillance. For alleviation, a surveillance oracle, or a cognitive communication entity needs to identify and confirm the appearance of known or unknown signal sources in real-time. In this paper, we provide a deep learning framework for RF signal surveillance. Specifically, we jointly integrate the Deep Neural Networks (DNNs) and Quickest Detection (QD) to form a sequential signal surveillance scheme. We first analyze the latent space characteristic of neural network classification models, and then we leverage the response characteristics of DNN classifiers and propose a novel method to transform existing DNN classifiers into performance-assured binary abnormality detectors. In this way, we seamlessly integrate the DNNs with the parametric quickest detection. Finally, we propose an enhanced Elastic Weight Consolidation (EWC) algorithm with better numerical stability for DNNs in signal surveillance systems to evolve incrementally, we demonstrate that the zero-bias DNN is superior to regular DNN models considering incremental learning and decision fairness. We evaluated the proposed framework using real signal datasets and we believe this framework is helpful in developing a trustworthy IoT ecosystem.


title: Adapting TTS models For New Speakers using Transfer Learning

abstract: Training neural text-to-speech (TTS) models for a new speaker typically requires several hours of high quality speech data. Prior works on voice cloning attempt to address this challenge by adapting pre-trained multi-speaker TTS models for a new voice, using a few minutes of speech data of the new speaker. However, publicly available large multi-speaker datasets are often noisy, thereby resulting in TTS models that are not suitable for use in products. We address this challenge by proposing transfer-learning guidelines for adapting high quality single-speaker TTS models for a new speaker, using only a few minutes of speech data. We conduct an extensive study using different amounts of data for a new speaker and evaluate the synthesized speech in terms of naturalness and voice/style similarity to the target speaker. We find that fine-tuning a single-speaker TTS model on just 30 minutes of data, can yield comparable performance to a model trained from scratch on more than 27 hours of data for both male and female target speakers.


title: $\mathbb{A}^1$-connectivity of moduli of vector bundles on a curve

abstract: In this note we prove that the moduli stack of vector bundles on a curve, with a fixed determinant is $\mathbb{A}^1$-connected. We obtain this result by classifying vector bundles on a curve upto $\mathbb{A}^1$-concordance. Consequently we classify$\mathbb{P}^n$- bundles on a curve upto $\mathbb{A}^1$-weak equivalence, extending a result of Asok-Morel. We also give an explicit example of a variety which is $\mathbb{A}^1$-h-cobordant to a projective bundle over $\mathbb{P}^2$ but does not have the structure of a projective bundle over $\mathbb{P}^2$, thus answering a question of Asok-Kebekus-Wendt


title: Tensor renormalization group and the volume independence in 2D U($N$) and SU($N$) gauge theories

abstract: The tensor renormalization group method is a promising approach to lattice field theories, which is free from the sign problem unlike standard Monte Carlo methods. One of the remaining issues is the application to gauge theories, which is so far limited to U(1) and SU(2) gauge groups. In the case of higher rank, it becomes highly nontrivial to restrict the number of representations in the character expansion to be used in constructing the fundamental tensor. We propose a practical strategy to accomplish this and demonstrate it in 2D U($N$) and SU($N$) gauge theories, which are exactly solvable. Using this strategy, we obtain the singular-value spectrum of the fundamental tensor, which turns out to have a definite profile in the large-$N$ limit. For the U($N$) case, in particular, we show that the large-$N$ behavior of the singular-value spectrum changes qualitatively at the critical coupling of the Gross-Witten-Wadia phase transition. As an interesting consequence, we find a new type of volume independence in the large-$N$ limit of the 2D U($N$) gauge theory with the $\theta$ term in the strong coupling phase, which goes beyond the Eguchi-Kawai reduction.


title: A Simple Way to Verify Linearizability of Concurrent Stacks

abstract: Linearizability is a commonly accepted correctness criterion for concurrent data structures. However, verifying linearizability of highly concurrent data structures is still a challenging task. In this paper, we present a simple and complete proof technique for verifying linearizability of concurrent stacks. Our proof technique reduces linearizability of concurrent stacks to establishing a set of conditions. These conditions are based on the happened-before order of operations, intuitively express the LIFO semantics and can be proved by simple arguments. Designers of concurrent data structures can easily and quickly learn to use the proof technique. We have successfully applied the method to several challenging concurrent stacks: the TS stack, the HSY stack, and the FA stack, etc.


title: Codabench: Flexible, Easy-to-Use and Reproducible Benchmarking Platform

abstract: Obtaining standardized crowdsourced benchmark of computational methods is a major issue in data science communities. Dedicated frameworks enabling fair benchmarking in a unified environment are yet to be developed. Here we introduce Codabench, an open-source, community-driven platform for benchmarking algorithms or software agents versus datasets or tasks. A public instance of Codabench (https://www.codabench.org/) is open to everyone, free of charge, and allows benchmark organizers to compare fairly submissions, under the same setting (software, hardware, data, algorithms), with custom protocols and data formats. Codabench has unique features facilitating the organization of benchmarks flexibly, easily and reproducibly, such as the possibility of re-using templates of benchmarks, and supplying compute resources on-demand. Codabench has been used internally and externally on various applications, receiving more than 130 users and 2500 submissions. As illustrative use cases, we introduce 4 diverse benchmarks covering Graph Machine Learning, Cancer Heterogeneity, Clinical Diagnosis and Reinforcement Learning.


title: SDWNet: A Straight Dilated Network with Wavelet Transformation for Image Deblurring

abstract: Image deblurring is a classical computer vision problem that aims to recover a sharp image from a blurred image. To solve this problem, existing methods apply the Encode-Decode architecture to design the complex networks to make a good performance. However, most of these methods use repeated up-sampling and down-sampling structures to expand the receptive field, which results in texture information loss during the sampling process and some of them design the multiple stages that lead to difficulties with convergence. Therefore, our model uses dilated convolution to enable the obtainment of the large receptive field with high spatial resolution. Through making full use of the different receptive fields, our method can achieve better performance. On this basis, we reduce the number of up-sampling and down-sampling and design a simple network structure. Besides, we propose a novel module using the wavelet transform, which effectively helps the network to recover clear high-frequency texture details. Qualitative and quantitative evaluations of real and synthetic datasets show that our deblurring method is comparable to existing algorithms in terms of performance with much lower training requirements. The source code and pre-trained models are available at https://github.com/FlyEgle/SDWNet.


title: Complexity of direct and iterative solvers on space-time formulations versus time--marching schemes for h-refined grids towards singularities

abstract: We study computational complexity aspects for Finite Element formulations considering hypercubic space--time full and time--marching discretization schemes for $h$--refined grids towards singularities. We perform a relatively comprehensive study of comparing the computational time via time complexities of direct and iterative solvers. We focus on the space-time formulation with refined computational grids and on the corresponding time slabs, namely, computational grids obtained by taking the "cross-sections" of the refined space-time mesh. We compare the computational complexity of the space-time formulation and the corresponding time--marching scheme. Our consideration concerns the computational complexity of the multi-frontal solvers, the iterative solvers, as well as the static condensation. Numerical experiments with Octave confirm our theoretical findings.


title: Real-time Skeletonization for Sketch-based Modeling

abstract: Skeleton creation is an important phase in the character animation pipeline. However, handcrafting skeleton takes extensive labor time and domain knowledge. Automatic skeletonization provides a solution. However, most of the current approaches are far from real-time and lack the flexibility to control the skeleton complexity. In this paper, we present an efficient skeletonization method, which can be seamlessly integrated into the sketch-based modeling process in real-time. The method contains three steps: local sub-skeleton extraction; sub-skeleton connection; and global skeleton refinement. Firstly, the local skeleton is extracted from the processed polygon stroke and forms a subpart along with the sub-mesh. Then, local sub-skeletons are connected according to the intersecting relationships and the modeling sequence of subparts. Lastly, a global refinement method is proposed to give users coarse-to-fine control on the connected skeleton. We demonstrate the effectiveness of our method on a variety of examples created by both novices and professionals.


title: Searching for low-mass dark matter via Migdal effect in COSINE-100

abstract: We report on the search for weakly interacting massive particle (WIMP) dark matter candidates in the galactic halo that interact with sodium and iodine nuclei in the COSINE-100 experiment and produce energetic electrons that accompany recoil nuclei via the the Migdal effect. The WIMP mass sensitivity of previous COSINE-100 searches that relied on the detection of ionization signals produced by target nuclei recoiling from elastic WIMP-nucleus scattering was restricted to WIMP masses above $\sim$5 GeV/$c^2$ by the detectors' 1 keVee energy-electron-equivalent threshold. The search reported here looks for recoil signals enhanced by the Migdal electrons that are ejected during the scattering process. This is particularly effective for the detection of low-mass WIMP scattering from the crystals' sodium nuclei in which a relatively larger fraction of the WIMP's energy is transferred to the nucleus recoil energy and the excitation of its orbital electrons. In this analysis, the low-mass WIMP search window of the COSINE-100 experiment is extended to WIMP mass down to 200 MeV/$c^2$. The low-mass WIMP sensitivity will be further improved by lowering the analysis threshold based on a multivariable analysis technique. We consider the influence of these improvements and recent developments in detector performance to re-evaluate sensitivities for the future COSINE-200 experiment. With a 0.2 keVee analysis threshold and high light-yield NaI(Tl) detectors (22 photoelectrons/keVee), the COSINE-200 experiment can explore low-mass WIMPs down to 20 MeV/$c^2$ and probe previously unexplored regions of parameter space.


title: Optimizing Ranking Systems Online as Bandits

abstract: Ranking system is the core part of modern retrieval and recommender systems, where the goal is to rank candidate items given user contexts. Optimizing ranking systems online means that the deployed system can serve user requests, e.g., queries in the web search, and optimize the ranking policy by learning from user interactions, e.g., clicks. Bandit is a general online learning framework and can be used in our optimization task. However, due to the unique features of ranking, there are several challenges in designing bandit algorithms for ranking system optimization. In this dissertation, we study and propose solutions for four challenges in optimizing ranking systems online: effectiveness, safety, nonstationarity, and diversification. First, the effectiveness is related to how fast the algorithm learns from interactions. We study the effective online ranker evaluation task and propose the MergeDTS algorithm to solve the problem effectively. Second, the deployed algorithm should be safe, which means the algorithm only displays reasonable content to user requests. To solve the safe online learning to rank problem, we propose the BubbleRank algorithm. Third, as users change their preferences constantly, the algorithm should handle the nonstationarity. We formulate this nonstationary online learning to rank problem as cascade non-stationary bandits and propose CascadeDUCB and CascadeSWUCB algorithms to solve the problem. Finally, the contents in ranked lists should be diverse. We consider the results diversification task and propose the CascadeHybird algorithm that considers both the item relevance and results diversification when learning from user interactions.


title: Worst-case Delay Bounds in Time-Sensitive Networks with Packet Replication and Elimination

abstract: Packet replication and elimination functions are used by time-sensitive networks (as in the context of IEEE TSN and IETF DetNet) to increase the reliability of the network. Packets are replicated onto redundant paths by a replication function. Later the paths merge again and an elimination function removes the duplicates. This redundancy scheme has an effect on the timing behavior of time-sensitive networks and many challenges arise from conducting timing analyses. The replication can induce a burstiness increase along the paths of replicates, as well as packet mis-ordering that could increase the delays in the crossed bridges or routers. The induced packet mis-ordering could also negatively affect the interactions between the redundancy and scheduling mechanisms such as traffic regulators (as with per-flow regulators and interleaved regulators, implemented by TSN asynchronous traffic shaping). Using the network calculus framework, we provide a method of worst-case timing analysis for time-sensitive networks that implement redundancy mechanisms in the general use case, i.e., at end-devices and/or intermediate nodes. We first provide a network calculus toolbox for bounding the burstiness increase and the amount of reordering caused by the elimination function of duplicate packets. We then analyze the interactions with traffic regulators and show that their shaping-for-free property does not hold when placed after a packet elimination function. We provide a bound for the delay penalty when using per-flow regulators and prove that the penalty is not bounded with interleaved regulators. Finally, we use an industrial use-case to show the applicability and the benefits of our findings.


title: Couple Learning for semi-supervised sound event detection

abstract: The recently proposed Mean Teacher method, which exploits large-scale unlabeled data in a self-ensembling manner, has achieved state-of-the-art results in several semi-supervised learning benchmarks. Spurred by current achievements, this paper proposes an effective Couple Learning method that combines a well-trained model and a Mean Teacher model. The suggested pseudo-labels generated model (PLG) increases strongly- and weakly-labeled data to improve the Mean Teacher method-s performance. Moreover, the Mean Teacher-s consistency cost reduces the noise impact in the pseudo-labels introduced by detection errors. The experimental results on Task 4 of the DCASE2020 challenge demonstrate the superiority of the proposed method, achieving about 44.25% F1-score on the public evaluation set, significantly outperforming the baseline system-s 32.39%. At the same time, we also propose a simple and effective experiment called the Variable Order Input (VOI) experiment, which proves the significance of the Couple Learning method. Our developed Couple Learning code is available on GitHub.


title: Open Player Modeling: Empowering Players through Data Transparency

abstract: Data is becoming an important central point for making design decisions for most software. Game development is not an exception. As data-driven methods and systems start to populate these environments, a good question is: can we make models developed from this data transparent to users? In this paper, we synthesize existing work from the Intelligent User Interface and Learning Science research communities, where they started to investigate the potential of making such data and models available to users. We then present a new area exploring this question, which we call Open Player Modeling, as an emerging research area. We define the design space of Open Player Models and present exciting open problems that the games research community can explore. We conclude the paper with a case study and discuss the potential value of this approach.


title: Geometry effects in topologically confined bilayer graphene loops

abstract: We investigate the electronic confinement in bilayer graphene by topological loops of different shapes. These loops are created by lateral gates acting via gap inversion on the two graphene sheets. For large-area loops the spectrum is well described by a quantization rule depending only on the loop perimeter. For small sizes, the spectrum depends on the loop shape. We find that zero-energy states exhibit a characteristic pattern that strongly depends on the spatial symmetry. We show this by considering loops of higher to lower symmetry (circle, square, rectangle and irregular polygon). Interestingly, magnetic field causes valley splittings of the states, an asymmetry between energy reversal states, flux periodicities and the emergence of persistent currents.


title: Satellite Image Semantic Segmentation

abstract: In this paper, we propose a method for the automatic semantic segmentation of satellite images into six classes (sparse forest, dense forest, moor, herbaceous formation, building, and road). We rely on Swin Transformer architecture and build the dataset from IGN open data. We report quantitative and qualitative segmentation results on this dataset and discuss strengths and limitations. The dataset and the trained model are made publicly available.


title: Real-space observation of emergent complexity of phase evolution in micrometer-sized IrTe$_2$ crystals

abstract: We report complex behaviors in the phase evolution of transition-metal dichalcogenide IrTe$_2$ thin flakes, captured with real-space observations using scanning Raman microscopy. The phase transition progresses via growth of a small number of domains, which is unlikely in statistical models that assume a macroscopic number of nucleation events. Consequently, the degree of phase evolution in the thin flakes is quite variable for the selected specimen and for a repeated measurement sequence, representing the emergence of complexity in the phase evolution. In the $\sim$20-$\mu$m$^3$-volume specimen, the complex phase evolution results in the emergent coexistence of a superconducting phase that originally requires chemical doping to become thermodynamically stable. These findings indicate that the complexity involved in phase evolution considerably affects the physical properties of a small-sized specimen.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.supr-con


title: Uncertainty quantification and control of kinetic models of tumour growth under clinical uncertainties

abstract: In this work, we develop a kinetic model of tumour growth taking into account the effects of clinical uncertainties characterising the tumours' progression. The action of therapeutic protocols trying to steer the tumours' volume towards a target size is then investigated by means of suitable selective-type controls acting at the level of cellular dynamics. By means of classical tools of statistical mechanics for many-agent systems, we are able to prove that it is possible to dampen clinical uncertainties across the scales. To take into account the scarcity of clinical data and the possible source of error in the image segmentation of tumours' evolution, we estimated empirical distributions of relevant parameters that are considered to calibrate the resulting model obtained from real cases of primary glioblastoma. Suitable numerical methods for uncertainty quantification of the resulting kinetic equations are discussed and, in the last part of the paper, we compare the effectiveness of the introduced control approaches in reducing the variability in tumours' size due to the presence of uncertain quantities.

categories: math.OC nlin.AO physics.bio-ph q-bio.PE q-bio.QM


title: Covariance-Based Joint Device Activity and Delay Detection in Asynchronous mMTC

abstract: In this letter, we study the joint device activity and delay detection problem in asynchronous massive machine-type communications (mMTC), where all active devices asynchronously transmit their preassigned preamble sequences to the base station (BS) for device identification and delay detection. We first formulate this joint detection problem as a maximum likelihood estimation problem, which depends on the received signal only through its sample covariance, and then propose efficient coordinate descent type of algorithms to solve the formulated problem. Our proposed covariance-based approach is sharply different from the existing compressed sensing (CS) approach for the same problem. Numerical results show that our proposed covariance-based approach significantly outperforms the CS approach in terms of the detection performance since our proposed approach can make better use of the BS antennas than the CS approach.


title: Form-preserving Darboux transformations for $4\times 4$ Dirac equations

abstract: Darboux transformation is a powerful tool for the construction of new solvable models in quantum mechanics. In this article, we discuss its use in the context of physical systems described by $4\times4$ Dirac Hamiltonians. The general framework provides limited control over the resulting energy operator, so that it can fail to have the required physical interpretation. We show that this problem can be circumvented with the reducible Darboux transformation that can preserve the required form of physical interactions by construction. To demonstrate it explicitly, we focus on distortion scattering and spin-orbit interaction of Dirac fermions in graphene. We use the reducible Darboux transformation to construct exactly solvable models of these systems where backscattering is absent, i.e. the models are reflectionless.

categories: quant-ph cond-mat.mes-hall math-ph math.MP


title: WRF model parameter calibration to improve the prediction of tropical cyclones over the Bay of Bengal using Machine Learning-based Multiobjective Optimization

abstract: The prediction skill of a numerical model can be enhanced by calibrating the sensitive parameters that significantly influence the model forecast. The objective of the present study is to improve the prediction of surface wind speed and precipitation by calibrating the Weather Research and Forecasting (WRF) model parameters for the simulations of tropical cyclones over the Bay of Bengal region. Ten tropical cyclones across different intensity categories between 2011 and 2017 are selected for the calibration experiments. Eight sensitive model parameters are calibrated by minimizing the prediction error corresponding to 10m wind speed and precipitation, using a multiobjective adaptive surrogate model-based optimization (MO-ASMO) framework. The 10m wind speed and precipitation simulated by the default and calibrated parameter values across different aspects are compared. The results show that the calibrated parameters improved the prediction of 10m wind speed by 17.62% and precipitation by 8.20% compared to the default parameters. The effect of calibrated parameters on other model output variables, such as cyclone track and intensities, and 500 hPa wind fields, is investigated. Eight tropical cyclones across different categories between 2011 and 2018 are selected to corroborate the performance of the calibrated parameter values for other cyclone events. Finally, the robustness of the calibrated parameters across different boundary conditions and grid resolutions is also examined. These results will have significant implications for improving the predictability of tropical cyclone characteristics. This allows us to better plan the adaptation and mitigation strategies and thus help in preventing the adverse effects on society.


title: Collapsed ancient solutions of the Ricci flow on compact homogeneous spaces

abstract: We prove a general existence theorem for collapsed ancient solutions to the Ricci flow on compact homogeneous spaces and we show that they converge in the Gromov-Hausdorff topology, under a suitable rescaling, to an Einstein metric on the base of a torus fibration. This construction generalizes all previous known examples in the literature.


title: Event-Based high-speed low-latency fiducial marker tracking

abstract: Motion and dynamic environments, especially under challenging lighting conditions, are still an open issue for robust robotic applications. In this paper, we propose an end-to-end pipeline for real-time, low latency, 6 degrees-of-freedom pose estimation of fiducial markers. Instead of achieving a pose estimation through a conventional frame-based approach, we employ the high-speed abilities of event-based sensors to directly refine the spatial transformation, using consecutive events. Furthermore, we introduce a novel two-way verification process for detecting tracking errors by backtracking the estimated pose, allowing us to evaluate the quality of our tracking. This approach allows us to achieve pose estimation at a rate up to 156~kHz, while only relying on CPU resources. The average end-to-end latency of our method is 3~ms. Experimental results demonstrate outstanding potential for robotic tasks, such as visual servoing in fast action-perception loops.


title: CoarSAS2hvec: Heterogeneous Information Network Embedding with Balanced Network Sampling

abstract: Heterogeneous information network (HIN) embedding aims to find the representations of nodes that preserve the proximity between entities of different nature. A family of approaches that are wildly adopted applies random walk to generate a sequence of heterogeneous context, from which the embedding is learned. However, due to the multipartite graph structure of HIN, hub nodes tend to be over-represented in the sampled sequence, giving rise to imbalanced samples of the network. Here we propose a new embedding method CoarSAS2hvec. The self-avoid short sequence sampling with the HIN coarsening procedure (CoarSAS) is utilized to better collect the rich information in HIN. An optimized loss function is used to improve the performance of the HIN structure embedding. CoarSAS2hvec outperforms nine other methods in two different tasks on four real-world data sets. The ablation study confirms that the samples collected by CoarSAS contain richer information of the network compared with those by other methods, which is characterized by a higher information entropy. Hence, the traditional loss function applied to samples by CoarSAS can also yield improved results. Our work addresses a limitation of the random-walk-based HIN embedding that has not been emphasized before, which can shed light on a range of problems in HIN analyses.


title: First passage percolation in hostile environment is not monotone

abstract: We study a natural growth process with competition, modeled by two first passage percolation processes, $FPP_1$ and $FPP_\lambda$, spreading on a graph. $FPP_1$ starts at the origin and spreads at rate $1$, whereas $FPP_\lambda$ starts from a random set of \emph{inactive seeds} distributed as Bernoulli percolation of parameter $\mu\in (0,1)$. A seed of $FPP_\lambda$ gets activated when one of the two processes attempts to occupy its location, and from this moment onwards spreads at some fixed rate $\lambda>0$. In previous works~[17, 3, 7] it has been shown that when both $\mu$ or $\lambda$ are small enough, then $FPP_1$ \emph{survives} (i.e., it occupies an infinite set of vertices) with positive probability. It might seem intuitive that decreasing $\mu$ or $\lambda$ is beneficial to $FPP_1$. However, we prove that, in general, this is indeed false by constructing a graph for which the probability that $FPP_1$ survives is not a monotone function of $\mu$ or $\lambda$, implying the existence of multiple phase transitions. This behavior contrasts with other natural growth processes such as the $2$-type Richardson model.


title: The Onsager-Machlup Integral for Non-reciprocal Systems with Odd Elasticity

abstract: The variational principle of the Onsager-Machlup integral is used to describe the stochastic dynamics of a micromachine, such as an enzyme, characterized by odd elasticity. The obtained most probable path is found to become non-reciprocal in the presence of odd elasticity and is further related to the entropy production.


title: Modular Nuclearity and Entanglement measures

abstract: In the framework of Algebraic Quantum Field Theory, several operator algebraic notions of entanglement entropy can be associated to a couple of causally disjoint and distant spacetime regions $\mathcal{S}_A$ and $\mathcal{S}_B$. In this work, we show that the mutual information is finite in any local QFT verifying a modular $p$-nuclearity condition for some $0 < p <1$. A similar result is proved for another recently studied entanglement measure. Furthermore, if we assume conformal covariance then by comparison with other entanglement measures we can state that the mutual information satisfies lower bounds of area law type when the distance between $\mathcal{S}_A$ and $\mathcal{S}_B$ approaches to zero. As an application, in $1+1$-dimensional integrable models with factorizing S-matrices, we study the asymptotic behaviour of different entanglement measures as the distance between two causally disjoint wedges diverges.


title: Geometric phases and the Sagnac effect: Foundational aspects and sensing applications

abstract: Geometric phase is a key player in many areas of quantum science and technology. In this review article, several foundational aspects of quantum geometric phases and their relations to classical geometric phases are outlined. How the Aharonov--Bohm and Sagnac effects fit into this context is then discussed. Moreover, a concise overview of technological applications of the latter, with special emphasis on gravitational sensing, like in gyroscopes and gravitational wave detectors is presented.


title: Finite groups of bimeromorphic selfmaps of non-uniruled K\"ahler threefolds

abstract: We prove the Jordan property for groups of bimeromorphic selfmaps of three-dimensional compact K\"ahler varieties of non-negative Kodaira dimension and positive irregularity.


title: Uniform concentration bounds for frequencies of rare events

abstract: New Vapnik and Chervonenkis type concentration inequalities are derived for the empirical distribution of an independent random sample. Focus is on the maximal deviation over classes of Borel sets within a low probability region. The constants are explicit, enabling numerical comparisons.


title: A characterization of 4-$\chi_S$-vertex-critical graphs for packing sequences with $s_1 =1$ and $s_2\ge 3$

abstract: If $S=(s_1,s_2,\ldots)$ is a non-decreasing sequence of positive integers, then the $S$-packing $k$-coloring of a graph $G$ is a mapping $c: V(G)\rightarrow[k]$ such that if $c(u)=c(v)=i$ for $u\neq v\in V(G)$, then $d_G(u,v)>s_i$. The $S$-packing chromatic number of $G$ is the smallest integer $k$ such that $G$ admits an $S$-packing $k$-coloring. A graph $G$ is $\chi_S$-vertex-critical if $\chi_S(G-u) < \chi_S(G)$ for each $u\in V(G)$. If $G$ is $\chi_S$-vertex-critical and $\chi_S(G) = k$, then $G$ is $k$-$\chi_S$-vertex-critical. In this paper, $4$-$\chi_S$-vertex-critical graphs are characterized for sequences $S = (1,s_2, s_3, \ldots)$ with $s_2 \ge 3$. There are $28$ sporadic examples and two infinite families of such graphs.


title: An Empirical Study of Configuration Mismatches in Linux

abstract: Ideally the variability of a product line is represented completely and correctly by its variability model. However, in practice additional variability is often represented on the level of the build system or in the code. Such a situation may lead to inconsistencies, where the actually realized variability does not fully correspond to the one described by the variability model. In this paper we focus on configuration mismatches, i.e., cases where the effective variability differs from the variability as it is represented by the variability model. While previous research has already shown that these situations still exist even today in well-analyzed product lines like Linux, so far it was unclear under what circumstances such issues occur in reality. In particular, it is open what types of configuration mismatches occur and how severe they are. Here, our contribution is to close this gap by presenting a detailed manual analysis of 80 configuration mismatches in the Linux 4.4.1 kernel and assess their criticality. We identify various categories of configuration issues and show that about two-thirds of the configuration mismatches may actually lead to kernel misconfigurations.


title: Formation of the Thebe Extension in the Ring System of Jupiter

abstract: Jupiter's tenuous dust ring system is embedded in the planet's inner magnetosphere, and - among other structures - contains a very tenuous protrusion called the Thebe extension. In an attempt to explain the existence of this swath of particles beyond Thebe's orbit, Hamilton and Kr\"uger (2008) proposed that the dust particle motion is driven by a shadow resonance caused by variable dust charging on the day and night side of Jupiter. However, the model by Divine (1983) together with recent observations by the Juno spacecraft indicates a warm and rather dense inner magnetosphere of Jupiter which implies that the mechanism of the shadow resonance does not work. Instead we argue that dust grains ejected from Thebe due to micrometeoroid bombardment become the source of dust in the Thebe extension. We show that large (grain radii of a few micrometers up to multi-micrometers) charged dust grains having significant initial velocities oscillate in the Thebe extension. Smaller charged grains (with sub-micrometer radii) ejected from Thebe do not spend much time in the Thebe extension and migrate into the Thebe ring. At the same time, if such grains are ejected from larger dust grains in the Thebe extension due to fragmentation, they continue to oscillate within the Thebe extension for years. We argue that fragmentation of large dust grains in the Thebe extension could be the main source of sub-micrometer grains detected in the Thebe extension.


title: Swish-Driven GoogleNet for Intelligent Analog Beam Selection in Terahertz Beamspace MIMO

abstract: In this paper, we propose an intelligent analog beam selection strategy in a terahertz (THz) band beamspace multiple-input multiple-output (MIMO) system. First inspired by transfer learning, we fine-tune the pre-trained off-the-shelf GoogleNet classifier, to learn analog beam selection as a multi-class mapping problem. Simulation results show 83% accuracy for the analog beam selection, which subsequently results in 12% spectral efficiency (SE) gain, upon the existing counterparts. Towards a more accurate classifier, we replace the conventional rectified linear unit (ReLU) activation function of the GoogleNet with the recently proposed Swish and retrain the fine-tuned GoogleNet to learn analog beam selection. It is numerically indicated that the fine-tuned Swish-driven GoogleNet achieves 86% accuracy, as well as 18% improvement in achievable SE, upon the similar schemes. Eventually, a strong ensembled classifier is developed to learn analog beam selection by sequentially training multiple fine-tuned Swish-driven GoogleNet classifiers. According to the simulations, the strong ensembled model is 90% accurate and yields 27% gain in achievable SE, in comparison with prior methods.


title: On the oscillation of certain second-order linear differential equations

abstract: This paper consists of three parts: First, letting $b_1(z)$, $b_2(z)$, $p_1(z)$ and $p_2(z)$ be nonzero polynomials such that $p_1(z)$ and $p_2(z)$ have the same degree $k\geq 1$ and distinct leading coefficients $1$ and $\alpha$, respectively, we solve entire solutions of the Tumura--Clunie type differential equation $f^{n}+P(z,f)=b_1(z)e^{p_1(z)}+b_2(z)e^{p_2(z)}$, where $n\geq 2$ is an integer, $P(z,f)$ is a differential polynomial in $f$ of degree $\leq n-1$ with coefficients having polynomial growth. Second, we study the oscillation of the second-order differential equation $f''-[b_1(z)e^{p_1(z)}+b_2(z)e^{p_2(z)}]f=0$ and prove that $\alpha=[2(m+1)-1]/[2(m+1)]$ for some integer $m\geq 0$ if this equation admits a nontrivial solution such that $\lambda(f)<\infty$. This partially answers a question of Ishizaki. Finally, letting $b_2\not=0$ and $b_3$ be constants and $l$ and $s$ be relatively prime integers such that $l> s\geq 1$, we prove that $l=2$ if the equation $f''-(e^{lz}+b_2e^{sz}+b_3)f=0$ admits two linearly independent solutions $f_1$ and $f_2$ such that $\max\{\lambda(f_1),\lambda(f_2)\}<\infty$. In particular, we precisely characterize all solutions such that $\lambda(f)<\infty$ when $l=2$ and $l=4$.


title: Cometary dust analogues for physics experiments

abstract: The CoPhyLab (Cometary Physics Laboratory) project is designed to study the physics of comets through a series of earth-based experiments. For these experiments, a dust analogue was created with physical properties comparable to those of the non-volatile dust found on comets. This "CoPhyLab dust" is planned to be mixed with water and CO$_2$ ice and placed under cometary conditions in vacuum chambers to study the physical processes taking place on the nuclei of comets. In order to develop this dust analogue, we mixed two components representative for the non-volatile materials present in cometary nuclei. We chose silica dust as representative for the mineral phase and charcoal for the organic phase, which also acts as a darkening agent. In this paper, we provide an overview of known cometary analogues before presenting measurements of eight physical properties of different mixtures of the two materials and a comparison of these measurements with known cometary values. The physical properties of interest are: particle size, density, gas permeability, spectrophotometry, mechanical, thermal and electrical properties. We found that the analogue dust that matches the highest number of physical properties of cometary materials consists of a mixture of either 60\%/40\% or 70\%/30\% of silica dust/charcoal by mass. These best-fit dust analogue will be used in future CoPhyLab experiments.


title: Predictive design of impact absorbers for mitigating resonances of flexible structures using a semi-analytical approach

abstract: Analytical conditions are available for the optimum design of impact absorbers for the case where the host structure is well described as rigid body. Accordingly, the analysis relies on the assumption that the impacts cause immediate dissipation in the contact region, which is modeled in terms of a known coefficient of restitution. When a flexible host structure is considered instead, the impact absorber not only dissipates energy at the time instances of impact, but it inflicts nonlinear energy scattering between structural modes. Hence, it is crucial to account for such nonlinear energy transfers yielding energy redistribution within the modal space of the structure. In the present work, we develop a design approach for reonantly-driven, flexible host structures. We demonstrate decoupling of the time scales of the impact and the resonant vibration. On the long time scale, the dynamics can be properly reduced to the fundamental harmonic of the resonant mode. A light impact absorber responds to this enforced motion, and we recover the Slow Invariant Manifold of the dynamics for the regime of two impacts per period. On the short time scale, the contact mechanics and elasto-dynamics must be finely resolved. We show that it is sufficient to run a numerical simulation of a single impact event with adequate pre-impact velocity. From this simulation, we derive a modal coefficient of restitution and the properties of the contact force pulse, needed to approximate the behavior on the long time scale. We establish that the design problem can be reduced to four dimensionless parameters and demonstrate the approach for the numerical example of a cantilevered beam with an impact absorber. We conclude that the proposed semi-analytical procedure enables deep qualitative understanding of the problem and, at the same time, yields a quantitatively accurate prediction of the optimum design.


title: Critical condition and transient evolution of methane detonation extinction by fine water droplet curtains

abstract: Two-dimensional numerical simulations with Eulerian-Lagrangian method and detailed chemical mechanism are conducted to study the methane detonation propagation across a water curtain with finite thickness. The critical length of the water curtain with sprayed droplets is determined through parametric simulations with different water mass loadings and droplet sizes. The influence of water curtain length on the methane detonation is examined by the trajectories of peak pressure and time history of average heat release rate. The results indicate that the water curtain not only inhibit the incident detonation wave, but also prevent the detonation re-ignition after the incident wave is quenched. Moreover, unsteady response of gaseous methane detonation to water curtain are analyzed. The detonation re-initiation process behind the water curtain near the critical loading is also captured. In addition, mechanism of detonation inhibition with fine water droplets are discussed. It is found that energy and momentum exchanges start immediately when the detonation wave enters the water curtain area, but the mass transfer starts well behind the detonation wave due to the finitely long droplet heating duration. It is shown that the convective heat transfer by water droplets plays a significant role in quenching a detonation.


title: Boundary integral equation methods for the solution of scattering and transmission 2D elastodynamic problems

abstract: We introduce and analyze various Regularized Combined Field Integral Equations (CFIER) formulations of time-harmonic Navier equations in media with piece-wise constant material properties. These formulations can be derived systematically starting from suitable coercive approximations of Dirichlet-to-Neumann operators (DtN), and we present a periodic pseudodifferential calculus framework within which the well posedness of CIER formulations can be established. We also use the DtN approximations to derive and analyze Optimized Schwarz (OS) methods for the solution of elastodynamics transmission problems. The pseudodifferential calculus we develop in this paper relies on careful singularity splittings of the kernels of Navier boundary integral operators which is also the basis of high-order Nystr\"om quadratures for their discretizations. Based on these high-order discretizations we investigate the rate of convergence of iterative solvers applied to CFIER and OS formulations of scattering and transmission problems. We present a variety of numerical results that illustrate that the CFIER methodology leads to important computational savings over the classical CFIE one, whenever iterative solvers are used for the solution of the ensuing discretized boundary integral equations. Finally, we show that the OS methods are competitive in the high-frequency high-contrast regime.


title: AVoE: A Synthetic 3D Dataset on Understanding Violation of Expectation for Artificial Cognition

abstract: Recent work in cognitive reasoning and computer vision has engendered an increasing popularity for the Violation-of-Expectation (VoE) paradigm in synthetic datasets. Inspired by work in infant psychology, researchers have started evaluating a model's ability to discriminate between expected and surprising scenes as a sign of its reasoning ability. Existing VoE-based 3D datasets in physical reasoning only provide vision data. However, current cognitive models of physical reasoning by psychologists reveal infants create high-level abstract representations of objects and interactions. Capitalizing on this knowledge, we propose AVoE: a synthetic 3D VoE-based dataset that presents stimuli from multiple novel sub-categories for five event categories of physical reasoning. Compared to existing work, AVoE is armed with ground-truth labels of abstract features and rules augmented to vision data, paving the way for high-level symbolic predictions in physical reasoning tasks.


title: Explicit CSI Feedback Compression via Learned Approximate Message Passing

abstract: Explicit channel state information at the transmitter side is helpful to improve downlink precoding performance for multi-user MIMO systems. In order to reduce feedback signalling overhead, compression of Channel State Information (CSI) is essential. In this work different low complexity compressed sensing algorithms are compared in the context of an explicit CSI feedback scheme for 5G new radio. A neural network approach, based on learned approximate message passing for the computation of row-sparse solutions to matrix-valued compressed sensing problems is introduced. Due to extensive weight sharing, it shares the low memory footprint and fast evaluation of the forward pass with few iterations of a first order iterative algorithm. Furthermore it can be trained on purely synthetic data prior to deployment. Its performance in the explicit CSI feedback application is evaluated, and its key benefits in terms of computational complexity savings are discussed.


title: Balancing Average and Worst-case Accuracy in Multitask Learning

abstract: When training and evaluating machine learning models on a large number of tasks, it is important to not only look at average task accuracy -- which may be biased by easy or redundant tasks -- but also worst-case accuracy (i.e. the performance on the task with the lowest accuracy). In this work, we show how to use techniques from the distributionally robust optimization (DRO) literature to improve worst-case performance in multitask learning. We highlight several failure cases of DRO when applied off-the-shelf and present an improved method, Lookahead-DRO (L-DRO), which mitigates these issues. The core idea of L-DRO is to anticipate the interaction between tasks during training in order to choose a dynamic re-weighting of the various task losses, which will (i) lead to minimal worst-case loss and (ii) train on as many tasks as possible. After demonstrating the efficacy of L-DRO on a small controlled synthetic setting, we evaluate it on two realistic benchmarks: a multitask version of the CIFAR-100 image classification dataset and a large-scale multilingual language modeling experiment. Our empirical results show that L-DRO achieves a better trade-off between average and worst-case accuracy with little computational overhead compared to several strong baselines.


title: PLNet: Plane and Line Priors for Unsupervised Indoor Depth Estimation

abstract: Unsupervised learning of depth from indoor monocular videos is challenging as the artificial environment contains many textureless regions. Fortunately, the indoor scenes are full of specific structures, such as planes and lines, which should help guide unsupervised depth learning. This paper proposes PLNet that leverages the plane and line priors to enhance the depth estimation. We first represent the scene geometry using local planar coefficients and impose the smoothness constraint on the representation. Moreover, we enforce the planar and linear consistency by randomly selecting some sets of points that are probably coplanar or collinear to construct simple and effective consistency losses. To verify the proposed method's effectiveness, we further propose to evaluate the flatness and straightness of the predicted point cloud on the reliable planar and linear regions. The regularity of these regions indicates quality indoor reconstruction. Experiments on NYU Depth V2 and ScanNet show that PLNet outperforms existing methods. The code is available at \url{https://github.com/HalleyJiang/PLNet}.


title: A bridge between features and evidence for binary attribute-driven perfect privacy

abstract: Attribute-driven privacy aims to conceal a single user's attribute, contrary to anonymisation that tries to hide the full identity of the user in some data. When the attribute to protect from malicious inferences is binary, perfect privacy requires the log-likelihood-ratio to be zero resulting in no strength-of-evidence. This work presents an approach based on normalizing flow that maps a feature vector into a latent space where the evidence, related to the binary attribute, and an independent residual are disentangled. It can be seen as a non-linear discriminant analysis where the mapping is invertible allowing generation by mapping the latent variable back to the original space. This framework allows to manipulate the log-likelihood-ratio of the data and therefore allows to set it to zero for privacy. We show the applicability of the approach on an attribute-driven privacy task where the sex information is removed from speaker embeddings. Results on VoxCeleb2 dataset show the efficiency of the method that outperforms in terms of privacy and utility our previous experiments based on adversarial disentanglement.