title: MIND: Maximum Mutual Information Based Neural Decoder

abstract: We are assisting at a growing interest in the development of learning architectures with application to digital communication systems. Herein, we consider the detection/decoding problem. We aim at developing an optimal neural architecture for such a task. The definition of the optimal criterion is a fundamental step. We propose to use the mutual information (MI) of the channel input-output signal pair, which yields to the minimization of the a-posteriori information of the transmitted codeword given the communication channel output observation. The computation of the a-posteriori information is a formidable task, and for the majority of channels it is unknown. Therefore, it has to be learned. For such an objective, we propose a novel neural estimator based on a discriminative formulation. This leads to the derivation of the mutual information neural decoder (MIND). The developed neural architecture is capable not only to solve the decoding problem in unknown channels, but also to return an estimate of the average MI achieved with the coding scheme, as well as the decoding error probability. Several numerical results are reported and compared with maximum a-posteriori and maximum likelihood decoding strategies.


title: An Interpretable MRI Reconstruction Network with Two-grid-cycle Correction and Geometric Prior Distillation

abstract: Although existing deep learning compressed-sensing-based Magnetic Resonance Imaging (CS-MRI) methods have achieved considerably impressive performance, explainability and generalizability continue to be challenging for such methods since the transition from mathematical analysis to network design not always natural enough, often most of them are not flexible enough to handle multi-sampling-ratio reconstruction assignments. {In this work, to tackle explainability and generalizability, we propose a unifying deep unfolding multi-sampling-ratio interpretable CS-MRI framework.} The combined approach offers more generalizability than previous works whereas deep learning gains explainability through a geometric prior module. Inspired by the multigrid algorithm, we first embed the CS-MRI-based optimization algorithm into correction-distillation scheme that consists of three ingredients: pre-relaxation module, correction module and geometric prior distillation module. Furthermore, we employ a condition module to learn adaptively step-length and noise level, which enables the proposed framework to jointly train multi-ratio tasks through a single model. { The proposed model not only compensates for the lost contextual information of reconstructed image which is refined from low frequency error in geometric characteristic k-space}, but also integrates the theoretical guarantee of model-based methods and the superior reconstruction performances of deep learning-based methods. Therefore, it can give us a novel perspective to design biomedical imaging networks. { Numerical experiments show that our framework outperforms state-of-the-art methods in terms of qualitative and quantitative evaluations.} {Our method achieves 3.18 dB improvement at low CS ratio 10\% and average 1.42 dB improvement over other comparison methods on brain dataset using Cartesian sampling mask.


title: Sensitive detection of local magnetic field changes with atomic interferometry by using superconducting Meissner effects

abstract: Sensitive detection of magnetic field is one of the open problem in metrology. Here, we propose an Mach-Zehnder atomic interferometry to sensitively detect the very weak local magnetic field, which is expelled by the superconductor (as the "testing magnet") due to the Meissner effect. The induced magnetic field gradient near the superconductor provides a centripetal acceleration of the atomic motion in the interferometry and thus can be detected by using the atomic interferences. Given gravity acceleration of the atoms have been measured at the accuracy of $10^{-12}$ g, the measured sensitivity of the expelled local field could reach $10^{-14}$ T.


title: Gorenstein Endomorphism Rings on Curve Singularities

abstract: We characterize the Gorensteinness of endomorphism rings of a fractional ideal on a curve singularity by stability of the ideal and a condition on its value semigroup ideal. Moreover, the Gorenstein algebroid curves with only Gorenstein integral extensions are classified.


title: What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge

abstract: There are limitations in learning language from text alone. Therefore, recent focus has been on developing multimodal models. However, few benchmarks exist that can measure what language models learn about language from multimodal training. We hypothesize that training on a visual modality should improve on the visual commonsense knowledge in language models. Therefore, we introduce two evaluation tasks for measuring visual commonsense knowledge in language models and use them to evaluate different multimodal models and unimodal baselines. Primarily, we find that the visual commonsense knowledge is not significantly different between the multimodal models and unimodal baseline models trained on visual text data.


title: F1 Hand: A Versatile Fixed-Finger Gripper for Delicate Teleoperation and Autonomous Grasping

abstract: Teleoperation is often limited by the ability of an operator to react and predict the behavior of the robot as it interacts with the environment. For example, to grasp small objects on a table, the teleoperator needs to predict the position of the fingertips before the fingers are closed to avoid them hitting the table. For that reason, we developed the F1 hand, a single-motor gripper that facilitates teleoperation with the use of a fixed finger. The hand is capable of grasping objects as thin as a paper clip, and as heavy and large as a cordless drill. The applicability of the hand can be expanded by replacing the fixed finger with different shapes. This flexibility makes the hand highly versatile while being easy and cheap to develop. However, due to the atypical asymmetric structure and actuation of the hand usual grasping strategies no longer apply. Thus, we propose a controller that approximates actuation symmetry by using the motion of the whole arm. The F1 hand and its controller are compared side-by-side with the original Toyota Human Support Robot (HSR) gripper in teleoperation using 22 objects from the YCB dataset in addition to small objects. The grasping time and peak contact forces could be decreased by 20% and 70%, respectively while increasing success rates by 5%. Using an off-the-shelf grasp pose estimator for autonomous grasping, the system achieved similar success rates to the original HSR gripper, at the order of 80%.


title: How planar superconductors cure their infrared divergences

abstract: Planar superconductors, thin films with thickness comparable to the superconducting coherence length, differ crucially from their bulk counterparts. The Coulomb interaction is logarithmic up to distances exceeding typical sample sizes and the Anderson-Higgs mechanism is ineffective to screen the resulting infrared divergences of the resulting (2+1)-dimensional QED because the Pearl length is also typically larger than sample sizes. As a consequence, the system decomposes into superconducting droplets with the typical size of the coherence length. We show that the two possible phases of the system match the two known mechanisms by which (2+1)-dimensional QED cures its infrared divergences, either by generating a mixed topological Chern-Simons mass or by magnetic monopole instantons. The former is realized in superconductors, the latter governs mirror-dual superinsulators. Planar superconductors are thus described by a topological Chern-Simons gauge (TCSG) theory which replaces the Ginzburg-Landau model in two dimensions. In the TCSG model, the Higgs field is absent. Accordingly, in planar superconductors Abrikosov vortices do not form, and only Josephson vortices with no normal core can emerge.


title: On the multiplication operator by an independent variable in matrix Sobolev spaces

abstract: We study the operator $\mathcal{A}$ of multiplication by an independent variable in a matrix Sobolev space $W^2(M)$. In the cases of finite measures on $[a,b]$ with $(2\times 2)$ and $(3\times 3)$ real continuous matrix weights of full rank it is shown that the operator $\mathcal{A}$ is symmetrizable. Namely, there exist two symmetric operators $\mathcal{B}$ and $\mathcal{C}$ in a larger space such that $\mathcal{A} f = \mathcal{C} \mathcal{B}^{-1} f$, $f\in D(\mathcal{A})$. As a corollary, we obtain some new orthogonality conditions for the associated Sobolev orthogonal polynomials. These conditions involve two symmetric operators in an indefinite metric space.


title: Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties

abstract: We develop a stochastic differential equation, called homogenized SGD, for analyzing the dynamics of stochastic gradient descent (SGD) on a high-dimensional random least squares problem with $\ell^2$-regularization. We show that homogenized SGD is the high-dimensional equivalence of SGD -- for any quadratic statistic (e.g., population risk with quadratic loss), the statistic under the iterates of SGD converges to the statistic under homogenized SGD when the number of samples $n$ and number of features $d$ are polynomially related ($d^c < n < d^{1/c}$ for some $c > 0$). By analyzing homogenized SGD, we provide exact non-asymptotic high-dimensional expressions for the generalization performance of SGD in terms of a solution of a Volterra integral equation. Further we provide the exact value of the limiting excess risk in the case of quadratic losses when trained by SGD. The analysis is formulated for data matrices and target vectors that satisfy a family of resolvent conditions, which can roughly be viewed as a weak (non-quantitative) form of delocalization of sample-side singular vectors of the data. Several motivating applications are provided including sample covariance matrices with independent samples and random features with non-generative model targets.


title: A Learning Approach for Joint Design of Event-triggered Control and Power-Efficient Resource Allocation

abstract: In emerging Industrial Cyber-Physical Systems (ICPSs), the joint design of communication and control sub-systems is essential, as these sub-systems are interconnected. In this paper, we study the joint design problem of an event-triggered control and an energy-efficient resource allocation in a fifth generation (5G) wireless network. We formally state the problem as a multi-objective optimization one, aiming to minimize the number of updates on the actuators' input and the power consumption in the downlink transmission. To address the problem, we propose a model-free hierarchical reinforcement learning approach \textcolor{blue}{with uniformly ultimate boundedness stability guarantee} that learns four policies simultaneously. These policies contain an update time policy on the actuators' input, a control policy, and energy-efficient sub-carrier and power allocation policies. Our simulation results show that the proposed approach can properly control a simulated ICPS and significantly decrease the number of updates on the actuators' input as well as the downlink power consumption.


title: Teleparallel Geometry with a Single Affine Symmetry

abstract: In teleparallel geometries, symmetries are represented by affine frame symmetries which constrain both the (co)frame basis and the spin-connection (which are the primary geometric objects). In this paper we shall study teleparallel geometries with a single affine symmetry, utilizing the locally Lorentz covariant approach and adopting a complex null gauge. We first introduce an algorithm to study geometries with an affine frame symmetry, which consists of choosing coordinates adapted to the symmetry, constructing a canonical frame, and solving the equations describing the symmetry. %for the spin connection (to determine the six real Lorentz functions. All of the constraints on the geometry are determined in the case of a single affine symmetry, but there are additional constraints arising from the field equations for a given theory of teleparallel gravity. In particular, we find that in $f(T)$ teleparallel gravity there will be severe constraints on the geometry arising from the antisymmetric part of the field equations.


title: The crosscut poset

abstract: We introduce a new combinatorial invariant, which we call crosscut poset, that is finer than the crosscut complex. We exhibit many applications of the crosscut poset which include a generalization of Bj\"orner's crosscut theorem and two results concerning the fixed point property and the fixed simplex property.


title: An Architecture for the detection of GAN-generated Flood Images with Localization Capabilities

abstract: In this paper, we address a new image forensics task, namely the detection of fake flood images generated by ClimateGAN architecture. We do so by proposing a hybrid deep learning architecture including both a detection and a localization branch, the latter being devoted to the identification of the image regions manipulated by ClimateGAN. Even if our goal is the detection of fake flood images, in fact, we found that adding a localization branch helps the network to focus on the most relevant image regions with significant improvements in terms of generalization capabilities and robustness against image processing operations. The good performance of the proposed architecture is validated on two datasets of pristine flood images downloaded from the internet and three datasets of fake flood images generated by ClimateGAN starting from a large set of diverse street images.


title: Quantum Brownian Motion of a charged oscillator in a magnetic field coupled to a heat bath through momentum variables

abstract: We study the Quantum Brownian motion of a charged particle moving in a harmonic potential in the presence of an uniform external magnetic field and linearly coupled to an Ohmic bath through momentum variables. We analyse the growth of the mean square displacement of the particle in the classical high temperature domain and in the quantum low temperature domain dominated by zero point fluctuations. We also analyse the Position Response Function and the long time tails of various correlation functions. We notice some distinctive features, different from the usual case of a charged quantum Brownian particle in a magnetic field and linearly coupled to an Ohmic bath via position variables.


title: Corrosion Detection for Industrial Objects: From Multi-Sensor System to 5D Feature Space

abstract: Corrosion is a form of damage that often appears on the surface of metal-made objects used in industrial applications. Those damages can be critical depending on the purpose of the used object. Optical-based testing systems provide a form of non-contact data acquisition, where the acquired data can then be used to analyse the surface of an object. In the field of industrial image processing, this is called surface inspection. We provide a testing setup consisting of a rotary table which rotates the object by 360 degrees, as well as industrial RGB cameras and laser triangulation sensors for the acquisition of 2D and 3D data as our multi-sensor system. These sensors acquire data while the object to be tested takes a full rotation. Further on, data augmentation is applied to prepare new data or enhance already acquired data. In order to evaluate the impact of a laser triangulation sensor for corrosion detection, one challenge is to at first fuse the data of both domains. After the data fusion process, 5 different channels can be utilized to create a 5D feature space. Besides the red, green and blue channels of the image (1-3), additional range data from the laser triangulation sensor is incorporated (4). As a fifth channel, said sensor provides additional intensity data (5). With a multi-channel image classification, a 5D feature space will lead to slightly superior results opposed to a 3D feature space, composed of only the RGB channels of the image.


title: Spiking Approximations of the MaxPooling Operation in Deep SNNs

abstract: Spiking Neural Networks (SNNs) are an emerging domain of biologically inspired neural networks that have shown promise for low-power AI. A number of methods exist for building deep SNNs, with Artificial Neural Network (ANN)-to-SNN conversion being highly successful. MaxPooling layers in Convolutional Neural Networks (CNNs) are an integral component to downsample the intermediate feature maps and introduce translational invariance, but the absence of their hardware-friendly spiking equivalents limits such CNNs' conversion to deep SNNs. In this paper, we present two hardware-friendly methods to implement Max-Pooling in deep SNNs, thus facilitating easy conversion of CNNs with MaxPooling layers to SNNs. In a first, we also execute SNNs with spiking-MaxPooling layers on Intel's Loihi neuromorphic hardware (with MNIST, FMNIST, & CIFAR10 dataset); thus, showing the feasibility of our approach.


title: Deep Learning the Efficient Frontier of Convex Vector Optimization Problems

abstract: In this paper, we design a neural network architecture to approximate the weakly efficient frontier of convex vector optimization problems (CVOP) satisfying Slater's condition. The proposed machine learning methodology provides both an inner and outer approximation of the weakly efficient frontier, as well as an upper bound to the error at each approximated efficient point. In numerical case studies we demonstrate that the proposed algorithm is effectively able to approximate the true weakly efficient frontier of CVOPs. This remains true even for large problems (i.e., many objectives, variables, and constraints) and thus overcoming the curse of dimensionality.


title: Electromagnetic Composites: from Effective Medium Theories to Metamaterials

abstract: Electromagnetic (EM) composites have stimulated tremendous fundamental and practical interests owing to their flexible electromagnetic properties and extensive potential engineering applications. Hence, it is necessary to systematically understand the physical mechanisms and design principles controlling EM composites. In this tutorial, we first provide an overview of the basic theory of electromagnetism about electromagnetic constitutive parameters that can represent the electromagnetic properties of materials. We show how this corpus allows a consistent construction of effective medium theories and allows for numerical simulation of EM composites to deal with structure-property relationships. We then discuss the influence of spatial dispersion of shaped inclusions in the material medium on the EM properties of composites, which has not been systematically illustrated in the context of this interdisciplinary topic. Next, artificial composites or metamaterials with peculiar properties not readily available in nature are highlighted with particular emphasis on the control of the EM interaction with composites. We conclude by discussing appropriate methods of electromagnetic measurement and practical aspects for implementing composites for specific applications are described. Overall, this tutorial will serve the purpose of introducing the basics and applications of electromagnetic composites to newcomers in this field. It is also anticipated that researchers from different backgrounds including materials science, optics, and electrical engineering can communicate to each other with the same language when dealing with this interdisciplinary subject and further push forward this advancement from fundamental science to technological applications.


title: Energy Efficient UAV-Based Service Offloading over Cloud-Fog Architectures

abstract: Unmanned Aerial Vehicles (UAVs) are poised to play a central role in revolutionizing future services offered by the envisioned smart cities, thanks to their agility, flexibility, and cost-efficiency. UAVs are being widely deployed in different verticals including surveillance, search and rescue missions, delivery of items, and as an infrastructure for aerial communications in future wireless networks. UAVs can be used to survey target locations, collect raw data from the ground (i.e., video streams), generate computing task(s) and offload it to the available servers for processing. In this work, we formulate a multi-objective optimization framework for both the network resource allocation and the UAV trajectory planning problem using Mixed Integer Linear Programming (MILP) optimization model. In consideration of the different stake holders that may exist in a Cloud-Fog environment, we minimize the sum of a weighted objective function, which allows network operators to tune the weights to emphasize/de-emphasize different cost functions such as the end-to-end network power consumption (EENPC), processing power consumption (PPC), UAVs total flight distance (UAVTFD), and UAVs total power consumption (UAVTPC). Our optimization models and results enable the optimum offloading decisions to be made under different constraints relating to EENPC, PPC, UAVTFD and UAVTPC which we explore in detail. For example, when the UAVs propulsion efficiency (UPE) is at its worst (10% considered), offloading via the macro base station is the best choice and a maximum power saving of 34% can be achieved. Extensive studies on the UAVs coverage path planning (CPP) and computation offloading have been conducted, but none has tackled the issue in a practical Cloud-Fog architecture in which access, metro and core layers are considered in the service offloading in a distributed architecture like the Cloud-Fog.


title: Modeling survival probabilities of superheavy nuclei at high excitations

abstract: This work investigated the first-chance survival probabilities of highly excited compound superheavy nuclei in the prospect of synthesizing new superheavy elements. The main feature of our modelings is the adoption of microscopic temperature dependent fission barriers in calculations of fission rates. A simple derivation is demonstrated to elucidate the connection between Bohr-Wheeler statistical model and imaginary free energy method, obtaining a new formula for fission rates. The best modeling is chosen with respect to reproducing the experimental fission probability of $^{210}$Po. Systematic studies of fission and survival probabilities of No, Fl, Og, and $Z$=120 compound nuclei are performed. Results show large discrepancies by different models for survival probabilities of superheavy nuclei although they are close for $^{210}$Po. We see that the first-chance survival probabilities of $Z$=120 are comparable to that of Fl and Og.


title: GoalNet: Inferring Conjunctive Goal Predicates from Human Plan Demonstrations for Robot Instruction Following

abstract: Our goal is to enable a robot to learn how to sequence its actions to perform tasks specified as natural language instructions, given successful demonstrations from a human partner. The ability to plan high-level tasks can be factored as (i) inferring specific goal predicates that characterize the task implied by a language instruction for a given world state and (ii) synthesizing a feasible goal-reaching action-sequence with such predicates. For the former, we leverage a neural network prediction model, while utilizing a symbolic planner for the latter. We introduce a novel neuro-symbolic model, GoalNet, for contextual and task dependent inference of goal predicates from human demonstrations and linguistic task descriptions. GoalNet combines (i) learning, where dense representations are acquired for language instruction and the world state that enables generalization to novel settings and (ii) planning, where the cause-effect modeling by the symbolic planner eschews irrelevant predicates facilitating multi-stage decision making in large domains. GoalNet demonstrates a significant improvement (51%) in the task completion rate in comparison to a state-of-the-art rule-based approach on a benchmark data set displaying linguistic variations, particularly for multi-stage instructions.


title: Generalized common index jump theorem with applications to closed characteristics on star-shaped hypersurfaces and beyond

abstract: In this paper, we first generalize the common index jump theorem of Long-Zhu in 2002 and Duan-Long-Wang in 2016 to the case where the mean indices of symplectic paths are not required to be all positive. As applications, we study closed characteristics on compact star-shaped hypersurfaces in ${\bf R}^{2n}$, when both positive and negative mean indices may appear simultaneously. Specially we establish the existence of at least $n$ geometrically distinct closed characteristics on every compact non-degenerate perfect star-shaped hypersurface $\Sigma$ in ${\bf R}^{2n}$ provided that every prime closed characteristic possesses nonzero mean index. Furthermore, in the case of ${\bf R}^6$ we remove the nonzero mean index condition by showing that the existence of only finitely many geometrically distinct closed characteristics implies that each of them must possess nonzero mean index. We also generalize the above results about closed characteristics on non-degenerate star-shaped hypersurfaces to closed Reeb orbits of non-degenerate contact forms on a broad class of prequantization bundles.


title: Pretraining Approaches for Spoken Language Recognition: TalTech Submission to the OLR 2021 Challenge

abstract: This paper investigates different pretraining approaches to spoken language identification. The paper is based on our submission to the Oriental Language Recognition 2021 Challenge. We participated in two tracks of the challenge: constrained and unconstrained language recognition. For the constrained track, we first trained a Conformer-based encoder-decoder model for multilingual automatic speech recognition (ASR), using the provided training data that had transcripts available. The shared encoder of the multilingual ASR model was then finetuned for the language identification task. For the unconstrained task, we relied on both externally available pretrained models as well as external data: the multilingual XLSR-53 wav2vec2.0 model was finetuned on the VoxLingua107 corpus for the language recognition task, and finally finetuned on the provided target language training data, augmented with CommonVoice data. Our primary metric $C_{\rm avg}$ values on the Test set are 0.0079 for the constrained task and 0.0119 for the unconstrained task which resulted in the second place in both rankings. In post-evaluation experiments, we study the amount of target language data needed for training an accurate backend model, the importance of multilingual pretraining data, and compare different models as finetuning starting points.


title: Short-Pulsed Metamaterials

abstract: We study a class of temporal metamaterials characterized by time-varying dielectric permittivity waveforms of duration much smaller than the characteristic wave-dynamical timescale. In the analogy between spatial and temporal metamaterials, such a short-pulsed regime can be viewed as the temporal counterpart of metasurfaces. We introduce a general and compact analytical formalism for modeling the interaction of a short-pulsed metamaterial with an electromagnetic wavepacket. Specifically, we elucidate the role of local and nonlocal effects, as well as of the time-reversal symmetry breaking, and we show how they can be harnessed to perform elementary analog computing, such as first and second derivatives. Our theory, validated against full-wave numerical simulations, suggests a novel route for manipulating electromagnetic waves without relying on long, periodic temporal modulations. Just as metasurfaces have played a pivotal role in the technological viability and practical applicability of conventional (spatial) metamaterials, short-pulsed metamaterials may catalyze the development of temporal and space-time metamaterials.


title: Monitoring of Pigmented Skin Lesions Using 3D Whole Body Imaging

abstract: Advanced artificial intelligence and machine learning have great potential to redefine how skin lesions are detected, mapped, tracked and documented. Here, We propose a 3D whole-body imaging system known as 3DSkin-mapper to enable automated detection, evaluation and mapping of skin lesions. A modular camera rig arranged in a cylindrical configuration was designed to automatically capture images of the entire skin surface of a subject synchronously from multiple angles. Based on the images, we developed algorithms for 3D model reconstruction, data processing and skin lesion detection and tracking based on deep convolutional neural networks. We also introduced a customised, user-friendly, and adaptable interface that enables individuals to interactively visualise, manipulate, and annotate the images. The proposed system is developed for skin lesion screening, the focus of this paper is to introduce the system instead of clinical study. Using synthetic and real images we demonstrate the effectiveness of the proposed system by providing multiple views of a target skin lesion, enabling further 3D geometry analysis and longitudinal tracking. It takes only a few seconds to capture the entire skin surface, and about half an hour to process and analyse the images. Our experiments show that the proposed system allow fast and easy whole body 3D imaging. It can be used by dermatological clinics to conduct skin screening, detect and track skin lesions over time, identify suspicious lesions, and document pigmented lesions. The system can potentially save clinicians time and effort significantly. The 3D imaging and analysis has the potential to change the paradigm of whole body photography with many applications in skin diseases, including inflammatory and pigmentary disorders.


title: Collar-aware Training for Streaming Speaker Change Detection in Broadcast Speech

abstract: In this paper, we present a novel training method for speaker change detection models. Speaker change detection is often viewed as a binary sequence labelling problem. The main challenges with this approach are the vagueness of annotated change points caused by the silences between speaker turns and imbalanced data due to the majority of frames not including a speaker change. Conventional training methods tackle these by artificially increasing the proportion of positive labels in the training data. Instead, the proposed method uses an objective function which encourages the model to predict a single positive label within a specified collar. This is done by marginalizing over all possible subsequences that have exactly one positive label within the collar. Experiments on English and Estonian datasets show large improvements over the conventional training method. Additionally, the model outputs have peaks concentrated to a single frame, removing the need for post-processing to find the exact predicted change point which is particularly useful for streaming applications.


title: Pattern reconstruction with restricted Boltzmann machines

abstract: Restricted Boltzmann machines are energy models made of a visible and a hidden layer. We identify an effective energy function describing the zero-temperature landscape on the visible units and depending only on the tail behaviour of the hidden layer prior distribution. Studying the location of the local minima of such an energy function, we show that the ability of a restricted Boltzmann machine to reconstruct a random pattern depends indeed only on the tail of the hidden prior distribution. We find that hidden priors with strictly super-Gaussian tails give only a logarithmic loss in pattern retrieval, while an efficient retrieval is much harder with hidden units with strictly sub-Gaussian tails; if the hidden prior has Gaussian tails, the retrieval capability is determined by the number of hidden units (as in the Hopfield model).


title: Planck Stars from a Scale-dependent Gravity theory

abstract: Scale dependence of fundamental physical parameters is a generic feature of ordinary quantum field theory. When applied to gravity, this idea produces effective actions generically containing a running Newtonian coupling constant, from which new (spherically symmetric) black hole spacetimes can be inferred. As a minimum useful requirement, of course, the new metrics should match with a Schwarzschild field at large radial coordinate. By further imposing to the new scale dependent metric the simple request of matching with the Donoghue quantum corrected potential, we find a not yet explored black hole spacetime, which naturally turns out to describe the so-called Planck stars.


title: On extendability of functionals on Hilbert $C^*$-modules

abstract: Let $M\subset N$ be Hilbert $C^*$-modules over a $C^*$-algebra $A$ with $M^\perp=0$. It was shown recently by J. Kaad and M. Skeide that there exists a non-zero $A$-valued functional on $N$ such that its restriction onto $M$ is zero. Here we show that this may happen even if $A$ is monotone complete. On the other hand, we show that for certain type I $W^*$-algebras this cannot happen.


title: Evaluating Forecasts with scoringutils in R

abstract: Evaluating forecasts is essential in order to understand and improve forecasting and make forecasts useful to decision-makers. Much theoretical work has been done on the development of proper scoring rules and other scoring metrics that can help evaluate forecasts. In practice, however, conducting a forecast evaluation and comparison of different forecasters remains challenging. In this paper we introduce scoringutils, an R package that aims to greatly facilitate this process. It is especially geared towards comparing multiple forecasters, regardless of how forecasts were created, and visualising results. The package is able to handle missing forecasts and is the first R package to offer extensive support for forecasts represented through predictive quantiles, a format used by several collaborative ensemble forecasting efforts. The paper gives a short introduction to forecast evaluation, discusses the metrics implemented in scoringutils and gives guidance on when they are appropriate to use, and illustrates the application of the package using example data of forecasts for COVID-19 cases and deaths submitted to the European Forecast Hub between May and September 2021


title: Effect of Hydrostatic Pressure on Lone Pair Activity and Phonon Transport in Bi$_2$O$_2$S

abstract: Dibismuth dioxychalcogenides, Bi$_2$O$_2$Ch (Ch = S, Se, Te) are emerging class of materials for next generation electronics and thermoelectrics with an ultrahigh carrier mobility and excellent air stability. Among these, Bi$_2$O$_2$S is fascinating because of stereochemically active 6$s^2$ lone pair of Bi$^{3+}$ cation, heterogeneous bonding and high mass contrast of constituent elements. In this work, we systematically investigate the effect of hydrostatic pressure and its implications on lattice dynamics and phonon transport properties of Bi$_2$O$_2$S by employing first principles calculations along with the Boltzmann transport theory. The ambient $Pnmn$ phase exhibits a low average lattice thermal conductivity ($\kappa_l$) of 1.71 W-m/K at 300 K. We also find that Bi$_2$O$_2$S undergoes a structural phase transition from low symmetry ($Pnmn$) to a high symmetry ($I4/mmm$) structure around 4 GPa due to the Bi$^{3+}$ cation centering. Upon compression the lone pair activity of Bi$^{3+}$ cation is suppressed, which increases $\kappa_l$ by nearly 3 times to 4.92 W-m/K at 5 GPa for $I4/mmm$ phase. The calculated phonon lifetimes and Gr\"uneisen parameters show that anharmonicity reduces with increasing pressure due to further suppression of lone pair, strengthening of intra and inter molecular interactions, which raises the average room temperature $\kappa_l$ to 12.82 W-m/K at 20 GPa. Overall, the present study provides a comprehensive understanding of hydrostatic pressure effects on stereochemical activity of the Bi$^{3+}$ cation lone pair and its consequences on phonon transport properties of Bi$_2$O$_2$S.


title: Blind Goal-Oriented Massive Access for Future Wireless Networks

abstract: Emerging communication networks are envisioned to support massive wireless connectivity of heterogeneous devices with sporadic traffic and diverse requirements in terms of latency, reliability, and bandwidth. Providing multiple access to an increasing number of uncoordinated users and sharing the limited resources become essential in this context. In this work, we revisit the random access (RA) problem and exploit the continuous angular group sparsity feature of wireless channels to propose a novel RA strategy that provides low latency, high reliability, and massive access with limited bandwidth resources in an all-in-one package. To this end, we first design a reconstruction-free goal-oriented optimization problem, which only preserves the angular information required to identify the active devices. To solve this, we propose an alternating direction method of multipliers (ADMM) and derive closed-form expressions for each ADMM step. Then, we design a clustering algorithm that assigns the users in specific groups from which we can identify active stationary devices by their angles. For mobile devices, we propose an alternating minimization algorithm to recover their data and their channel gains simultaneously, which allows us to identify active mobile users. Simulation results show significant performance gains in terms of active user detection and false alarm probabilities as compared to state-of-the-art RA schemes, even with limited number of preambles. Moreover, unlike prior work, the performance of the proposed blind goal-oriented massive access does not depend on the number of devices.


title: Dialectica Principles via G\"odel Doctrines

abstract: G\"odel's Dialectica interpretation was conceived as a tool to obtain the consistency of Peano arithmetic via a proof of consistency of Heyting arithmetic in the 40s. In recent years, several proof-theoretic transformations, based on G\"odel's Dialectica interpretation, have been used systematically to extract new content from classical proofs, following a suggestion of Kreisel. Thus, the interpretation has found new relevant applications in several areas of mathematics and computer science. Several authors have explained the Dialectica interpretation in categorical terms. In our previous work, we introduced an intrinsic categorical presentation of the Dialectica construction via a generalisation of Hofstra's work, using the notion of G\"odel fibration and its proof-irrelevant version, a G\"odel doctrine. The key idea is that G\"odel fibrations can be thought of as fibrations generated by some basic elements playing the role of quantifier-free elements. This categorification of quantifier-free elements is crucial not only to show that our notion of G\"odel fibration is equivalent to Hofstra's Dialectica fibration in the appropriate way, but also to show how G\"odel doctrines embody the main logical features of the Dialectica Interpretation. To show that, we derive the soundness of the interpretation of the implication connective, as expounded by Troelstra, in the categorical model. This requires extra logical principles, going beyond intuitionistic logic, namely Markov Principle and the Independence of Premise principle, as well as some choice. We show how these principles are satisfied in the categorical setting, establishing a tight correspondence between the logical system and the categorical framework. Finally, to complete our analysis, we characterise categories obtained as results of the tripos-to-topos of Hyland, Johnstone and Pitts applied to G\"odel doctrines.


title: Superconducting density of states and bandstructure at the surface of the candidate topological superconductor Au2Pb

abstract: The electronic bandstructure of Au$_2$Pb has a Dirac cone which gaps when undergoing a structural transition into a low temperature superconducting phase. This suggests that the superconducting phase ($T_c=1.1$ K) might hold topological properties at the surface. Here we make Scanning Tunneling Microscopy experiments on the surface of superconducting Au$_2$Pb. We measure the superconducting gap and find a sizeable superconducting density of states at the Fermi level. We discuss possible origins for this finding in terms of superconductivity induced into surface states.


title: Virial Expansions for Correlation Functions in Canonical Ensemble

abstract: The infinite set of coupled integral nonlinear equations for correlation functions in the case of classical canonical ensemble is considered. Some kind of graph expansions of correlation functions in the density parameter are constructed. Existing of unique solutions for small value of density and high temperature is discussed.


title: Multi-modal curb detection and filtering

abstract: Reliable knowledge of road boundaries is critical for autonomous vehicle navigation. We propose a robust curb detection and filtering technique based on the fusion of camera semantics and dense lidar point clouds. The lidar point clouds are collected by fusing multiple lidars for robust feature detection. The camera semantics are based on a modified EfficientNet architecture which is trained with labeled data collected from onboard fisheye cameras. The point clouds are associated with the closest curb segment with $L_2$-norm analysis after projecting into the image space with the fisheye model projection. Next, the selected points are clustered using unsupervised density-based spatial clustering to detect different curb regions. As new curb points are detected in consecutive frames they are associated with the existing curb clusters using temporal reachability constraints. If no reachability constraints are found a new curb cluster is formed from these new points. This ensures we can detect multiple curbs present in road segments consisting of multiple lanes if they are in the sensors' field of view. Finally, Delaunay filtering is applied for outlier removal and its performance is compared to traditional RANSAC-based filtering. An objective evaluation of the proposed solution is done using a high-definition map containing ground truth curb points obtained from a commercial map supplier. The proposed system has proven capable of detecting curbs of any orientation in complex urban road scenarios comprising straight roads, curved roads, and intersections with traffic isles.


title: Adaptive construction of shallower quantum circuits with quantum spin projection for fermionic systems

abstract: Quantum computing is a promising approach to harnessing strong correlation in molecular systems; however, current devices only allow for hybrid quantum-classical algorithms with a shallow circuit depth, such as the variational quantum eigensolver (VQE). In this study, we report the importance of the Hamiltonian symmetry in constructing VQE circuits adaptively. This treatment often violates symmetry, thereby deteriorating the convergence of fidelity to the exact solution, and ultimately resulting in deeper circuits. We demonstrate that symmetry-projection can provide a simple yet effective solution to this problem, by keeping the quantum state in the correct symmetry space, to reduce the overall gate operations. The scheme also reveals the significance of preserving symmetry in computing molecular properties, as demonstrated in our illustrative calculations.


title: Extrinsic Calibration and Verification of Multiple Non-overlapping Field of View Lidar Sensors

abstract: We demonstrate a multi-lidar calibration framework for large mobile platforms that jointly calibrate the extrinsic parameters of non-overlapping Field-of-View (FoV) lidar sensors, without the need for any external calibration aid. The method starts by estimating the pose of each lidar in its corresponding sensor frame in between subsequent timestamps. Since the pose estimates from the lidars are not necessarily synchronous, we first align the poses using a Dual Quaternion (DQ) based Screw Linear Interpolation. Afterward, a Hand-Eye based calibration problem is solved using the DQ-based formulation to recover the extrinsics. Furthermore, we verify the extrinsics by matching chosen lidar semantic features, obtained by projecting the lidar data into the camera perspective after time alignment using vehicle kinematics. Experimental results on the data collected from a Scania vehicle [$\sim$ 1 Km sequence] demonstrate the ability of our approach to obtain better calibration parameters than the provided vehicle CAD model calibration parameters. This setup can also be scaled to any combination of multiple lidars.


title: Differentiable SAR Renderer and SAR Target Reconstruction

abstract: Forward modeling of wave scattering and radar imaging mechanisms is the key to information extraction from synthetic aperture radar (SAR) images. Like inverse graphics in optical domain, an inherently-integrated forward-inverse approach would be promising for SAR advanced information retrieval and target reconstruction. This paper presents such an attempt to the inverse graphics for SAR imagery. A differentiable SAR renderer (DSR) is developed which reformulates the mapping and projection algorithm of SAR imaging mechanism in the differentiable form of probability maps. First-order gradients of the proposed DSR are then analytically derived which can be back-propagated from rendered image/silhouette to the target geometry and scattering attributes. A 3D inverse target reconstruction algorithm from SAR images is devised. Several simulation and reconstruction experiments are conducted, including targets with and without background, using both synthesized data or real measured inverse SAR (ISAR) data by ground radar. Results demonstrate the efficacy of the proposed DSR and its inverse approach.


title: Multiformer: A Head-Configurable Transformer-Based Model for Direct Speech Translation

abstract: Transformer-based models have been achieving state-of-the-art results in several fields of Natural Language Processing. However, its direct application to speech tasks is not trivial. The nature of this sequences carries problems such as long sequence lengths and redundancy between adjacent tokens. Therefore, we believe that regular self-attention mechanism might not be well suited for it. Different approaches have been proposed to overcome these problems, such as the use of efficient attention mechanisms. However, the use of these methods usually comes with a cost, which is a performance reduction caused by information loss. In this study, we present the Multiformer, a Transformer-based model which allows the use of different attention mechanisms on each head. By doing this, the model is able to bias the self-attention towards the extraction of more diverse token interactions, and the information loss is reduced. Finally, we perform an analysis of the head contributions, and we observe that those architectures where all heads relevance is uniformly distributed obtain better results. Our results show that mixing attention patterns along the different heads and layers outperforms our baseline by up to 0.7 BLEU.


title: Nonparametric Value-at-Risk via Sieve Estimation

abstract: Artificial Neural Networks (ANN) have been employed for a range of modelling and prediction tasks using financial data. However, evidence on their predictive performance, especially for time-series data, has been mixed. Whereas some applications find that ANNs provide better forecasts than more traditional estimation techniques, others find that they barely outperform basic benchmarks. The present article aims to provide guidance as to when the use of ANNs might result in better results in a general setting. We propose a flexible nonparametric model and extend existing theoretical results for the rate of convergence to include the popular Rectified Linear Unit (ReLU) activation function and compare the rate to other nonparametric estimators. Finite sample properties are then studied with the help of Monte-Carlo simulations to provide further guidance. An application to estimate the Value-at-Risk of portfolios of varying sizes is also considered to show the practical implications.


title: The undecidability of having the QWEP

abstract: We show that neither the class of C*-algebras with Kirchberg's QWEP property nor the class of W*-probability spaces with the QWEP property are effectively axiomatizable (in the appropriate languages). The latter result follows from a more general result, namely that the hyperfinite III$_1$ factor does not have a computable universal theory in the language of W*-probability spaces. We also prove that the Powers' factors $\mathcal{R}_\lambda$, for $0<\lambda<1$, when equipped with their canonical Powers' states, do not have computable universal theory.


title: The restricted minimum density power divergence estimator for non-destructive one-shot device testing the under step-stress model with exponential lifetimes

abstract: One-shot devices data represent an extreme case of interval censoring.Some kind of one-shot units do not get destroyed when tested, and so, survival units can continue within the test providing extra information about their lifetime. Moreover, one-shot devices may last for long times under normal operating conditions, and so accelerated life tests (ALTs) may be used for inference. ALTs relate the lifetime distribution of an unit with the stress level at which it is tested via log-linear relationship.Then, mean lifetime of the devices are reduced during the test by increasing the stress level and inference results on increased stress levels can be easily extrapolated to normal operating conditions. In particular, the step-stress ALT model increases the stress level at pre-fixed times gradually during the life-testing experiment, which may be specially advantageous for non-destructive one-shot devices. However, when the number of units under test are few, outlying data may greatly influence the parameter estimation. In this paper, we develop robust restricted estimators based on the density power divergence (DPD) under linearly restricted subspaces, for non-destructive one-shot devices under the step-stress ALTs with exponential lifetime distributions. We theoretically study the asymptotic and robustness properties of the restricted estimators and we empirically illustrate such properties through a simulation study.


title: Evolutionary optimization of the Verlet closure relation for the hard-sphere and square-well fluids

abstract: The Ornstein-Zernike equation is solved for the hard-sphere and square-well fluids using a diverse selection of closure relations; the attraction range of the square-well is chosen to be $\lambda=1.5.$ In particular, for both fluids we mainly focus on the solution based on a three-parameter version of the Verlet closure relation [Mol. Phys. 42, 1291-1302 (1981)]. To find the free parameters of the latter, an unconstrained optimization problem is defined as a condition of thermodynamic consistency based on the compressibility and solved using Evolutionary Algorithms. For the hard-sphere fluid, the results show good agreement when compared with mean-field equations of state and accurate computer simulation results; at high densities, i.e., close to the freezing transition, expected (small) deviations are seen. In the case of the square-well fluid, a good agreement is observed at low and high densities when compared with event-driven molecular dynamics computer simulations. For intermediate densities, the explored closure relations vary in terms of accuracy. Our findings suggest that a modification of the optimization problem to include, for example, additional thermodynamic consistency criteria could improve the results for the type of fluids here explored.


title: On homogeneity of $\mathbb N^\tau$

abstract: It is shown that any homeomorphism between two compact subsets of $\mathbb N^\tau$ can be extended to an autohomeomorphism of $\mathbb N^\tau$.


title: Robust Regularized Low-Rank Matrix Models for Regression and Classification

abstract: While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy matrix-valued predictors. To address these issues, this paper proposes a framework of matrix variate regression models based on a rank constraint, vector regularization (e.g., sparsity), and a general loss function with three special cases considered: ordinary matrix regression, robust matrix regression, and matrix logistic regression. We also propose an alternating projected gradient descent algorithm. Based on analyzing our objective functions on manifolds with bounded curvature, we show that the algorithm is guaranteed to converge, all accumulation points of the iterates have estimation errors in the order of $O(1/\sqrt{n})$ asymptotically and substantially attaining the minimax rate. Our theoretical analysis can be applied to general optimization problems on manifolds with bounded curvature and can be considered an important technical contribution to this work. We validate the proposed method through simulation studies and real image data examples.


title: Tutorial: A Beginner's Guide to Interpreting Magnetic Susceptibility Data with the Curie-Weiss Law

abstract: Magnetic susceptibility measurements are often the first characterization tool that researchers turn to when beginning to assess the magnetic nature of a newly discovered material. Breakthroughs in instrumentation have made the collection of high quality magnetic susceptibility data more accessible than ever before. However, the analysis of susceptibility data remains a common challenge for newcomers to the field of magnetism. While a comprehensive treatment of the theoretical aspects of magnetism are found in numerous excellent textbooks, there is a gap at the point of practical application. We were inspired by this obstacle to put together this guide to the analysis and interpretation of magnetic susceptibility data, with an emphasis on materials that exhibit Curie-Weiss paramagnetism.


title: Formalizing PQRST Complex in Accelerometer-based Gait Cycle for Authentication

abstract: Accelerometer signals generated through gait present a new frontier of human interface with mobile devices. Gait cycle detection based on these signals has applications in various areas, including authentication, health monitoring, and activity detection. Template-based studies focus on how the entire gait cycle represents walking patterns, but these are compute-intensive. Aggregate feature-based studies extract features in the time domain and frequency domain from the entire gait cycle to reduce the number of features. However, these methods may miss critical structural information needed to appropriately represent the intricacies of walking patterns. To the best of our knowledge, no study has formally proposed a structure to capture variations within gait cycles or phases from accelerometer readings. We propose a new structure named the PQRST Complex, which corresponds to the swing phase in a gait cycle and matches the foot movements during this phase, thus capturing the changes in foot position. In our experiments, based on the nine features derived from this structure, the accelerometer-based gait authentication system outperforms many state-of-the-art gait cycle-based authentication systems. Our work opens up a new paradigm of capturing the structure of gait and opens multiple areas of research and practice using gait analogous to the "QRS complex" structure of ECG signals related to the heart.


title: Unsupervised Abnormal Traffic Detection through Topological Flow Analysis

abstract: Cyberthreats are a permanent concern in our modern technological world. In the recent years, sophisticated traffic analysis techniques and anomaly detection (AD) algorithms have been employed to face the more and more subversive adversarial attacks. A malicious intrusion, defined as an invasive action intending to illegally exploit private resources, manifests through unusual data traffic and/or abnormal connectivity pattern. Despite the plethora of statistical or signature-based detectors currently provided in the literature, the topological connectivity component of a malicious flow is less exploited. Furthermore, a great proportion of the existing statistical intrusion detectors are based on supervised learning, that relies on labeled data. By viewing network flows as weighted directed interactions between a pair of nodes, in this paper we present a simple method that facilitate the use of connectivity graph features in unsupervised anomaly detection algorithms. We test our methodology on real network traffic datasets and observe several improvements over standard AD.


title: SystemMatch: optimizing preclinical drug models to human clinical outcomes via generative latent-space matching

abstract: Translating the relevance of preclinical models ($\textit{in vitro}$, animal models, or organoids) to their relevance in humans presents an important challenge during drug development. The rising abundance of single-cell genomic data from human tumors and tissue offers a new opportunity to optimize model systems by their similarity to targeted human cell types in disease. In this work, we introduce SystemMatch to assess the fit of preclinical model systems to an $\textit{in sapiens}$ target population and to recommend experimental changes to further optimize these systems. We demonstrate this through an application to developing $\textit{in vitro}$ systems to model human tumor-derived suppressive macrophages. We show with held-out $\textit{in vivo}$ controls that our pipeline successfully ranks macrophage subpopulations by their biological similarity to the target population, and apply this analysis to rank a series of 18 $\textit{in vitro}$ macrophage systems perturbed with a variety of cytokine stimulations. We extend this analysis to predict the behavior of 66 $\textit{in silico}$ model systems generated using a perturbational autoencoder and apply a $k$-medoids approach to recommend a subset of these model systems for further experimental development in order to fully explore the space of possible perturbations. Through this use case, we demonstrate a novel approach to model system development to generate a system more similar to human biology.


title: Bohr's phenomenon in complex Banach space

abstract: In this article, we investigate sharp Bohr's phenomenon to four classes of holomorphic functions mappings the bounded balanced domain $G$ of a complex Banach space $X$ into the right half-plane, the slit domain, the punctured unit disk, and the exterior of the closed unit disk.


title: FROG: Forward-Secure Post-Quantum Signature

abstract: Forward-secure signatures guarantee that the signatures generated before the compromise of private key remain secure, and therefore offer an enhanced compromise-resiliency for real-life applications such as digital forensics, audit logs, and financial systems. However, the vast majority of state-of-the-art forward-secure signatures rely on conventional intractability assumptions and therefore are not secure against quantum computers. Hash-based signatures (HBS) (e.g., XMSS) can offer forward-secure post-quantum security. However, they are efficient only for a pre-defined number of messages to be signed and incur high key generation overhead, highly expensive signing, and large signature sizes for an increasing number of messages. It is an open problem to develop quantum-safe forward-secure signatures that are efficient and practical with a signing capability scalable to their security parameters. In this work, we propose a new series of post-quantum signatures that we call FROG (Forward-secuRe pOst-quantum siGnature). Unlike HBS alternatives, FROG can achieve highly computational efficient signatures with sub-linear key/signature sizes and (practically) unbounded signing capability. This is achieved by transforming suitable post-quantum signatures into forward-secure settings via MMM constructions. We investigated the transformation of prominent post-quantum secure signatures such as Dilithium, WOTS, and BLISS with MMM. Our experiments indicate that FROG outperforms XMSS for the vast majority (if not all for a large number of messages) of performance metrics. We also discuss one-time variants of these base signature schemes that can push the performance of FROG to the edge. Overall, FROG shows a better performance than the existing alternatives with forward-security and therefore is an ideal alternative for the standardization efforts for forward-secure post-quantum signatures.


title: Fidelity overhead for non-local measurements in variational quantum algorithms

abstract: Measuring quantum observables by grouping terms that can be rotated to sums of only products of Pauli $\hat z$ operators (Ising form) is proven to be efficient in near term quantum computing algorithms. This approach requires extra unitary transformations to rotate the state of interest so that the measurement of a fragment's Ising form would be equivalent to measurement of the fragment for the unrotated state. These extra rotations allow one to perform a fewer number of measurements by grouping more terms into the measurable fragments with a lower overall estimator variance. However, previous estimations of the number of measurements did not take into account non-unit fidelity of quantum gates implementing the additional transformations. Through a circuit fidelity reduction, additional transformations introduce extra uncertainty and increase the needed number of measurements. Here we consider a simple model for errors introduced by additional gates needed in schemes involving grouping of commuting Pauli products. For a set of molecular electronic Hamiltonians, we confirm that the numbers of measurements in schemes using non-local qubit rotations are still lower than those in their local qubit rotation counterparts, even after accounting for uncertainties introduced by additional gates.


title: Regularity for free multiplicative convolution on the unit circle

abstract: It is shown that the free multiplicative convolution of two nondegenerate probability measures on the unit circle has no continuous singular part relative to arclength measure. Analogous results have long been known for free additive convolutions on the line and free multiplicative convolution on the positive half-line.


title: Nearly optimal resolution estimate for the two-dimensional super-resolution and a new algorithm for direction of arrival estimation with uniform rectangular array

abstract: In this paper, we develop a new technique to obtain nearly optimal estimates of the computational resolution limits introduced in Appl. Comput. Harmon. Anal. 56 (2022) 402-446; IEEE Trans. Inf. Theory 67(7) (2021) 4812-4827; Inverse Probl. 37(10) (2021) 104001 for two-dimensional super-resolution problems. Our main contributions are fivefold: (i) Our work improves the resolution estimate for number detection and location recovery in two-dimensional super-resolution problems to nearly optimal; (ii) As a consequence, we derive a stability result for a sparsity-promoting algorithm in two-dimensional super-resolution problems (or Direction of Arrival problems (DOA)). The stability result exhibits the optimal performance of sparsity promoting in solving such problems; (iii) Our techniques pave the way for improving the estimate for resolution limits in higher-dimensional super-resolutions to nearly optimal; (iv) Inspired by these new techniques, we propose a new coordinate-combination-based model order detection algorithm for two-dimensional DOA estimation and theoretically demonstrate its optimal performance, and (v) we also propose a new coordinate-combination-based MUSIC algorithm for super-resolving sources in two-dimensional DOA estimation. It has excellent performance and enjoys many advantages compared to the conventional DOA algorithms. The coordinate-combination idea seems to be a promising way for multi-dimensional DOA estimation.


title: Practical Insights of Repairing Model Problems on Image Classification

abstract: Additional training of a deep learning model can cause negative effects on the results, turning an initially positive sample into a negative one (degradation). Such degradation is possible in real-world use cases due to the diversity of sample characteristics. That is, a set of samples is a mixture of critical ones which should not be missed and less important ones. Therefore, we cannot understand the performance by accuracy alone. While existing research aims to prevent a model degradation, insights into the related methods are needed to grasp their benefits and limitations. In this talk, we will present implications derived from a comparison of methods for reducing degradation. Especially, we formulated use cases for industrial settings in terms of arrangements of a data set. The results imply that a practitioner should care about better method continuously considering dataset availability and life cycle of an AI system because of a trade-off between accuracy and preventing degradation.


title: Time-domain Hong-Ou-Mandel interference of quasi-thermal fields and its application in linear optical circuit characterization

abstract: We study temporal correlations of interfering quasi-thermal fields, obtained by scattering laser radiation on a rotating ground glass disk. We show that the Doppler effect causes oscillations in temporal cross-correlation function. Furthermore, we propose how to use Hong-Ou-Mandel interference of quasi-thermal fields in the time domain to characterize linear optical circuits.


title: Efficient Deep Learning Methods for Identification of Defective Casting Products

abstract: Quality inspection has become crucial in any large-scale manufacturing industry recently. In order to reduce human error, it has become imperative to use efficient and low computational AI algorithms to identify such defective products. In this paper, we have compared and contrasted various pre-trained and custom-built architectures using model size, performance and CPU latency in the detection of defective casting products. Our results show that custom architectures are efficient than pre-trained mobile architectures. Moreover, custom models perform 6 to 9 times faster than lightweight models such as MobileNetV2 and NasNet. The number of training parameters and the model size of the custom architectures is significantly lower (~386 times & ~119 times respectively) than the best performing models such as MobileNetV2 and NasNet. Augmentation experimentations have also been carried out on the custom architectures to make the models more robust and generalizable. Our work sheds light on the efficiency of these custom-built architectures for deployment on Edge and IoT devices and that transfer learning models may not always be ideal. Instead, they should be specific to the kind of dataset and the classification problem at hand.


title: Uncertainty Quantification in Breakup Reactions

abstract: Breakup reactions are one of the favored probes to study loosely bound nuclei, particularly those in the limit of stability forming a halo. In order to interpret such breakup experiments, the continuum discretized coupled channel method is typically used. In this study, the first Bayesian analysis of a breakup reaction model is performed. We use a combination of statistical methods together with a three-body reaction model (the continuum discretized coupled channel method) to quantify the uncertainties on the breakup observables due to the parameters in the effective potential describing the loosely bound projectile of interest. The combination of tools we develop opens the path for a Bayesian analysis of not only breakup processes, but also a wide array of complex processes that require computationally intensive reaction models.


title: An upper bound on binomial coefficients in the de Moivre-Laplace form

abstract: We suggest an upper bound on binomial coefficients that holds over the entire parameter range and whose form repeats the form of the de Moivre-Laplace approximation of the symmetric binomial distribution. Using the bound, we estimate the number of continuations of a given Boolean function to bent functions, investigate dependencies into the Walsh-Hadamard spectra, obtain restrictions on the number of representations as sum of squares of integers bounded in magnitude.


title: Revisiting Facial Key Point Detection: An Efficient Approach Using Deep Neural Networks

abstract: Facial landmark detection is a widely researched field of deep learning as this has a wide range of applications in many fields. These key points are distinguishing characteristic points on the face, such as the eyes center, the eye's inner and outer corners, the mouth center, and the nose tip from which human emotions and intent can be explained. The focus of our work has been evaluating transfer learning models such as MobileNetV2 and NasNetMobile, including custom CNN architectures. The objective of the research has been to develop efficient deep learning models in terms of model size, parameters, and inference time and to study the effect of augmentation imputation and fine-tuning on these models. It was found that while augmentation techniques produced lower RMSE scores than imputation techniques, they did not affect the inference time. MobileNetV2 architecture produced the lowest RMSE and inference time. Moreover, our results indicate that manually optimized CNN architectures performed similarly to Auto Keras tuned architecture. However, manually optimized architectures yielded better inference time and training curves.


title: Double-GEM based thermal neutron detector prototype

abstract: The Helium-3 shortage and the growing interest in neutron science constitute a driving factor in developing new neutron detection technologies. In this work, we report the development of a double-GEM detector prototype that uses a $^{10}$B$_4$C layer as a neutron converter material. GEANT4 simulations were performed predicting an efficiency of 3.14(10) %, agreeing within 2.7 $\sigma$ with the experimental and analytic detection efficiencies obtained by the detector when tested in a 41.8 meV thermal neutron beam. The detector is position sensitive, equipped with a 256+256 strip readout connected to resistive chains, and achieves a spatial resolution better than 3 mm. The gain stability over time was also measured with a fluctuation of about 0.2 %h$^{-1}$ of the signal amplitude. A simple data acquisition with only 5 electronic channels is sufficient to operate this detector.


title: The VoicePrivacy 2020 Challenge Evaluation Plan

abstract: The VoicePrivacy Challenge aims to promote the development of privacy preservation tools for speech technology by gathering a new community to define the tasks of interest and the evaluation methodology, and benchmarking solutions through a series of challenges. In this document, we formulate the voice anonymization task selected for the VoicePrivacy 2020 Challenge and describe the datasets used for system development and evaluation. We also present the attack models and the associated objective and subjective evaluation metrics. We introduce two anonymization baselines and report objective evaluation results.


title: Classification of Astronomical Bodies by Efficient Layer Fine-Tuning of Deep Neural Networks

abstract: The SDSS-IV dataset contains information about various astronomical bodies such as Galaxies, Stars, and Quasars captured by observatories. Inspired by our work on deep multimodal learning, which utilized transfer learning to classify the SDSS-IV dataset, we further extended our research in the fine tuning of these architectures to study the effect in the classification scenario. Architectures such as Resnet-50, DenseNet-121 VGG-16, Xception, EfficientNetB2, MobileNetV2 and NasnetMobile have been built using layer wise fine tuning at different levels. Our findings suggest that freezing all layers with Imagenet weights and adding a final trainable layer may not be the optimal solution. Further, baseline models and models that have higher number of trainable layers performed similarly in certain architectures. Model need to be fine tuned at different levels and a specific training ratio is required for a model to be termed ideal. Different architectures had different responses to the change in the number of trainable layers w.r.t accuracies. While models such as DenseNet-121, Xception, EfficientNetB2 achieved peak accuracies that were relatively consistent with near perfect training curves, models such as Resnet-50,VGG-16, MobileNetV2 and NasnetMobile had lower, delayed peak accuracies with poorly fitting training curves. It was also found that though mobile neural networks have lesser parameters and model size, they may not always be ideal for deployment on a low computational device as they had consistently lower validation accuracies. Customized evaluation metrics such as Tuning Parameter Ratio and Tuning Layer Ratio are used for model evaluation.


title: A Low-latency Communication Design for Brain Simulations

abstract: Brain simulation, as one of the latest advances in artificial intelligence, facilitates better understanding about how information is represented and processed in the brain. The extreme complexity of human brain makes brain simulations only feasible upon high-performance computing platforms. Supercomputers with a large number of interconnected graphical processing units (GPUs) are currently employed for supporting brain simulations. Therefore, high-throughput low-latency inter-GPU communications in supercomputers play a crucial role in meeting the performance requirements of brain simulation as a highly time-sensitive application. In this paper, we first provide an overview of the current parallelizing technologies for brain simulations using multi-GPU architectures. Then, we analyze the challenges to communications for brain simulation and summarize guidelines for communication design to address such challenges. Furthermore, we propose a partitioning algorithm and a two-level routing method to achieve efficient low-latency communications in multi-GPU architecture for brain simulation. We report experiment results obtained on a supercomputer with 2,000 GPUs for simulating a brain model with 10 billion neurons to show that our approach can significantly improve communication performance. We also discuss open issues and identify some research directions for low-latency communication design for brain simulations.


title: LB-OPAR: Load Balanced Optimized Predictive and Adaptive Routing for Cooperative UAV Networks

abstract: Cooperative ad-hoc UAV networks have been turning into the primary solution set for situations where establishing a communication infrastructure is not feasible. Search-and-rescue after a disaster and intelligence, surveillance, and reconnaissance (ISR) are two examples where the UAV nodes need to send their collected data cooperatively into a central decision maker unit. Recently proposed SDN-based solutions show incredible performance in managing different aspects of such networks. Alas, the routing problem for the highly dynamic UAV networks has not been addressed adequately. An optimal, reliable, and adaptive routing algorithm compatible with the SDN design and highly dynamic nature of such networks is required to improve the network performance. This paper proposes a load-balanced optimized predictive and adaptive routing (LB-OPAR), an SDN-based routing solution for cooperative UAV networks. LB-OPAR is the extension of our recently published routing algorithm (OPAR) that balances the network load and optimizes the network performance in terms of throughput, success rate, and flow completion time (FCT). We analytically model the routing problem in highly dynamic UAV network and propose a lightweight algorithmic solution to find the optimal solution with $O(|E|^2)$ time complexity where $|E|$ is the total number of network links. We exhaustively evaluate the proposed algorithm's performance using ns-3 network simulator. Results show that LB-OPAR outperforms the benchmark algorithms by $20\%$ in FCT, by $30\%$ in flow success rate on average, and up to $400\%$ in throughput.


title: Magnetic susceptibility of the square lattice Ising model

abstract: In this work, the susceptibility of the square lattice Ising model is investigated using the recently obtained average magnetization interrelation, which is given by $\langle\sigma_{0, i}\rangle= \langle\tanh[K(\sigma_{1,i}+\sigma_{2,i}+\dots +\sigma_{z,i})+H]\rangle $. Here, $z$ is the number of nearest neighbors, $\sigma_{0,i}$ denotes the central spin at the $i^{th}$ site while $\sigma_{l,i}$, $l=1,2,\dots,z$, are the nearest neighbor spins around the central spin, $K=J/(k_{B}T)$, where $J$ is the nearest neighbor coupling constant, $k_{B}$ is the Boltzmann's constant and $T$ is the temperature of the system. In our investigation, inevitably we have to make a conjecture about the three-site correlation function appearing in the obtained relation of this paper. The conjectured form of the the three spin correlation function is given by the relation, $\langle\sigma_{1}\sigma_{2}\sigma_{3}\rangle=a(K,H)\langle\sigma\rangle+[1-a(K,H)]\langle\sigma\rangle^{(1+\beta^{-1})}$. Here $\beta$ denotes the critical exponent for the average magnetization and $a(K,H)$ is a function whose behavior will be described around the critical point with an arbitrary constant. To elucidate the relevance of the method used in this paper, we have first calculated the susceptibility of the 1D chain as an example, and the obtained susceptibility expression is seen as equivalent to the result of the susceptibility of the conventional method. The magnetic critical exponent $\gamma$ of the square lattice Ising model is obtained as $\gamma=1.72$ for $T\!>\!T_{c}$, and $\gamma=0.91$ for $T\!<\!T_{c}$.


title: Statistical discrimination and statistical informativeness

abstract: We study the link between Phelps-Aigner-Cain-type statistical discrimination and familiar notions of statistical informativeness. Our central insight is that Blackwell's Theorem, suitably relabeled, characterizes statistical discrimination in terms of statistical informativeness. This delivers one-half of Chambers and Echenique's (2021) characterization of statistical discrimination as a corollary, and suggests a different interpretation of it: that discrimination is inevitable. In addition, Blackwell's Theorem delivers a number of finer-grained insights into the nature of statistical discrimination. We argue that the discrimination-informativeness link is quite general, illustrating with an informativeness characterization of a different type of discrimination.


title: Efficient lifting of symmetry breaking constraints for complex combinatorial problems

abstract: Many industrial applications require finding solutions to challenging combinatorial problems. Efficient elimination of symmetric solution candidates is one of the key enablers for high-performance solving. However, existing model-based approaches for symmetry breaking are limited to problems for which a set of representative and easily-solvable instances is available, which is often not the case in practical applications. This work extends the learning framework and implementation of a model-based approach for Answer Set Programming to overcome these limitations and address challenging problems, such as the Partner Units Problem. In particular, we incorporate a new conflict analysis algorithm in the Inductive Logic Programming system ILASP, redefine the learning task, and suggest a new example generation method to scale up the approach. The experiments conducted for different kinds of Partner Units Problem instances demonstrate the applicability of our approach and the computational benefits due to the first-order constraints learned.


title: Contribution of exclusive $(\pi^0\pi^0, \pi^0\eta, \eta\eta)\gamma$ channels to the leading order HVP of the muon $g-2$

abstract: We evaluate the contributions of $(\pi^0\pi^0, \pi^0\eta, \eta\eta)\gamma$ exclusive channels to the dispersion integral of the leading order HVP of the muon anomalous magnetic moment. These channels are included in some way in previous evaluations of the $\pi^0\omega, \eta\omega$ and $\eta\phi$ contributions to $a_{\mu}^{\rm had, LO}$, where the vector resonances (decaying into $\pi^0/\eta+ \gamma$) are assumed to be on-shell. Since the separation of resonance and background contributions in a given observable is, in general, a model-dependent procedure, here we use pseudoscalar mesons and the photon as the $in$ and $out$ states of the $e^+e^- \to (\pi^0\pi^0, \pi^0\eta, \eta\eta)\gamma$ $S$-matrix, such that the cross section contains the interferences among different contributing to the amplitudes. We find $a^{\rm had, LO}_{\mu}(P^0_1P^0_2\gamma)=(1.13\pm 0.13 ) \times 10^{-10}$, where uncertainties stem mainly from vector meson dominance model parameters. Improved experimental studies of these exclusive channels in the whole range below 2 GeV would reduce model-dependency.


title: Scientific Workflows in Heterogeneous Edge-Cloud Computing: A Data Placement Strategy Based on Reinforcement learning

abstract: The heterogeneous edge-cloud computing paradigm can provide an optimal solution to deploy scientific workflows compared to cloud computing or other traditional distributed computing environments. Owing to the different sizes of scientific datasets and the privacy issue concerning some of these datasets, it is essential to find a data placement strategy that can minimize data transmission time. Some state-of-the-art data placement strategies combine edge computing and cloud computing to distribute scientific datasets. However, the dynamic distribution of newly generated datasets to appropriate datacenters and exiting the spent datasets are still a challenge during workflows execution. To address this challenge, this study not only constructs a data placement model that includes shared datasets within individual and among multiple workflows across various geographical regions, but also proposes a data placement strategy (DYM-RL-DPS) based on algorithms of two stages. First, during the build-time stage of workflows, we use the discrete particle swarm optimization algorithm with differential evolution to pre-allocate initial datasets to proper datacenters. Then, we reformulate the dynamic datasets distribution problem as a Markov decision process and provide a reinforcement learning-based approach to learn the optimal strategy in the runtime stage of scientific workflows. Through simulating heterogeneous edge-cloud computing environments, we designed comprehensive experiments to demonstrate the superiority of DYM-RL-DPS. The results of our strategy can effectively reduce the data transmission time as compared to other strategies.


title: Analytic average magnetization expression for the body centered cubic Ising lattice

abstract: Recently we have performed large-scale average magnetization studies of the Ising model for the square, honeycomb, triangular, and simple cubic lattice. We want to complement those studies with the structurally more complicated body-centered cubic lattice Ising model in this paper. We have relevantly calculated the order parameter or average magnetization expression for the body-centered cubic Ising lattice based on the recently developed interrelation, given by $\langle\sigma_{0, i}\rangle= \langle\tanh[K(\sigma_{1,i}+\sigma_{2,i}+\dots +\sigma_{z,i})+H]\rangle$. We will use the same conjectures for the odd spins correlation functions as in our previous works. The mathematical forms of the odd spin correlation functions will be eventually elucidated by some physical discussions. We have seen that the obtained average magnetization expression with the numerical data for the body-centered cubic lattice Ising model is in good agreement.


title: A basic homogenization problem for the $p$-Laplacian in ${\mathbb R}^d$ perforated along a sphere: $L^\infty$ estimates

abstract: We consider a boundary value problem for the $p$-Laplacian, posed in the exterior of small cavities that all have the same $p$-capacity and are anchored to the unit sphere in $\mathbb{R}^d$, where $1<p<d.$ We assume that the distance between anchoring points is at least $\varepsilon$ and the characteristic diameter of cavities is $\alpha \varepsilon$, where $\alpha=\alpha(\varepsilon)$ tends to 0 with $\varepsilon$. We also assume that anchoring points are asymptotically uniformly distributed as $\varepsilon \downarrow 0$, and their number is asymptotic to a positive constant times $\varepsilon^{1-d}$. The solution $u=u^\varepsilon$ is required to be 1 on all cavities and decay to 0 at infinity. Our goal is to describe the behavior of solutions for small $\varepsilon>0$. We show that the problem possesses a critical window characterized by $\tau:=\lim_{\varepsilon \downarrow 0}\alpha /\alpha_c \in (0,\infty)$, where $\alpha_c=\varepsilon^{1/\gamma}$ and $\gamma= \frac{d-p}{p-1}.$ We prove that outside the unit sphere, as $\varepsilon\downarrow 0$, the solution converges to $A_*U$ for some constant $A_*$, where $U(x)=\min\{1,|x|^{-\gamma}\}$ is the radial $p$-harmonic function outside the unit ball. Here the constant $A_*$ equals 0 if $\tau=0$, while $A_*=1$ if $\tau=\infty$. In the critical window where $\tau$ is positive and finite, $ A_*\in(0,1)$ is explicitly computed in terms of the parameters of the problem. We also evaluate the limiting $p$-capacity in all three cases mentioned above. Our key new tool is the construction of an explicit ansatz function $u_{A_*}^\varepsilon$ that approximates the solution $u^\varepsilon$ in $L^{\infty}(\mathbb{R}^d)$ and satisfies $\|\nabla u^\varepsilon-\nabla u_{A_*}^\varepsilon \|_{L^{p}(\mathbb{R}^d)} \to 0$ as $\varepsilon \downarrow 0$.


title: ETAD: Training Action Detection End to End on a Laptop

abstract: Temporal action detection (TAD) with end-to-end training often suffers from the pain of huge demand for computing resources due to long video duration. In this work, we propose an efficient temporal action detector (ETAD) that can train directly from video frames with extremely low GPU memory consumption. Our main idea is to minimize and balance the heavy computation among features and gradients in each training iteration. We propose to sequentially forward the snippet frame through the video encoder, and backward only a small necessary portion of gradients to update the encoder. To further alleviate the computational redundancy in training, we propose to dynamically sample only a small subset of proposals during training. Moreover, various sampling strategies and ratios are studied for both the encoder and detector. ETAD achieves state-of-the-art performance on TAD benchmarks with remarkable efficiency. On ActivityNet-1.3, training ETAD in 18 hours can reach 38.25% average mAP with only 1.3 GB memory consumption per video under end-to-end training. Our code will be publicly released.


title: Transport, flow topology and Lagrangian conditional statistics in edge plasma turbulence

abstract: Lagrangian statistics and particle transport in edge plasma turbulence are investigated using the Hasegawa-Wakatani model and its modified version. The latter shows the emergence of pronounced zonal flows. Different values of the adiabaticity parameter are considered. The main goal is to characterize the role of coherent structures, i.e., vortices and zonal flows, and their impact on the Lagrangian statistics of particles. Computationally intensive long time simulations following ensembles of test particles over hundreds of eddy turnover times are considered in statistically stationary turbulent flows. The flow topology is characterized using the Lagrangian Okubo-Weiss criterion, and the flow can thus be split into topologically different domains. In elliptic and hyperbolic regions, the probability density functions (pdfs) of the residence time have self-similar algebraic decaying tails. However, in the intermediate regions the pdfs do exhibit exponentially decaying tails. Topologically conditioned pdfs of the Lagrangian velocity, and acceleration and density fluctuations are likewise computed. The differences between the classical Hasegawa-Wakatani system and its modified version are assessed and the role of zonal flows is highlighted. The density flux spectrum which characterizes the contributions of different length scales is studied and its inertial scaling is found to be in agreement with predictions based on dimensional arguments. Analyzing the angular change of particle tracers at different time scales, corresponding to coarse grained curvature, completes the study and the multiscale geometric statistics quantify the directional properties of the particle motion in the different flow regimes.


title: Electronic excited states in extreme limits via ensemble density functionals

abstract: Density functional theory (DFT) has greatly expanded our ability to affordably compute and understand electronic ground states, by replacing intractable {\em ab initio} calculations by models based on paradigmatic physics from high- and low-density limits. But, a comparable treatment of excited states lags behind. Here, we solve this outstanding problem by employing a generalization of density functional theory to ensemble states (EDFT). We thus address important paradigmatic cases of all electronic systems in strongly (low-density) and weakly (high-density) correlated regimes. We show that the high-density limit connects to recent, exactly-solvable EDFT results. The low-density limit reveals an unnoticed and most unexpected result -- density functionals for strictly correlated {\em ground} states can be reused {\em directly} for excited states. Non-trivial dependence on excitation structure only shows up at third leading order. Overall, our results provide foundations for effective models of excited states that interpolate between exact low- and high-density limits, which we illustrate on the cases of singlet-singlet excitations in H$_2$ and a ring of quantum wells.


title: On uniformly $S$-coherent rings

abstract: In this paper, we introduce and study the notions of uniformly $S$-finitely presented modules and uniformly $S$-coherent rings (modules) which are "uniform" versions of ($c$-)$S$-finitely presented modules and ($c$-)$S$-coherent rings (modules) introduced by Bennis and Hajoui \cite{bh18}. Among the results, uniformly $S$-versions of Chase's result, Chase Theorem and Matlis Theorem are obtained.


title: Bounded weight modules for basic classical Lie superalgebras at infinity

abstract: We classify simple bounded weight modules over the complex simple Lie superalgebras $\mathfrak{sl}(\infty |\infty)$ and $\mathfrak{osp} (m | 2n)$, when at least one of $m$ and $n$ equals $\infty$. For $\mathfrak{osp} (m | 2n)$ such modules are of spinor-oscillator type, i.e., they combine into one the known classes of spinor $\mathfrak{o} (m)$-modules and oscillator-type $\mathfrak{sp} (2n)$-modules. In addition, we characterize the category of bounded weight modules over $\mathfrak{osp} (m | 2n)$ (under the assumption $\dim \, \mathfrak{osp} (m | 2n) = \infty$) by reducing its study to already known categories of representations of $\mathfrak{sp} (2n)$, where $n$ possibly equals $\infty$. When classifying simple bounded weight $\mathfrak{sl}(\infty |\infty)$-modules, we prove that every such module is integrable over one of the two infinite-dimensional ideals of the Lie algebra $\mathfrak{sl}(\infty |\infty)_{\bar{0}}$. We finish the paper by establishing some first facts about the category of bounded weight $\mathfrak{sl} (\infty |\infty)$-modules.


title: Breaking with Fixed Set Pathology Recognition through Report-Guided Contrastive Training

abstract: When reading images, radiologists generate text reports describing the findings therein. Current state-of-the-art computer-aided diagnosis tools utilize a fixed set of predefined categories automatically extracted from these medical reports for training. This form of supervision limits the potential usage of models as they are unable to pick up on anomalies outside of their predefined set, thus, making it a necessity to retrain the classifier with additional data when faced with novel classes. In contrast, we investigate direct text supervision to break away from this closed set assumption. By doing so, we avoid noisy label extraction via text classifiers and incorporate more contextual information. We employ a contrastive global-local dual-encoder architecture to learn concepts directly from unstructured medical reports while maintaining its ability to perform free form classification. We investigate relevant properties of open set recognition for radiological data and propose a method to employ currently weakly annotated data into training. We evaluate our approach on the large-scale chest X-Ray datasets MIMIC-CXR, CheXpert, and ChestX-Ray14 for disease classification. We show that despite using unstructured medical report supervision, we perform on par with direct label supervision through a sophisticated inference setting.


title: Error Exponents of the Dirty-Paper and Gel'fand-Pinsker Channels

abstract: We derive various error exponents for communication channels with random states, which are available non-causally at the encoder only. For both the finite-alphabet Gel'fand-Pinsker channel and its Gaussian counterpart, the dirty-paper channel, we derive random coding exponents, error exponents of the typical random codes (TRCs), and error exponents of expurgated codes. For the two channel models, we analyze some sub-optimal bin-index decoders, which turn out to be asymptotically optimal, at least for the random coding error exponent. For the dirty-paper channel, we show explicitly via a numerical example, that both the error exponent of the TRC and the expurgated exponent strictly improve upon the random coding exponent, at relatively low coding rates, which is a known fact for discrete memoryless channels without random states. We also show that at rates below capacity, the optimal values of the dirty-paper design parameter $\alpha$ in the random coding sense and in the TRC exponent sense are different from one another, and they are both different from the optimal $\alpha$ that is required for attaining the channel capacity. For the Gel'fand-Pinsker channel, we allow for a variable-rate random binning code construction, and prove that the previously proposed maximum penalized mutual information decoder is asymptotically optimal within a given class of decoders, at least for the random coding error exponent.


title: BackLink: Supervised Local Training with Backward Links

abstract: Empowered by the backpropagation (BP) algorithm, deep neural networks have dominated the race in solving various cognitive tasks. The restricted training pattern in the standard BP requires end-to-end error propagation, causing large memory cost and prohibiting model parallelization. Existing local training methods aim to resolve the training obstacle by completely cutting off the backward path between modules and isolating their gradients to reduce memory cost and accelerate the training process. These methods prevent errors from flowing between modules and hence information exchange, resulting in inferior performance. This work proposes a novel local training algorithm, BackLink, which introduces inter-module backward dependency and allows errors to flow between modules. The algorithm facilitates information to flow backward along with the network. To preserve the computational advantage of local training, BackLink restricts the error propagation length within the module. Extensive experiments performed in various deep convolutional neural networks demonstrate that our method consistently improves the classification performance of local training algorithms over other methods. For example, in ResNet32 with 16 local modules, our method surpasses the conventional greedy local training method by 4.00\% and a recent work by 1.83\% in accuracy on CIFAR10, respectively. Analysis of computational costs reveals that small overheads are incurred in GPU memory costs and runtime on multiple GPUs. Our method can lead up to a 79\% reduction in memory cost and 52\% in simulation runtime in ResNet110 compared to the standard BP. Therefore, our method could create new opportunities for improving training algorithms towards better efficiency and biological plausibility.


title: Using Time-Varying Systems to Challenge Fundamental Limitations in Electromagnetics

abstract: Time-varying systems open intriguing opportunities to explore novel approaches in the design of efficient electromagnetic devices. While such explorations date back to more than half a century ago, recent years have experienced a renewed and increased interest into the design of dynamic electromagnetic systems. This resurgence has been partly fueled by the desire to surpass the performance of conventional devices, and to enable systems that can challenge various well-established performance bounds, such as the Bode-Fano limit, the Chu limit, and others. Here, we overview this emerging research area and provide a concise and systematic summary of the most relevant applications for which the relevant performance bounds can be overcome through time-varying elements. In addition to enabling devices with superior performance metrics, such research endeavors may open entirely new opportunities and offer insight towards future electromagnetic and optical technologies.