title: Stochastic Model Predictive Control for Linear Systems with Unbounded Additive Uncertainties

abstract: This paper presents two stochastic model predictive control methods for linear time-invariant systems subject to unbounded additive uncertainties. The new methods are developed by formulating the chance constraints into deterministic form, which are treated in analogy with robust constraints, by using the probabilistic reachable set. Firstly, the probabilistically resolvable time-varying tube-based stochastic model predictive control algorithm is designed by employing the time-varying probabilistic reachable sets as the tubes. Secondly, by utilizing the probabilistic positively invariant set, the probabilistically resolvable constant tube-based stochastic model predictive control algorithm is developed by employing the constantly tightened constraints in the entire prediction horizons. In addition, to enhance the feasibility of the algorithms, the soft constraints are imposed to the state initializations. The algorithm feasibility and closed-loop stability results are provided. The efficacy of the approaches are demonstrated by means of numerical simulations.


title: Deep Learning Based Proactive Optimization for Mobile LiFi Systems with Channel Aging

abstract: This paper investigates the channel aging problem of mobile light-fidelity (LiFi) systems. In the LiFi physical layer, the majority of the optimization problems for mobile users are non-convex and require the use of dual decomposition or heuristics techniques. Such techniques are based on iterative algorithms, and often, cause a high processing delay at the physical layer. Hence, the obtained solutions are no longer optimal since the LiFi channels are evolving. In this paper, a proactive-optimization (PO) approach that can alleviate the LiFi channel aging problem is proposed. The core idea is to design a long-short-term-memory (LSTM) network that is capable of predicting posterior positions and orientations of mobile users, which can be then used to predict their channel coefficients. Consequently, the obtained channel coefficients can be exploited to derive near-optimal transmission-schemes prior to the intended service-time, which enables real-time service. Through various simulations, the performance of the designed LSTM model is evaluated in terms of prediction error and time, as well as its application in a practical LiFi optimization problem.


title: Wide-Beam Array Antenna Power Gain Maximization via ADMM Framework

abstract: This paper proposes two algorithms to maximize the minimum array power gain in a wide-beam mainlobe by solving the power gain pattern synthesis (PGPS) problem with and without sidelobe constraints. Firstly, the nonconvex PGPS problem is transformed into a nonconvex linear inequality optimization problem and then converted to an augmented Lagrangian problem by introducing auxiliary variables via the Alternating Direction Method of Multipliers (ADMM) framework. Next,the original intractable problem is converted into a series of nonconvex and convex subproblems. The nonconvex subproblems are solved by dividing their solution space into a finite set of smaller ones, in which the solution would be obtained pseudoanalytically. In such a way, the proposed algorithms are superior to the existing PGPS-based ones as their convergence can be theoretically guaranteed with a lower computational burden. Numerical examples with both isotropic element pattern (IEP) and active element pattern (AEP) arrays are simulated to show the effectiveness and superiority of the proposed algorithms by comparing with the related existing algorithms.


title: Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps

abstract: We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time. First, we design the reliability-based attention module to analyze the reliability of multiple annotated frames. Second, we develop the intersection-aware propagation module to propagate segmentation results to neighboring frames. Third, we introduce the GIS mechanism for a user to select unsatisfactory frames quickly with less effort. Experimental results demonstrate that the proposed algorithm provides more accurate segmentation results at a faster speed than conventional algorithms. Codes are available at https://github.com/yuk6heo/GIS-RAmap.


title: Enabling Fast Exploration and Validation of Thermal Dissipation Requirements for Heterogeneous SoCs

abstract: The management of the energy consumption and thermal dissipation of multi-core heterogeneous platforms is becoming increasingly important as it can have direct impact on the platform performance. This paper discusses an approach that enables fast exploration and validation of heterogeneous system on chips (SoCs) platform configurations with respect to their thermal dissipation. Such platforms can be configured to find the optimal trade-off between performance and power consumption. This directly reflects in the head dissipation of the platform, which when increases over a given threshold will actually decrease the performance of the platform. Therefore, it is important to be able to quickly probe and explore different configurations and identify the most suitable one. However, this task is hindered by the large space of possible configurations of such platforms and by the time required to benchmark each configurations. As such, we propose an approach in which we construct a model of the thermal dissipation of a given platform using a system identification methods and then we use this model to explore and validate different configurations. The approach allows us to decrease the exploration time with several orders of magnitude. We exemplify the approach on an Odroid-XU4 board featuring an Exynos 5422 SoC.


title: A regularized gradient flow for the $p$-elastic energy

abstract: We prove long-time existence for the negative $L^2$-gradient flow of the $p$-elastic energy, $p\geq 2$, with an additive positive multiple of the length of the curve. To achieve this result we regularize the energy by adding a small multiple of a higher order energy, namely the square of the $L^2$-norm of the normal gradient of the curvature $\kappa$. Long-time existence is proved for the gradient flow of these new energies together with the smooth sub-convergence of the evolution equation's solutions to critical points of the regularized energy in $W^{2,p}$. We then show that the solutions to the regularized evolution equations converge to a weak solution of the negative gradient flow of the $p$-elastic energies. These latter weak solutions also sub-converge to critical points of the $p$-elastic energy.


title: Arbitrary synthetic dimensions via multi-boson dynamics on a one-dimensional lattice

abstract: The synthetic dimension, a research topic of both fundamental significance and practical applications, is attracting increasing attention in recent years. In this paper, we propose a theoretical framework to construct arbitrary synthetic dimensions, or N-boson synthetic lattices, using multiple bosons on one-dimensional lattices. We show that a one-dimensional lattice hosting N indistinguishable bosons can be mapped to a single boson on a N-dimensional lattice with high symmetry. Band structure analyses on this N-dimensional lattice can then be mathematically performed to predict the existence of exotic eigenstates and the motion of N-boson wavepackets. As illustrative examples, we demonstrate the edge states in two-boson Su-Schrieffer-Heeger synthetic lattices without interactions, interface states in two-boson Su-Schrieffer-Heeger synthetic lattices with interactions, and weakly-bound triplon states in three-boson tight-binding synthetic lattices with interactions. The interface states and weakly-bound triplon states have not been thoroughly understood in previous literatures. Our proposed theoretical framework hence provides a novel perspective to explore the multi-boson dynamics on lattices with boson-boson interactions, and opens up a future avenue in the fields of multi-boson manipulation in quantum engineering.


title: Cosmology of Linear Higgs-Sigma Models with Conformal Invariance

abstract: We consider general linear Higgs-sigma models as ultra-violet completions of the Higgs inflation. We introduce general higher curvature terms beyond Einstein gravity and recast them into a class of linear Higgs-sigma models in the scalar-dual formulation where conformal symmetry is manifest. Integrating out the sigma field in this class of linear sigma models, we obtain the same Higgs inflation Lagrangian of non-linear sigma model type in the effective theory. We show that the successful inflation for sigma field singles out the sigma-field potential derived from the $R^2$ term and the tracker solution for dark energy at late times can be realized for the $R^{p+1}$ term with $-1<p<0$. We also discuss the implications of Higgs-sigma interactions for the inflation and the vacuum stability in the Standard Model.


title: Sequential symmetry breakings in charging and discharging Li batteries

abstract: The sequential group-by-group charging/discharging in Li batteries with phase-separation thermodynamics was detected by numerical simulations and justified by several experiments published in literature. The present work is the first to quantitatively predict the main characteristics of the sequential symmetry breaking (SB) such as the average Li concentration and the fraction of the low Li part at the SB points. Using a reduced two-zone (low and high concentration) model we derived an approximate solution predicting the effect of initial separation or of imposed parameter perturbation referred to as 'noise' on the SB characteristics. We suggest that the governing parameters that account for the complex effect are the liquid potential drop over the cathode and the noise factor. A bifurcation map showing the lowest current boundary that ensures a homogeneous lithiation/ delithiation as the function of noise is constructed


title: Jump-Drift and Jump-Diffusion Processes : Large Deviations for the density, the current and the jump-flow and for the excursions between jumps

abstract: For one-dimensional Jump-Drift and Jump-Diffusion processes converging towards some steady state, the large deviations of a long dynamical trajectory are described from two perspectives. Firstly, the joint probability of the empirical time-averaged density, of the empirical time-averaged current and of the empirical time-averaged jump-flow are studied via the large deviations at Level 2.5. Secondly, the joint probability of the empirical jumps and of the empirical excursions between consecutive jumps are analyzed via the large deviations at Level 2.5 for the alternate Markov chain that governs the series of all the jump events of a long trajectory. These two general frameworks are then applied to three examples of positive jump-drift processes without diffusion, and to two examples of jump-diffusion processes, in order to illustrate various simplifications that may occur in rate functions and in contraction procedures.


title: Photophysics of two-dimensional perovskites -- learning from metal halide substitution

abstract: Whereas their photophysics exhibits an intricate interplay of carriers with the lattice, most reports have so far relied on single compound studies. With the exception of variations of the organic spacer cations, the effect of constituent substitution on the photophysics and the nature of emitting species, in particular, has remained largely under-explored. Here PEA$_2$PbBr$_4$, PEA$_2$PbI$_4$, and PEA$_2$SnI$_4$ are studied through a variety of optical spectroscopy techniques to reveal a complex set of excitonic transitions at low temperature. We attribute the emergence of weak high energy features to a vibronic progression breaking Kasha's rule and highlight that the responsible phonons cannot be accessed through simple Raman spectroscopy. Bright peaks at lower energy are due to two distinct excitons, of which the upper is a convolution of a bright exciton and a localised state, whereas the lower is attributed to shallow defects. Our study offers deeper insights into the photophysics of two-dimensional perovskites through compositional substitution and highlights critical limits to the communities' current understanding of the photophysics of these compounds.


title: Game Theory to Study Interactions between Mobility Stakeholders

abstract: Increasing urbanization and exacerbation of sustainability goals threaten the operational efficiency of current transportation systems and confront cities with complex choices with huge impact on future generations. At the same time, the rise of private, profit-maximizing Mobility Service Providers leveraging public resources, such as ride-hailing companies, entangles current regulation schemes. This calls for tools to study such complex socio-technical problems. In this paper, we provide a game-theoretic framework to study interactions between stakeholders of the mobility ecosystem, modeling regulatory aspects such as taxes and public transport prices, as well as operational matters for Mobility Service Providers such as pricing strategy, fleet sizing, and vehicle design. Our framework is modular and can readily accommodate different types of Mobility Service Providers, actions of municipalities, and low-level models of customers choices in the mobility system. Through both an analytical and a numerical case study for the city of Berlin, Germany, we showcase the ability of our framework to compute equilibria of the problem, to study fundamental tradeoffs, and to inform stakeholders and policy makers on the effects of interventions. Among others, we show tradeoffs between customers satisfaction, environmental impact, and public revenue, as well as the impact of strategic decisions on these metrics.


title: GGS: a Generic Geant4 Simulation package for small- and medium-sized particle detection experiments

abstract: The Generic Geant4 Simulation (GGS) is a package designed to speed-up the realization and deployment of Monte Carlo simulation software based on Geant4, for small- and medium-sized high-energy experiments. For many common use cases, the task of setting up a full-featured simulation of the detector is reduced to the definition of the detector geometry, by providing generic and reusable implementations of the mandatory Geant4 user classes (particle generation, scoring, output etc.). Extensibility is provided by a simple plugin system that allows replacing of the generic implementations distributed with GGS with custom ones. These features make it especially suitable for cases where limited manpower, like during preliminary detector design studies, can severely limit the scope of an R\&D program.


title: Disturbance-resilient Distributed Resource Allocation over Stochastic Networks using Uncoordinated Stepsizes

abstract: This paper studies distributed resource allocation problem in multi-agent systems, where all the agents cooperatively minimize the sum of their cost functions with global resource constraints over stochastic communication networks. This problem arises from many practical domains such as economic dispatch in smart grid, task assignment, and power allocation in robotic control. Most of existing works cannot converge to the optimal solution if states deviate from feasible region due to disturbance caused by environmental noise, misoperation, malicious attack, etc. To solve this problem, we propose a distributed deviation-tracking resource allocation algorithm and prove that it linearly converges to the optimal solution with constant stepsizes. We further explore its resilience properties of the proposed algorithm. Most importantly, the algorithm still converges to the optimal solution under the disturbance injection and random communication failure. In order to improve the convergence rate, the optimal stepsizes for the fastest convergence rate are established. We also prove the algorithm converges linearly to the optimal solution in mean square even with uncoordinated stepsizes, i.e., agents are allowed to employ different stepsizes. Simulations are provided to verify the theoretical results.


title: Stable Nonlinear and IQ Imbalance RF Fingerprint for Wireless OFDM Devices

abstract: An estimation method of Radio Frequency fingerprint (RFF) based on the physical hardware properties of the nonlinearity and in-phase and quadrature (IQ) imbalance of the transmitter is proposed for the authentication of wireless orthogonal frequency division multiplexing (OFDM) devices. Firstly, the parameters of the nonlinearity of the transmitter and finite impulse response (FIR) of the wireless multipath channel are estimated with a Hammerstein system parameter separation technique. Secondly, the best IQ imbalance parameter combination estimation is obtained with a searching algorithm and the applied conjugate anti-symmetric pilots. Thirdly, the estimations of the nonlinear coefficients and IQ imbalance parameter combination are considered as a novel RFF, the features are extracted from the novel RFF, and a k-Nearest Neighbor (k-NN) classifier is used to classify the communication devices with the features. It is demonstrated with the numerical experiments of five transmitters that the novel RFF eliminates the adverse effect of the wireless channel and is therefore stable. The proposed RF fingerprinting method is helpful for the high-strength authentication of the OFDM communication devices with subtle differences from the same model and same series.


title: Learning future terrorist targets through temporal meta-graphs

abstract: In the last 20 years, terrorism has led to hundreds of thousands of deaths and massive economic, political, and humanitarian crises in several regions of the world. Using real-world data on attacks occurred in Afghanistan and Iraq from 2001 to 2018, we propose the use of temporal meta-graphs and deep learning to forecast future terrorist targets. Focusing on three event dimensions, i.e., employed weapons, deployed tactics and chosen targets, meta-graphs map the connections among temporally close attacks, capturing their operational similarities and dependencies. From these temporal meta-graphs, we derive 2-day-based time series that measure the centrality of each feature within each dimension over time. Formulating the problem in the context of the strategic behavior of terrorist actors, these multivariate temporal sequences are then utilized to learn what target types are at the highest risk of being chosen. The paper makes two contributions. First, it demonstrates that engineering the feature space via temporal meta-graphs produces richer knowledge than shallow time-series that only rely on frequency of feature occurrences. Second, the performed experiments reveal that bi-directional LSTM networks achieve superior forecasting performance compared to other algorithms, calling for future research aiming at fully discovering the potential of artificial intelligence to counter terrorist violence.


title: Synthetic Topology and Constructive Metric Spaces

abstract: The thesis presents the subject of synthetic topology, especially with relation to metric spaces. A model of synthetic topology is a categorical model in which objects possess an intrinsic topology in a suitable sense, and all morphisms are continuous with regard to it. We redefine synthetic topology in order to incorporate closed sets, and several generalizations are made. Real numbers are reconstructed (to suit the new background) as open Dedekind cuts. An extensive theory is developed when metric and intrinsic topology match. In the end the results are examined in four specific models.


title: Federated Traffic Synthesizing and Classification Using Generative Adversarial Networks

abstract: With the fast growing demand on new services and applications as well as the increasing awareness of data protection, traditional centralized traffic classification approaches are facing unprecedented challenges. This paper introduces a novel framework, Federated Generative Adversarial Networks and Automatic Classification (FGAN-AC), which integrates decentralized data synthesizing with traffic classification. FGAN-AC is able to synthesize and classify multiple types of service data traffic from decentralized local datasets without requiring a large volume of manually labeled dataset or causing any data leakage. Two types of data synthesizing approaches have been proposed and compared: computation-efficient FGAN (FGAN-\uppercase\expandafter{\romannumeral1}) and communication-efficient FGAN (FGAN-\uppercase\expandafter{\romannumeral2}). The former only implements a single CNN model for processing each local dataset and the later only requires coordination of intermediate model training parameters. An automatic data classification and model updating framework has been proposed to automatically identify unknown traffic from the synthesized data samples and create new pseudo-labels for model training. Numerical results show that our proposed framework has the ability to synthesize highly mixed service data traffic and can significantly improve the traffic classification performance compared to existing solutions.


title: Multi-Attention-Based Soft Partition Network for Vehicle Re-Identification

abstract: Vehicle re-identification helps in distinguishing between images of the same and other vehicles. It is a challenging process because of significant intra-instance differences between identical vehicles from different views and subtle inter-instance differences between similar vehicles. To solve this issue, researchers have extracted view-aware or part-specific features via spatial attention mechanisms, which usually result in noisy attention maps or otherwise require expensive additional annotation for metadata, such as key points, to improve the quality. Meanwhile, based on the researchers' insights, various handcrafted multi-attention architectures for specific viewpoints or vehicle parts have been proposed. However, this approach does not guarantee that the number and nature of attention branches will be optimal for real-world re-identification tasks. To address these problems, we proposed a new vehicle re-identification network based on a multiple soft attention mechanism for capturing various discriminative regions from different viewpoints more efficiently. Furthermore, this model can significantly reduce the noise in spatial attention maps by devising a new method for creating an attention map for insignificant regions and then excluding it from generating the final result. We also combined a channel-wise attention mechanism with a spatial attention mechanism for the efficient selection of important semantic attributes for vehicle re-identification. Our experiments showed that our proposed model achieved a state-of-the-art performance among the attention-based methods without metadata and was comparable to the approaches using metadata for the VehicleID and VERI-Wild datasets.


title: PTHash: Revisiting FCH Minimal Perfect Hashing

abstract: Given a set $S$ of $n$ distinct keys, a function $f$ that bijectively maps the keys of $S$ into the range $\{0,\ldots,n-1\}$ is called a minimal perfect hash function for $S$. Algorithms that find such functions when $n$ is large and retain constant evaluation time are of practical interest; for instance, search engines and databases typically use minimal perfect hash functions to quickly assign identifiers to static sets of variable-length keys such as strings. The challenge is to design an algorithm which is efficient in three different aspects: time to find $f$ (construction time), time to evaluate $f$ on a key of $S$ (lookup time), and space of representation for $f$. Several algorithms have been proposed to trade-off between these aspects. In 1992, Fox, Chen, and Heath (FCH) presented an algorithm at SIGIR providing very fast lookup evaluation. However, the approach received little attention because of its large construction time and higher space consumption compared to other subsequent techniques. Almost thirty years later we revisit their framework and present an improved algorithm that scales well to large sets and reduces space consumption altogether, without compromising the lookup time. We conduct an extensive experimental assessment and show that the algorithm finds functions that are competitive in space with state-of-the art techniques and provide $2-4\times$ better lookup time.


title: Model-aided Deep Reinforcement Learning for Sample-efficient UAV Trajectory Design in IoT Networks

abstract: Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT) connectivity. DRL solutions offer the advantage of on-the-go learning hence relying on very little prior contextual information. A corresponding drawback however lies in the need for many learning episodes which severely restricts the applicability of such approach in real-world time- and energy-constrained missions. Here, we propose a model-aided deep Q-learning approach that, in contrast to previous work, considerably reduces the need for extensive training data samples, while still achieving the overarching goal of DRL, i.e to guide a battery-limited UAV on an efficient data harvesting trajectory, without prior knowledge of wireless channel characteristics and limited knowledge of wireless node locations. The key idea consists in using a small subset of nodes as anchors (i.e. with known location) and learning a model of the propagation environment while implicitly estimating the positions of regular nodes. Interaction with the model allows us to train a deep Q-network (DQN) to approximate the optimal UAV control policy. We show that in comparison with standard DRL approaches, the proposed model-aided approach requires at least one order of magnitude less training data samples to reach identical data collection performance, hence offering a first step towards making DRL a viable solution to the problem.


title: Uplink Performance Analysis of Cell-Free mMIMO Systems under Channel Aging

abstract: In this paper, we investigate the impact of channel aging on the uplink performance of a cell-free~(CF) massive multiple-input multiple-output (mMIMO) system with a minimum mean squared error (MMSE) receiver. To this end, we present a new model for the temporal evolution of the channel, which allows the channel to age at different rates at different access points (APs). Under this setting, we derive the deterministic equivalent of the per-user achievable signal-to-interference-plus-noise ratio (SINR). In addition to validating the theoretical expressions, our simulation results reveal that, {at low user mobilities,} the SINR of CF-mMIMO is nearly 5 dB higher than its cellular counterpart with the same number of antennas, and about 8 dB higher than that of an equivalent small-cell network with the same number of APs. {On the other hand, at very high user velocities, and when the channel between the UEs the different APs age at same rate, the relative impact of aging is higher for CF-mMIMO compared to cellular mMIMO. However, when the channel ages at the different APs with different rates, the effect of aging on CF-mMIMO is marginally mitigated, especially for larger frame durations.


title: BMS Field Theories and Weyl Anomaly

abstract: Two dimensional field theories with Bondi-Metzner-Sachs symmetry have been proposed as duals to asymptotically flat spacetimes in three dimensions. These field theories are naturally defined on null surfaces and hence are conformal cousins of Carrollian theories, where the speed of light goes to zero. In this paper, we initiate an investigation of anomalies in these field theories. Specifically, we focus on the BMS equivalent of Weyl invariance and its breakdown in these field theories and derive an expression for Weyl anomaly. Considering the transformation of partition functions under this symmetry, we derive a Carrollian Liouville action different from ones obtained in the literature earlier.


title: Discrete-continuous Action Space Policy Gradient-based Attention for Image-Text Matching

abstract: Image-text matching is an important multi-modal task with massive applications. It tries to match the image and the text with similar semantic information. Existing approaches do not explicitly transform the different modalities into a common space. Meanwhile, the attention mechanism which is widely used in image-text matching models does not have supervision. We propose a novel attention scheme which projects the image and text embedding into a common space and optimises the attention weights directly towards the evaluation metrics. The proposed attention scheme can be considered as a kind of supervised attention and requiring no additional annotations. It is trained via a novel Discrete-continuous action space policy gradient algorithm, which is more effective in modelling complex action space than previous continuous action space policy gradient. We evaluate the proposed methods on two widely-used benchmark datasets: Flickr30k and MS-COCO, outperforming the previous approaches by a large margin.


title: Analysis of Distributed Average Consensus Algorithms for Robust IoT networks

abstract: Internet of Things(IoT) is a heterogeneous network consists of various physical objects such as large number of sensors, actuators, RFID tags, smart devices, and servers connected to the internet. IoT networks have potential applications in healthcare, transportation, smart home, and automotive industries. To realize the IoT applications, all these devices need to be dynamically cooperated and utilize their resources effectively in a distributed fashion. Consensus algorithms have attracted much research attention in recent years due to their simple execution, robustness to topology changes, and distributed philosophy. These algorithms are extensively utilized for synchronization, resource allocation, and security in IoT networks. Performance of the distributed consensus algorithms can be effectively quantified by the Convergence Time, Network Coherence, Maximum Communication Time-Delay. In this work, we model the IoT network as a q-triangular r-regular ring network as q-triangular topologies exhibit both small-world and scale-free features. Scale-free and small-world topologies widely applied for modelling IoT as these topologies are effectively resilient to random attacks. In this paper, we derive explicit expressions for all eigenvalues of Laplacian matrix for q-triangular r-regular networks. We then apply the obtained eigenvalues to determine the convergence time, network coherence, and maximum communication timedelay. Our analytical results indicate that the effects of noise and communication delay on the consensus process are negligible for q-triangular r-regular networks. We argue that q-triangulation operation is responsible for the strong robustness with respect to noise and communication time-delay in the proposed network topologies.


title: On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs

abstract: Recent studies emphasize the need of document context in human evaluation of machine translations, but little research has been done on the impact of user interfaces on annotator productivity and the reliability of assessments. In this work, we compare human assessment data from the last two WMT evaluation campaigns collected via two different methods for document-level evaluation. Our analysis shows that a document-centric approach to evaluation where the annotator is presented with the entire document context on a screen leads to higher quality segment and document level assessments. It improves the correlation between segment and document scores and increases inter-annotator agreement for document scores but is considerably more time consuming for annotators.


title: Fermiology of two-dimensional titanium carbide and nitride MXenes

abstract: MXenes are a family two-dimensional transition metal carbide and nitride materials, which often exhibit very good metallic conductivity and are thus of great interest for applications in, e.g., flexible electronics, electrocatalysis, and electromagnetic interference shielding. However, surprisingly little is known about the fermiology of MXenes, i.e, the shape and size of their Fermi-surfaces, and its effect on the material properties. One reason for this may be that MXene surfaces are almost always covered by a mixture of functional groups, and studying Fermi-surfaces of disordered systems is cumbersome. Here, we study fermiology of four common Ti-based MXenes as a function of the surface functional group composition. We first calculate the effective band structures of systems with explicit mixed surfaces and observe gradual evolution in the filling of the Ti-d band and resulting shift of Fermi-level. We then demonstrate that these band structures can be closely approximated by using pseudohydrogenated surfaces, and also compare favorably to the experimental angle-resolved photoemission spectroscopy results. By modifying the pseudohydrogen charge we then proceed to plot Fermi-surfaces for all systems and extract their properties, such as the Fermi-surface area and average Fermi-velocity. These are in turn used to evaluate the electrical conductivity with the relaxation time fitted to experimentally measured conductivities.


title: Principal Component Density Estimation for Scenario Generation Using Normalizing Flows

abstract: Neural networks-based learning of the distribution of non-dispatchable renewable electricity generation from sources such as photovoltaics (PV) and wind as well as load demands has recently gained attention. Normalizing flow density models are particularly well suited for this task due to the training through direct log-likelihood maximization. However, research from the field of image generation has shown that standard normalizing flows can only learn smeared-out versions of manifold distributions. Previous works on normalizing flow-based scenario generation do not address this issue, and the smeared-out distributions result in the sampling of noisy time series. In this paper, we exploit the isometry of the principal component analysis (PCA), which sets up the normalizing flow in a lower-dimensional space while maintaining the direct and computationally efficient likelihood maximization. We train the resulting principal component flow (PCF) on data of PV and wind power generation as well as load demand in Germany in the years 2013 to 2015. The results of this investigation show that the PCF preserves critical features of the original distributions, such as the probability density and frequency behavior of the time series. The application of the PCF is, however, not limited to renewable power generation but rather extends to any data set, time series, or otherwise, which can be efficiently reduced using PCA.


title: Open and anisotropic soft regions in a model polymer glass

abstract: The vibrational dynamics of a model polymer glass is studied by Molecular Dynamics simulations. The focus is on the "soft" monomers with high participation to the lower-frequency vibrational modes contributing to the thermodynamic anomalies of glasses. To better evidence their role, the threshold to qualify monomers as soft is made severe, allowing for the use of systems with limited size. A marked tendency of soft monomers to form quasi-local clusters involving up to 15 monomers is evidenced. Each chain contributes to a cluster up to about three monomers and a single cluster involves monomer belonging to about 2-3 chains. Clusters with monomers belonging to a single chain are rare. The open and tenuous character of the clusters is revealed by their fractal dimension $d_f < 2$. The inertia tensor of the soft clusters evidences their strong anisotropy in shape and remarkable linear correlation of the two largest eigenvalues. Owing to the limited size of the system, finite-size effects, as well as dependence of the results on the adopted polymer length, cannot be ruled out.


title: Comprehensive Multi-Modal Interactions for Referring Image Segmentation

abstract: We investigate Referring Image Segmentation (RIS), which outputs a segmentation map corresponding to the natural language description. Addressing RIS efficiently requires considering the interactions happening across visual and linguistic modalities and the interactions within each modality. Existing methods are limited because they either compute different forms of interactions sequentially (leading to error propagation) or ignore intramodal interactions. We address this limitation by performing all three interactions simultaneously through a Synchronous Multi-Modal Fusion Module (SFM). Moreover, to produce refined segmentation masks, we propose a novel Hierarchical Cross-Modal Aggregation Module (HCAM), where linguistic features facilitate the exchange of contextual information across the visual hierarchy. We present thorough ablation studies and validate our approach's performance on four benchmark datasets, showing considerable performance gains over the existing state-of-the-art (SOTA) methods.


title: The axion-baryon coupling in SU(3) heavy baryon chiral perturbation theory

abstract: In the past, the axion-nucleon coupling has been calculated in the framework of SU(2) heavy baryon chiral perturbation theory up to third order in the chiral power counting. Here, we extend these earlier studies to the case of heavy baryon chiral perturbation theory with SU(3) flavor symmetry and derive the axion coupling to the full SU(3) baryon octet, showing that the axion also significantly couples to hyperons. As studies on dense nuclear matter suggest the possible existence of hyperons in stellar objects such as neutron stars, our results should have phenomenological implications related to the so-called axion window.


title: Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimation

abstract: Although deep convolution neural networks (DCNN) have achieved excellent performance in human pose estimation, these networks often have a large number of parameters and computations, leading to the slow inference speed. For this issue, an effective solution is knowledge distillation, which transfers knowledge from a large pre-trained network (teacher) to a small network (student). However, there are some defects in the existing approaches: (I) Only a single teacher is adopted, neglecting the potential that a student can learn from multiple teachers. (II) The human segmentation mask can be regarded as additional prior information to restrict the location of keypoints, which is never utilized. (III) A student with a small number of parameters cannot fully imitate heatmaps provided by datasets and teachers. (IV) There exists noise in heatmaps generated by teachers, which causes model degradation. To overcome these defects, we propose an orderly dual-teacher knowledge distillation (ODKD) framework, which consists of two teachers with different capabilities. Specifically, the weaker one (primary teacher, PT) is used to teach keypoints information, the stronger one (senior teacher, ST) is utilized to transfer segmentation and keypoints information by adding the human segmentation mask. Taking dual-teacher together, an orderly learning strategy is proposed to promote knowledge absorbability. Moreover, we employ a binarization operation which further improves the learning ability of the student and reduces noise in heatmaps. Experimental results on COCO and OCHuman keypoints datasets show that our proposed ODKD can improve the performance of different lightweight models by a large margin, and HRNet-W16 equipped with ODKD achieves state-of-the-art performance for lightweight human pose estimation.


title: Tackling Variabilities in Autonomous Driving

abstract: The state-of-the-art driving automation system demands extreme computational resources to meet rigorous accuracy and latency requirements. Though emerging driving automation computing platforms are based on ASIC to provide better performance and power guarantee, building such an accelerator-based computing platform for driving automation still present challenges. First, the workloads mix and performance requirements exposed to driving automation system present significant variability. Second, with more cameras/sensors integrated in a future fully autonomous driving vehicle, a heterogeneous multi-accelerator architecture substrate is needed that requires a design space exploration for a new form of parallelism. In this work, we aim to extensively explore the above system design challenges and these challenges motivate us to propose a comprehensive framework that synergistically handles the heterogeneous hardware accelerator design principles, system design criteria, and task scheduling mechanism. Specifically, we propose a novel heterogeneous multi-core AI accelerator (HMAI) to provide the hardware substrate for the driving automation tasks with variability. We also define system design criteria to better utilize hardware resources and achieve increased throughput while satisfying the performance and energy restrictions. Finally, we propose a deep reinforcement learning (RL)-based task scheduling mechanism FlexAI, to resolve task mapping issue. Experimental results show that with FlexAI scheduling, basically 100% tasks in each driving route can be processed by HMAI within their required period to ensure safety, and FlexAI can also maximally reduce the breaking distance up to 96% as compared to typical heuristics and guided random-search-based algorithms.


title: Extended superconformal higher-spin gauge theories in four dimensions

abstract: Using the off-shell formulation for ${\cal N}=2$ conformal supergravity in four dimensions, we describe superconformal higher-spin multiplets of conserved currents in a curved background and present their associated unconstrained gauge prepotentials. The latter are used to construct locally superconformal chiral actions, which are demonstrated to be gauge invariant in arbitrary conformally flat backgrounds. The main ${\cal N}=2$ results are then generalised to the ${\cal N}$-extended case. We also present the gauge-invariant field strengths for on-shell massless higher-spin ${\cal N}=2$ supermultiplets in anti-de Sitter space. These field strengths prove to furnish representations of the ${\cal N}=2$ superconformal group.


title: Subdifferential decomposition of 1D-regularized total variation with nonhomogeneous coefficients

abstract: In this paper, we consider a convex function defined as a 1D-regularized total variation with nonhomogeneous coefficients, and prove the Main Theorem concerned with the decomposition of the subdifferential of this convex function to a weighted singular diffusion and a linear regular diffusion. The Main Theorem will be to enhance the previous regularity result for quasilinear equation with singularity, and moreover, it will be to provide some useful information in the advanced mathematical studies of grain boundary motion, based on KWC type energy.


title: FD-JCAS Techniques for mmWave HetNets: Ginibre Point Process Modeling and Analysis

abstract: In this paper, we study the co-design of full-duplex (FD) radio with joint communication and radar sensing (JCAS) techniques in millimeter-wave (mmWave) heterogeneous networks (HetNets). Spectral co-existence of radar and communication systems causes mutual interference between the two systems, compromising both the data exchange and sensing capabilities. Focusing on the detection performance, we propose a cooperative detection technique, which exploits the sensing information from multiple base stations (BSs), aiming at enhancing the probability of successfully detecting an object. Three combining rules are considered, namely the \textit{OR}, the \textit{Majority} and the \textit{AND} rule. In real-world network scenarios, the locations of the BSs are spatially correlated, exhibiting a repulsive behavior. Therefore, we model the spatial distribution of the BSs as a $\beta$-Ginibre point process ($\beta$-GPP), which can characterize the repulsion among the BSs. By using stochastic geometry tools, analytical expressions for the detection performance of $\beta$-GPP-based FD-JCAS systems are expressed for each of the considered combining rule. Furthermore, by considering temporal interference correlation, we evaluate the probability of successfully detecting an object over two different time slots. Our results demonstrate that our proposed technique can significantly improve the detection performance when compared to the conventional non-cooperative technique.


title: PP-YOLOv2: A Practical Object Detector

abstract: Being effective and efficient is essential to an object detector for practical use. To meet these two concerns, we comprehensively evaluate a collection of existing refinements to improve the performance of PP-YOLO while almost keep the infer time unchanged. This paper will analyze a collection of refinements and empirically evaluate their impact on the final model performance through incremental ablation study. Things we tried that didn't work will also be discussed. By combining multiple effective refinements, we boost PP-YOLO's performance from 45.9% mAP to 49.5% mAP on COCO2017 test-dev. Since a significant margin of performance has been made, we present PP-YOLOv2. In terms of speed, PP-YOLOv2 runs in 68.9FPS at 640x640 input size. Paddle inference engine with TensorRT, FP16-precision, and batch size = 1 further improves PP-YOLOv2's infer speed, which achieves 106.5 FPS. Such a performance surpasses existing object detectors with roughly the same amount of parameters (i.e., YOLOv4-CSP, YOLOv5l). Besides, PP-YOLOv2 with ResNet101 achieves 50.3% mAP on COCO2017 test-dev. Source code is at https://github.com/PaddlePaddle/PaddleDetection.


title: Machine vision detection to daily facial fatigue with a nonlocal 3D attention network

abstract: Fatigue detection is valued for people to keep mental health and prevent safety accidents. However, detecting facial fatigue, especially mild fatigue in the real world via machine vision is still a challenging issue due to lack of non-lab dataset and well-defined algorithms. In order to improve the detection capability on facial fatigue that can be used widely in daily life, this paper provided an audiovisual dataset named DLFD (daily-life fatigue dataset) which reflected people's facial fatigue state in the wild. A framework using 3D-ResNet along with non-local attention mechanism was training for extraction of local and long-range features in spatial and temporal dimensions. Then, a compacted loss function combining mean squared error and cross-entropy was designed to predict both continuous and categorical fatigue degrees. Our proposed framework has reached an average accuracy of 90.8% on validation set and 72.5% on test set for binary classification, standing a good position compared to other state-of-the-art methods. The analysis of feature map visualization revealed that our framework captured facial dynamics and attempted to build a connection with fatigue state. Our experimental results in multiple metrics proved that our framework captured some typical, micro and dynamic facial features along spatiotemporal dimensions, contributing to the mild fatigue detection in the wild.


title: Monotone convex order for the McKean-Vlasov processes

abstract: In this paper, we establish the monotone convex order between two $\mathbb{R}$-valued McKean-Vlasov processes $X=(X_t)_{t\in [0, T]}$ and $Y=(Y_t)_{t\in [0, T]}$ defined on a filtered probability space $(\Omega, \mathcal{F}, (\mathcal{F}_{t})_{t\geq0}, \mathbb{P})$ by \begin{align} &dX_{t}=b(t, X_{t}, \mu_{t})dt+\sigma(t, X_{t}, \mu_{t})dB_{t}, \quad X_{0}\in L^{p}(\mathbb{P})\; \text{with}\; p\geq 2,\nonumber\\ &dY_{t}=\beta(t, Y_{t}, \nu_{t})dt+\theta(t, \,Y_{t}, \nu_{t})\,dB_{t}, \,\quad Y_{0}\in L^{p}(\mathbb{P}), \nonumber \end{align} where $\forall\, t\in [0, T],\: \mu_{t}=\mathbb{P}\circ X_{t}^{-1}, \:\nu_{t}=\mathbb{P}\circ Y_{t}^{-1}. $ If we make the convexity and monotony assumption (only) on $b$ and $|\sigma|$ and if $b\leq \beta$ and $|\sigma|\leq |\theta|$, then the monotone convex order for the initial random variable $X_0\preceq_{\,\text{mcv}} Y_0$ can be propagated to the whole path of processes $X$ and $Y$. That is, if we consider a non-decreasing convex functional $F$ defined on the path space with polynomial growth, we have $\mathbb{E}\, F(X)\leq \mathbb{E}\, F(Y)$; for a non-decreasing convex functional $G$ defined on the product space involving the path space and its marginal distribution space, we have $\mathbb{E}\, G(X, (\mu_{t})_{t\in [0, T]})\leq \mathbb{E}\, G(Y, (\nu_{t})_{t\in [0, T]})$ under appropriate conditions. The symmetric setting is also valid, that is, if $Y_0\preceq_{\,\text{mcv}} X_0$ and $|\theta|\leq |\sigma|$, then $\mathbb{E}\, F(Y)\leq \mathbb{E}\, F(X)$ and $\mathbb{E}\, G(Y, (\nu_{t})_{t\in [0, T]})\leq \mathbb{E}\, G(X, (\mu_{t})_{t\in [0, T]})$. The proof is based on several forward and backward dynamic programming principle and the convergence of the truncated Euler scheme of the McKean-Vlasov equation.


title: Investigations on mixed harmonic cumulants in heavy-ion collisions at the LHC

abstract: A series of new flow observables mixed harmonic multi-particle cumulants (MHC), which allow for the first time to quantify the correlations strength between different order of flow coefficients with various moments, was investigated using hydrodynamic model. These new observables are constructed based on multi-particle cumulants, and thus by design will be less sensitive to the non-flow contaminations. In addition to the previous study of correlation involving two flow coefficients with their second moments, both correlations of three flow coefficients and the correlations of higher order moments of $v_2$ and $v_3$ are systematically investigated using iEBE-VISHNU hybrid model with two different initial conditions, AMPT and TRENTo, respectively. These systematic studies using hydrodynamic models will significantly improve the understanding on the correlations between different orders (and moments) of flow coefficients. The hydrodynamic predictions shown in this paper and the future comparisons to experimental measurements will provide more constraints on theoretical models and extract more information about the transport properties of the quark-gluon plasma created in heavy-ion collisions.


title: Exponential cosmological solutions in Einstein-Gauss-Bonnet gravity with two subspaces: general approach

abstract: In this paper we perform systematic investigation of all possible exponential solutions in Einstein-Gauss-Bonnet gravity with the spatial section being a product of two subspaces. We describe a scheme which always allow to find solution for a given $\{p, q\} > 2$ (number of dimensions of two subspaces) and $\zeta$ (ratio of the expansion rates of these two subspaces). Depending on the parameters, for given $\{\alpha, \Lambda\}$ (Gauss-Bonnet coupling and cosmological constant) there could be up to four distinct solutions (with different $\zeta$'s). Stability requirement introduces relation between $\zeta$, $\{p, q\}$ and sign of the expansion rate. Nevertheless, for any $\{p, q\} > 2$ we can always choose sign for expansion rates so that the resulting solution would be stable. The scheme for finding solutions is described and the bounds on the parameters are drawn. Specific cases with $\{p, q\} = \{1, 2\}$ are also considered. Finally, we separately described physically sensible case with one of the subspaces being three-dimensional and expanding (resembling our Universe) while another to be contracting (resembling extra dimensions), describing successful compactification; for this case we also drawn bounds on the parameters where such regime occurs.


title: Link Prediction on N-ary Relational Data Based on Relatedness Evaluation

abstract: With the overwhelming popularity of Knowledge Graphs (KGs), researchers have poured attention to link prediction to fill in missing facts for a long time. However, they mainly focus on link prediction on binary relational data, where facts are usually represented as triples in the form of (head entity, relation, tail entity). In practice, n-ary relational facts are also ubiquitous. When encountering such facts, existing studies usually decompose them into triples by introducing a multitude of auxiliary virtual entities and additional triples. These conversions result in the complexity of carrying out link prediction on n-ary relational data. It has even proven that they may cause loss of structure information. To overcome these problems, in this paper, we represent each n-ary relational fact as a set of its role and role-value pairs. We then propose a method called NaLP to conduct link prediction on n-ary relational data, which explicitly models the relatedness of all the role and role-value pairs in an n-ary relational fact. We further extend NaLP by introducing type constraints of roles and role-values without any external type-specific supervision, and proposing a more reasonable negative sampling mechanism. Experimental results validate the effectiveness and merits of the proposed methods.


title: Sparse-shot Learning with Exclusive Cross-Entropy for Extremely Many Localisations

abstract: Object localisation, in the context of regular images, often depicts objects like people or cars. In these images, there is typically a relatively small number of objects per class, which usually is manageable to annotate. However, outside the setting of regular images, we are often confronted with a different situation. In computational pathology, digitised tissue sections are extremely large images, whose dimensions quickly exceed 250'000x250'000 pixels, where relevant objects, such as tumour cells or lymphocytes can quickly number in the millions. Annotating them all is practically impossible and annotating sparsely a few, out of many more, is the only possibility. Unfortunately, learning from sparse annotations, or sparse-shot learning, clashes with standard supervised learning because what is not annotated is treated as a negative. However, assigning negative labels to what are true positives leads to confusion in the gradients and biased learning. To this end, we present exclusive cross-entropy, which slows down the biased learning by examining the second-order loss derivatives in order to drop the loss terms corresponding to likely biased terms. Experiments on nine datasets and two different localisation tasks, detection with YOLLO and segmentation with Unet, show that we obtain considerable improvements compared to cross-entropy or focal loss, while often reaching the best possible performance for the model with only 10-40% of annotations.


title: Stability and Optimization of Speculative Queueing Networks

abstract: We provide a queueing-theoretic framework for job replication schemes based on the principle "\emph{replicate a job as soon as the system detects it as a \emph{straggler}}". This is called job \emph{speculation}. Recent works have analyzed {replication} on arrival, which we refer to as \emph{replication}. Replication is motivated by its implementation in Google's BigTable. However, systems such as Apache Spark and Hadoop MapReduce implement speculative job execution. The performance and optimization of speculative job execution is not well understood. To this end, we propose a queueing network model for load balancing where each server can speculate on the execution time of a job. Specifically, each job is initially assigned to a single server by a frontend dispatcher. Then, when its execution begins, the server sets a timeout. If the job completes before the timeout, it leaves the network, otherwise the job is terminated and relaunched or resumed at another server where it will complete. We provide a necessary and sufficient condition for the stability of speculative queueing networks with heterogeneous servers, general job sizes and scheduling disciplines. We find that speculation can increase the stability region of the network when compared with standard load balancing models and replication schemes. We provide general conditions under which timeouts increase the size of the stability region and derive a formula for the optimal speculation time, i.e., the timeout that minimizes the load induced through speculation. We compare speculation with redundant-$d$ and redundant-to-idle-queue-$d$ rules under an $S\& X$ model. For light loaded systems, redundancy schemes provide better response times. However, for moderate to heavy loadings, redundancy schemes can lose capacity and have markedly worse response times when compared with a speculative scheme.


title: Dynamics of lineages in adaptation to a gradual environmental change

abstract: We investigate a simple quantitative genetics model subjet to a gradual environmental change from the viewpoint of the phylogenies of the living individuals. We aim to understand better how the past traits of their ancestors are shaped by the adaptation to the varying environment. The individuals are characterized by a one-dimensional trait. The dynamics -- births and deaths -- depend on a time-changing mortality rate that shifts the optimal trait to the right at constant speed. The population size is regulated by a nonlinear non-local logistic competition term. The macroscopic behaviour can be described by a PDE that admits a unique positive stationary solution. In the stationary regime, the population can persist, but with a lag in the trait distribution due to the environmental change. For the microscopic (individual-based) stochastic process, the evolution of the lineages can be traced back using the historical process, that is, a measure-valued process on the set of continuous real functions of time. Assuming stationarity of the trait distribution, we describe the limiting distribution, in large populations, of the path of an individual drawn at random at a given time $T$. Freezing the non-linearity due to competition allows the use of a many-to-one identity together with Feynman-Kac's formula. This path, in reversed time, remains close to a simple Ornstein-Uhlenbeck process. It shows how the lagged bulk of the present population stems from ancestors once optimal in trait but still in the tail of the trait distribution in which they lived.


title: Reflections on the photodissociation of CO in circumstellar envelopes

abstract: Carbon monoxide (CO) is the most abundant molecule after molecular hydrogen and is important for the chemistry in circumstellar envelopes around evolved stars. When modelling the strength and shape of molecular lines, the size of the CO envelope is an input parameter and influences the derived mass-loss rates. In particular the low-J transition CO lines are sensitive to the CO photodissociation radius. Recently, new CO photodissociation radii have been published using different formalisms that differ considerably. One set of calculations is based on an escape-probability formalisms that uses numerical approximations derived in the early-eighties. The accuracy of these approximations is investigated and it is shown that they are less accurate than claimed. Improved formalism are derived. Nevertheless, the changes in CO envelope size are small to moderate, less than 2\% for models with $10^{-7}< \dot{M}< 10^{-4}$ \msolyr\ and at most 7\% for model with $\dot{M} = 10^{-8}$ \msolyr.


title: Portfolio Search and Optimization for General Strategy Game-Playing

abstract: Portfolio methods represent a simple but efficient type of action abstraction which has shown to improve the performance of search-based agents in a range of strategy games. We first review existing portfolio techniques and propose a new algorithm for optimization and action-selection based on the Rolling Horizon Evolutionary Algorithm. Moreover, a series of variants are developed to solve problems in different aspects. We further analyze the performance of discussed agents in a general strategy game-playing task. For this purpose, we run experiments on three different game-modes of the Stratega framework. For the optimization of the agents' parameters and portfolio sets we study the use of the N-tuple Bandit Evolutionary Algorithm. The resulting portfolio sets suggest a high diversity in play-styles while being able to consistently beat the sample agents. An analysis of the agents' performance shows that the proposed algorithm generalizes well to all game-modes and is able to outperform other portfolio methods.


title: Convergence for sums of i. i. d. random variables under sublinear expectations

abstract: In this paper, we prove the equivalent conditions of complete moment convergence of the maximum for partial weighted sums of independent, identically distributed random variables under sublinear expectations space. As applications, the Baum-Katz type results for the maximum for partial weighted sums of independent, identically distributed random variables are established under sublinear expectations space. The results obtained in the article are the extensions of the equivalent conditions of complete moment convergence of the maximum under classical linear expectation space.


title: Room adaptive conditioning method for sound event classification in reverberant environments

abstract: Ensuring performance robustness for a variety of situations that can occur in real-world environments is one of the challenging tasks in sound event classification. One of the unpredictable and detrimental factors in performance, especially in indoor environments, is reverberation. To alleviate this problem, we propose a conditioning method that provides room impulse response (RIR) information to help the network become less sensitive to environmental information and focus on classifying the desired sound. Experimental results show that the proposed method successfully reduced performance degradation caused by the reverberation of the room. In particular, our proposed method works even with similar RIR that can be inferred from the room type rather than the exact one, which has the advantage of potentially being used in real-world applications.


title: Two-step deswelling in the Volume Phase Transition of thermoresponsive microgels

abstract: Thermoresponsive microgels are one of the most investigated class of soft colloids, thanks to their ability to undergo a Volume Phase Transition (VPT) close to ambient temperature. However, this fundamental phenomenon still lacks a detailed microscopic understanding, particularly regarding the presence and the role of charges in the deswelling process. Here we fill this gap by combining experiments and simulations to show that the microgel collapse does not happen in a homogeneous fashion, but through a two-step mechanism, entirely attributable to electrostatic effects. The signature of this phenomenon is the emergence of a minimum in the ratio between gyration and hydrodynamic radii at the VPT. Thanks to simulations of several microgels with different cross-linker concentrations, charge contents and charge distributions, we build a unifying master-curve able to predict the two-step deswelling. Our results have direct relevance on fundamental soft condensed matter science and on microgel applications ranging from materials to biomedical technologies.


title: Quantum state evolution in an environment of cosmological perturbations

abstract: We study the pure and thermal states of quantized scalar and tensor perturbations in various epochs of Universe evolution. We calculate the density matrix of non-relativistic particles in an environment of these perturbations. We show that particle's motion can be described by a stochastic equation with a noise coming from the cosmological environment. We investigate the squeezing of Gaussian wave packets in different epochs and its impact upon the noise of quantized cosmological perturbations.


title: Entanglement instability in the interaction of two qubits with a common non-Markovian environment

abstract: In this work we study the steady state entanglement between two qubits interacting asymetrically with a common non-Markovian environment. Depending on the initial two-qubit state, the asymmetry in the couplings between each qubit and the non-Markovian environment may lead to enhanced entanglement in the steady state of the system, measured in terms of the two-qubit concurrence. Our results indicate that, if a qubit-qubit interaction is also present, the two-qubit steady state concurrence is always favored by the symmetric or anti-symmetric coupling configuration. Although finite, the steady concurrence is predicted to be highly unstable in this regime as long as the interaction between the two qubits is larger than the couplings between each qubit and the non-Markovian reservoir.


title: MATLAB Simulations of the Helium Liquefier in the FREIA Laboratory

abstract: We describe simulations that track a state vector with pressure, temperature, and gas flow through the helium liquefier in the FREIA laboratory. Most components, including threeway heat exchangers, are represented by matrices that allow us to track the state through the system. The only non-linear element is the Joule-Thomson valve, which is represented by a non-linear map for the state variables. Realistic properties for the enthalpy and other thermodynamic quantities are taken into account with the help of the CoolProp library. The resulting system of equations is rapidly solved by iteration and shows good agreement with the observed LHe yield with and without liquid nitrogen pre-cooling.


title: Modeling sign concordance of quantile regression residuals with multiple outcomes

abstract: Quantile regression permits describing how quantiles of a scalar response variable depend on a set of predictors. Because a unique definition of multivariate quantiles is lacking, extending quantile regression to multivariate responses is somewhat complicated. In this paper, we describe a simple approach based on a two-step procedure: in the first step, quantile regression is applied to each response separately; in the second step, the joint distribution of the signs of the residuals is modeled through multinomial regression. The described approach does not require a multidimensional definition of quantiles, and can be used to capture important features of a multivariate response and assess the effects of covariates on the correlation structure. We apply the proposed method to analyze two different datasets.


title: Weak solutions for nonlinear waves in adhesive phenomena

abstract: We discuss a notion of weak solution for a semilinear wave equation that models the interaction of an elastic body with a rigid substrate through an adhesive layer, relying on results in [2]. Our analysis embraces the vector-valued case in arbitrary dimension as well as the case of non-local operators (e.g. fractional Laplacian).


title: Unification of computer reality

abstract: The work attempts to unify the conceptual model of the user's virtual computer environment, with the aim of combining the local environments of operating systems and the global Internet environment into a single virtual environment built on general principles. To solve this problem, it is proposed to unify the conceptual basis of these environments. The existing conceptual basis of operating systems, built on the "desktop" metaphor, contains redundant concepts associated with computer architecture. The use of the spatial conceptual basis "object - place" with the concepts of "domain", "site", and "data object" allows to completely virtualize the user environment, separating it from the hardware concepts. The virtual concept "domain" is becoming a universal way of structuring the user's space. The introduction of this concept to describe the environments of operating systems provides at the mental level the integration of the structures of the local and global space. The use of the concept of "personal domain" will allow replacing the concept of "personal computer" in the mind of the user. The virtual concept of "site" as an environment for activities and data storage will allow abandoning such concepts as "application" (program), or "memory device". The site in the mind of the user is a virtual environment that includes both places for storing data objects and places for working with them. The introduction of the concept "site" into the structure of operating systems environments and the concept of "data site" into the structure of the global network integrates the structure of the global and local space in the user's mind. The introduction of the concept of "portal" as a means of integrating information necessary for interaction, allows ensuring the methodological homogeneity of the user's work in a single virtual environment.


title: The Milky Way's nuclear stellar disc: A dynamically cool and metal-rich component formed from the Central Molecular Zone?

abstract: The nuclear stellar disc (NSD) is, together with the nuclear star cluster (NSC) and the central massive black hole, one of the main components in the central parts of our Milky Way. However, until recently, only few studies of the stellar content of the NSD have been obtained due to extreme extinction and stellar crowding. With a dedicated KMOS (VLT, ESO) spectroscopic survey, we study the kinematics and global metallicities of the NSD based on the observations of K/M giant stars. We trace radial velocities and metallicities which were derived based on spectral indices (Na I and CO) along the NSD and compare those with a Galactic Bulge sample of APOGEE (DR16) and data from the NSC. We find that the metallicity distribution function and the fraction of metal-rich and metal-poor stars in the NSD are different from the corresponding distributions and ratios of the NSC and the Galactic Bulge. By tracing the velocity dispersion as a function of metallicity, we clearly see that the NSD is kinematically cool and that the velocity dispersion decreases with increasing metallicity contrary to the inner Bulge sample of APOGEE ($\rm |b| < 4^{o}$). Using molecular gas tracers ($\rm H_{2}CO$, CO(4-3)) of the Central Molecular Zone (CMZ) we find an astonishing agreement between the gas rotation and the rotation of the metal-rich population indicating that the metal-rich stars could have formed from gas in the CMZ. On the other hand, the metal-poor stars show a much slower rotation profile with signs of counter-rotation indicating a different origin of these stars. Coupling kinematics with global metallicities, our results demonstrate that the NSD is chemically and kinematically distinct with respect to the inner Bulge indicating a different formation scenario.


title: Impact of COVID-19 on travel behaviour, transport, lifestyles and location choices in Scotland

abstract: In March 2020, the UK and Scottish Governments imposed a lockdown restricting everyday life activities to only the most essential. These Governmental measures together with individual choices to refrain from travelling during the COVID-19 pandemic have had a profound effect on transport related activity. In the current investigation an online questionnaire was distributed to 994 Scottish residents in order to identify travel habits, attitudes and preferences during the different phases of the COVID-19 pandemic outbreak and anticipated travel habits after the pandemic. Quota constraints were enforced for age, gender and household income to ensure the sample was representative of the Scottish population as a whole. Perceptions of risk, trust in information sources and compliance with COVID-19 regulations were determined together with changes in levels of life satisfaction and modal choice following the onset of COVID-19. In addition, survey responses were used to identify anticipated travel mode use in the future. Consideration was also given to the effects of COVID-19 on transport related lifestyle issues such as working from home, online shopping and the expectations of moving residences in the future. As part of the analysis, statistical models were developed to provide an insight into both the relationships between the levels of non compliance with COVID-19 regulations and demographic variables and the respondent attributes which might affect future public transport usage. In general, the study confirmed significant reductions in traffic activity, among respondents during the COVID-19 pandemic associated with walking, driving a car and either using a bus or train. The respondents also indicated that they anticipated they would continue to make less use of buses and trains at the end of the pandemic.


title: Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead?

abstract: Most work in NLP makes the assumption that it is desirable to develop solutions in the native language in question. There is consequently a strong trend towards building native language models even for low-resource languages. This paper questions this development, and explores the idea of simply translating the data into English, thereby enabling the use of pretrained, and large-scale, English language models. We demonstrate empirically that a large English language model coupled with modern machine translation outperforms native language models in most Scandinavian languages. The exception to this is Finnish, which we assume is due to inferior translation quality. Our results suggest that machine translation is a mature technology, which raises a serious counter-argument for training native language models for low-resource languages. This paper therefore strives to make a provocative but important point. As English language models are improving at an unprecedented pace, which in turn improves machine translation, it is from an empirical and environmental stand-point more effective to translate data from low-resource languages into English, than to build language models for such languages.


title: Fourier Contour Embedding for Arbitrary-Shaped Text Detection

abstract: One of the main challenges for arbitrary-shaped text detection is to design a good text instance representation that allows networks to learn diverse text geometry variances. Most of existing methods model text instances in image spatial domain via masks or contour point sequences in the Cartesian or the polar coordinate system. However, the mask representation might lead to expensive post-processing, while the point sequence one may have limited capability to model texts with highly-curved shapes. To tackle these problems, we model text instances in the Fourier domain and propose one novel Fourier Contour Embedding (FCE) method to represent arbitrary shaped text contours as compact signatures. We further construct FCENet with a backbone, feature pyramid networks (FPN) and a simple post-processing with the Inverse Fourier Transformation (IFT) and Non-Maximum Suppression (NMS). Different from previous methods, FCENet first predicts compact Fourier signatures of text instances, and then reconstructs text contours via IFT and NMS during test. Extensive experiments demonstrate that FCE is accurate and robust to fit contours of scene texts even with highly-curved shapes, and also validate the effectiveness and the good generalization of FCENet for arbitrary-shaped text detection. Furthermore, experimental results show that our FCENet is superior to the state-of-the-art (SOTA) methods on CTW1500 and Total-Text, especially on challenging highly-curved text subset.


title: Interpretability of machine-learning models in physical sciences

abstract: In machine learning (ML), it is in general challenging to provide a detailed explanation on how a trained model arrives at its prediction. Thus, usually we are left with a black-box, which from a scientific standpoint is not satisfactory. Even though numerous methods have been recently proposed to interpret ML models, somewhat surprisingly, interpretability in ML is far from being a consensual concept, with diverse and sometimes contrasting motivations for it. Reasonable candidate properties of interpretable models could be model transparency (i.e. how does the model work?) and post hoc explanations (i.e., what else can the model tell me?). Here, I review the current debate on ML interpretability and identify key challenges that are specific to ML applied to materials science.


title: Data envelopment analysis -- a flexible device to assessing SMEs performance

abstract: In a context of global economy, addressing SMEs performance within a local framework appears rather a naive approach. The key drawback of such an approach stems from its restriction to socio-economic factors that might lead to biased decisions regarding potential venues for performance improvement. In practice, the key objective of performance analysis consists in identifying benchmarks for best managerial practices with respect to resource allocation as well as production level setting. Conducting the analysis within a specific country, let it be a developing country, may be misleading. Although, the best of the class (benchmark) can be a valid reference for its peers within the same class, its status might not be preserved if the analysis is projected outside the borders of the class. Indeed, the likelihood for outperformance is high. In order to set targets for global competition, decision makers ought to look at the concept of performance from a broader geographical perspective, instead of confining it to a local scope. Here, we analyze, through a case study, SMEs performance within local and global production technology frameworks and we highlight the impact of the economy scope on various decisions. Data envelopment analysis (DEA) is used as a mathematical tool to support such decisions.


title: Establishing quasi-linear quadrupole functional topology by oxygen-vacancy engineering at a ferroelectric domain wall

abstract: Oxygen vacancies in two-dimensional metal-oxide structures garner much attention due to unique conductive, magnetic and even superconductive functionalities they induce. Ferroelectric domain walls have been a prominent recent example because they serve as a hub for topological defects that enable unusual symmetries and are relevant for low-energy switching technologies. However, owing to the light weight of oxygen atoms and localized effects of their vacancies, the atomic-scale electrical and mechanical influence of oxygen vacancies has remained elusive. Here, stable individual oxygen vacancies were found and engineered in situ at domain walls of seminal titanate perovskite ferroics. The atomic-scale strain, electric-field, charge and dipole-moment distribution around these vacancies were characterized by combining advanced transmission electron microscopy and first-principle methodologies. 3-5 % tensile strain was observed at the immediate surrounding unit cells of the vacancies. The dipole-moment distribution around the vacancy was found to be an alternating head-to-head $-$ tail-to-tail $-$ head-to-head structure, giving rise to a quasi-linear quadrupole topology. Reduction of the nearby Ti ion as well as enhanced charging and electric-field concentration near the vacancy confirmed the quadrupole structure and illustrated its local effects on the electrical and structural properties. Significant intra-band states were found in the unit cell of the vacancies, proposing a meaningful domain-wall conductivity. Oxygen-vacancy engineering and controllable quadrupoles that enable pre-determining both atomic-scale and global functional properties offer a promising platform of electro-mechanical topological solitons and device miniaturization in metal oxides.


title: Lacon-, Shrub- and Parity-Decompositions: Characterizing Transductions of Bounded Expansion Classes

abstract: The concept of bounded expansion provides a robust way to capture sparse graph classes with interesting algorithmic properties. Most notably, every problem definable in first-order logic can be solved in linear time on bounded expansion graph classes. First-order interpretations and transductions of sparse graph classes lead to more general, dense graph classes that seem to inherit many of the nice algorithmic properties of their sparse counterparts. In this paper, we show that one can encode graphs from a class with structurally bounded expansion via lacon-, shrub- and parity-decompositions from a class with bounded expansion. These decompositions are useful for lifting properties from sparse to structurally sparse graph classes.


title: A Meta-Learning Approach for Medical Image Registration

abstract: Non-rigid registration is a necessary but challenging task in medical imaging studies. Recently, unsupervised registration models have shown good performance, but they often require a large-scale training dataset and long training times. Therefore, in real world application where only dozens to hundreds of image pairs are available, existing models cannot be practically used. To address these limitations, we propose a novel unsupervised registration model which is integrated with a gradient-based meta learning framework. In particular, we train a meta learner which finds an initialization point of parameters by utilizing a variety of existing registration datasets. To quickly adapt to various tasks, the meta learner was updated to get close to the center of parameters which are fine-tuned for each registration task. Thereby, our model can adapt to unseen domain tasks via a short fine-tuning process and perform accurate registration. To verify the superiority of our model, we train the model for various 2D medical image registration tasks such as retinal choroid Optical Coherence Tomography Angiography (OCTA), CT organs, and brain MRI scans and test on registration of retinal OCTA Superficial Capillary Plexus (SCP). In our experiments, the proposed model obtained significantly improved performance in terms of accuracy and training time compared to other registration models.


title: Gamma Ray Burst studies with THESEUS

abstract: Gamma-ray Bursts (GRBs) are the most powerful transients in the Universe, over-shining for a few seconds all other $\gamma$-ray sky sources. Their emission is produced within narrowly collimated relativistic jets launched after the core-collapse of massive stars or the merger of compact binaries. THESEUS will open a new window for the use of GRBs as cosmological tools by securing a statistically significant sample of high-$z$ GRBs, as well as by providing a large number of GRBs at low-intermediate redshifts extending the current samples to low luminosities. The wide energy band and unprecedented sensitivity of the Soft X-ray Imager (SXI) and X-Gamma rays Imaging Spectrometer (XGIS) instruments provide us a new route to unveil the nature of the prompt emission. For the first time, a full characterisation of the prompt emission spectrum from 0.3 keV to 10 MeV with unprecedented large count statistics will be possible revealing the signatures of synchrotron emission. SXI spectra, extending down to 0.3 keV, will constrain the local metal absorption and, for the brightest events, the progenitors' ejecta composition. Investigation of the nature of the internal energy dissipation mechanisms will be obtained through the systematic study with XGIS of the sub-second variability unexplored so far over such a wide energy range. THESEUS will follow the spectral evolution of the prompt emission down to the soft X-ray band during the early steep decay and through the plateau phase with the unique ability of extending above 10 keV the spectral study of these early afterglow emission phases.


title: Multi-scalar signature of self-interacting dark matter in the NMSSM and beyond

abstract: This work studies the self-interacting dark matter (SIDM) scenario in the general NMSSM and beyond, where the dark matter is a Majorana fermion and the force mediator is a scalar boson. An improved analytical expression for the dark matter (DM) self-interacting cross section which takes into account the Born level effects is proposed. Due to the large couplings and light mediator in SIDM scenario, the DM/mediator will go through multiple branchings if they are produced with high energy. Based on the Monte Carlo simulation of the showers in the DM sector, we obtain the multiplicities and the spectra of the DM/mediator from the Higgsino production and decay at the LHC for our benchmark points.


title: Making Differentiable Architecture Search less local

abstract: Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency. However, it has been shown to suffer from performance collapse, where the search often leads to detrimental architectures. Many recent works try to address this issue of DARTS by identifying indicators for early stopping, regularising the search objective to reduce the dominance of some operations, or changing the parameterisation of the search problem. In this work, we hypothesise that performance collapses can arise from poor local optima around typical initial architectures and weights. We address this issue by developing a more global optimisation scheme that is able to better explore the space without changing the DARTS problem formulation. Our experiments show that our changes in the search algorithm allow the discovery of architectures with both better test performance and fewer parameters.


title: Generalized quantum measurements with matrix product states: Entanglement phase transition and clusterization

abstract: We propose a method, based on matrix product states, for studying the time evolution of many-body quantum lattice systems under continuous and site-resolved measurement. Both the frequency and the strength of generalized measurements can be varied within our scheme, thus allowing us to explore the corresponding two-dimensional phase diagram. The method is applied to one-dimensional chains of nearest-neighbor interacting hard-core bosons. A transition from an entangling to a disentangling (area-law) phase is found. However, by resolving time-dependent density correlations in the monitored system, we find important differences between different regions at the phase boundary. In particular, we observe a peculiar phenomenon of measurement-induced particle clusterization that takes place only for frequent moderately strong measurements, but not for strong infrequent measurements.


title: The nylon balloon for xenon loaded liquid scintillator in KamLAND-Zen 800 neutrinoless double-beta decay search experiment

abstract: The KamLAND-Zen 800 experiment is searching for the neutrinoless double-beta decay of $^{136}$Xe by using $^{136}$Xe-loaded liquid scintillator. The liquid scintillator is enclosed inside a balloon made of thin, transparent, low-radioactivity film that we call Inner Balloon (IB). The IB, apart from guaranteeing the liquid containment, also allows to minimize the background from cosmogenic muon-spallation products and $^{8}$B solar neutrinos. Indeed these events could contribute to the total counts in the region of interest around the Q-value of the double-beta decay of $^{136}$Xe. In this paper, we present an overview of the IB and describe the various steps of its commissioning minimizing the radioactive contaminations, from the material selection, to the fabrication of the balloon and its installation inside the KamLAND detector. Finally, we show the impact of the IB on the KamLAND background as measured by the KamLAND detector itself.


title: Brittle Features May Help Anomaly Detection

abstract: One-class anomaly detection is challenging. A representation that clearly distinguishes anomalies from normal data is ideal, but arriving at this representation is difficult since only normal data is available at training time. We examine the performance of representations, transferred from auxiliary tasks, for anomaly detection. Our results suggest that the choice of representation is more important than the anomaly detector used with these representations, although knowledge distillation can work better than using the representations directly. In addition, separability between anomalies and normal data is important but not the sole factor for a good representation, as anomaly detection performance is also correlated with more adversarially brittle features in the representation space. Finally, we show our configuration can detect 96.4% of anomalies in a genuine X-ray security dataset, outperforming previous results.


title: Text Summarization of Czech News Articles Using Named Entities

abstract: The foundation for the research of summarization in the Czech language was laid by the work of Straka et al. (2018). They published the SumeCzech, a large Czech news-based summarization dataset, and proposed several baseline approaches. However, it is clear from the achieved results that there is a large space for improvement. In our work, we focus on the impact of named entities on the summarization of Czech news articles. First, we annotate SumeCzech with named entities. We propose a new metric ROUGE_NE that measures the overlap of named entities between the true and generated summaries, and we show that it is still challenging for summarization systems to reach a high score in it. We propose an extractive summarization approach Named Entity Density that selects a sentence with the highest ratio between a number of entities and the length of the sentence as the summary of the article. The experiments show that the proposed approach reached results close to the solid baseline in the domain of news articles selecting the first sentence. Moreover, we demonstrate that the selected sentence reflects the style of reports concisely identifying to whom, when, where, and what happened. We propose that such a summary is beneficial in combination with the first sentence of an article in voice applications presenting news articles. We propose two abstractive summarization approaches based on Seq2Seq architecture. The first approach uses the tokens of the article. The second approach has access to the named entity annotations. The experiments show that both approaches exceed state-of-the-art results previously reported by Straka et al. (2018), with the latter achieving slightly better results on SumeCzech's out-of-domain testing set.


title: Reinforcement Learning for Traffic Signal Control: Comparison with Commercial Systems

abstract: Recently, Intelligent Transportation Systems are leveraging the power of increased sensory coverage and computing power to deliver data-intensive solutions achieving higher levels of performance than traditional systems. Within Traffic Signal Control (TSC), this has allowed the emergence of Machine Learning (ML) based systems. Among this group, Reinforcement Learning (RL) approaches have performed particularly well. Given the lack of industry standards in ML for TSC, literature exploring RL often lacks comparison against commercially available systems and straightforward formulations of how the agents operate. Here we attempt to bridge that gap. We propose three different architectures for TSC RL agents and compare them against the currently used commercial systems MOVA, SurTrac and Cyclic controllers and provide pseudo-code for them. The agents use variations of Deep Q-Learning and Actor Critic, using states and rewards based on queue lengths. Their performance is compared in across different map scenarios with variable demand, assessing them in terms of the global delay and average queue length. We find that the RL-based systems can significantly and consistently achieve lower delays when compared with existing commercial systems.


title: Modelling the Spread of an Epidemic in Presence of Vaccination using Cellular Automata

abstract: The results of Kermack-McKendrick SIR model are planned to be reproduced by cellular automata (CA) lattice model. The CA algorithms are proposed to study the model of epidemic, systematically. The basic goal is to capture the effects of spreading of infection over a scale of length. This CA model can provide the rate of growth of the infection over the space which was lacking in the mean-field like SIR model. The motion of the circular front of an infected cluster shows a linear behaviour in time. The correlation of a particular site to be infected, with respect to the central site is also studied. The outcomes of CA model are in good agreement with that obtained from SIR model. The results of vaccination have been also incorporated in the CA algorithm with a satisfactory degree of success. The advantage of the present model is that it can shed considerable amount of light to the physical properties of the spread of a typical epidemic in a simple, yet robust way.


title: Macroeconomic forecasting with statistically validated knowledge graphs

abstract: This study leverages narrative from global newspapers to construct theme-based knowledge graphs about world events, demonstrating that features extracted from such graphs improve forecasts of industrial production in three large economies compared to a number of benchmarks. Our analysis relies on a filtering methodology that extracts "backbones" of statistically significant edges from large graph data sets. We find that changes in the eigenvector centrality of nodes in such backbones capture shifts in relative importance between different themes significantly better than graph similarity measures. We supplement our results with an interpretability analysis, showing that the theme categories "disease" and "economic" have the strongest predictive power during the time period that we consider. Our work serves as a blueprint for the construction of parsimonious - yet informative - theme-based knowledge graphs to monitor in real time the evolution of relevant phenomena in socio-economic systems.


title: Almost sure asymptotic behaviour of Birkhoff sums for infinite measure-preserving dynamical systems

abstract: We consider a conservative ergodic measure-preserving transformation $T$ of a $\sigma$-finite measure space $(X,\mathcal{B},\mu)$ with $\mu(X)=\infty$. Given an observable $f:X\to \mathbb{R}$ we study the almost sure asymptotic behaviour of the Birkhoff sums $S_Nf(x) := \sum_{j=1}^N\, (f\circ T^{j-1})(x)$. In infinite ergodic theory it is well known that the asymptotic behaviour of $S_Nf(x)$ strongly depends on the point $x\in X$, and if $f\in L^1(X,\mu)$, then there exists no real valued sequence $(b(N))$ such that $\lim_{N\to\infty} S_Nf(x)/b(N)=1$ almost surely. In this paper we show that for dynamical systems with strong mixing assumptions for the induced map on a finite measure set, there exists a sequence $(\alpha(N))$ and $m\colon X\times \mathbb{N}\to\mathbb{N}$ such that for $f\in L^1(X,\mu)$ we have $\lim_{N\to\infty} S_{N+m(x,N)}f(x)/\alpha(N)=1$ for $\mu$-a.e. $x\in X$. Moreover if $f\not\in L^1(X,\mu)$ we give conditions on the induced observable such that there exists a sequence $(G(N))$ depending on $f$, for which $\lim_{N\to\infty} S_{N}f(x)/G(N)=1$ holds for $\mu$-a.e. $x\in X$.


title: Jacobian Regularization for Mitigating Universal Adversarial Perturbations

abstract: Universal Adversarial Perturbations (UAPs) are input perturbations that can fool a neural network on large sets of data. They are a class of attacks that represents a significant threat as they facilitate realistic, practical, and low-cost attacks on neural networks. In this work, we derive upper bounds for the effectiveness of UAPs based on norms of data-dependent Jacobians. We empirically verify that Jacobian regularization greatly increases model robustness to UAPs by up to four times whilst maintaining clean performance. Our theoretical analysis also allows us to formulate a metric for the strength of shared adversarial perturbations between pairs of inputs. We apply this metric to benchmark datasets and show that it is highly correlated with the actual observed robustness. This suggests that realistic and practical universal attacks can be reliably mitigated without sacrificing clean accuracy, which shows promise for the robustness of machine learning systems.


title: Spin-wave driven bidirectional domain wall motion in kagome antiferromagnets

abstract: We predict a mechanism to controllably manipulate domain walls in kagome antiferromagnets via a single linearly polarized spin-wave source. We show by means of atomistic spin dynamics simulations of antiferromagnets with kagome structure that the speed and direction of the domain wall motion can be regulated by only tuning the frequency of the applied spin-wave. Starting from microscopics, we establish an effective action and derive the corresponding equations of motion for the spin-wave-driven domain wall. Our analytical calculations reveal that the coupling of two spin-wave modes inside the domain wall explains the frequency-dependent velocity of the spin texture. Such a highly tunable spin-wave-induced domain wall motion provides a key component toward next-generation fast, energy-efficient, and Joule-heating-free antiferromagnetic insulator devices.


title: Improving the Accuracy of Early Exits in Multi-Exit Architectures via Curriculum Learning

abstract: Deploying deep learning services for time-sensitive and resource-constrained settings such as IoT using edge computing systems is a challenging task that requires dynamic adjustment of inference time. Multi-exit architectures allow deep neural networks to terminate their execution early in order to adhere to tight deadlines at the cost of accuracy. To mitigate this cost, in this paper we introduce a novel method called Multi-Exit Curriculum Learning that utilizes curriculum learning, a training strategy for neural networks that imitates human learning by sorting the training samples based on their difficulty and gradually introducing them to the network. Experiments on CIFAR-10 and CIFAR-100 datasets and various configurations of multi-exit architectures show that our method consistently improves the accuracy of early exits compared to the standard training approach.