title: Loosely-Stabilizing Phase Clocks and the Adaptive Majority Problem

abstract: We present a loosely-stabilizing phase clock for population protocols. In the population model we are given a system of $n$ identical agents which interact in a sequence of randomly chosen pairs. Our phase clock is leaderless and it requires $O(\log n)$ states. It runs forever and is, at any point of time, in a synchronous state w.h.p. When started in an arbitrary configuration, it recovers rapidly and enters a synchronous configuration within $O(n\log n)$ interactions w.h.p. Once the clock is synchronized, it stays in a synchronous configuration for at least poly $n$ parallel time w.h.p. We use our clock to design a loosely-stabilizing protocol that solves the comparison problem introduced by Alistarh et al., 2021. In this problem, a subset of agents has at any time either $A$ or $B$ as input. The goal is to keep track which of the two opinions is (momentarily) the majority. We show that if the majority has a support of at least $\Omega(\log n)$ agents and a sufficiently large bias is present, then the protocol converges to a correct output within $O(n\log n)$ interactions and stays in a correct configuration for poly $n$ interactions, w.h.p.


title: A Bogomolov property for the canonical height of maps with superattracting periodic points

abstract: We prove that if $f$ is a polynomial over a number field $K$ with a finite superattracting periodic point and a non-archimedean place of bad reduction, then there is an $\epsilon>0$ such that only finitely many $P\in K^{\text{ab}}$ have canonical height less than $\epsilon$ with respect to $f$. The key ingredient is the geometry of the filled Julia set at a place of bad reduction. We also prove a conditional uniform boundedness result for the $K$-rational preperiodic points of such polynomials, as well as a uniform lower bound on the canonical height of non-preperiodic points in $K$. We further prove unconditional analogues of these results in the function field setting.


title: Sensing applied pressure by triggering electronic quantum many-body excitations in an optical waveguide

abstract: Recently, nanomaterials are arousing increasing interest and a wide variety of opto-electronic devices have been developed, such as light-emitting diodes, solar cells, and photodetectors. However, the study of the light emission properties of quantum dots under pressure is still limited. By using a joint theoretical and experimental approach, we developed a polymer waveguide doped with CdSe quantum dots for pressure sensing. Absorption and re-emission effects of the quantum dots are affected by the pressure applied on the waveguide. Specifically, since both amplitude and wavelength are modulated, not only the pressure can be detected, but also its location along the waveguide. The calibration results demonstrate the feasibility of the proposed force sensor design. Theoretical model and simulations further validate the presented sensing principle. The proposed prototype benefits from the main advantages of optical sensors, such as their predisposition to miniaturization, small cable sizes and weights, immunity to electromagnetic interference, and safe operation in hazard environments. In addition, bio-compatibility, non-toxicity and flexibility make the presented sensor potentially appealing to various application fields such as nanobiotechnology and robotic sensing.

categories: quant-ph cond-mat.mes-hall cond-mat.mtrl-sci physics.ins-det physics.optics


title: Thermal and Vibrationally Activated Decomposition of the syn-CH$_3$CHOO Criegee Intermediate

abstract: The full reaction pathway between the syn-CH$_3$CHOO Criegee Intermediate via vinyl hydroxyperoxide to OH+CH$_2$COH is followed for vibrationally excited and thermally prepared reactants. The rates from vibrational excitation are consistent with those found from experiments and tunneling is not required for reactivity at all initial conditions probed. For vibrationally excited reactant, VHP accumulates and becomes a bottleneck for the reaction. The two preparations - relevant for laboratory studies and conditions in the atmosphere - lead to a difference of close to one order of magnitude in OH production (~ 5 % vs. 35 %) on the 1 ns time scale which is an important determinant for the chemical evolution of the atmosphere.


title: In-depth Analysis of Evolving Binary Systems that Produce Nova Eruptions

abstract: This study is the direct continuation of the work performed in Hillman et al. (2020) where they used their feedback dominated numerical simulations to model the evolution of four initial models with white dwarf (WD) masses of 0.7 and 1.0M_Solar and red dwarf (RD) masses of 0.45 and 0.7M_Solar from first Roche-lobe contact of the donor RD, over a few times 10^9 years, until the RD was eroded down to below 0.1M_Solar. This study presents an in-depth analysis of their four models complimented by three models with a higher WD mass of 1.25M_Solar, one of which comprises an oxygen-neon (ONe) core. Common features were found for all seven models on a secular time scale as well as on a cyclic time scale. On the other hand, certain features were found that are strongly dependent either on the WD or the RD mass but are indifferent to the other of the two. Additionally, a model with a WD composed of an ONe core was compared with its corresponding carbon oxygen (CO) core WD model and found to have a significant impact on the heavy element abundances in the ejecta composition.


title: Bi-Lipschitz embeddings of quasiconformal trees

abstract: A quasiconformal tree is a doubling metric tree in which the diameter of each arc is bounded above by a fixed multiple of the distance between its endpoints. In this paper we show that every quasiconformal tree bi-Lipschitz embeds in some Euclidean space, with the ambient dimension and the bi-Lipschitz constant depending only on the doubling and bounded turning constants of the tree. This answers Question 1.6 in \cite{DV} (arXiv:2007.12297).


title: Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting

abstract: Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior Transformer-based models adopt various self-attention mechanisms to discover the long-range dependencies. However, intricate temporal patterns of the long-term future prohibit the model from finding reliable dependencies. Also, Transformers have to adopt the sparse versions of point-wise self-attentions for long series efficiency, resulting in the information utilization bottleneck. Going beyond Transformers, we design Autoformer as a novel decomposition architecture with an Auto-Correlation mechanism. We break with the pre-processing convention of series decomposition and renovate it as a basic inner block of deep models. This design empowers Autoformer with progressive decomposition capacities for complex time series. Further, inspired by the stochastic process theory, we design the Auto-Correlation mechanism based on the series periodicity, which conducts the dependencies discovery and representation aggregation at the sub-series level. Auto-Correlation outperforms self-attention in both efficiency and accuracy. In long-term forecasting, Autoformer yields state-of-the-art accuracy, with a 38% relative improvement on six benchmarks, covering five practical applications: energy, traffic, economics, weather and disease. Code is available at this repository: \url{https://github.com/thuml/Autoformer}.


title: Angular momentum distribution in a relativistic configuration: Magnetic quantum number analysis

abstract: This paper is devoted to the analysis of the distribution of the total magnetic quantum number $M$ in a relativistic subshell with $N$ equivalent electrons of momentum $j$. This distribution is analyzed through its cumulants and through their generating function, for which an analytical expression is provided. This function also allows us to get the values of the cumulants at any order. Such values are useful to obtain the moments at various orders. Since the cumulants of the distinct subshells are additive this study directly applies to any relativistic configuration. Recursion relations on the generating function are given. It is shown that the generating function of the magnetic quantum number distribution may be expressed as a n-th derivative of a polynomial. This leads to recurrence relations for this distribution which are very efficient even in the case of large $j$ or $N$. The magnetic quantum number distribution is numerically studied using the Gram-Charlier and Edgeworth expansions. The inclusion of high-order terms may improve the accuracy of the Gram-Charlier representation for instance when a small and a large angular momenta coexist in the same configuration. However such series does not exhibit convergence when high orders are considered and the account for the first two terms often provides a fair approximation of the magnetic quantum number distribution. The Edgeworth series offers an interesting alternative though this expansion is also divergent and of asymptotic nature.


title: Peccei-Quinn symmetry with residual symmetries

abstract: So far the null results from axion searches have enforced a huge hierarchy between the Peccei-Quinn and electroweak symmetry breaking scales. Then the inevitable Higgs portal poses a large fine tuning on the standard model Higgs scalar. Now we find if the Peccei-Quinn global symmetry has a set of residually discrete symmetries, these global and discrete symmetries can achieve a chain breaking at low scales such as the accessible TeV scale. This novel mechanism can accommodate some new phenomena including a sizable coupling of the standard model Higgs boson to the axion.


title: Graphlets in multilayer networks

abstract: Representing various networked data as multiplex networks, networks of networks and other multilayer networks can reveal completely new types of structures in these system. We introduce a general and principled graphlet framework for multilayer networks which allows one to break any multilayer network into small multilayered building blocks. These multilayer graphlets can be either analyzed themselves or used to do tasks such as comparing different systems. The method is flexible in terms of multilayer isomorphism, automorphism orbit definition, and the type of multilayer network. We illustrate our method for multiplex networks and show how it can be used to distinguish networks produced with multiple models from each other in an unsupervised way. In addition, we include an automatic way of generating the hundreds of dependency equations between the orbit counts needed to remove redundant orbit counts. The framework introduced here allows one to analyze multilayer networks with versatile semantics, and these methods can thus be used to analyze the structural building blocks of myriad multilayer networks.


title: Runtime Permission Issues in Android Apps: Taxonomy, Practices, and Ways Forward

abstract: Android introduces a new permission model that allows apps to request permissions at runtime rather than at the installation time since 6.0 (Marshmallow, API level 23). While this runtime permission model provides users with greater flexibility in controlling an app's access to sensitive data and system features, it brings new challenges to app development. First, as users may grant or revoke permissions at any time while they are using an app, developers need to ensure that the app properly checks and requests required permissions before invoking any permission-protected APIs. Second, Android's permission mechanism keeps evolving and getting customized by device manufacturers. Developers are expected to comprehensively test their apps on different Android versions and device models to make sure permissions are properly requested in all situations. Unfortunately, these requirements are often impractical for developers. In practice, many Android apps suffer from various runtime permission issues (ARP issues). While existing studies have explored ARP issues, the understanding of such issues is still preliminary. To better characterize ARP issues, we performed an empirical study using 135 Stack Overflow posts that discuss ARP issues and 199 real ARP issues archived in popular open-source Android projects on GitHub. Via analyzing the data, we observed 11 types of ARP issues that commonly occur in Android apps. Furthermore, we conducted a field survey and in-depth interviews among practitioners, to gain insights from industrial practices and learn practitioners' requirements of tools that can help combat ARP issues. We hope that our findings can shed light on future research and provide useful guidance to practitioners.


title: A Fully Problem-Dependent Regret Lower Bound for Finite-Horizon MDPs

abstract: We derive a novel asymptotic problem-dependent lower-bound for regret minimization in finite-horizon tabular Markov Decision Processes (MDPs). While, similar to prior work (e.g., for ergodic MDPs), the lower-bound is the solution to an optimization problem, our derivation reveals the need for an additional constraint on the visitation distribution over state-action pairs that explicitly accounts for the dynamics of the MDP. We provide a characterization of our lower-bound through a series of examples illustrating how different MDPs may have significantly different complexity. 1) We first consider a "difficult" MDP instance, where the novel constraint based on the dynamics leads to a larger lower-bound (i.e., a larger regret) compared to the classical analysis. 2) We then show that our lower-bound recovers results previously derived for specific MDP instances. 3) Finally, we show that, in certain "simple" MDPs, the lower bound is considerably smaller than in the general case and it does not scale with the minimum action gap at all. We show that this last result is attainable (up to $poly(H)$ terms, where $H$ is the horizon) by providing a regret upper-bound based on policy gaps for an optimistic algorithm.


title: Exploring Stronger Feature for Temporal Action Localization

abstract: Temporal action localization aims to localize starting and ending time with action category. Limited by GPU memory, mainstream methods pre-extract features for each video. Therefore, feature quality determines the upper bound of detection performance. In this technical report, we explored classic convolution-based backbones and the recent surge of transformer-based backbones. We found that the transformer-based methods can achieve better classification performance than convolution-based, but they cannot generate accuracy action proposals. In addition, extracting features with larger frame resolution to reduce the loss of spatial information can also effectively improve the performance of temporal action localization. Finally, we achieve 42.42% in terms of mAP on validation set with a single SlowFast feature by a simple combination: BMN+TCANet, which is 1.87% higher than the result of 2020's multi-model ensemble. Finally, we achieve Rank 1st on the CVPR2021 HACS supervised Temporal Action Localization Challenge.


title: A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians

abstract: A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic structure of the proposed method is based on a step decomposition strategy that is known in the literature to be widely effective in practice, wherein each search direction is computed as the sum of a normal step (toward linearized feasibility) and a tangential step (toward objective decrease in the null space of the constraint Jacobian). However, the proposed method is unique from others in the literature in that it both allows the use of stochastic objective gradient estimates and possesses convergence guarantees even in the setting in which the constraint Jacobians may be rank deficient. The results of numerical experiments demonstrate that the algorithm offers superior performance when compared to popular alternatives.


title: Preparation of individual magnetic sub-levels of $^4$He($2^3$S$_1$) in a supersonic beam using laser optical pumping and magnetic hexapole focusing

abstract: We compare two different experimental techniques for the magnetic-sub-level preparation of metastable $^4$He in the $2^3$S$_1$ level in a supersonic beam, namely magnetic hexapole focusing and optical pumping by laser radiation. At a beam velocity of $v = 830\,$m/s, we deduce from a comparison with a particle trajectory simulation that up to $99\,$\% of the metastable atoms are in the $M_{J^{''}} = +1$ sub-level after magnetic hexapole focusing. Using laser optical pumping via the $2^3$P$_2-2^3$S$_1$ transition, we achieve a maximum efficiency of $94\pm3\,$\% for the population of the $M_{J^{''}} = +1$ sub-level. For the first time, we show that laser optical pumping via the $2^3$P$_1-2^3$S$_1$ transition can be used to selectively populate each of the three $M_{J^{''}}$ sub-levels ($M_{J^{''}} = $ -1, 0, +1). We also find that laser optical pumping leads to higher absolute atom numbers in specific $M_{J^{''}}$ sub-levels than magnetic hexapole focusing.


title: Central limit theorem and geodesic tracking on hyperbolic spaces and Teichm\"uller spaces

abstract: We study random walks on the isometry group of a Gromov hyperbolic space or Teichm\"uller space. We prove that the translation lengths of random isometries satisfy a central limit theorem if and only if the random walk has finite second moment. While doing this, we recover the central limit theorem of Benoist and Quint for the displacement of a reference point and establish its converse. Also discussed are the corresponding laws of the iterated logarithm. Finally, we prove sublinear geodesic tracking by random walks with finite $(1/2)$-th moment and logarithmic tracking by random walks with finite exponential moment.


title: MeerKAT 21-cm HI imaging of Abell 2626 and beyond

abstract: The morphology-density relation manifests the environmental dependence of the formation and evolution of galaxies as they continuously migrate through the cosmic web to ever denser environments. As gas-rich galaxies traverse the outskirts and inner regions of galaxy clusters they experience sudden and radical changes in their gas content and star formation activity. The goal of this work is to gain an H$\,$I perspective on gas depletion mechanisms acting on galaxies and galaxy groups that are being accreted by a moderately massive galaxy cluster. We aim to study the relative importance and efficiency of processes such as ram-pressure stripping and tidal interactions as well as their dependency on the local and global environment of galaxies in the cluster core and in its surroundings. We have conducted a blind radio continuum and H$\,$I spectral line imaging survey with the MeerKAT radio telescope of a 2$^\circ$ $\times$ 2$^\circ$ area centred on the galaxy cluster Abell 2626. We have used the CARAcal pipeline to reduce the data, SoFiA to detect sources within the H$\,$I data cube, and GIPSY to construct spatially resolved information on the H$\,$I morphologies and kinematics of the H$\,$I detected galaxies. We have detected H$\,$I in 219 galaxies with optical counterparts within the entire surveyed volume. We present the H$\,$I properties of each of the detected galaxies as a data catalogue and as an atlas page for each galaxy, including H$\,$I column-density maps, velocity fields, position-velocity diagrams and global H$\,$I profiles. These data will also be used for case studies of identified ``jellyfish'' galaxies and galaxy population studies by means of morphological classification of the direct H$\,$I detections as well as using the H$\,$I stacking technique.


title: Stream-based State-Machine Replication

abstract: Developing state-machine replication protocols for practical use is a complex and labor-intensive process because of the myriad of essential tasks (e.g., deployment, communication, recovery) that need to be taken into account in an implementation. In this paper, we show how this problem can be addressed with stream-based replication, a novel approach that implements a replication protocol as application on top of a data-stream processing framework. With such framework already handling most essential tasks and furthermore providing means for debugging and monitoring, this technique has the key benefit of significantly minimizing overhead for both programmers as well as system operators. Our first stream-based protocol Tara tolerates crashes and comprises full-fledged mechanisms for request handling, checkpointing, and view changes. Still, Tara's prototype implementation, which is based on Twitter's Heron framework, consists of fewer than 1,500 lines of application-level code.


title: Zero-Cost, Arrow-Enabled Data Interface for Apache Spark

abstract: Distributed data processing ecosystems are widespread and their components are highly specialized, such that efficient interoperability is urgent. Recently, Apache Arrow was chosen by the community to serve as a format mediator, providing efficient in-memory data representation. Arrow enables efficient data movement between data processing and storage engines, significantly improving interoperability and overall performance. In this work, we design a new zero-cost data interoperability layer between Apache Spark and Arrow-based data sources through the Arrow Dataset API. Our novel data interface helps separate the computation (Spark) and data (Arrow) layers. This enables practitioners to seamlessly use Spark to access data from all Arrow Dataset API-enabled data sources and frameworks. To benefit our community, we open-source our work and show that consuming data through Apache Arrow is zero-cost: our novel data interface is either on-par or more performant than native Spark.


title: Improved Regret Bounds for Tracking Experts with Memory

abstract: We address the problem of sequential prediction with expert advice in a non-stationary environment with long-term memory guarantees in the sense of Bousquet and Warmuth [4]. We give a linear-time algorithm that improves on the best known regret bounds [26]. This algorithm incorporates a relative entropy projection step. This projection is advantageous over previous weight-sharing approaches in that weight updates may come with implicit costs as in for example portfolio optimization. We give an algorithm to compute this projection step in linear time, which may be of independent interest.


title: Two New Kinds of Interference Alignment Schemes for Cellular K-user MIMO Downlink Networks

abstract: It is known that interference alignment (IA) plays an important role in improving the degree of freedom (DoF) of multi-input and multi-output (MIMO) systems. However, most of the traditional IA schemes suffer from the high computational complexity and require the global and instantaneous channel state information (CSI), both of which make them difficult to be extended to cellular MIMO systems. To handle these issues, two new interference alignment schemes, i.e., the retrospective interference regeneration (RIR) scheme and the beamforming based distributed retrospective interference alignment (B-DRIA) scheme, are proposed for cellular K-user MIMO downlink networks. For the RIR scheme, it adopts interference elimination algorithm to erase redundant symbols in inter-cell interference (ICI) signals, and then uses interference regeneration algorithm to avoid secondary interference. The RIR scheme obtains greater DoF gain than the retrospective interference alignment (RIA) scheme, but incurs performance degradation when the transceiver antennas ratio (TAR) approaches 1. Therefore, the B-DRIA scheme is further proposed. For the B-DRIA scheme, the cellular beamforming matrix is introduced to eliminate the ICI, and meanwhile distributed retrospective interference alignment algorithm is adopted to align inter-user interference (IUI). The simulation results show that the B-DRIA scheme obtains larger DoF than the RIR scheme locally. Specifically, when TAR approaches 1, two schemes obtain the same DoF. While TAR approaches 2, the DoF of the B-DRIA scheme is superior than the RIR scheme.


title: Integration of Communication and Sensing in 6G: a Joint Industrial and Academic Perspective

abstract: 6G will likely be the first generation of mobile communication that will feature tight integration of localization and sensing with communication functionalities. Among several worldwide initiatives, the Hexa-X flagship project stands out as it brings together 25 key players from adjacent industries and academia, and has among its explicit goals to research fundamentally new radio access technologies and high-resolution localization and sensing. Such features will not only enable novel use cases requiring extreme localization performance, but also provide a means to support and improve communication functionalities. This paper provides an overview of the Hexa-X vision alongside the envisioned use cases. To close the required performance gap of these use cases with respect to 5G, several technical enablers will be discussed, together with the associated research challenges for the coming years.


title: Symmetric Wasserstein Autoencoders

abstract: Leveraging the framework of Optimal Transport, we introduce a new family of generative autoencoders with a learnable prior, called Symmetric Wasserstein Autoencoders (SWAEs). We propose to symmetrically match the joint distributions of the observed data and the latent representation induced by the encoder and the decoder. The resulting algorithm jointly optimizes the modelling losses in both the data and the latent spaces with the loss in the data space leading to the denoising effect. With the symmetric treatment of the data and the latent representation, the algorithm implicitly preserves the local structure of the data in the latent space. To further improve the quality of the latent representation, we incorporate a reconstruction loss into the objective, which significantly benefits both the generation and reconstruction. We empirically show the superior performance of SWAEs over the state-of-the-art generative autoencoders in terms of classification, reconstruction, and generation.


title: From downtown to the outskirts: a radio survey of the Orion Nebula Cluster

abstract: We present a newly enlarged census of the compact radio population towards the Orion Nebula Cluster (ONC) using high-sensitivity continuum maps (3-10 $\mu$Jy bm$^{-1}$) from a total of $\sim30$ h centimeter-wavelength observations over an area of $\sim$20$'\times20'$ obtained in the C-band (4$-$8 GHz) with the Karl G. Jansky Very Large Array (VLA) in its high-resolution A-configuration. We thus complement our previous deep survey of the innermost areas of the ONC, now covering the field of view of the Chandra Orion Ultra-deep Project (COUP). Our catalog contains 521 compact radio sources of which 198 are new detections. Overall, we find that 17% of the (mostly stellar) COUP sources have radio counterparts, while 53% of the radio sources have COUP counterparts. Most notably, the radio detection fraction of X-ray sources is higher in the inner cluster and almost constant for $r>3'$ (0.36 pc) from $\theta^1$ Ori C suggesting a correlation between the radio emission mechanism of these sources and their distance from the most massive stars at the center of the cluster, for example due to increased photoionisation of circumstellar disks. The combination with our previous observations four years prior lead to the discovery of fast proper motions of up to $\sim$373 km s$^{-1}$ from faint radio sources associated with ejecta of the OMC1 explosion. Finally, we search for strong radio variability. We found changes in flux density by a factor of $\lesssim$5 within our observations and a few sources with changes by a factor $>$10 on long timescales of a few years.


title: The Deeper, Wider, Faster Program: Exploring stellar flare activity with deep, fast cadenced DECam imaging via machine learning

abstract: We present our 500 pc distance-limited study of stellar fares using the Dark Energy Camera as part of the Deeper, Wider, Faster Program. The data was collected via continuous 20-second cadence g band imaging and we identify 19,914 sources with precise distances from Gaia DR2 within twelve, ~3 square-degree, fields over a range of Galactic latitudes. An average of ~74 minutes is spent on each field per visit. All light curves were accessed through a novel unsupervised machine learning technique designed for anomaly detection. We identify 96 flare events occurring across 80 stars, the majority of which are M dwarfs. Integrated are energies range from $\sim 10^{31}-10^{37}$ erg, with a proportional relationship existing between increased are energy with increased distance from the Galactic plane, representative of stellar age leading to declining yet more energetic are events. In agreement with previous studies we observe an increase in flaring fraction from M0 -> M6 spectral types. Furthermore, we find a decrease in the flaring fraction of stars as vertical distance from the galactic plane is increased, with a steep decline present around ~100 pc. We find that ~70% of identified flares occur on short timescales of ~8 minutes. Finally we present our associated are rates, finding a volumetric rate of $2.9 \pm 0.3 \times 10^{-6}$ flares pc$^{-3}$ hr$^{-1}$.


title: Lattice QCD Study of Transverse-Momentum Dependent Soft Function

abstract: In this work, we perform a lattice QCD study of the intrinsic, rapidity-independent soft function within the framework of large momentum effective theory. The computation is carried out using a gauge ensemble of $N_f=2+1+1$ clover-improved twisted mass fermion. After applying an appropriate renormalization procedure and the removal of significant higher-twist contamination, we obtain the intrinsic soft function that is comparable to the one-loop perturbative result at large external momentum. The determination of the nonperturbative soft function from first principles is crucial to sharpen our understanding of the processes with small transverse momentum such as the Drell-Yan production and the semi-inclusive deep inelastic scattering. Additionally, we calculate the Collins-Soper evolution kernel using the quasi-transverse-momentum-dependent wave function as input.


title: Assessing Scientific Practices in Physics Paper-based Assessments

abstract: Calls to transform introductory college physics courses to include scientific practices require assessments that can measure the extent to which these transformations are effective. Such assessments should be able to measure students' abilities to blend conceptually important concepts with practices scientists engage in. To design assessment tasks that can measure these abilities, we leveraged Evidence-Centered Design and the Three-Dimensional Learning Assessment Protocol with the focal scientific practice of "Using Mathematics." We conducted video recorded one-on-one think-aloud interviews to explore how students interpreted these tasks. In this paper, we articulate our design process and the analysis of students' responses using the ACER (Activation-Construction-Execution-Reflection) framework. Our assessment tasks elicited students' abilities to blend concepts with mathematics and written solutions elicited evidence of their abilities to blend them most of the time. This work extends our understanding on incorporating scientific practices into paper-based assessments at the introductory level.


title: PERT: A Progressively Region-based Network for Scene Text Removal

abstract: Scene text removal (STR) contains two processes: text localization and background reconstruction. Through integrating both processes into a single network, previous methods provide an implicit erasure guidance by modifying all pixels in the entire image. However, there exists two problems: 1) the implicit erasure guidance causes the excessive erasure to non-text areas; 2) the one-stage erasure lacks the exhaustive removal of text region. In this paper, we propose a ProgrEssively Region-based scene Text eraser (PERT), introducing an explicit erasure guidance and performing balanced multi-stage erasure for accurate and exhaustive text removal. Firstly, we introduce a new region-based modification strategy (RegionMS) to explicitly guide the erasure process. Different from previous implicitly guided methods, RegionMS performs targeted and regional erasure on only text region, and adaptively perceives stroke-level information to improve the integrity of non-text areas with only bounding box level annotations. Secondly, PERT performs balanced multi-stage erasure with several progressive erasing stages. Each erasing stage takes an equal step toward the text-erased image to ensure the exhaustive erasure of text regions. Compared with previous methods, PERT outperforms them by a large margin without the need of adversarial loss, obtaining SOTA results with high speed (71 FPS) and at least 25% lower parameter complexity. Code is available at https://github.com/wangyuxin87/PERT.


title: Design of a fretboard using the stiff string equation

abstract: Guitar fretboards are designed based on the equation of the ideal string. That is, it neglects several factors as nonlinearities and bending stiffness of the strings. Due to this fact, intonation of guitars along the whole neck is not perfect, and guitars have right tuning just in an \emph{average} sense. There are commercially available fretboards that differ from the traditional design. (One example is the \cite{patent} by the Company True Temperament AB, where each fretboard is made using CNC processes.) As a final application of this work we would like to redesign the fretboard layout considering the effects of bending stiffness. The main goal of this project is to analyze the differences between the differences in the solution for vibrations of the ideal string and a stiff string. These differences should lead to changes in the fret distribution for a guitar, and, hopefully improve the overall intonation of the instrument. We will start analyzing the ideal string equation and after a good understanding of this analytical solution we will proceed with the, more complex, stiff equation. Topics like separation of variables, Fourier transforms, and Perturbation analysis might prove useful during the course of this project


title: Towards Biologically Plausible Convolutional Networks

abstract: Convolutional networks are ubiquitous in deep learning. They are particularly useful for images, as they reduce the number of parameters, reduce training time, and increase accuracy. However, as a model of the brain they are seriously problematic, since they require weight sharing - something real neurons simply cannot do. Consequently, while neurons in the brain can be locally connected (one of the features of convolutional networks), they cannot be convolutional. Locally connected but non-convolutional networks, however, significantly underperform convolutional ones. This is troublesome for studies that use convolutional networks to explain activity in the visual system. Here we study plausible alternatives to weight sharing that aim at the same regularization principle, which is to make each neuron within a pool react similarly to identical inputs. The most natural way to do that is by showing the network multiple translations of the same image, akin to saccades in animal vision. However, this approach requires many translations, and doesn't remove the performance gap. We propose instead to add lateral connectivity to a locally connected network, and allow learning via Hebbian plasticity. This requires the network to pause occasionally for a sleep-like phase of "weight sharing". This method enables locally connected networks to achieve nearly convolutional performance on ImageNet and improves their fit to the ventral stream data, thus supporting convolutional networks as a model of the visual stream.


title: Optimization of IRS-aided Sub-THz Communications under practical design constraints

abstract: We consider the optimization of a smart radio environment where meta-surfaces are employed to improve the performance of multiuser wireless networks working at sub-THz frequencies. Motivated by the extreme sparsity of the THz channel we propose to model each meta-surface as an electronically steerable reflector, by using only two parameters, regardless of its size. This assumption, although suboptimal in a general multiuser setup, allows for a significant complexity reduction when optimizing the environment and, despite its simplicity, is able to provide high communication rates. We derive a set of asymptotic results providing insight on the system behavior when both the number of antennas at the transmitter and the meta-surfaces area grow large. For the optimization we propose an algorithm based on the Newton-Raphson method and a simpler, yet effective, heuristic approach based on a map associating meta-surfaces and users. Through numerical results we provide insights on the system behavior and we assess the performance limits of the network in terms of supported users and spatial density of the meta-surfaces.


title: A Transformer-based Cross-modal Fusion Model with Adversarial Training for VQA Challenge 2021

abstract: In this paper, inspired by the successes of visionlanguage pre-trained models and the benefits from training with adversarial attacks, we present a novel transformerbased cross-modal fusion modeling by incorporating the both notions for VQA challenge 2021. Specifically, the proposed model is on top of the architecture of VinVL model [19], and the adversarial training strategy [4] is applied to make the model robust and generalized. Moreover, two implementation tricks are also used in our system to obtain better results. The experiments demonstrate that the novel framework can achieve 76.72% on VQAv2 test-std set.


title: The condition number of many tensor decompositions is invariant under Tucker compression

abstract: We characterise the sensitivity of several additive tensor decompositions with respect to perturbations of the original tensor. These decompositions include canonical polyadic decompositions, block term decompositions, and sums of tree tensor networks. Our main result shows that the condition number of all these decompositions is invariant under Tucker compression. This result can dramatically speed up the computation of the condition number in practical applications. We give the example of an $265\times 371\times 7$ tensor of rank $3$ from a food science application whose condition number was computed in $6.9$ milliseconds by exploiting our new theorem, representing a speedup of four orders of magnitude over the previous state of the art.


title: Quantization Aware Training, ERNIE and Kurtosis Regularizer: a short empirical study

abstract: Pre-trained language models like Ernie or Bert are currently used in many applications. These models come with a set of pre-trained weights typically obtained in unsupervised/self-supervised modality on a huge amount of data. After that, they are fine-tuned on a specific task. Applications then use these models for inference, and often some additional constraints apply, like low power-budget or low latency between input and output. The main avenue to meet these additional requirements for the inference settings, is to use low precision computation (e.g. INT8 rather than FP32), but this comes with a cost of deteriorating the functional performance (e.g. accuracy) of the model. Some approaches have been developed to tackle the problem and go beyond the limitations of the PTO (Post-Training Quantization), more specifically the QAT (Quantization Aware Training, see [4]) is a procedure that interferes with the training process in order to make it affected (or simply disturbed) by the quantization phase during the training itself. Besides QAT, recently Intel-Habana Labs have proposed an additional and more direct way to make the training results more robust to subsequent quantization which uses a regularizer, therefore changing the loss function that drives the training procedure. But their proposal does not work out-of-the-box for pre-trained models like Ernie, for example. In this short paper we show why this is not happening (for the Ernie case) and we propose a very basic way to deal with it, sharing as well some initial results (increase in final INT8 accuracy) that might be of interest to practitioners willing to use Ernie in their applications, in low precision regime.


title: A scanning planar Yagi-Uda antenna for fluorescence detection

abstract: An effective approach to improve the detection efficiency of nanoscale light sources relies on a planar antenna configuration, which beams the emitted light into a narrow cone. Planar antennas operate like optical Yagi-Uda antennas, where reflector and director elements are made of metal films. Here we introduce and investigate, both theoretically and experimentally, a scanning implementation of a planar antenna. Using a small ensemble of molecules contained in fluorescent nanobeads placed in the antenna, we independently address the intensity, the radiation pattern and the decay rate as a function of distance between a flat-tip scanning gold wire (reflector) and a thin gold film coated on a glass coverslip (director). The scanning planar antenna changes the radiation pattern of a single fluorescent bead and it beams light into a narrow cone down to angles of 45{\deg} (full width at half maximum). Moreover, the collected signal compared to the case of a glass coverslip is larger than a factor of 3, which is mainly due to the excitation enhancement. These results offer a better understanding of the modification of light-matter interaction by planar antennas and they hold promise for applications, such as sensing, imaging and diagnostics.


title: Mix and Mask Actor-Critic Methods

abstract: Shared feature spaces for actor-critic methods aims to capture generalized latent representations to be used by the policy and value function with the hopes for a more stable and sample-efficient optimization. However, such a paradigm present a number of challenges in practice, as parameters generating a shared representation must learn off two distinct objectives, resulting in competing updates and learning perturbations. In this paper, we present a novel feature-sharing framework to address these difficulties by introducing the mix and mask mechanisms and the distributional scalarization technique. These mechanisms behaves dynamically to couple and decouple connected latent features variably between the policy and value function, while the distributional scalarization standardizes the two objectives using a probabilistic standpoint. From our experimental results, we demonstrate significant performance improvements compared to alternative methods using separate networks and networks with a shared backbone.


title: Variational Bihamiltonian Cohomologies and Integrable Hierarchies I: Foundations

abstract: This series of papers is devoted to the study of deformations of Virasoro symmetries of the principal hierarchies associated to semisimple Frobenius manifolds. The main tool we use is a generalization of the bihamiltonian cohomology called the variational bihamiltonian cohomology. In the present paper, we give its definitions and compute the associated cohomology groups that will be used in our study of deformations of Virasoro symmetries. To illustrate its application, we classify the conformal bihamiltonian structures with semisimple hydrodynamic limits.


title: Low-Latency Federated Learning over Wireless Channels with Differential Privacy

abstract: In federated learning (FL), model training is distributed over clients and local models are aggregated by a central server. The performance of uploaded models in such situations can vary widely due to imbalanced data distributions, potential demands on privacy protections, and quality of transmissions. In this paper, we aim to minimize FL training delay over wireless channels, constrained by overall training performance as well as each client's differential privacy (DP) requirement. We solve this problem in the framework of multi-agent multi-armed bandit (MAMAB) to deal with the situation where there are multiple clients confornting different unknown transmission environments, e.g., channel fading and interferences. Specifically, we first transform the long-term constraints on both training performance and each client's DP into a virtual queue based on the Lyapunov drift technique. Then, we convert the MAMAB to a max-min bipartite matching problem at each communication round, by estimating rewards with the upper confidence bound (UCB) approach. More importantly, we propose two efficient solutions to this matching problem, i.e., modified Hungarian algorithm and greedy matching with a better alternative (GMBA), in which the first one can achieve the optimal solution with a high complexity while the second one approaches a better trade-off by enabling a verified low-complexity with little performance loss. In addition, we develop an upper bound on the expected regret of this MAMAB based FL framework, which shows a linear growth over the logarithm of communication rounds, justifying its theoretical feasibility. Extensive experimental results are conducted to validate the effectiveness of our proposed algorithms, and the impacts of various parameters on the FL performance over wireless edge networks are also discussed.


title: Toward a High Performance IPMC Soft Actuator using A disturbance-aided method

abstract: Besides the advantages of Ionic polymer-metal composites (IPMCs) for biomedical applications, there are some drawbacks in their performance, which can be enhanced. One of those critical drawbacks is "back relaxation" (BR). If we apply a step voltage to IPMC, it will bend in the anode direction. Afterward, there is an unwanted and relatively slow counter-bending toward the cathode side. There are some disadvantages in the current BR control methods of IPMC actuators that prevent them from being used in real applications. This paper presents a new non-feedback method for eliminating the BR effect of non-patterned IPMCs by using a relatively high-frequency disturbance and proving it by theoretical and experimental explanations. The results show that the proposed method, needless to have any pattern on the electrodes of the IPMCs, can significantly eliminate the BR effect. Unlike the patterned IPMCs, no reduction will occur in the bending amplitude of IPMC, and even we can see the increased bending amplitude.


title: Unsupervised Learning of Depth and Depth-of-Field Effect from Natural Images with Aperture Rendering Generative Adversarial Networks

abstract: Understanding the 3D world from 2D projected natural images is a fundamental challenge in computer vision and graphics. Recently, an unsupervised learning approach has garnered considerable attention owing to its advantages in data collection. However, to mitigate training limitations, typical methods need to impose assumptions for viewpoint distribution (e.g., a dataset containing various viewpoint images) or object shape (e.g., symmetric objects). These assumptions often restrict applications; for instance, the application to non-rigid objects or images captured from similar viewpoints (e.g., flower or bird images) remains a challenge. To complement these approaches, we propose aperture rendering generative adversarial networks (AR-GANs), which equip aperture rendering on top of GANs, and adopt focus cues to learn the depth and depth-of-field (DoF) effect of unlabeled natural images. To address the ambiguities triggered by unsupervised setting (i.e., ambiguities between smooth texture and out-of-focus blurs, and between foreground and background blurs), we develop DoF mixture learning, which enables the generator to learn real image distribution while generating diverse DoF images. In addition, we devise a center focus prior to guiding the learning direction. In the experiments, we demonstrate the effectiveness of AR-GANs in various datasets, such as flower, bird, and face images, demonstrate their portability by incorporating them into other 3D representation learning GANs, and validate their applicability in shallow DoF rendering.


title: An open source MATLAB package to perform basic and advanced statistical analysis of turbulence data and other complex systems

abstract: We present a user-friendly open-source MATLAB\textsuperscript{\textregistered} package developed by the research group Turbulence, Wind energy and Stochastics (TWiSt) at the Carl von Ossietzky University of Oldenburg. Firstly, this package helps the user to perform a very basic statistical analysis of a given turbulent data set which we believe to be useful to the entire turbulence community. It can be used to estimate the statistical quantities of turbulence such as the spectrum density, turbulent intensity, integral length scale, Taylor microscale, Kolmogorov scale and dissipation rate. Different well-known methods available in the literature were selected so that they can be compared. Secondly, this package also performs an advanced analysis which includes the scale-dependent statistical description of turbulent cascade using the Fokker-Planck equation which consequently leads to the assessment of integral fluctuation theorem. This is utilized to estimate velocity increments, structure functions and their scaling exponents, drift and diffusion coefficients of the Fokker-Planck equation and consequently the total entropy production of the turbulent cascade. As a precondition for the stochastic process approach, Markovian properties of the turbulent cascade in scale are tested. The knowledge of a Fokker-Planck equation allows to determine for each independent cascade trajectories a total entropy production. The estimation of total entropy production allows to verify a rigorous law of non-equilibrium stochastic thermodynamics, namely the integral fluctuation theorem, which must be valid if Markov properties hold and the Fokker-Planck equation is correct. This approach to the turbulent cascade process has the potential for a new way to link the statistical description of turbulence, non-equilibrium stochastic thermodynamics and local turbulent flow structures.


title: AudioCLIP: Extending CLIP to Image, Text and Audio

abstract: In the past, the rapidly evolving field of sound classification greatly benefited from the application of methods from other domains. Today, we observe the trend to fuse domain-specific tasks and approaches together, which provides the community with new outstanding models. In this work, we present an extension of the CLIP model that handles audio in addition to text and images. Our proposed model incorporates the ESResNeXt audio-model into the CLIP framework using the AudioSet dataset. Such a combination enables the proposed model to perform bimodal and unimodal classification and querying, while keeping CLIP's ability to generalize to unseen datasets in a zero-shot inference fashion. AudioCLIP achieves new state-of-the-art results in the Environmental Sound Classification (ESC) task, out-performing other approaches by reaching accuracies of 90.07% on the UrbanSound8K and 97.15% on the ESC-50 datasets. Further it sets new baselines in the zero-shot ESC-task on the same datasets (68.78% and 69.40%, respectively). Finally, we also assess the cross-modal querying performance of the proposed model as well as the influence of full and partial training on the results. For the sake of reproducibility, our code is published.


title: Personalized Federated Learning with Contextualized Generalization

abstract: The prevalent personalized federated learning (PFL) usually pursues a trade-off between personalization and generalization by maintaining a shared global model to guide the training process of local models. However, the sole global model may easily transfer deviated context knowledge to some local models when multiple latent contexts exist across the local datasets. In this paper, we propose a novel concept called contextualized generalization (CG) to provide each client with fine-grained context knowledge that can better fit the local data distributions and facilitate faster model convergence, based on which we properly design a framework of PFL, dubbed CGPFL. We conduct detailed theoretical analysis, in which the convergence guarantee is presented and $\mathcal{O}(\sqrt{K})$ speedup over most existing methods is granted. To quantitatively study the generalization-personalization trade-off, we introduce the 'generalization error' measure and prove that the proposed CGPFL can achieve a better trade-off than existing solutions. Moreover, our theoretical analysis further inspires a heuristic algorithm to find a near-optimal trade-off in CGPFL. Experimental results on multiple real-world datasets show that our approach surpasses the state-of-the-art methods on test accuracy by a significant margin.


title: Where are we in semantic concept extraction for Spoken Language Understanding?

abstract: Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refers to natural language processing tasks related to semantic extraction from speech signal, like named entity recognition from speech or slot filling task in a context of human-machine dialogue. Classically, SLU tasks were processed through a cascade approach that consists in applying, firstly, an automatic speech recognition process, followed by a natural language processing module applied to the automatic transcriptions. These three last years, end-to-end neural approaches, based on deep neural networks, have been proposed in order to directly extract the semantics from speech signal, by using a single neural model. More recent works on self-supervised training with unlabeled data open new perspectives in term of performance for automatic speech recognition and natural language processing. In this paper, we present a brief overview of the recent advances on the French MEDIA benchmark dataset for SLU, with or without the use of additional data. We also present our last results that significantly outperform the current state-of-the-art with a Concept Error Rate (CER) of 11.2%, instead of 13.6% for the last state-of-the-art system presented this year.


title: About the (Hahn) classical character of 2-orthogonal solutions of two families of differential equations of third order

abstract: Considering a differential operator of third order that does not increase the degree of polynomials, we analyse some properties of elements of the dual space of 2-orthogonal polynomial eigenfunctions. In two classes of such generic operator, we prove that a 2-orthogonal polynomial solution fulfils Hahn's property.


title: The cohomology of the general stable sheaf on a K3 surface

abstract: Let $X$ be a K3 surface with Picard group $\mathrm{Pic}(X)\cong\mathbb{Z} H$ such that $H^2=2n$. Let $M_{H}(\mathbf{v})$ be the moduli space of Gieseker semistable sheaves on $X$ with Mukai vector $\mathbf{v}$. We say that $\mathbf{v}$ satisfies weak Brill-Noether if the general sheaf in $M_{H}(\mathbf{v})$ has at most one nonzero cohomology group. We show that given any rank $r \geq 2$, there are only finitely many Mukai vectors of rank $r$ on K3 surfaces of Picard rank one where weak Brill-Noether fails. We give an algorithm for finding the potential counterexamples and classify all such counterexamples up to rank 20 explicitly. Moreover, in each of these cases we calculate the cohomology of the general sheaf. Given $r$, we give sharp bounds on $n$, $d$, and $a$ that guarantee that $\mathbf{v}=(r,dH,a)$ satisfies weak Brill-Noether. As a corollary, we obtain another proof of the classification of Ulrich bundles on K3 surfaces of Picard rank one. In addition, we discuss the question of when the general sheaf in $M_H(\mathbf{v})$ is globally generated. Our techniques make crucial use of Bridgeland stability conditions.


title: Electron tunneling energies of a quantum dot in a magnetic field

abstract: Theoretical analysis of the experimental data for the energy levels of two interacting electrons confined by a finite Gaussian potential in a 2D quantum dot and subjected to a uniform magnetic field perpendicular to the plane of the dot is presented. While a previously published analytic solution for the magnetic field at which the ground state transitions from the spin-singlet to the spin-triplet state agreed well with the data, the calculated energy at higher magnetic fields diverged from the experimental data. It is shown that the experimental data do not support the current hypothesis that the experimental energy corresponds to the lowest electronic state in the quantum dot being resonant with the Fermi level of the n+ electrode. Instead the experimental data agree remarkably well with the theory when we use a mechanism in which the added electron to the QD tunnels from an intermediate state that is not dependent on the applied magnetic field to the 2-e state in the QD before it is manifested at the electrode.


title: Jets from MRC 0600-399 bent by magnetic fields in the cluster Abell 3376

abstract: Galaxy clusters are known to harbour magnetic fields. The nature of the intra-cluster magnetic fields remains an unresolved question. Intra-cluster magnetic field can be observed at the density contact discontinuity formed by cool and dense plasma running into hot ambient plasma, and the discontinuity exists near the 2nd BCG MRC 0600-399 of a merging galaxy cluster Abell 3376 (z=0.0461, hereafter as A3376). Elongated X-ray image in the east-west direction with a comet-like structure reaches a Mpc-scale (Fig1.(a)). Previous radio observations detected the bent jets from MRC 0600-399, moving in same direction as the sub-cluster's motion against ram pressure.Here we report a new radio observation of a radio galaxy MRC 0600-399 which is 3.4 times and 11 times higher resolution and sensitivity than the previous results. Contrary to typical jets, the MRC 0600-399 shows a 90deg bend at the contact discontinuity and the collimated jets further extend over 100 kpc from the bend point. Diffuse, elongated emission named "double-scythe" structures were detected for the first time. The spectral index flattens downstream of the bend point, indicating cosmic-ray re-acceleration. High-resolution numerical simulations reveal that the ordered magnetic field along the discontinuity plays a significant role in the change in the jet direction. The morphology of the "double-scythe" bear remarkable similarities with the simulations, which strengthens our understanding of the interaction between relativistic electrons and intra-cluster magnetic field.


title: How molecular effects affect solutal Marangoni convection

abstract: Interfacial tension gradients drive flow along liquid-liquid interfaces in a process known as the Marangoni effect. Such gradients can be caused by surfactants, which has been extensively studied in the literature. Less is known of its nanoscale properties, where molecular interfaces display properties separate from bulk liquid matter such as interfacial viscosity. In this report we study the molecular solutal Marangoni effect using molecular dynamics simulations. We show that molecular interfacial effects are important and should be accounted for in nanofluidic regimes. Hydrodynamic models can be extended with effective terms which include them.


title: On homology torsion growth

abstract: We prove new vanishing results on the growth of higher torsion homologies for suitable arithmetic lattices, Artin groups and mapping class groups. The growth is understood along Farber sequences, in particular, along residual chains. For principal congruence subgroups, we also obtain strong asymptotic bounds for the torsion growth. As a central tool, we introduce a quantitative homotopical method called effective rebuilding. This constructs small classifying spaces of finite index subgroups, at the same time controlling the complexity of the homotopy. The method easily applies to free abelian groups and then extends recursively to a wide class of residually finite groups.


title: Autonomous Driving Strategies at Intersections: Scenarios, State-of-the-Art, and Future Outlooks

abstract: Due to the complex and dynamic character of intersection scenarios, the autonomous driving strategy at intersections has been a difficult problem and a hot point in the research of intelligent transportation systems in recent years. This paper gives a brief summary of state-of-the-art autonomous driving strategies at intersections. Firstly, we enumerate and analyze common types of intersection scenarios, corresponding simulation platforms, as well as related datasets. Secondly, by reviewing previous studies, we have summarized characteristics of existing autonomous driving strategies and classified them into several categories. Finally, we point out problems of the existing autonomous driving strategies and put forward several valuable research outlooks.


title: On extendability to $F_\sigma$ ideals

abstract: Answering in negative a question of M. Hru\v{s}\'ak, we construct a Borel ideal not extendable to any $F_\sigma$ ideal and such that it is not Kat\v{e}tov above the ideal $\mathrm{conv}$.


title: Weighted majority tournaments and Kemeny ranking with 2-dimensional Euclidean preferences

abstract: The assumption that voters' preferences share some common structure is a standard way to circumvent NP-hardness results in social choice problems. While the Kemeny ranking problem is NP-hard in the general case, it is known to become easy if the preferences are 1-dimensional Euclidean. In this note, we prove that the Kemeny ranking problem remains NP-hard for $k$-dimensional Euclidean preferences with $k\!\ge\!2$ under norms $\ell_1$, $\ell_2$ and $\ell_\infty$, by showing that any weighted tournament (resp. weighted bipartite tournament) with weights of same parity (resp. even weights) is inducible as the weighted majority tournament of a profile of 2-Euclidean preferences under norm $\ell_2$ (resp. $\ell_1,\ell_{\infty}$), computable in polynomial time. More generally, this result regarding weighted tournaments implies, essentially, that hardness results relying on the (weighted) majority tournament that hold in the general case (e.g., NP-hardness of Slater ranking) are still true for 2-dimensional Euclidean preferences.


title: Understanding Uncertainty in Bayesian Deep Learning

abstract: Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainty by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have focused on formally evaluating the predictive uncertainties of these models. Furthermore, existing works point out the difficulties of encoding domain knowledge in models like NLMs, making them unsuitable for applications where interpretability is required. In this work, we show that traditional training procedures for NLMs can drastically underestimate uncertainty in data-scarce regions. We identify the underlying reasons for this behavior and propose a novel training method that can both capture useful predictive uncertainties as well as allow for incorporation of domain knowledge.


title: Morita Equivalence Classes of Tame Blocks of Finite Groups

abstract: We show that several Morita equivalence classes of tame algebras do not occur as blocks of finite groups. This refines classifications by Erdmann of classes of blocks with dihedral, semidihedral, and generalised quaternion defect groups. In particular we now have a complete classification of the Morita equivalence classes of blocks of finite groups with dihedral defect groups.


title: General construction of flat bands with and without band crossings based on wave function singularity

abstract: In this work, we develop a systematic method of constructing flat-band models with and without band crossings. Our construction scheme utilizes the symmetry and spatial shape of a compact localized state (CLS) and also the singularity of the flat-band wave function obtained by a Fourier transform of the CLS (FT-CLS). In order to construct a flat-band model systematically using these ingredients, we first choose a CLS with a specific symmetry representation in a given lattice. Then, the singularity of FT-CLS indicates whether the resulting flat band exhibits a band crossing point or not. A tight-binding Hamiltonian with the flat band corresponding to the FT-CLS is obtained by introducing a set of basis molecular orbitals, which are orthogonal to the FT-CLS. Our construction scheme can be systematically applied to any lattice so that it provides a powerful theoretical framework to study exotic properties of both gapped and gapless flat bands arising from their wave function singularities.


title: Fold2Seq: A Joint Sequence(1D)-Fold(3D) Embedding-based Generative Model for Protein Design

abstract: Designing novel protein sequences for a desired 3D topological fold is a fundamental yet non-trivial task in protein engineering. Challenges exist due to the complex sequence--fold relationship, as well as the difficulties to capture the diversity of the sequences (therefore structures and functions) within a fold. To overcome these challenges, we propose Fold2Seq, a novel transformer-based generative framework for designing protein sequences conditioned on a specific target fold. To model the complex sequence--structure relationship, Fold2Seq jointly learns a sequence embedding using a transformer and a fold embedding from the density of secondary structural elements in 3D voxels. On test sets with single, high-resolution and complete structure inputs for individual folds, our experiments demonstrate improved or comparable performance of Fold2Seq in terms of speed, coverage, and reliability for sequence design, when compared to existing state-of-the-art methods that include data-driven deep generative models and physics-based RosettaDesign. The unique advantages of fold-based Fold2Seq, in comparison to a structure-based deep model and RosettaDesign, become more evident on three additional real-world challenges originating from low-quality, incomplete, or ambiguous input structures. Source code and data are available at https://github.com/IBM/fold2seq.


title: Robust Decisions for Heterogeneous Agents via Certainty Equivalents

abstract: We study the problem of a planner who resolves risk-return trade-offs - like financial investment decisions - on behalf of a collective of agents with heterogeneous risk preferences. The planner's objective is a two-stage utility functional where an outer utility function is applied to the distribution of the agents' certainty equivalents from a given decision. Assuming lognormal risks and heterogeneous power utility preferences for the agents, we characterize optimal behavior in a setting where the planner can let each agent choose between different options from a fixed menu of possible decisions, leading to a grouping of the agents by risk preferences. These optimal decision menus are derived first for the case where the planner knows the distribution of preferences exactly and then for a case where he faces uncertainty about this distribution, only having access to upper and lower bounds on agents' relative risk aversion. Finally, we provide tight bounds on the welfare loss from offering a finite menu of choices rather than fully personalized decisions.


title: Hamiltonian kinetic-Hall Magnetohydrodynamics with fluid and kinetic ions in the current and pressure coupling schemes

abstract: We present two generalized hybrid kinetic-Hall magnetohydrodynamics (MHD) models describing the interaction of a two-fluid bulk plasma, which consists of thermal ions and electrons, with energetic, suprathermal ion populations described by Vlasov dynamics. The dynamics of the thermal components are governed by standard fluid equations in the Hall MHD limit with the electron momentum equation providing an Ohm's law with Hall and electron pressure terms involving a gyrotropic electron pressure tensor. The coupling of the bulk, low-energy plasma with the energetic particle dynamics is accomplished through the current density (current coupling scheme; CCS) and the ion pressure tensor appearing in the momentum equation (pressure coupling scheme; PCS) in the first and the second model, respectively. The CCS is a generalization of two well-known models, because in the limit of vanishing energetic and thermal ion densities we recover the standard Hall MHD and the hybrid kinetic-ions/fluid-electron model, respectively. This provides us with the capability to study in a continuous manner the global impact of the energetic particles in a regime extending from vanishing to dominant energetic particle densities. The noncanonical Hamiltonian structures of the CCS and PCS, which can be exploited to study equilibrium and stability properties through the energy-Casimir variational principle, are identified. As a first application here, we derive a generalized Hall MHD Grad--Shafranov--Bernoulli system for translationally symmetric equilibria with anisotropic electron pressure and kinetic effects owing to the presence of energetic particles using the PCS.


title: Fea2Fea: Exploring Structural Feature Correlations via Graph Neural Networks

abstract: Structural features are important features in a geometrical graph. Although there are some correlation analysis of features based on covariance, there is no relevant research on structural feature correlation analysis with graph neural networks. In this paper, we introuduce graph feature to feature (Fea2Fea) prediction pipelines in a low dimensional space to explore some preliminary results on structural feature correlation, which is based on graph neural network. The results show that there exists high correlation between some of the structural features. An irredundant feature combination with initial node features, which is filtered by graph neural network has improved its classification accuracy in some graph-based tasks. We compare differences between concatenation methods on connecting embeddings between features and show that the simplest is the best. We generalize on the synthetic geometric graphs and certify the results on prediction difficulty between structural features.


title: Efficient Tensor Contraction via Fast Count Sketch

abstract: Sketching uses randomized Hash functions for dimensionality reduction and acceleration. The existing sketching methods, such as count sketch (CS), tensor sketch (TS), and higher-order count sketch (HCS), either suffer from low accuracy or slow speed in some tensor based applications. In this paper, the proposed fast count sketch (FCS) applies multiple shorter Hash functions based CS to the vector form of the input tensor, which is more accurate than TS since the spatial information of the input tensor can be preserved more sufficiently. When the input tensor admits CANDECOMP/PARAFAC decomposition (CPD), FCS can accelerate CS and HCS by using fast Fourier transform, which exhibits a computational complexity asymptotically identical to TS for low-order tensors. The effectiveness of FCS is validated by CPD, tensor regression network compression, and Kronecker product compression. Experimental results show its superior performance in terms of approximation accuracy and computational efficiency.


title: Superconductivity with High Upper Critical Field in the Cubic Centrosymmetric $\eta$-Carbide Nb$_4$Rh$_2$C$_{1-\delta}$

abstract: The upper critical field is a fundamental measure of the strength of superconductivity in a material. It is also a cornerstone for the realization of superconducting magnet applications. The critical field arises because of the Copper pair breaking at a limiting field, which is due to the Pauli paramagnetism of the electrons. The maximal possible magnetic field strength for this effect is commonly known as the Pauli paramagnetic limit given as $\mu_0 H_{\rm Pauli} \approx 1.86{\rm [T/K]} \cdot T_{\rm c}$ for a weak-coupling BCS superconductor. The violation of this limit is only rarely observed. Exceptions include some low-temperature heavy fermion and some strongly anisotropic superconductors. Here, we report on the superconductivity at 9.75 K in the centrosymmetric, cubic $\eta$-carbide-type compound Nb$_4$Rh$_2$C$_{1-\delta}$, with a normalized specific heat jump of $\Delta C/\gamma T_{\rm c} =$ 1.64. We find that this material has a remarkably high upper critical field of $\mu_0 H_{\rm c2}{\rm (0)}$ =~28.5~T, which is exceeding by far its weak-coupling BCS Pauli paramagnetic limit of $\mu_0 H_{\rm Pauli}$~=~18.1 T. Determination of the origin and consequences of this effect will represent a significant new direction in the study of critical fields in superconductors.


title: Advancing biological super-resolution microscopy through deep learning: a brief review

abstract: Super-resolution microscopy overcomes the diffraction limit of conventional light microscopy in spatial resolution. By providing novel spatial or spatio-temporal information on biological processes at nanometer resolution with molecular specificity, it plays an increasingly important role in life sciences. However, its technical limitations require trade-offs to balance its spatial resolution, temporal resolution, and light exposure of samples. Recently, deep learning has achieved breakthrough performance in many image processing and computer vision tasks. It has also shown great promise in pushing the performance envelope of super-resolution microscopy. In this brief Review, we survey recent advances in using deep learning to enhance performance of super-resolution microscopy. We focus primarily on how deep learning ad-vances reconstruction of super-resolution images. Related key technical challenges are discussed. Despite the challenges, deep learning is set to play an indispensable and transformative role in the development of super-resolution microscopy. We conclude with an outlook on how deep learning could shape the future of this new generation of light microscopy technology.


title: Scalar Gravitational Wave Signals from Core Collapse in Massive Scalar-Tensor Gravity with Triple-Scalar Interactions

abstract: The spontaneous scalarization during the stellar core collapse in the massive scalar-tensor theories of gravity introduces extra polarizations (on top of the plus and cross modes) in gravitational waves, whose amplitudes are determined by several model parameters. Observations of such scalarization-induced gravitational waveforms therefore offer valuable probes into these theories of gravity. Considering a triple-scalar interactions in such theories, we find that the self-coupling effects suppress the magnitude of the scalarization and thus reduce the amplitude of the associated gravitational wave signals. In addition, the self-interacting effects in the gravitational waveform are shown to be negligible due to the dispersion throughout the astrophysically distant propagation. As a consequence, the gravitational waves observed on the Earth feature the characteristic inverse-chirp pattern. Although not with the on-going ground-based detectors, we illustrate that the scalarization-induced gravitational waves may be detectable at a signal-to-noise ratio level of ${\cal O}(100)$ with future detectors, such as Einstein Telescope and Cosmic Explorer.


title: Shallow Representation is Deep: Learning Uncertainty-aware and Worst-case Random Feature Dynamics

abstract: Random features is a powerful universal function approximator that inherits the theoretical rigor of kernel methods and can scale up to modern learning tasks. This paper views uncertain system models as unknown or uncertain smooth functions in universal reproducing kernel Hilbert spaces. By directly approximating the one-step dynamics function using random features with uncertain parameters, which are equivalent to a shallow Bayesian neural network, we then view the whole dynamical system as a multi-layer neural network. Exploiting the structure of Hamiltonian dynamics, we show that finding worst-case dynamics realizations using Pontryagin's minimum principle is equivalent to performing the Frank-Wolfe algorithm on the deep net. Various numerical experiments on dynamics learning showcase the capacity of our modeling methodology.


title: Stochastic Projective Splitting: Solving Saddle-Point Problems with Multiple Regularizers

abstract: We present a new, stochastic variant of the projective splitting (PS) family of algorithms for monotone inclusion problems. It can solve min-max and noncooperative game formulations arising in applications such as robust ML without the convergence issues associated with gradient descent-ascent, the current de facto standard approach in such situations. Our proposal is the first version of PS able to use stochastic (as opposed to deterministic) gradient oracles. It is also the first stochastic method that can solve min-max games while easily handling multiple constraints and nonsmooth regularizers via projection and proximal operators. We close with numerical experiments on a distributionally robust sparse logistic regression problem.


title: Kaplansky Test Problems for $R$-Modules in ZFC

abstract: Fix a ring $ R $ and look at the class of left $ R $-modules and naturally, we restrict ourselves to the case of rings such that this class is not too similar to the case $ R $ is a field. We shall solve Kaplansky test problems, all three of which say that we do not have decomposition theory, e.g., if the square of one module is isomorphic to the cube of another it does not follows that they are isomorphic. Our results are in the ordinary et theory, ZFC. For this, we look at bimodules, i.e., the structures which are simultaneously left $ R $-modules and right $ S $-modules with reasonable associativity, over a commutative ring $ T $ included in the centers of $ R $ and of $ S $. Eventually, we shall choose $ S $ to help solve each of the test questions. But first, we analyze what can be the smallest endomorphism ring of an $(R, S)$-bimodule. We construct such bimodules by using a simple version of the black box.


title: Metastability as a mechanism for yielding in amorphous solids under cyclic shear

abstract: We consider the yielding behavior of amorphous solids under cyclic shear deformation and show that it can be mapped into a random walk in a confining potential with an absorbing boundary. The resulting dynamics is governed by the first passage time into the absorbing state and suffices to capture the essential qualitative features recently observed in atomistic simulations of amorphous solids. Our results provide insight into the mechanism underlying yielding and its robustness. When the possibility of activated escape from absorbing states is added, it leads to a unique determination of a threshold energy and yield strain, suggesting thereby an appealing approach to understanding fatigue failure.


title: There is at most one continuous invariant mean

abstract: We show that, for a (not necessarily continuous) weakly contractive mean-type mapping $\mathbf{M} \colon I^p\to I^p$ (where $I$ is an interval and $p \in \mathbb{N}$), the functional equation $K \circ \mathbf{M}=K$ has at most one solution in the family of continuous means $K \colon I^p \to I$. Some general approach to the latter equation is also given.


title: ChaLearn Looking at People: Inpainting and Denoising challenges

abstract: Dealing with incomplete information is a well studied problem in the context of machine learning and computational intelligence. However, in the context of computer vision, the problem has only been studied in specific scenarios (e.g., certain types of occlusions in specific types of images), although it is common to have incomplete information in visual data. This chapter describes the design of an academic competition focusing on inpainting of images and video sequences that was part of the competition program of WCCI2018 and had a satellite event collocated with ECCV2018. The ChaLearn Looking at People Inpainting Challenge aimed at advancing the state of the art on visual inpainting by promoting the development of methods for recovering missing and occluded information from images and video. Three tracks were proposed in which visual inpainting might be helpful but still challenging: human body pose estimation, text overlays removal and fingerprint denoising. This chapter describes the design of the challenge, which includes the release of three novel datasets, and the description of evaluation metrics, baselines and evaluation protocol. The results of the challenge are analyzed and discussed in detail and conclusions derived from this event are outlined.


title: Arithmetic and topology of classical structures associated to plane quartics

abstract: We consider moduli spaces of plane quartics marked with various structures such as Cayley octads, Aronhold heptads, Steiner complexes and G\"opel subsets and determine their cohomology. This answers a series of questions of Jesse Wolfson. We also explore some arithmetic applications over finite fields.


title: Cauchy or not Cauchy? New goodness-of-fit tests for the Cauchy distribution

abstract: We introduce a new characterization of the Cauchy distribution and propose a class of goodness-of-fit tests to the Cauchy family. The limit distribution is derived in a Hilbert space framework under the null hypothesis and under fixed alternatives. The new tests are consistent against a large class of alternatives. A comparative Monte Carlo simulation study shows that the test is competitive to the state of the art procedures, and we apply the tests to log-returns of cryptocurrencies.


title: Properties of Gradient maps associated with Action of Real reductive Group

abstract: Let $(Z,\omega)$ be a \Keler manifold and let $U$ be a compact connected Lie group with Lie algebra $\mathfrak{u}$ acting on $Z$ and preserving $\omega$. We assume that the $U$-action extends holomorphically to an action of the complexified group $U^{\mathbb C}$ and the $U$-action on $Z$ is Hamiltonian. Then there exists a $U$-equivariant momentum map $\mu : Z\to \mathfrak{u}$. If $G\subset U^{\mathbb C}$ is a closed subgroup such that the Cartan decomposition $U^{\mathbb C} = U\text{exp}(i\mathfrak{u})$ induces a Cartan decomposition $G = K\text{exp}(\mathfrak{p}),$ where $K = U\cap G$, $\mathfrak{p} = \mathfrak{g}\cap i\mathfrak{u}$ and $\mathfrak{g}=\mathfrak k \oplus \mathfrak p$ is the Lie algebra of $G$, there is a corresponding gradient map $\mu_\mathfrak{p} : Z\to \mathfrak{p}$. If $X$ is a $G$-invariant compact and connected real submanifold of $Z,$ we may consider $\mu_{\mathfrak p}$ as a mapping $\mu_\mathfrak{p} : X\to \mathfrak{p}.$ Given an $\mathrm{Ad}(K)$-invariant scalar product on $\mathfrak p$, we obtain a Morse like function $f=\frac{1}{2}\parallel \mu_{\mathfrak p} \parallel^2$ on $X$. We point out that, without the assumption that $X$ is real analytic manifold, the Lojasiewicz gradient inequality holds for $f$. Therefore the limit of the negative gradient flow of $f$ exists and it is unique. Moreover, we prove that any $G$-orbit collapses to a single $K$-orbit and two critical points of $f$ which are in the same $G$-orbit belong to the same $K$-orbit. We also investigate convexity properties of the gradient map $\mu_\mathfrak{p}$ in the Abelian cases. In particular, we study two orbits variety $X$ and we investigate topological and cohomological properties of $X$.


title: Theory of Multi-Orbital Topological Superconductivity in Transition Metal Dichalcogenides

abstract: We study possible superconducting states in transition metal dichalcogenide (TMD) monolayers, assuming an on-site pairing potential that includes both intra- and inter-orbital terms. We find that if the mirror symmetry with respect to the system's plane is broken (e.g., by a substrate), this type of pairing can give rise to unconventional superconductivity, including time-reversal-invariant nodal and fully gapped topological phases. Using a multi-orbital renormalization group procedure, we show how these phases may result from the interplay between the local Coulomb repulsion, Hund's rule coupling, and phonon-mediated attraction. In particular, for a range of interaction parameters, the system transitions from a trivial phase to a nodal phase and finally to a gapped topological phase upon increasing the strength of the mirror symmetry breaking term.


title: Privacy Threats Analysis to Secure Federated Learning

abstract: Federated learning is emerging as a machine learning technique that trains a model across multiple decentralized parties. It is renowned for preserving privacy as the data never leaves the computational devices, and recent approaches further enhance its privacy by hiding messages transferred in encryption. However, we found that despite the efforts, federated learning remains privacy-threatening, due to its interactive nature across different parties. In this paper, we analyze the privacy threats in industrial-level federated learning frameworks with secure computation, and reveal such threats widely exist in typical machine learning models such as linear regression, logistic regression and decision tree. For the linear and logistic regression, we show through theoretical analysis that it is possible for the attacker to invert the entire private input of the victim, given very few information. For the decision tree model, we launch an attack to infer the range of victim's private inputs. All attacks are evaluated on popular federated learning frameworks and real-world datasets.


title: Optimal sequential sampling design for environmental extremes

abstract: The Sihl river, located near the city of Zurich in Switzerland, is under continuous and tight surveillance as it flows directly under the city's main railway station. To issue early warnings and conduct accurate risk quantification, a dense network of monitoring stations is necessary inside the river basin. However, as of 2021 only three automatic stations are operated in this region, naturally raising the question: how to extend this network for optimal monitoring of extreme rainfall events? So far, existing methodologies for station network design have mostly focused on maximizing interpolation accuracy or minimizing the uncertainty of some model's parameters estimates. In this work, we propose new principles inspired from extreme value theory for optimal monitoring of extreme events. For stationary processes, we study the theoretical properties of the induced sampling design that yields non-trivial point patterns resulting from a compromise between a boundary effect and the maximization of inter-location distances. For general applications, we propose a theoretically justified functional peak-over-threshold model and provide an algorithm for sequential station selection. We then issue recommendations for possible extensions of the Sihl river monitoring network, by efficiently leveraging both station and radar measurements available in this region.


title: Linear Space Streaming Lower Bounds for Approximating CSPs

abstract: We consider the approximability of constraint satisfaction problems in the streaming setting. For every constraint satisfaction problem (CSP) on $n$ variables taking values in $\{0,\ldots,q-1\}$, we prove that improving over the trivial approximability by a factor of $q$ requires $\Omega(n)$ space even on instances with $O(n)$ constraints. We also identify a broad subclass of problems for which any improvement over the trivial approximability requires $\Omega(n)$ space. The key technical core is an optimal, $q^{-(k-1)}$-inapproximability for the \textsf{Max $k$-LIN}-$\bmod\; q$ problem, which is the Max CSP problem where every constraint is given by a system of $k-1$ linear equations $\bmod\; q$ over $k$ variables. Our work builds on and extends the breakthrough work of Kapralov and Krachun (Proc. STOC 2019) who showed a linear lower bound on any non-trivial approximation of the MaxCut problem in graphs. MaxCut corresponds roughly to the case of \textsf{Max $k$-LIN}-$\bmod\; q$ with ${k=q=2}$. For general CSPs in the streaming setting, prior results only yielded $\Omega(\sqrt{n})$ space bounds. In particular no linear space lower bound was known for an approximation factor less than $1/2$ for {\em any} CSP. Extending the work of Kapralov and Krachun to \textsf{Max $k$-LIN}-$\bmod\; q$ to $k>2$ and $q>2$ (while getting optimal hardness results) is the main technical contribution of this work. Each one of these extensions provides non-trivial technical challenges that we overcome in this work.


title: First 3D vector tracking of helium recoils for fast neutron measurements at SuperKEKB

abstract: We present results from the first deployment of novel, high definition, compact gas Time Projection Chambers (TPCs) with pixel chip readout as part of the BEAST II beam background measurement project at SuperKEKB. The TPCs provide detailed 3D imaging of ionization from neutron-induced nuclear recoils in a helium and carbon dioxide target gas mixture at standard temperature and pressure. We find excellent electron background rejection, leading to background-free nuclear recoil measurements above 50 keVee, despite the extreme high-background environment. We measure an angular resolution better than 20{\deg} for recoil tracks longer than 1.7 mm, corresponding to an average ionization energy of ~100 keVee. We also obtain the 3D vector direction of helium recoils by utilizing charge profile measurements along the recoil axis, with a correct head/tail assignment efficiency of approximately 80%. With this performance, we present comparisons between measured and simulated event rates, recoil energy spectra, and directional distributions originating from beam-gas and Touschek beam losses at SuperKEKB. We utilize head/tail recognition to distinguish neutron components travelling with positive radial velocity in the Belle II coordinate system from those with opposite directionality. Finally, we present a novel method of discriminating beam-gas interactions from Touschek beam losses that can eliminate the need for dedicated accelerator runs for background measurements. This method is still statistics-limited. However, future studies should be able to verify this method, which in turn could lead to neutron background analysis runs symbiotic with normal Belle II operation. The capabilities demonstrated here also suggest that high definition recoil imaging in gas TPCs is applicable to low energy, low-background experiments, such as directional dark matter searches.


title: PDEs from matrices with orthogonal columns

abstract: We discuss a system of third order PDEs for strictly convex smooth functions on domains of Euclidean space. We argue that it may be understood as a closure of sorts of the first order prolongation of a family of second order PDEs. We describe explicitly its real analytic solutions and all the solutions which satisfy a genericity condition; we also describe a family of non-generic solutions which has an application to Poisson geometry and Kahler structures on toric varieties. Our methods are geometric: we use the theory of Hessian metrics and symmetric spaces to link the analysis of the system of PDEs with properties of the manifold of matrices with orthogonal columns.


title: Artifact Detection and Correction in EEG data: A Review

abstract: Electroencephalography (EEG) has countless applications across many of fields. However, EEG applications are limited by low signal-to-noise ratios. Multiple types of artifacts contribute to the noisiness of EEG, and many techniques have been proposed to detect and correct these artifacts. These techniques range from simply detecting and rejecting artifact ridden segments, to extracting the noise component from the EEG signal. In this paper we review a variety of recent and classical techniques for EEG data artifact detection and correction with a focus on the last half-decade. We compare the strengths and weaknesses of the approaches and conclude with proposed future directions for the field.


title: On the relationship between predictive coding and backpropagation

abstract: Artificial neural networks are often interpreted as abstract models of biological neuronal networks, but they are typically trained using the biologically unrealistic backpropagation algorithm and its variants. Predictive coding has been proposed as a potentially more biologically realistic alternative to backpropagation for training neural networks. This manuscript reviews and extends recent work on the mathematical relationship between predictive coding and backpropagation for training feedforward artificial neural networks on supervised learning tasks. Implications of these results for the interpretation of predictive coding and deep neural networks as models of biological learning are discussed along with a repository of functions, Torch2PC, for performing predictive coding with PyTorch neural network models.


title: A Declarative Goal-oriented Framework for Smart Environments with LPaaS

abstract: Smart environments powered by the Internet of Things aim at improving our daily lives by automatically tuning ambient parameters (e.g. temperature, interior light) and by achieving energy savings through self-managing cyber-physical systems. Commercial solutions, however, only permit setting simple target goals on those parameters and do not consider mediating conflicting goals among different users and/or system administrators, and feature limited compatibility across different IoT verticals. In this article, we propose a declarative framework to represent smart environments, user-set goals and customisable mediation policies to reconcile contrasting goals encompassing multiple IoT systems. An open-source Prolog prototype of the framework is showcased over two lifelike motivating examples.


title: Real Time State Estimation of Power Grids Using Convolutional Neural Networks and State Forecasting Via Recurrent Neural Networks

abstract: Power grids play a very important role in delivering electrical energy to homes, industries and other places that require it. Because of this increased demand they are facing a great challenge of voltage variations. This happens due to varied use of energy-consuming devices and appliances like electric vehicles, industrial consumption, occasional peak in energy demands etc. For these fluctuations in demands, it becomes extremely important to monitor the conditions at which the power grid operates. Once these conditions are known, the energy production can be manipulated to meet the demand. It has been found that the existing Power System State Estimation (PSSE) techniques may not be good in producing optimal Performance. Moreover, they are also expensive in terms of computational processing. To address this problem, this research proposes a state estimation method for power grids using Convolutional Neural Networks (CNN). It was found that the model produced an RMSE of 2.57 x 10-4, which was comparatively accurate than one of previous studies involved in making the estimation using a Prox Linear Model (2.97 x 10-4). Furthermore, the research also proposes Power System State Forecasting for improving system awareness and resilience. The forecasting is carried out using a model of Recurrent Neural Network (RNN). This model helps in accounting for long-term nonlinear aspects present in data and based on that it does the forecasting. The proposed model forecasted with a RMSE of 2.53 x 10-3, which is comparatively equal to the previous study mentioned above (2.59 x 10-3).


title: Coherent, super resolved radar beamforming using self-supervised learning

abstract: High resolution automotive radar sensors are required in order to meet the high bar of autonomous vehicles needs and regulations. However, current radar systems are limited in their angular resolution causing a technological gap. An industry and academic trend to improve angular resolution by increasing the number of physical channels, also increases system complexity, requires sensitive calibration processes, lowers robustness to hardware malfunctions and drives higher costs. We offer an alternative approach, named Radar signal Reconstruction using Self Supervision (R2-S2), which significantly improves the angular resolution of a given radar array without increasing the number of physical channels. R2-S2 is a family of algorithms which use a Deep Neural Network (DNN) with complex range-Doppler radar data as input and trained in a self-supervised method using a loss function which operates in multiple data representation spaces. Improvement of 4x in angular resolution was demonstrated using a real-world dataset collected in urban and highway environments during clear and rainy weather conditions.


title: Partial Maximum Correntropy Regression for Robust Trajectory Decoding from Noisy Epidural Electrocorticographic Signals

abstract: The Partial Least Square Regression (PLSR) exhibits admirable competence for predicting continuous variables from inter-correlated brain recordings in the brain-computer interface. However, PLSR is in essence formulated based on the least square criterion, thus, being non-robust with respect to noises. The aim of this study is to propose a new robust implementation for PLSR. To this end, the maximum correntropy criterion (MCC) is used to propose a new robust variant of PLSR, called as Partial Maximum Correntropy Regression (PMCR). The half-quadratic optimization is utilized to calculate the robust projectors for the dimensionality reduction, and the regression coefficients are optimized by a fixed-point approach. We evaluate the proposed PMCR with a synthetic example and the public Neurotycho electrocorticography (ECoG) datasets. The extensive experimental results demonstrate that, the proposed PMCR can achieve better prediction performance than the conventional PLSR and existing variants with three different performance indicators in high-dimensional and noisy regression tasks. PMCR can suppress the performance degradation caused by the adverse noise, ameliorating the decoding robustness of the brain-computer interface.