title: Relation-aware Graph Attention Model With Adaptive Self-adversarial Training

abstract: This paper describes an end-to-end solution for the relationship prediction task in heterogeneous, multi-relational graphs. We particularly address two building blocks in the pipeline, namely heterogeneous graph representation learning and negative sampling. Existing message passing-based graph neural networks use edges either for graph traversal and/or selection of message encoding functions. Ignoring the edge semantics could have severe repercussions on the quality of embeddings, especially when dealing with two nodes having multiple relations. Furthermore, the expressivity of the learned representation depends on the quality of negative samples used during training. Although existing hard negative sampling techniques can identify challenging negative relationships for optimization, new techniques are required to control false negatives during training as false negatives could corrupt the learning process. To address these issues, first, we propose RelGNN -- a message passing-based heterogeneous graph attention model. In particular, RelGNN generates the states of different relations and leverages them along with the node states to weigh the messages. RelGNN also adopts a self-attention mechanism to balance the importance of attribute features and topological features for generating the final entity embeddings. Second, we introduce a parameter-free negative sampling technique -- adaptive self-adversarial (ASA) negative sampling. ASA reduces the false-negative rate by leveraging positive relationships to effectively guide the identification of true negative samples. Our experimental evaluation demonstrates that RelGNN optimized by ASA for relationship prediction improves state-of-the-art performance across established benchmarks as well as on a real industrial dataset.


title: Semi-classical edge states for the Robin Laplacian

abstract: Motivated by the study of high energy Steklov eigenfunctions, we examine the semi-classical Robin Laplacian. In the two dimensional situation, we determine an effective operator describing the asymptotic distribution of the negative eigenvalues, and we prove that the corresponding eigenfunctions decay away from the boundary, for all dimensions.


title: Think Global and Act Local: Bayesian Optimisation over High-Dimensional Categorical and Mixed Search Spaces

abstract: High-dimensional black-box optimisation remains an important yet notoriously challenging problem. Despite the success of Bayesian optimisation methods on continuous domains, domains that are categorical, or that mix continuous and categorical variables, remain challenging. We propose a novel solution -- we combine local optimisation with a tailored kernel design, effectively handling high-dimensional categorical and mixed search spaces, whilst retaining sample efficiency. We further derive convergence guarantee for the proposed approach. Finally, we demonstrate empirically that our method outperforms the current baselines on a variety of synthetic and real-world tasks in terms of performance, computational costs, or both.


title: On $1$-absorbing $\delta$-primary ideals

abstract: Let $R$ be a commutative ring with nonzero identity. Let $\mathcal{I}(R)$ be the set of all ideals of $R$ and let $\delta : \mathcal{I}(R)\longrightarrow \mathcal{I}(R)$ be a function. Then $\delta$ is called an expansion function of ideals of $R$ if whenever $L, I, J$ are ideals of R with $J \subseteq I$, we have $L \subseteq \delta( L)$ and $\delta(J)\subseteq \delta(I)$. Let $\delta$ be an expansion function of ideals of $R$. In this paper, we introduce and investigate a new class of ideals that is closely related to the class of $\delta$-primary ideals. A proper ideal $I$ of $R$ is said to be a $1$-absorbing $\delta$-primary ideal if whenever nonunit elements $a,b,c \in R $ and $abc\in I$, then $ab \in I$ or $c\in \delta(I).$ Moreover, we give some basic properties of this class of ideals and we study the $1$-absorbing $\delta$-primary ideals of the localization of rings, the direct product of rings and the trivial ring extensions.


title: Modified non-linear Schr\"odinger models, ${\cal C}{\cal P}_s{\cal T}_d$ symmetry, dark solitons and infinite towers of anomalous charges

abstract: Some modified (defocusing) non-linear Schr\"odinger models (MNLS) possess infinite towers of anomalous conservation laws with asymptotically conserved charges. The so-called anomalies of the quasi-conservation laws vanish upon space-time integration for a special ${\cal C}{\cal P}_s{\cal T}_d$ symmetric field configurations. We verify numerically the degree of modifications of the charges around the dark-soliton interaction regions by computing numerically some representative anomalies related to lowest order quasi-conservation laws of the non-integrable cubic-quintic NLS model as a modified (defocusing) NLS model. This modification depends on the parameter $\epsilon$, such that the standard NLS is recovered for $\epsilon=0$. Here we present the numerical simulations for small values of $|\epsilon|$, and show that the collision of two dark solitons are elastic. The NLS-type equations are quite ubiquitous in several areas of non-linear science.


title: Data-Driven Retrospective Cost Adaptive Control for Flight Control Application

abstract: Unlike fixed-gain robust control, which trades off performance with modeling uncertainty, direct adaptive control uses partial modeling information for online tuning. The present paper combines retrospective cost adaptive control (RCAC), a direct adaptive control technique for sampled-data systems, with online system identification based on recursive least squares (RLS) with variable-rate forgetting (VRF). The combination of RCAC and RLS-VRF constitutes data-driven RCAC (DDRCAC), where the online system identification is used to construct the target model, which defines the retrospective performance variable. This paper investigates the ability of RLS-VRF to provide the modeling information needed for the target model, especially nonminimum-phase (NMP) zeros. DDRCAC is applied to single-input, single-output (SISO) and multiple-input, multiple-output (MIMO) numerical examples with unknown NMP zeros, as well as several flight control problems, namely, unknown transition from minimum-phase to NMP lateral dynamics, flexible modes, flutter, and nonlinear planar missile dynamics.


title: Improved Bengali Image Captioning via deep convolutional neural network based encoder-decoder model

abstract: Image Captioning is an arduous task of producing syntactically and semantically correct textual descriptions of an image in natural language with context related to the image. Existing notable pieces of research in Bengali Image Captioning (BIC) are based on encoder-decoder architecture. This paper presents an end-to-end image captioning system utilizing a multimodal architecture by combining a one-dimensional convolutional neural network (CNN) to encode sequence information with a pre-trained ResNet-50 model image encoder for extracting region-based visual features. We investigate our approach's performance on the BanglaLekhaImageCaptions dataset using the existing evaluation metrics and perform a human evaluation for qualitative analysis. Experiments show that our approach's language encoder captures the fine-grained information in the caption, and combined with the image features, it generates accurate and diversified caption. Our work outperforms all the existing BIC works and achieves a new state-of-the-art (SOTA) performance by scoring 0.651 on BLUE-1, 0.572 on CIDEr, 0.297 on METEOR, 0.434 on ROUGE, and 0.357 on SPICE.


title: Human-Robot Handshaking: A Review

abstract: For some years now, the use of social, anthropomorphic robots in various situations has been on the rise. These are robots developed to interact with humans and are equipped with corresponding extremities. They already support human users in various industries, such as retail, gastronomy, hotels, education and healthcare. During such Human-Robot Interaction (HRI) scenarios, physical touch plays a central role in the various applications of social robots as interactive non-verbal behaviour is a key factor in making the interaction more natural. Shaking hands is a simple, natural interaction used commonly in many social contexts and is seen as a symbol of greeting, farewell and congratulations. In this paper, we take a look at the existing state of Human-Robot Handshaking research, categorise the works based on their focus areas, draw out the major findings of these areas while analysing their pitfalls. We mainly see that some form of synchronisation exists during the different phases of the interaction. In addition to this, we also find that additional factors like gaze, voice facial expressions etc. can affect the perception of a robotic handshake and that internal factors like personality and mood can affect the way in which handshaking behaviours are executed by humans. Based on the findings and insights, we finally discuss possible ways forward for research on such physically interactive behaviours.


title: Euclidean Frustrated Ribbons

abstract: Geometrical frustration in thin sheets is ubiquitous across scales in biology and becomes increasingly relevant in technology. Previous research identified the origin of the frustration as the violation of Gauss's \emph{Theorema Egregium}. Such "Gauss frustration" exhibits rich phenomenology; it may lead to mechanical instabilities, anomalous mechanics and shape-morphing abilities that can be harnessed in engineering systems. Here we report a new type of geometrical frustration, one that is as general as Gauss frustration. We show that its origin is the violation of Mainardi-Codazzi-Peterson compatibility equations and that it appears in Euclidean sheets. Combining experiments, simulations and theory, we study the specific case of a Euclidean ribbon with radial and geodesic curvatures. Experiments, conducted using different materials and techniques, reveal shape transitions, symmetry breaking and spontaneous stress focusing. These observations are quantitatively rationalized using analytic solutions and geometrical arguments. We expect this frustration to play a significant role in natural and engineering systems, specifically in slender 3D printed sheets.


title: HEVC Watermarking Techniques for Authentication and Copyright Applications: Challenges and Opportunities

abstract: Recently, High-Efficiency Video Coding (HEVC/H.265) has been chosen to replace previous video coding standards, such as H.263 and H.264. Despite the efficiency of HEVC, it still lacks reliable and practical functionalities to support authentication and copyright applications. In order to provide this support, several watermarking techniques have been proposed by many researchers during the last few years. However, those techniques are still suffering from many issues that need to be considered for future designs. In this paper, a Systematic Literature Review (SLR) is introduced to identify HEVC challenges and potential research directions for interested researchers and developers. The time scope of this SLR covers all research articles published during the last six years starting from January 2014 up to the end of April 2020. Forty-two articles have met the criteria of selection out of 343 articles published in this area during the mentioned time scope. A new classification has been drawn followed by an identification of the challenges of implementing HEVC watermarking techniques based on the analysis and discussion of those chosen articles. Eventually, recommendations for HEVC watermarking techniques have been listed to help researchers to improve the existing techniques or to design new efficient ones.


title: Remarks on the Stanley depth and Hilbert depth of monomial ideals with linear quotients

abstract: We prove that if $I$ is a monomial ideal with linear quotients in a ring of polynomials $S$ in $n$ indeterminates and $\operatorname{depth}(S/I)=n-2$, then $\operatorname{sdepth}(S/I)=n-2$ and, if $I$ is squarefree, $\operatorname{hdepth}(S/I)=n-2$. Also, we prove that $\operatorname{sdepth}(S/I)\geq \operatorname{depth}(S/I)$ for a monomial ideal $I$ with linear quotients which satisfies certain technical conditions.


title: Energy and Spectral Efficiency Balancing Algorithm for Energy Saving in LTE Downlinks

abstract: In wireless network communication environments, Spectral Efficiency (SE) and Energy Efficiency (EE) are among the major indicators used for evaluating network performance. However, given the high demand for data rate services and the exponential growth of energy consumption, SE and EE continue to elicit increasing attention in academia and industries. Consequently, a study of the trade-off between these metrics is imperative. In contrast with existing works, this study proposes an efficient SE and EE trade-off algorithm for saving energy in downlink Long Term Evolution (LTE) networks to concurrently optimize SE and EE while considering battery life at the Base Station (BS). The scheme is formulated as a Multi-objective Optimization Problem (MOP) and its Pareto optimal solution is examined. In contrast with other algorithms that prolong battery life by considering the idle state of a BS, thereby increasing average delay and energy consumption, the proposed algorithm prolongs battery life by adjusting the initial and final states of a BS to minimize the average delay and the energy consumption. Similarly, the use of an omni-directional antenna to spread radio signals to the user equipment in all directions causes high interference and low spatial reuse. We propose using a directional antenna instead of an omni-directional antenna by transmitting signals in one direction which results in no or low interference and high spatial reuse. The proposed scheme has been extensively evaluated through simulation, where simulation results prove that the proposed scheme is efficiently able to decrease the average response delay, improve SE, and minimize energy consumption.


title: How Misuse of Statistics Can Spread Misinformation: A Study of Misrepresentation of COVID-19 Data

abstract: This paper investigates various ways in which a pandemic such as the novel coronavirus, could be predicted using different mathematical models. It also studies the various ways in which these models could be depicted using various visualization techniques. This paper aims to present various statistical techniques suggested by the Centres for Disease Control and Prevention in order to represent the epidemiological data. The main focus of this paper is to analyse how epidemiological data or contagious diseases are theorized using any available information and later may be presented wrongly by not following the guidelines, leading to inaccurate representation and interpretations of the current scenario of the pandemic; with a special reference to the Indian Subcontinent.


title: Hugo: A Cluster Scheduler that Efficiently Learns to Select Complementary Data-Parallel Jobs

abstract: Distributed data processing systems like MapReduce, Spark, and Flink are popular tools for analysis of large datasets with cluster resources. Yet, users often overprovision resources for their data processing jobs, while the resource usage of these jobs also typically fluctuates considerably. Therefore, multiple jobs usually get scheduled onto the same shared resources to increase the resource utilization and throughput of clusters. However, job runtimes and the utilization of shared resources can vary significantly depending on the specific combinations of co-located jobs. This paper presents Hugo, a cluster scheduler that continuously learns how efficiently jobs share resources, considering metrics for the resource utilization and interference among co-located jobs. The scheduler combines offline grouping of jobs with online reinforcement learning to provide a scheduling mechanism that efficiently generalizes from specific monitored job combinations yet also adapts to changes in workloads. Our evaluation of a prototype shows that the approach can reduce the runtimes of exemplary Spark jobs on a YARN cluster by up to 12.5%, while resource utilization is increased and waiting times can be bounded.


title: Knowledge Graph Embedding using Graph Convolutional Networks with Relation-Aware Attention

abstract: Knowledge graph embedding methods learn embeddings of entities and relations in a low dimensional space which can be used for various downstream machine learning tasks such as link prediction and entity matching. Various graph convolutional network methods have been proposed which use different types of information to learn the features of entities and relations. However, these methods assign the same weight (importance) to the neighbors when aggregating the information, ignoring the role of different relations with the neighboring entities. To this end, we propose a relation-aware graph attention model that leverages relation information to compute different weights to the neighboring nodes for learning embeddings of entities and relations. We evaluate our proposed approach on link prediction and entity matching tasks. Our experimental results on link prediction on three datasets (one proprietary and two public) and results on unsupervised entity matching on one proprietary dataset demonstrate the effectiveness of the relation-aware attention.


title: Optimal design of optical analog solvers of linear systems

abstract: In this paper, given a linear system of equations A x = b, we are finding locations in the plane to place objects such that sending waves from the source points and gathering them at the receiving points solves that linear system of equations. The ultimate goal is to have a fast physical method for solving linear systems. The issue discussed in this paper is to apply a fast and accurate algorithm to find the optimal locations of the scattering objects. We tackle this issue by using asymptotic expansions for the solution of the underlyingpartial differential equation. This also yields a potentially faster algorithm than the classical BEM for finding solutions to the Helmholtz equation.


title: CMIP: Clone Mobile-agent Itinerary Planning Approach for Enhancing Event-to-Sink Throughput in Wireless Sensor Networks

abstract: In order to mitigate the problem of data congestion, increased latency, and high energy consumption in Wireless Sensor Networks (WSNs), Mobile Agent (MA) has been proven to be a viable alternative to the traditional client-server data gathering model. MA has the ability to migrate among network nodes based on an assigned itinerary, which can be formed via Single Itinerary Planning (SIP) or Multiple Itinerary Planning (MIP). MIP-based data gathering approach solves problems associated with SIP in terms of task duration, energy consumption, and reliability. However, the majority of existing MIP approaches focus only on reducing energy consumption and task duration, while the Event-to-sink throughput has not been considered. In this paper, a Clone Mobile-agent Itinerary Planning approach (CMIP) is proposed to reduce task duration while improving the Event-to-sink throughput in real-time applications, especially when the MA is assigned to visit a large number of source nodes. Simulation results show that the CMIP approach outperforms both Central Location-based MIP (CL-MIP) and Greatest Information in Greatest Memory-based MIP (GIGM-MIP) in terms of reducing task duration by about 56% and 16%, respectively. Furthermore, CMIP improves the Event-to-sink throughput by about 93% and 22% as compared to both CL-MIP and GIGM-MIP approaches, respectively.


title: Improved Estimators for Semi-supervised High-dimensional Regression Model

abstract: We study a linear high-dimensional regression model in a semi-supervised setting, where for many observations only the vector of covariates $X$ is given with no response $Y$. We do not make any sparsity assumptions on the vector of coefficients, and aim at estimating $\mathrm{Var}(Y|X)$. We propose an estimator, which is unbiased, consistent, and asymptotically normal. This estimator can be improved by adding zero-estimators arising from the unlabelled data. Adding zero-estimators does not affect the bias and potentially can reduce variance. In order to achieve optimal improvement, many zero-estimators should be used, but this raises the problem of estimating many parameters. Therefore, we introduce covariate selection algorithms that identify which zero-estimators should be used in order to improve the above estimator. We further illustrate our approach for other estimators, and present an algorithm that improves estimation for any given variance estimator. Our theoretical results are demonstrated in a simulation study.


title: Review on QoS provisioning approaches for supporting video traffic in IEEE802.11e: challenges and issues

abstract: Recently, the demand for multimedia applications is dramatically increased, which in turn increases the portion of video traffic on the Internet. The video streams, which require stringent Quality of Service (QoS), are expected to occupy more than two-thirds of web traffic by 2019. IEEE802.11e has introduced HCF Controlled Channel Access (HCCA) to provide QoS for delay-sensitive applications including highly compressed video streams. However, IEEE802.11e performance is hindered by the dynamic nature of Variable Bit Rate (VBR) video streams in which packet size and interval time are rapidly fluctuating during the traffic lifetime. In order to make IEEE802.11e able to accommodate with the irregularity of VBR video traffic, many approaches have been used in the literature. In this article, we highlight and discuss the QoS challenges in IEEE802.11e. Then, we classify the existing QoS approaches in IEEE802.11e and we also discuss the selection of recent promising and interesting enhancements of HCCA. Eventually, a set of open research issues and potential future directions is presented.


title: Neutron background measurement for rare event search experiments in the YangYang Underground Laboratory

abstract: Several experiments have been conducted in the YangYang Underground Laboratory in the Republic of Korea such as the search for dark matter and the search for neutrinoless double-beta decay, which require an extremely low background event rate due to the detector system and the environment. In underground experiments, neutrons have been identified as one of the background sources. The neutron flux in the experimental site needs to be determined to design a proper shielding system and for precise background estimation. We measured the neutron spectrum with a Bonner sphere spectrometer, with Helium-3 ($^{3}$He) proportional counters. The neutron flux at the underground laboratory was so low that the radioactive decays from the radioisotopes contained in the detector created a significant background interference to the neutron measurement. Using Monte Carlo simulations, the intrinsic $\alpha$ background distribution due to the radioactive isotopes in the detector materials, was estimated. The neutron count rate of each Bonner sphere was measured from the pulse height spectrum of the $^{3}$He proportional counter, after subtracting the $\alpha$ particle background. The neutron flux and the energy spectrum were determined using the unfolding technique. The total neutron flux measured was (4.46 $\pm$ 0.66) $\times$ $10^{-5}$ $\rm{cm^{-2} s^{-1}}$, and the thermal and fast neutron flux (in the range 1 to 10 MeV) were (1.44 $\pm$ 0.15) $\times$ 10$^{-5}$ $\rm{cm^{-2} s^{-1}}$ and (0.71 $\pm$ 0.10) $\times$ 10$^{-5}$ $\rm{cm^{-2} s^{-1}}$, respectively.


title: Sample Efficient Subspace-based Representations for Nonlinear Meta-Learning

abstract: Constructing good representations is critical for learning complex tasks in a sample efficient manner. In the context of meta-learning, representations can be constructed from common patterns of previously seen tasks so that a future task can be learned quickly. While recent works show the benefit of subspace-based representations, such results are limited to linear-regression tasks. This work explores a more general class of nonlinear tasks with applications ranging from binary classification, generalized linear models and neural nets. We prove that subspace-based representations can be learned in a sample-efficient manner and provably benefit future tasks in terms of sample complexity. Numerical results verify the theoretical predictions in classification and neural-network regression tasks.


title: One-dimensional discrete-time quantum walks with general coin

abstract: Quantum walk (QW) is the quantum analog of the random walk. QW is an integral part of the development of numerous quantum algorithms. Hence, an in-depth understanding of QW helps us to grasp the quantum algorithms. We revisit the one-dimensional discrete-time QW and discuss basic steps in detail by incorporating the most general coin operator. We investigate the impact of each parameter of the general coin operator on the probability distribution of the quantum walker. We show that by tuning the parameters of the general coin, one can regulate the probability distribution of the walker. We provide an algorithm for the one-dimensional quantum walk driven by the general coin operator. The study conducted on general coin operator also includes the popular coins -- Hadamard, Grover, and Fourier coins.


title: Assessing the spatio-temporal spread of COVID-19 via compartmental models with diffusion in Italy, USA, and Brazil

abstract: The outbreak of COVID-19 in 2020 has led to a surge in interest in the mathematical modeling of infectious diseases. Such models are usually defined as compartmental models, in which the population under study is divided into compartments based on qualitative characteristics, with different assumptions about the nature and rate of transfer across compartments. Though most commonly formulated as ordinary differential equation (ODE) models, in which the compartments depend only on time, recent works have also focused on partial differential equation (PDE) models, incorporating the variation of an epidemic in space. Such research on PDE models within a Susceptible, Infected, Exposed, Recovered, and Deceased (SEIRD) framework has led to promising results in reproducing COVID-19 contagion dynamics. In this paper, we assess the robustness of this modeling framework by considering different geometries over more extended periods than in other similar studies. We first validate our code by reproducing previously shown results for Lombardy, Italy. We then focus on the U.S. state of Georgia and on the Brazilian state of Rio de Janeiro, one of the most impacted areas in the world. Our results show good agreement with real-world epidemiological data in both time and space for all regions across major areas and across three different continents, suggesting that the modeling approach is both valid and robust.


title: Stability of the bulk gap for frustration-free topologically ordered quantum lattice systems

abstract: We prove that uniformly small short-range perturbations do not close the bulk gap above the ground state of frustration-free quantum spin systems that satisfy a standard local topological quantum order condition. In contrast with earlier results, we do not require a positive lower bound for finite-system Hamiltonians uniform in the system size. To obtain this result, we adapt the Bravyi-Hastings-Michalakis strategy to the GNS representation of the infinite-system ground state.

categories: math-ph cond-mat.str-el math.MP quant-ph


title: Reversible Action Design for Combinatorial Optimization with Reinforcement Learning

abstract: Combinatorial optimization problem (COP) over graphs is a fundamental challenge in optimization. Reinforcement learning (RL) has recently emerged as a new framework to tackle these problems and has demonstrated promising results. However, most RL solutions employ a greedy manner to construct the solution incrementally, thus inevitably pose unnecessary dependency on action sequences and need a lot of problem-specific designs. We propose a general RL framework that not only exhibits state-of-the-art empirical performance but also generalizes to a variety class of COPs. Specifically, we define state as a solution to a problem instance and action as a perturbation to this solution. We utilize graph neural networks (GNN) to extract latent representations for given problem instances for state-action encoding, and then apply deep Q-learning to obtain a policy that gradually refines the solution by flipping or swapping vertex labels. Experiments are conducted on Maximum $k$-Cut and Traveling Salesman Problem and performance improvement is achieved against a set of learning-based and heuristic baselines.


title: Efficient Designs of SLOPE Penalty Sequences in Finite Dimension

abstract: In linear regression, SLOPE is a new convex analysis method that generalizes the Lasso via the sorted L1 penalty: larger fitted coefficients are penalized more heavily. This magnitude-dependent regularization requires an input of penalty sequence $\lambda$, instead of a scalar penalty as in the Lasso case, thus making the design extremely expensive in computation. In this paper, we propose two efficient algorithms to design the possibly high-dimensional SLOPE penalty, in order to minimize the mean squared error. For Gaussian data matrices, we propose a first order Projected Gradient Descent (PGD) under the Approximate Message Passing regime. For general data matrices, we present a zero-th order Coordinate Descent (CD) to design a sub-class of SLOPE, referred to as the k-level SLOPE. Our CD allows a useful trade-off between the accuracy and the computation speed. We demonstrate the performance of SLOPE with our designs via extensive experiments on synthetic data and real-world datasets.


title: Continuous Real-Time Sensing with a Nitrogen Vacancy Center via Coherent Population Trapping

abstract: We propose and theoretically analyze the use of coherent population trapping of a single diamond nitrogen vacancy (NV) center for continuous real-time sensing. The formation of the dark state in coherent population trapping prevents optical emissions from the NV center. Fluctuating magnetic fields, however, can kick the NV center out of the dark state, leading to a sequence of single-photon emissions. A time series of the photon counts detected can be used for magnetic field estimations, even when the average photon count per update time interval is much smaller than 1. For a theoretical demonstration, the nuclear spin bath in a diamond lattice is used as a model fluctuating magnetic environment. For fluctuations with known statistical properties, such as an Ornstein-Uhlenbeck process, Bayesian inference-based estimators can lead to an estimation variance that approaches the classical Cramer-Rao lower bound and can provide dynamical information on a timescale that is comparable to the inverse of the average photon counting rate. Real-time sensing using coherent population trapping adds a new and powerful tool to the emerging technology of quantum sensing.


title: Why Talking about ethics is not enough: a proposal for Fintech's AI ethics

abstract: As the potential applications of Artificial Intelligence (AI) in the financial sector increases, ethical issues become gradually latent. The distrust of individuals, social groups, and governments about the risks arising from Fintech's activities is growing. Due to this scenario, the preparation of recommendations and Ethics Guidelines is increasing and the risks of being chosen the principles and ethical values most appropriate to companies are high. Thus, this exploratory research aims to analyze the benefits of the application of the stakeholder theory and the idea of Social License to build an environment of trust and for the realization of ethical principles by Fintech. The formation of a Fintech association for the creation of a Social License will allow early-stage Fintech to participate from the beginning of its activities in the elaboration of a dynamic ethical code and with the participation of stakeholders.


title: Communication-Efficient Distributed Optimization with Quantized Preconditioners

abstract: We investigate fast and communication-efficient algorithms for the classic problem of minimizing a sum of strongly convex and smooth functions that are distributed among $n$ different nodes, which can communicate using a limited number of bits. Most previous communication-efficient approaches for this problem are limited to first-order optimization, and therefore have \emph{linear} dependence on the condition number in their communication complexity. We show that this dependence is not inherent: communication-efficient methods can in fact have sublinear dependence on the condition number. For this, we design and analyze the first communication-efficient distributed variants of preconditioned gradient descent for Generalized Linear Models, and for Newton's method. Our results rely on a new technique for quantizing both the preconditioner and the descent direction at each step of the algorithms, while controlling their convergence rate. We also validate our findings experimentally, showing fast convergence and reduced communication.


title: Large-Scale Meta-Learning with Continual Trajectory Shifting

abstract: Meta-learning of shared initialization parameters has shown to be highly effective in solving few-shot learning tasks. However, extending the framework to many-shot scenarios, which may further enhance its practicality, has been relatively overlooked due to the technical difficulties of meta-learning over long chains of inner-gradient steps. In this paper, we first show that allowing the meta-learners to take a larger number of inner gradient steps better captures the structure of heterogeneous and large-scale task distributions, thus results in obtaining better initialization points. Further, in order to increase the frequency of meta-updates even with the excessively long inner-optimization trajectories, we propose to estimate the required shift of the task-specific parameters with respect to the change of the initialization parameters. By doing so, we can arbitrarily increase the frequency of meta-updates and thus greatly improve the meta-level convergence as well as the quality of the learned initializations. We validate our method on a heterogeneous set of large-scale tasks and show that the algorithm largely outperforms the previous first-order meta-learning methods in terms of both generalization performance and convergence, as well as multi-task learning and fine-tuning baselines.


title: Phenomenology of fermion dark matter as neutrino mass mediator with gauged B-L

abstract: We analyze a model with unbroken B-L gauge symmetry where neutrino masses are generated at one loop, after spontaneous breaking of a global U(1) symmetry. These symmetries ensure dark matter stability and the Diracness of neutrinos. Within this context, we examine fermionic dark matter. Consistency between the required neutrino mass and the observed relic abundance indicates dark matter masses and couplings within the reach of direct detection experiments.


title: Event-chain Monte Carlo: foundations, applications, and prospects

abstract: This review treats the mathematical and algorithmic foundations of non-reversible Markov chains in the context of event-chain Monte Carlo (ECMC), a continuous-time lifted Markov chain that employs the factorized Metropolis algorithm. It analyzes a number of model applications, and then reviews the formulation as well as the performance of ECMC in key models in statistical physics. Finally, the review reports on an ongoing initiative to apply the method to the sampling problem in molecular simulation, that is, to real-world models of peptides, proteins, and polymers in aqueous solution.


title: Urban Metric Maps for Small Unmanned Aircraft Systems Motion Planning

abstract: Low-altitude urban flight planning for small Unmanned Aircraft Systems (UAS) requires accurate vehicle, environment maps, and risk models to assure flight plans consider the urban landscape as well as airspace constraints. This paper presents a suite of motion planning metrics designed for small UAS urban flight. We define map-based and path-based metrics to holistically characterize motion plan quality. Proposed metrics are examined in the context of representative geometric, graph-based, and sampling-based motion planners applied to a multicopter small UAS. A novel multi-objective heuristic is proposed and applied for graph-based and sampling motion planners at four urban UAS flight altitude layers. Monte Carlo case studies in a New York City urban environment illustrate metric map properties and planner performance. Motion plans are evaluated as a function of planning algorithm, location, range, and flight altitude.


title: Error-driven Pruning of Language Models for Virtual Assistants

abstract: Language models (LMs) for virtual assistants (VAs) are typically trained on large amounts of data, resulting in prohibitively large models which require excessive memory and/or cannot be used to serve user requests in real-time. Entropy pruning results in smaller models but with significant degradation of effectiveness in the tail of the user request distribution. We customize entropy pruning by allowing for a keep list of infrequent n-grams that require a more relaxed pruning threshold, and propose three methods to construct the keep list. Each method has its own advantages and disadvantages with respect to LM size, ASR accuracy and cost of constructing the keep list. Our best LM gives 8% average Word Error Rate (WER) reduction on a targeted test set, but is 3 times larger than the baseline. We also propose discriminative methods to reduce the size of the LM while retaining the majority of the WER gains achieved by the largest LM.


title: Dynamics of two languages competing on a network: a case study

abstract: A language dynamics model on a square lattice, which is an extension of the one popularized by Abrams and Strogatz [1], is analyzed using ODE bifurcation theory. For this model we are interested in the existence and spectral stability of structures such as stripes, which are realized through pulses and/or the concatenation of fronts, and spots, which are a contiguous collection of sites in which one language is dominant. Because the coupling between sites is nonlinear, the boundary between sites containing speaking two different languages is "sharp"; in particular, in a PDE approximation it allows for the existence of compactly supported pulses (compactons). The dynamics are considered as a function of the prestige of a language. In particular, it is seen that as the prestige varies, it allows for a language to spread through the network, or conversely for its demise.


title: Near-Optimal Scheduling in the Congested Clique

abstract: This paper provides three nearly-optimal algorithms for scheduling $t$ jobs in the $\mathsf{CLIQUE}$ model. First, we present a deterministic scheduling algorithm that runs in $O(\mathsf{GlobalCongestion} + \mathsf{dilation})$ rounds for jobs that are sufficiently efficient in terms of their memory. The $\mathsf{dilation}$ is the maximum round complexity of any of the given jobs, and the $\mathsf{GlobalCongestion}$ is the total number of messages in all jobs divided by the per-round bandwidth of $n^2$ of the $\mathsf{CLIQUE}$ model. Both are inherent lower bounds for any scheduling algorithm. Then, we present a randomized scheduling algorithm which runs $t$ jobs in $O(\mathsf{GlobalCongestion} + \mathsf{dilation}\cdot\log{n}+t)$ rounds and only requires that inputs and outputs do not exceed $O(n\log n)$ bits per node, which is met by, e.g., almost all graph problems. Lastly, we adjust the \emph{random-delay-based} scheduling algorithm [Ghaffari, PODC'15] from the $\mathsf{CLIQUE}$ model and obtain an algorithm that schedules any $t$ jobs in $O(t / n + \mathsf{LocalCongestion} + \mathsf{dilation}\cdot\log{n})$ rounds, where the $\mathsf{LocalCongestion}$ relates to the congestion at a single node of the $\mathsf{CLIQUE}$. We compare this algorithm to the previous approaches and show their benefit. We schedule the set of jobs on-the-fly, without a priori knowledge of its parameters or the communication patterns of the jobs. In light of the inherent lower bounds, all of our algorithms are nearly-optimal. We exemplify the power of our algorithms by analyzing the message complexity of the state-of-the-art MIS protocol [Ghaffari, Gouleakis, Konrad, Mitrovic and Rubinfeld, PODC'18], and we show that we can solve $t$ instances of MIS in $O(t + \log\log\Delta\log{n})$ rounds, that is, in $O(1)$ amortized time, for $t\geq \log\log\Delta\log{n}$.


title: Exclusion of Extreme Jurors and Minority Representation: The Effect of Jury Selection Procedures

abstract: We compare two jury selection procedures meant to safeguard against the inclusion of biased jurors that are perceived as causing minorities to be under-represented. The Strike and Replace procedure presents potential jurors one-by-one to the parties, while the Struck procedure presents all potential jurors before the parties exercise their challenges. Struck more effectively excludes extreme jurors but leads to a worse representation of minorities. The advantage of Struck in terms of excluding extremes is sizable in a wide range of cases. In contrast, Strike and Replace better represents minorities only if the minority and majority are polarized. Results are robust to assuming the parties statistically discriminate against jurors based on group identity.


title: A new search direction for full-Newton step infeasible interior-point method in linear optimization

abstract: In this paper, we study an infeasible interior-point method for linear optimization with full-Newton step. The introduced method uses an algebraic equivalent transformation on the centering equation of the system which defines the central path. We prove that the method finds an $\varepsilon$-optimal solution of the underlying problem in polynomial time.


title: Gap in the Dirac spectrum and quark propagator symmetries in lattice QCD

abstract: Recent studies on lattice QCD have shown the emergence of large symmetries at high temperature. This includes not only the restoration $SU(n_F)_L \times SU(n_F)_R$, but also the effective emergence of an unexpected symmetry group, namely $SU(2)_{CS}$, which contains $U(1)_A$ as subgroup. At the same time, at high $T$, a gap in Dirac spectrum appears. As it is argued in several works of \textit{L. Glozman et al.}, there should be a connection between a gap in the Dirac spectrum and the presence of $SU(2)_{CS}$.In this paper, we analyze whether the quark propagator can be invariant under $SU(n_F)_L \times SU(n_F)_R$ and $SU(2)_{CS}$ transformations, in case of a gap in the Dirac spectrum, and consequently the invariance of hadron correlators, giving the condition for a quark propagator to be invariant under $SU(2)_{CS}$.


title: Multi-Texture GAN: Exploring the Multi-Scale Texture Translation for Brain MR Images

abstract: Inter-scanner and inter-protocol discrepancy in MRI datasets are known to lead to significant quantification variability. Hence image-to-image or scanner-to-scanner translation is a crucial frontier in the area of medical image analysis with a lot of potential applications. Nonetheless, a significant percentage of existing algorithms cannot explicitly exploit and preserve texture details from target scanners and offers individual solutions towards specialized task-specific architectures. In this paper, we design a multi-scale texture transfer to enrich the reconstruction images with more details. Specifically, after calculating textural similarity, the multi-scale texture can adaptively transfer the texture information from target images or reference images to restored images. Different from the pixel-wise matching space as done by previous algorithms, we match texture features in a multi-scale scheme implemented in the neural space. The matching mechanism can exploit multi-scale neural transfer that encourages the model to grasp more semantic-related and lesion-related priors from the target or reference images. We evaluate our multi-scale texture GAN on three different tasks without any task-specific modifications: cross-protocol super-resolution of diffusion MRI, T1-Flair, and Flair-T2 modality translation. Our multi-texture GAN rehabilitates more high-resolution structures (i.e., edges and anatomy), texture (i.e., contrast and pixel intensities), and lesion information (i.e., tumor). The extensively quantitative and qualitative experiments demonstrate that our method achieves superior results in inter-protocol or inter-scanner translation over state-of-the-art methods.


title: An Efficient Forecasting Approach to Reduce Boundary Effects in Real-Time Time-Frequency Analysis

abstract: Time-frequency (TF) representations of time series are intrinsically subject to the boundary effects. As a result, the structures of signals that are highlighted by the representations are garbled when approaching the boundaries of the TF domain. In this paper, for the purpose of real-time TF information acquisition of nonstationary oscillatory time series, we propose a numerically efficient approach for the reduction of such boundary effects. The solution relies on an extension of the analyzed signal obtained by a forecasting technique. In the case of the study of a class of locally oscillating signals, we provide a theoretical guarantee of the performance of our approach. Following a numerical verification of the algorithmic performance of our approach, we validate it by implementing it on biomedical signals.


title: Learning by Turning: Neural Architecture Aware Optimisation

abstract: Descent methods for deep networks are notoriously capricious: they require careful tuning of step size, momentum and weight decay, and which method will work best on a new benchmark is a priori unclear. To address this problem, this paper conducts a combined study of neural architecture and optimisation, leading to a new optimiser called Nero: the neuronal rotator. Nero trains reliably without momentum or weight decay, works in situations where Adam and SGD fail, and requires little to no learning rate tuning. Also, Nero's memory footprint is ~ square root that of Adam or LAMB. Nero combines two ideas: (1) projected gradient descent over the space of balanced networks; (2) neuron-specific updates, where the step size sets the angle through which each neuron's hyperplane turns. The paper concludes by discussing how this geometric connection between architecture and optimisation may impact theories of generalisation in deep learning.


title: Estimating Nonplanar Flow from 2D Motion-blurred Widefield Microscopy Images via Deep Learning

abstract: Optical flow is a method aimed at predicting the movement velocity of any pixel in the image and is used in medicine and biology to estimate flow of particles in organs or organelles. However, a precise optical flow measurement requires images taken at high speed and low exposure time, which induces phototoxicity due to the increase in illumination power. We are looking here to estimate the three-dimensional movement vector field of moving out-of-plane particles using normal light conditions and a standard microscope camera. We present a method to predict, from a single textured wide-field microscopy image, the movement of out-of-plane particles using the local characteristics of the motion blur. We estimated the velocity vector field from the local estimation of the blur model parameters using an deep neural network and achieved a prediction with a regression coefficient of 0.92 between the ground truth simulated vector field and the output of the network. This method could enable microscopists to gain insights about the dynamic properties of samples without the need for high-speed cameras or high-intensity light exposure.


title: A new solution for the two dimensional dimer problem

abstract: The classical 1961 solution to the problem of determining the number of perfect matchings (or dimer coverings) of a rectangular grid graph -- due independently to Kasteleyn and to Temperley and Fisher -- consists of changing the sign of some of the entries in the adjacency matrix so that the Pfaffian of the new matrix gives the number of perfect matchings, and then evaluating this Pfaffian. Another classical method is to use the Lindstr\"om-Gessel-Viennot theorem on non-intersecting lattice paths to express the number of perfect matchings as a determinant, and then evaluate this determinant. In this paper we present a new method for solving the two dimensional dimer problem, which relies on the Cauchy-Binet theorem. It only involves facts that were known in the mid 1930's when the dimer problem was phrased, so it could have been discovered while the dimer problem was still open. We provide explicit product formulas for both the square and the hexagonal lattice. One advantage of our formula for the square lattice compared to the original formula of Kasteleyn, Temperley and Fisher is that ours has a linear number of factors, while the number of factors in the former is quadratic. Our result for the hexagonal lattice yields a formula for the number of periodic stepped surfaces that fit in an infinite tube of given cross-section, which can be regarded as a counterpart of MacMahon's boxed plane partition theorem.

categories: math.CO cond-mat.stat-mech math-ph math.MP


title: Symmetrizing cathode-anode response to speed up charging of nanoporous supercapacitors

abstract: Asymmetric behaviors of capacitance and charging dynamics in the cathode and anode are general for nanoporous supercapacitors. Understanding this behavior is essential for the optimal design of supercapacitors. Herein, we perform constant-potential molecular dynamics simulations to reveal asymmetric features of porous supercapacitors and their effects on capacitance and charging dynamics. Our simulations show that, counterintuitively, charging dynamics can be fast in pores providing slow ion diffusion and vice versa. Unlike electrodes with single-size pores, multi-pore electrodes show overcharging and accelerated co-ion desorption, which can be attributed to the subtle interplay between the dynamics and charging mechanisms. We find that capacitance and charging dynamics correlate with how the ions respond to an applied cell voltage in the cathode and anode. We demonstrate that symmetrizing this response can help boost power density, which may find practical applications in supercapacitor optimization.


title: Thermal quarks and gluon propagators in two-color dense QCD

abstract: We study Landau gauge gluon propagators in two-color QCD at finite quark chemical potential ($\mu_q$) and temperature ($T$). We include medium polarization effects at one-loop by quarks into massive gluon propagators, and compared the analytic results with the available lattice data. We particularly focus on the high density phase of color-singlet diquark condensates whose critical temperature is $\sim 100$ MeV with weak dependence on $\mu_q$. At zero temperature the color singlet condensates protect the IR limit of electric and magnetic gluon propagators from the medium screening effects. At finite temperature, this behavior remains true for the magnetic sector, but the electric screening mass should be generated by thermal, and hence gapless, particles which are unbound from the diquark condensates. Treating thermal excitations as quasi-quarks, we found that the electric screening develops too fast compared to the lattice results. Beyond the critical temperature for diquark condensates the analytic results are consistent with the lattice results.


title: Dynamical phase transition in the first-passage probability of a Brownian motion

abstract: We study theoretically, experimentally and numerically the probability distribution $F(t_f|x_0,L)$ of the first passage times $t_f$ needed by a freely diffusing Brownian particle to reach a target at a distance $L$ from the initial position $x_0$, taken from a normalized distribution $(1/\sigma)\, g(x_0/\sigma)$ of finite width $\sigma$. We show the existence of a critical value $b_c$ of the parameter $b=L/\sigma$, which determines the shape of $F(t_f|x_0,L)$. For $b>b_c$ the distribution $F(t_f|x_0,L)$ has a maximum and a minimum whereas for $b<b_c$ it is a monotonically decreasing function of $t_f$. This dynamical phase transition is generated by the presence of two characteristic times $\sigma^2/D$ and $L^2/D$, where $D$ is the diffusion coefficient. The theoretical predictions are experimentally checked on a Brownian bead whose free diffusion is initialized by an optical trap which determines the initial distribution $g(x_0/\sigma)$. The presence of the phase transition in 2d has also been numerically estimated using a Langevin dynamics.


title: The $\bar{B}\to \pi$ form factors from QCD and their impact on $|V_{ub}|$

abstract: We revisit light-cone sum rules with pion distribution amplitudes to determine the full set of local $B \to \pi$ form factors. To this end, we determine all duality threshold parameters from a Bayesian fit for the first time. Our results, obtained at small momentum transfer $q^2$, are extrapolated to large $q^2$ where they agree with precise lattice QCD results. We find that a modification to the commonly used BCL parametrization is crucial to interpolate the scalar form factor between the two $q^2$ regions. We provide numerical results for the form factor parameters -- including their covariance -- based on simultaneous fit of all three form factors to both the sum rule and lattice QCD results. Our predictions for the form factors agree well with measurements of the $q^2$ spectrum of the semileptonic decay $\bar{B}^0\to \pi^+\ell^-\bar\nu$. From the world average of the latter we obtain $|V_{ub}| = (3.77 \pm 0.15)\cdot 10^{-3}$, which is in agreement with the most recent inclusive determination at the $1\,\sigma$ level.


title: One Hundred Probability and Statistics Inequalities

abstract: Herein we present one hundred inequalities culled from various corners of the probability, statistics, and combinatorics literature. We welcome new suggestions.


title: Revisiting the Strong Shock Problem: Converging and Diverging Shocks in Different Geometries

abstract: Self-similar solutions to converging (implosions) and diverging (explosions) shocks have been studied before, in planar, cylindrical or spherical symmetry. Here we offer a unified treatment of these apparently disconnected problems . We study the flow of an ideal gas with adiabatic index $\gamma$ with initial density $\rho\sim r^{-\omega}$, containing a strong shock wave. We characterize the self-similar solutions in the entirety of the parameter space $\gamma,\omega$, and draw the connections between the different geometries. We find that only type II self-similar solutions are valid in converging shocks, and that in some cases, a converging shock might not create a reflected shock after its convergence. Finally, we derive analytical approximations for the similarity exponent in the entirety of parameter space.


title: Joint Rate Distortion Function of a Tuple of Correlated Multivariate Gaussian Sources with Individual Fidelity Criteria

abstract: In this paper we analyze the joint rate distortion function (RDF), for a tuple of correlated sources taking values in abstract alphabet spaces (i.e., continuous) subject to two individual distortion criteria. First, we derive structural properties of the realizations of the reproduction Random Variables (RVs), which induce the corresponding optimal test channel distributions of the joint RDF. Second, we consider a tuple of correlated multivariate jointly Gaussian RVs, $X_1 : \Omega \rightarrow {\mathbb R}^{p_1}, X_2 : \Omega \rightarrow {\mathbb R}^{p_2}$ with two square-error fidelity criteria, and we derive additional structural properties of the optimal realizations, and use these to characterize the RDF as a convex optimization problem with respect to the parameters of the realizations. We show that the computation of the joint RDF can be performed by semidefinite programming. Further, we derive closed-form expressions of the joint RDF, such that Gray's [1] lower bounds hold with equality, and verify their consistency with the semidefinite programming computations.


title: An Axiom for Concavifiable Preferences in View of Alt's Theory

abstract: We present a necessary and sufficient condition for Alt's system to be represented by a continuous utility function. Moreover, we present a necessary and sufficient condition for this utility function to be concave. The latter condition can be seen as an extension of Gossen's first law, and thus has an economic interpretation. Together with the above results, we provide a necessary and sufficient condition for Alt's utility to be continuously differentiable.


title: Double-descent curves in neural networks: a new perspective using Gaussian processes

abstract: Double-descent curves in neural networks describe the phenomenon that the generalisation error initially descends with increasing parameters, then grows after reaching an optimal number of parameters which is less than the number of data points, but then descends again in the overparameterized regime. In this paper, we use techniques from random matrix theory to characterize the spectral distribution of the empirical feature covariance matrix as a width-dependent perturbation of the spectrum of the neural network Gaussian process (NNGP) kernel, thus establishing a novel connection between the NNGP literature and the random matrix theory literature in the context of neural networks. Our analytical expression allows us to study the generalisation behavior of the corresponding kernel and GP regression, and provides a new interpretation of the double-descent phenomenon, namely as governed by the discrepancy between the width-dependent empirical kernel and the width-independent NNGP kernel.


title: Concomitant appearance of conductivity and superconductivity in (111)LaAlO3/SrTiO3 interface with metal capping

abstract: In polar-oxide interfaces, a certain number of monolayers (ML) is needed for conductivity to appear. This threshold for conductivity is explained by accumulating sufficient electric potential to initiate charge transfer to the interface. Here we study experimentally and theoretically the (111) SrTiO3/LaAlO3 interface where a critical thickness, tc, of nine epitaxial LaAlO3 ML is required to turn the interface from insulating to conducting and even superconducting. We show that tc decreases to 3ML when depositing a cobalt over-layer (capping) and 6ML for platinum capping. The latter result contrasts with the (100) interface, where platinum capping increases tc beyond the bare interface. The observed threshold for conductivity for the bare and the metal-capped interfaces is confirmed by our density functional theory calculations. Interestingly, for (111) SrTiO3/LaAlO3/Metal interfaces, conductivity appears concomitantly with superconductivity in contrast with the (100) SrTiO3/LaAlO3/Metal interfaces where tc is smaller than the critical thickness for superconductivity. We attribute this dissimilarity to the different orbital polarization of e'g for the (111) versus dxy for the (001) interface.


title: Good-case Latency of Byzantine Broadcast: A Complete Categorization

abstract: This paper explores the problem good-case latency of Byzantine fault-tolerant broadcast, motivated by the real-world latency and performance of practical state machine replication protocols. The good-case latency measures the time it takes for all non-faulty parties to commit when the designated broadcaster is non-faulty. We provide a complete characterization of tight bounds on good-case latency, in the authenticated setting under synchrony, partial synchrony and asynchrony. Some of our new results may be surprising, e.g., 2-round PBFT-style partially synchronous Byzantine broadcast is possible if and only if $n\geq 5f-1$, and a tight bound for good-case latency under $n/3<f<n/2$ under synchrony is not an integer multiple of the delay bound.


title: Ramsey theory over partitions I: Positive Ramsey relations from forcing axioms

abstract: In this series of papers, we advance Ramsey theory of colorings over partitions. In this part, a correspondence between anti-Ramsey properties of partitions and chain conditions of the natural forcing notions that homogenize colorings over them is uncovered. At the level of the first uncountable cardinal this gives rise to a duality theorem under Martin's Axiom: a function $p:[\omega_1]^2\rightarrow\omega$ witnesses a weak negative Ramsey relation when $p$ plays the role of a coloring if and only if a positive Ramsey relation holds over $p$ when $p$ plays the role of a partition. The consistency of positive Ramsey relations over partitions does not stop at the first uncountable cardinal: it is established that at any prescribed uncountable cardinal these relations follow from forcing axioms without large cardinal strength. This result solves in particular two problems from [CKS21].


title: Higgs alignment and the top quark

abstract: There is a surprising connection between the top quark and Higgs alignment in Gildener-Weinberg multi-Higgs doublet models. Were it not for the top quark and its large mass, the coupling of the 125 GeV Higgs boson $H$ to gauge bosons and fermions would be indistinguishable from those of the Standard Model Higgs. The top quark's coupling to a single Higgs doublet breaks this perfect alignment in higher orders of the Coleman-Weinberg loop expansion of the effective potential. But the effect is still small, $< {\cal{O}}(1\%)$, and probably experimentally inaccessible.


title: Naturalizing Neuromorphic Vision Event Streams Using GANs

abstract: Dynamic vision sensors are able to operate at high temporal resolutions within resource constrained environments, though at the expense of capturing static content. The sparse nature of event streams enables efficient downstream processing tasks as they are suited for power-efficient spiking neural networks. One of the challenges associated with neuromorphic vision is the lack of interpretability of event streams. While most application use-cases do not intend for the event stream to be visually interpreted by anything other than a classification network, there is a lost opportunity to integrating these sensors in spaces that conventional high-speed CMOS sensors cannot go. For example, biologically invasive sensors such as endoscopes must fit within stringent power budgets, which do not allow MHz-speeds of image integration. While dynamic vision sensing can fill this void, the interpretation challenge remains and will degrade confidence in clinical diagnostics. The use of generative adversarial networks presents a possible solution to overcoming and compensating for a vision chip's poor spatial resolution and lack of interpretability. In this paper, we methodically apply the Pix2Pix network to naturalize the event stream from spike-converted CIFAR-10 and Linnaeus 5 datasets. The quality of the network is benchmarked by performing image classification of naturalized event streams, which converges to within 2.81% of equivalent raw images, and an associated improvement over unprocessed event streams by 13.19% for the CIFAR-10 and Linnaeus 5 datasets.


title: Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPS

abstract: Cyber Physical Systems (CPS) are characterized by their ability to integrate the physical and information or cyber worlds. Their deployment in critical infrastructure have demonstrated a potential to transform the world. However, harnessing this potential is limited by their critical nature and the far reaching effects of cyber attacks on human, infrastructure and the environment. An attraction for cyber concerns in CPS rises from the process of sending information from sensors to actuators over the wireless communication medium, thereby widening the attack surface. Traditionally, CPS security has been investigated from the perspective of preventing intruders from gaining access to the system using cryptography and other access control techniques. Most research work have therefore focused on the detection of attacks in CPS. However, in a world of increasing adversaries, it is becoming more difficult to totally prevent CPS from adversarial attacks, hence the need to focus on making CPS resilient. Resilient CPS are designed to withstand disruptions and remain functional despite the operation of adversaries. One of the dominant methodologies explored for building resilient CPS is dependent on machine learning (ML) algorithms. However, rising from recent research in adversarial ML, we posit that ML algorithms for securing CPS must themselves be resilient. This paper is therefore aimed at comprehensively surveying the interactions between resilient CPS using ML and resilient ML when applied in CPS. The paper concludes with a number of research trends and promising future research directions. Furthermore, with this paper, readers can have a thorough understanding of recent advances on ML-based security and securing ML for CPS and countermeasures, as well as research trends in this active research area.


title: Smoothness Matrices Beat Smoothness Constants: Better Communication Compression Techniques for Distributed Optimization

abstract: Large scale distributed optimization has become the default tool for the training of supervised machine learning models with a large number of parameters and training data. Recent advancements in the field provide several mechanisms for speeding up the training, including {\em compressed communication}, {\em variance reduction} and {\em acceleration}. However, none of these methods is capable of exploiting the inherently rich data-dependent smoothness structure of the local losses beyond standard smoothness constants. In this paper, we argue that when training supervised models, {\em smoothness matrices} -- information-rich generalizations of the ubiquitous smoothness constants -- can and should be exploited for further dramatic gains, both in theory and practice. In order to further alleviate the communication burden inherent in distributed optimization, we propose a novel communication sparsification strategy that can take full advantage of the smoothness matrices associated with local losses. To showcase the power of this tool, we describe how our sparsification technique can be adapted to three distributed optimization algorithms -- DCGD, DIANA and ADIANA -- yielding significant savings in terms of communication complexity. The new methods always outperform the baselines, often dramatically so.


title: Responsibility Management through Responsibility Networks

abstract: The safety management is critically important in the workplace. Unfortunately, responsibility issues therein such as inefficient supervision, poor evaluation and inadequate perception have not been properly addressed. To this end, in this paper, we deploy the Internet of Responsibilities (IoR) for responsibility management. Through the building of IoR framework, hierarchical responsibility management, automated responsibility evaluation at all level and efficient responsibility perception are achieved. The practical deployment of IoR system showed its effective responsibility management capability in various workplaces.


title: Reinforcement Learning for IoT Security: A Comprehensive Survey

abstract: The number of connected smart devices has been increasing exponentially for different Internet-of-Things (IoT) applications. Security has been a long run challenge in the IoT systems which has many attack vectors, security flaws and vulnerabilities. Securing billions of B connected devices in IoT is a must task to realize the full potential of IoT applications. Recently, researchers have proposed many security solutions for IoT. Machine learning has been proposed as one of the emerging solutions for IoT security and Reinforcement learning is gaining more popularity for securing IoT systems. Reinforcement learning, unlike other machine learning techniques, can learn the environment by having minimum information about the parameters to be learned. It solves the optimization problem by interacting with the environment adapting the parameters on the fly. In this paper, we present an comprehensive survey of different types of cyber-attacks against different IoT systems and then we present reinforcement learning and deep reinforcement learning based security solutions to combat those different types of attacks in different IoT systems. Furthermore, we present the Reinforcement learning for securing CPS systems (i.e., IoT with feedback and control) such as smart grid and smart transportation system. The recent important attacks and countermeasures using reinforcement learning B in IoT are also summarized in the form of tables. With this paper, readers can have a more thorough understanding of IoT security attacks and countermeasures using Reinforcement Learning, as well as research trends in this area.


title: Small size instanton contributions to the quark quasi-PDF and matching kernel

abstract: We investigate the non-perturbative contribution of instantons to current matching kernels used in the context of the large momentum effective theory (LaMET). We derive explicitly these contributions using first principle semi-classical calculus for the unpolarized and polarized quark parton distributions and the matching kernel, and show that they are part of a trans-series expansion. These contributions are substantial at current lattice matching momenta.


title: Effectual Topological Complexity

abstract: We introduce the effectual topological complexity (ETC) of a $G$-space $X$. This is a $G$-equivariant homotopy invariant sitting in between the effective topological complexity of the pair $(X,G)$ and the (regular) topological complexity of the orbit space $X/G$. We study ETC for spheres and surfaces with antipodal involution, obtaining a full computation in the case of the torus. This allows us to prove the vanishing of twice the non-trivial obstruction responsible for the fact that the topological complexity of the Klein bottle is 4. In addition, this gives a counterexample to the possibility -- suggested in Pave\v{s}i\'c's work on the topological complexity of a map -- that ETC of $(X,G)$ would agree with Farber's $TC(X)$ whenever the projection map $X\to X/G$ is finitely sheeted. We conjecture that ETC of spheres with antipodal action recasts the Hopf invariant one problem, and describe (conjecturally optimal) effectual motion planners.


title: Observation of Stark many-body localization without disorder

abstract: Thermalization is a ubiquitous process of statistical physics, in which details of few-body observables are washed out in favor of a featureless steady state. Even in isolated quantum many-body systems, limited to reversible dynamics, thermalization typically prevails. However, in these systems, there is another possibility: many-body localization (MBL) can result in preservation of a non-thermal state. While disorder has long been considered an essential ingredient for this phenomenon, recent theoretical work has suggested that a quantum many-body system with a uniformly increasing field -- but no disorder -- can also exhibit MBL, resulting in `Stark MBL.' Here we realize Stark MBL in a trapped-ion quantum simulator and demonstrate its key properties: halting of thermalization and slow propagation of correlations. Tailoring the interactions between ionic spins in an effective field gradient, we directly observe their microscopic equilibration for a variety of initial states, and we apply single-site control to measure correlations between separate regions of the spin chain. Further, by engineering a varying gradient, we create a disorder-free system with coexisting long-lived thermalized and nonthermal regions. The results demonstrate the unexpected generality of MBL, with implications about the fundamental requirements for thermalization and with potential uses in engineering long-lived non-equilibrium quantum matter.


title: Graphene oxide films for ultra-flat optics and linear and nonlinear integrated photonic circuits

abstract: With superior optical properties, high flexibility in engineering its material properties, and strong capability for large-scale on-chip integration, graphene oxide (GO) is an attractive solution for on-chip integration of two-dimensional (2D) materials to implement functional integrated photonic devices capable of new features. Over the past decade, integrated GO photonics, representing an innovative merging of integrated photonic devices and thin GO films, has experienced significant development, leading to a surge in many applications covering almost every field of optical sciences. This paper reviews the recent advances in this emerging field, providing an overview of the optical properties of GO as well as methods for the on-chip integration of GO. The main achievements made in GO hybrid integrated photonic devices for diverse applications are summarized. The open challenges as well as the potential for future improvement are also discussed.


title: On Topology Optimization and Routing in Integrated Access and Backhaul Networks: A Genetic Algorithm-based Approach

abstract: In this paper, we study the problem of topology optimization and routing in integrated access and backhaul (IAB) networks, as one of the promising techniques for evolving 5G networks. We study the problem from different perspectives. We develop efficient genetic algorithm-based schemes for both IAB node placement and non-IAB backhaul link distribution, and evaluate the effect of routing on bypassing temporal blockages. Here, concentrating on millimeter wave-based communications, we study the service coverage probability, defined as the probability of the event that the user equipments' (UEs) minimum rate requirements are satisfied. Moreover, we study the effect of different parameters such as the antenna gain, blockage and tree foliage on the system performance. Finally, we summarize the recent Rel-16 as well as the upcoming Rel-17 3GPP discussions on routing in IAB networks, and discuss the main challenges for enabling mesh-based IAB networks. As we show, with a proper network topology, IAB is an attractive approach to enable the network densification required by 5G and beyond.


title: Modularity of minor-free graphs

abstract: We prove that a class of graphs with an excluded minor and with the maximum degree sublinear in the number of edges is maximally modular, that is, modularity tends to 1 as the number of edges tends to infinity.


title: Asymptotically Optimal Strategies For Combinatorial Semi-Bandits in Polynomial Time

abstract: We consider combinatorial semi-bandits with uncorrelated Gaussian rewards. In this article, we propose the first method, to the best of our knowledge, that enables to compute the solution of the Graves-Lai optimization problem in polynomial time for many combinatorial structures of interest. In turn, this immediately yields the first known approach to implement asymptotically optimal algorithms in polynomial time for combinatorial semi-bandits.


title: Frequency prediction from exact or self-consistent meanflows

abstract: A number of approximations have been proposed to estimate basic hydrodynamic quantities, in particular the frequency of a limit cycle. One of these, RZIF (for Real Zero Imaginary Frequency), calls for linearizing the governing equations about the mean flow and estimating the frequency as the imaginary part of the leading eigenvalue. A further reduction, the SCM (for Self-Consistent Model), approximates the mean flow as well, as resulting only from the nonlinear interaction of the leading eigenmode with itself. Both RZIF and SCM have proven dramatically successful for the archetypal case of the wake of a circular cylinder. Here, the SCM is applied to thermosolutal convection, for which a supercritical Hopf bifurcation gives rise to branches of standing waves and traveling waves. The SCM is solved by means of a full Newton method coupling the approximate mean flow and leading eigenmode. Although the RZIF property is verified for the traveling waves, the SCM reproduces the nonlinear frequency only very near the onset of the bifurcation and for another isolated parameter value. Thus, the nonlinear interaction arising from the leading mode is insufficient to reproduce the nonlinear mean field and frequency.


title: A learning-based multiscale method and its application to inelastic impact problems

abstract: The macroscopic properties of materials that we observe and exploit in engineering application result from complex interactions between physics at multiple length and time scales: electronic, atomistic, defects, domains etc. Multiscale modeling seeks to understand these interactions by exploiting the inherent hierarchy where the behavior at a coarser scale regulates and averages the behavior at a finer scale. This requires the repeated solution of computationally expensive finer-scale models, and often a priori knowledge of those aspects of the finer-scale behavior that affect the coarser scale (order parameters, state variables, descriptors, etc.). We address this challenge in a two-scale setting where we learn the fine-scale behavior from off-line calculations and then use the learnt behavior directly in coarse scale calculations. The approach draws from recent successes of deep neural networks, in combination with ideas from model reduction. The approach builds on the recent success of deep neural networks by combining their approximation power in high dimensions with ideas from model reduction. It results in a neural network approximation that has high fidelity, is computationally inexpensive, is independent of the need for a priori knowledge, and can be used directly in the coarse scale calculations. We demonstrate the approach on problems involving the impact of magnesium, a promising light-weight structural and protective material.


title: An Algorithm for Reconstructing the Orphan Stream Progenitor with MilkyWay@home Volunteer Computing

abstract: We have developed a method for estimating the properties of the progenitor dwarf galaxy from the tidal stream of stars that were ripped from it as it fell into the Milky Way. In particular, we show that the mass and radial profile of a progenitor dwarf galaxy evolved along the orbit of the Orphan Stream, including the stellar and dark matter components, can be reconstructed from the distribution of stars in the tidal stream it produced. We use MilkyWay@home, a PetaFLOPS-scale distributed supercomputer, to optimize our dwarf galaxy parameters until we arrive at best-fit parameters. The algorithm fits the dark matter mass, dark matter radius, stellar mass, radial profile of stars, and orbital time. The parameters are recovered even though the dark matter component extends well past the half light radius of the dwarf galaxy progenitor, proving that we are able to extract information about the dark matter halos of dwarf galaxies from the tidal debris. Our simulations assumed that the Milky Way potential, dwarf galaxy orbit, and the form of the density model for the dwarf galaxy were known exactly; more work is required to evaluate the sources of systematic error in fitting real data. This method can be used to estimate the dark matter content in dwarf galaxies without the assumption of virial equilibrium that is required to estimate the mass using line-of-sight velocities. This demonstration is a first step towards building an infrastructure that will fit the Milky Way potential using multiple tidal streams.


title: A Glimpse of Physical Layer Decision Mechanisms: Facts, Challenges, and Remedies

abstract: Communications are realized as a result of successive decisions at the physical layer, from modulation selection to multi-antenna strategy, and each decision affects the performance of the communication systems. Future communication systems must include extensive capabilities as they will encompass a wide variety of devices and applications. Conventional physical layer decision mechanisms may not meet these requirements, as they are often based on impractical and oversimplifying assumptions that result in a trade-off between complexity and efficiency. By leveraging past experiences, learning-driven designs are promising solutions to present a resilient decision mechanism and enable rapid response even under exceptional circumstances. The corresponding design solutions should evolve following the lines of learning-driven paradigms that offer more autonomy and robustness. This evolution must take place by considering the facts of real-world systems and without restraining assumptions. In this paper, the common assumptions in the physical layer are presented to highlight their discrepancies with practical systems. As a solution, learning algorithms are examined by considering the implementation steps and challenges. Furthermore, these issues are discussed through a real-time case study using software-defined radio nodes to demonstrate the potential performance improvement. A cyber-physical framework is presented to incorporate future remedies.


title: Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognition

abstract: Attention is a very popular and effective mechanism in artificial neural network-based sequence-to-sequence models. In this survey paper, a comprehensive review of the different attention models used in developing automatic speech recognition systems is provided. The paper focuses on the development and evolution of attention models for offline and streaming speech recognition within recurrent neural network- and Transformer- based architectures.


title: PCM-trace: Scalable Synaptic Eligibility Traces with Resistivity Drift of Phase-Change Materials

abstract: Dedicated hardware implementations of spiking neural networks that combine the advantages of mixed-signal neuromorphic circuits with those of emerging memory technologies have the potential of enabling ultra-low power pervasive sensory processing. To endow these systems with additional flexibility and the ability to learn to solve specific tasks, it is important to develop appropriate on-chip learning mechanisms.Recently, a new class of three-factor spike-based learning rules have been proposed that can solve the temporal credit assignment problem and approximate the error back-propagation algorithm on complex tasks. However, the efficient implementation of these rules on hybrid CMOS/memristive architectures is still an open challenge. Here we present a new neuromorphic building block,called PCM-trace, which exploits the drift behavior of phase-change materials to implement long lasting eligibility traces, a critical ingredient of three-factor learning rules. We demonstrate how the proposed approach improves the area efficiency by >10X compared to existing solutions and demonstrates a techno-logically plausible learning algorithm supported by experimental data from device measurements


title: Mappings with the inverse Poletsky inequality are discrete on the boundary

abstract: It is established a continuous boundary extension of some class of mappings. Under some additional conditions, we have established that this extension is light in the closure of the definition domain. Under some stronger conditions, we also have proved that it is open and discrete there.


title: Destabilization of ferromagnetism by frustration and realization of a nonmagnetic Mott transition in the quarter-filled two-orbital Hubbard model

abstract: The two-orbital Hubbard model on a square lattice at quarter filling (electron number per site $n=1$) is investigated by the variational Monte Carlo method. For the variational wave function, we include short-range doublon-holon binding factors. We find that the energy of this wave function is lower than that of the density-density Jastrow wave function partially including long-range correlations used in a previous study. We introduce frustration to the model by the next-nearest-neighbor hopping $t'$ in addition to the nearest-neighbor hopping $t$. For $t'=0$, a ferromagnetic state with staggered orbital order occurs by increasing the Coulomb interaction $U$ before the Mott transition takes place. By increasing $t'$, the region of this ferromagnetic phase shrinks, and the Mott transition without magnetic order occurs.


title: A benchmark for the Bayesian inversion of coefficients in partial differential equations

abstract: Bayesian methods have been widely used in the last two decades to infer statistical properties of spatially variable coefficients in partial differential equations from measurements of the solutions of these equations. Yet, in many cases the number of variables used to parameterize these coefficients is large, and obtaining meaningful statistics of their values is difficult using simple sampling methods such as the basic Metropolis-Hastings (MH) algorithm -- in particular if the inverse problem is ill-conditioned or ill-posed. As a consequence, many advanced sampling methods have been described in the literature that converge faster than MH, for example by exploiting hierarchies of statistical models or hierarchies of discretizations of the underlying differential equation. At the same time, it remains difficult for the reader of the literature to quantify the advantages of these algorithms because there is no commonly used benchmark. This paper presents a benchmark Bayesian inverse problem -- namely, the determination of a spatially-variable coefficient, discretized by 64 values, in a Poisson equation, based on point measurements of the solution -- that fills the gap between widely used simple test cases (such as superpositions of Gaussians) and real applications that are difficult to replicate for developers of sampling algorithms. We provide a complete description of the test case, and provide an open source implementation that can serve as the basis for further experiments. We have also computed $2\times 10^{11}$ samples, at a cost of some 30 CPU years, of the posterior probability distribution from which we have generated detailed and accurate statistics against which other sampling algorithms can be tested.


title: Modeling Electrical Resistance Drift with Ultrafast Saturation of OTS Selectors

abstract: Crossbar array architecture is an essential design element for densely connected Non-Volatile Memory(NVM) applications. To overcome intrinsic sneak current problem of crossbar arrays, each memory unit is serially attached to a selector unit with highly nonlinear current-voltage (I-V) characteristics. Recently, Ovonic Threshold Switching (OTS) materials are preferred as selectors due to their fabrication compatibility with PRAM, MRAM or ReRAM technologies; however, OTS selectors suffer from the temporal drift of its threshold voltage. First, based on Poole-Frenkel conduction, we present time and temperature dependent model that predicts temporally evolving I-V characteristics,including threshold voltage of OTS selectors. Second, we report an ultrafast saturation ($\sim 10^3$ seconds) of the drift and extend the model to predict the time of drift saturation. Our model shows excellent agreement with OTS devices fabricated with 8 nm technology node at 25{\deg}C and 85{\deg}C ambient temperatures. The proposed model plays a significant role in understanding OTS device internals and the development of reliable threshold voltage jump table.


title: Exploring Adversarial Robustness of Deep Metric Learning

abstract: Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is small while dissimilar ones are far apart. Although the underlying neural networks produce good accuracy on naturally occurring samples, they are vulnerable to adversarially-perturbed samples that reduce performance. We take a first step towards training robust DML models and tackle the primary challenge of the metric losses being dependent on the samples in a mini-batch, unlike standard losses that only depend on the specific input-output pair. We analyze this dependence effect and contribute a robust optimization formulation. Using experiments on three commonly-used DML datasets, we demonstrate 5-76 fold increases in adversarial accuracy, and outperform an existing DML model that sought out to be robust.


title: Sparse Attention Guided Dynamic Value Estimation for Single-Task Multi-Scene Reinforcement Learning

abstract: Training deep reinforcement learning agents on environments with multiple levels / scenes from the same task, has become essential for many applications aiming to achieve generalization and domain transfer from simulation to the real world. While such a strategy is helpful with generalization, the use of multiple scenes significantly increases the variance of samples collected for policy gradient computations. Current methods, effectively continue to view this collection of scenes as a single Markov decision process (MDP), and thus learn a scene-generic value function V(s). However, we argue that the sample variance for a multi-scene environment is best minimized by treating each scene as a distinct MDP, and then learning a joint value function V(s,M) dependent on both state s and MDP M. We further demonstrate that the true joint value function for a multi-scene environment, follows a multi-modal distribution which is not captured by traditional CNN / LSTM based critic networks. To this end, we propose a dynamic value estimation (DVE) technique, which approximates the true joint value function through a sparse attention mechanism over multiple value function hypothesis / modes. The resulting agent not only shows significant improvements in the final reward score across a range of OpenAI ProcGen environments, but also exhibits enhanced navigation efficiency and provides an implicit mechanism for unsupervised state-space skill decomposition.


title: Open model-based analysis of a 100% renewable and sector-coupled energy system -- The case of Germany in 2050

abstract: The ambitious energy target to achieve climate-neutrality in the European Union (EU) energy system raises the feasibility question of using only renewables across all energy sectors. As one of the EU's leading industrialized countries, Germany has adopted several climate-action plans for the realistic implementation and maximum utilization of renewable energies in its energy system. The literature review shows a clear gap in comprehensive techniques describing an open modeling approach for analyzing fully renewable and sector-coupled energy systems. This paper outlines a method for analyzing the 100% renewable-based and sector-coupled energy system's feasibility in Germany. Based on the open energy modeling framework, an hourly optimization tool 'OSeEM-DE' is developed to investigate the German energy system. The model results show that a 100% renewable-based and sector-coupled system for electricity and building heat is feasible in Germany. The investment capacities and component costs depend on the parametric variations of the developed scenarios. The annual investment costs vary between 17.6 and 26.6 bn Euro/yr for volatile generators and between 23.7 and 28.8 bn Euro/yr for heat generators. The model suggests an investment of a minimum of 2.7-3.9 bn Euro/yr for electricity and heat storage. Comparison of OSeEM-DE results with recent studies validates the percentage-wise energy mix composition and the calculated Levelized Cost of Electricity (LCOE) values from the model. Sensitivity analyses indicate that storage and grid expansion maximize the system's flexibility and decrease the investment cost. The study concludes by showing how the tool can analyze different energy systems in the EU context.


title: Using analog computers in today's largest computational challenges

abstract: Analog computers can be revived as a feasible technology platform for low precision, energy efficient and fast computing. We justify this statement by measuring the performance of a modern analog computer and comparing it with that of traditional digital processors. General statements are made about the solution of ordinary and partial differential equations. Computational fluid dynamics are discussed as an example of large scale scientific computing applications. Several models are proposed which demonstrate the benefits of analog and digital-analog hybrid computing.


title: The combinatorics of Jeff Remmel

abstract: We give a brief overview of the life and combinatorics of Jeff Remmel, a mathematician with successful careers in both logic and combinatorics.


title: Representation of non-special curves of genus 5 as plane sextic curves and its application to finding curves with many rational points

abstract: In algebraic geometry, it is important to provide effective parametrizations for families of curves, both in theory and in practice. In this paper, we present such an effective parametrization for the moduli of genus-$5$ curves that are neither hyperelliptic nor trigonal. Subsequently, we construct an algorithm for a complete enumeration of non-special genus-$5$ curves having more rational points than a specified bound, where ``non-special curve'' means that the curve is non-hyperelliptic and non-trigonal with mild singularities of the associated sextic model that we propose. As a practical application, we implement this algorithm using the computer algebra system MAGMA, specifically for curves over the prime field of characteristic $3$.


title: Attention-gated convolutional neural networks for off-resonance correction of spiral real-time MRI

abstract: Spiral acquisitions are preferred in real-time MRI because of their efficiency, which has made it possible to capture vocal tract dynamics during natural speech. A fundamental limitation of spirals is blurring and signal loss due to off-resonance, which degrades image quality at air-tissue boundaries. Here, we present a new CNN-based off-resonance correction method that incorporates an attention-gate mechanism. This leverages spatial and channel relationships of filtered outputs and improves the expressiveness of the networks. We demonstrate improved performance with the attention-gate, on 1.5 Tesla spiral speech RT-MRI, compared to existing off-resonance correction methods.


title: Observing the Time Evolution of the Multi-Component Nucleus of 3C\,84

abstract: The advent of global mm-band Very Long Baseline Interferometry (VLBI) in recent years has finally revealed the morphology of the base of the two most prominent nearby, bright, extragalactic radio jets in M\,87 and 3C\,84. The images are quite surprising considering the predictions of jet theory and current numerical modeling. The jet bases are extremely wide compared to expectations and the nucleus of 3C\,84 is very complicated. It appears as a double in 86\,GHz observations with 50\,$\mu$as resolution and a triple nucleus with 30\,$\mu$as resolution with space-based VLBI by RadioAstron at 22\,GHz. What is even odder is that the double and triple are arranged along an east-west line that is approximately orthogonal to the north-south large scale jet on 150\,$\mu$as $-$ 4\,mas scales. We explore the emergence of an (east-west) double nucleus in the lower resolution 43\,GHz Very Long Baseline Array (VLBA) imaging from August 2018 to April 2020. The double is marginally resolved. We exploit the east-west resolution associated with the longest baselines, $\sim 0.08$\,mas, to track a predominantly east-west separation speed of $\approx 0.086\pm 0.008$\,c. We estimate that the observed mildly relativistic speed persists over a de-projected distance of $\sim 1900-9800$ times the central, supermassive black hole, gravitational radius ($\sim 0.3-1.5$\,lt-yrs) from the point of origin.


title: Multiple ergodic averages in abelian groups and Khintchine type recurrence

abstract: Let $G$ be a countable abelian group. We study ergodic averages associated with configurations of the form $\{ag,bg,(a+b)g\}$ for some $a,b\in\mathbb{Z}$. Under some assumptions on $G$, we prove that the universal characteristic factor for these averages is a factor of a $2$-step nilpotent homogeneous space. As an application we derive a Khintchine type recurrence result. In particular, we prove that for every countable abelian group $G$, if $a,b\in\mathbb{Z}$ are such that $aG,bG,(b-a)G$ and $(a+b)G$ are of finite index in $G$, then for every $E\subset G$ and $\varepsilon>0$ the set $$\{g\in G : d(E\cap E-ag\cap E-bg\cap E-(a+b)g)\geq d(E)^4-\varepsilon\}$$ is syndetic. This generalizes previous results for $G=\mathbb{Z}$, $G=\mathbb{F}_p^\omega$ and $G=\bigoplus_{p\in P}\mathbb{F}_p$ by Bergelson Host and Kra, Bergelson Tao and Ziegler and the author, respectively.


title: Probing photoinduced proton coupled electron transfer process by means of two-dimensional resonant electronic-vibrational spectroscopy

abstract: We develop a detailed theoretical model of photo-induced proton-coupled electron transfer (PPCET) processes, which are at the basis of solar energy harvesting in biological systems and photovoltaic materials. Our model enables to analyze the dynamics and the efficiency of a PPCET reaction under the influence of a thermal environment by disentangling the contribution of the fundamental electron transfer (ET) and proton transfer (PT) steps. In order to study quantum dynamics of the PPCET process under an interaction with non-Markovian environment we employ the hierarchical equations of motion (HEOM). We calculate transient absorption spectroscopy (TAS) and a newly defined two-dimensional resonant electronic-vibrational spectroscopy (2DREVS) signals in order to study the nonequilibrium reaction dynamics. Our results show that different transition pathways can be separated by TAS and 2DREVS.