title: Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Data

abstract: Electronic Health Record (EHR) data has been of tremendous utility in Artificial Intelligence (AI) for healthcare such as predicting future clinical events. These tasks, however, often come with many challenges when using classical machine learning models due to a myriad of factors including class imbalance and data heterogeneity (i.e., the complex intra-class variances). To address some of these research gaps, this paper leverages the exciting contrastive learning framework and proposes a novel contrastive regularized clinical classification model. The contrastive loss is found to substantially augment EHR-based prediction: it effectively characterizes the similar/dissimilar patterns (by its "push-and-pull" form), meanwhile mitigating the highly skewed class distribution by learning more balanced feature spaces (as also echoed by recent findings). In particular, when naively exporting the contrastive learning to the EHR data, one hurdle is in generating positive samples, since EHR data is not as amendable to data augmentation as image data. To this end, we have introduced two unique positive sampling strategies specifically tailored for EHR data: a feature-based positive sampling that exploits the feature space neighborhood structure to reinforce the feature learning; and an attribute-based positive sampling that incorporates pre-generated patient similarity metrics to define the sample proximity. Both sampling approaches are designed with an awareness of unique high intra-class variance in EHR data. Our overall framework yields highly competitive experimental results in predicting the mortality risk on real-world COVID-19 EHR data with a total of 5,712 patients admitted to a large, urban health system. Specifically, our method reaches a high AUROC prediction score of 0.959, which outperforms other baselines and alternatives: cross-entropy(0.873) and focal loss(0.931).


title: Does the First Response Matter for Future Contributions? A Study of First Contributions

abstract: Open Source Software (OSS) projects rely on a continuous stream of new contributors for their livelihood. Recent studies reported that new contributors experience many barriers in their first contribution, with the social barrier being critical. Although a number of studies investigated the social barriers to new contributors, we hypothesize that negative first responses may cause an unpleasant feeling, and subsequently lead to the discontinuity of any future contribution. We execute protocols of a registered report to analyze 2,765,917 first contributions as Pull Requests (PRs) with 642,841 first responses. We characterize most first response as being positive, but less responsive, and exhibiting sentiments of fear, joy and love. Results also indicate that negative first responses have the literal intention to arouse emotions of being either constructive (50.71%) or criticizing (37.68%) in nature. Running different machine learning models, we find that predicting future interactions is low (F1 score of 0.6171), but relatively better than baselines. Furthermore, an analysis of these models show that interactions are positively correlated with a future contribution, with other dimensions (i.e., project, contributor, contribution) having a large effect.


title: A Question-answering Based Framework for Relation Extraction Validation

abstract: Relation extraction is an important task in knowledge acquisition and text understanding. Existing works mainly focus on improving relation extraction by extracting effective features or designing reasonable model structures. However, few works have focused on how to validate and correct the results generated by the existing relation extraction models. We argue that validation is an important and promising direction to further improve the performance of relation extraction. In this paper, we explore the possibility of using question answering as validation. Specifically, we propose a novel question-answering based framework to validate the results from relation extraction models. Our proposed framework can be easily applied to existing relation classifiers without any additional information. We conduct extensive experiments on the popular NYT dataset to evaluate the proposed framework, and observe consistent improvements over five strong baselines.


title: TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognition

abstract: The high temporal resolution and the asymmetric spatial activations are essential attributes of electroencephalogram (EEG) underlying emotional processes in the brain. To learn the temporal dynamics and spatial asymmetry of EEG towards accurate and generalized emotion recognition, we propose TSception, a multi-scale convolutional neural network that can classify emotions from EEG. TSception consists of dynamic temporal, asymmetric spatial, and high-level fusion layers, which learn discriminative representations in the time and channel dimensions simultaneously. The dynamic temporal layer consists of multi-scale 1D convolutional kernels whose lengths are related to the sampling rate of EEG, which learns the dynamic temporal and frequency representations of EEG. The asymmetric spatial layer takes advantage of the asymmetric EEG patterns for emotion, learning the discriminative global and hemisphere representations. The learned spatial representations will be fused by a high-level fusion layer. Using more generalized cross-validation settings, the proposed method is evaluated on two publicly available datasets DEAP and MAHNOB-HCI. The performance of the proposed network is compared with prior reported methods such as SVM, KNN, FBFgMDM, FBTSC, Unsupervised learning, DeepConvNet, ShallowConvNet, and EEGNet. TSception achieves higher classification accuracies and F1 scores than other methods in most of the experiments. The codes are available at https://github.com/yi-ding-cs/TSception


title: Understanding the Benefit of Being Patient in Payment Channel Networks

abstract: Scaling blockchain efficiency is crucial to its widespread usage in which the payment channel is one of the most prominent approaches. With payment channels and the network they construct, two users can move some transactions off-chain in a predetermined duration to avoid expensive and time-consuming on-chain settlements. Existing work is devoted to designing high-throughput payment channel networks (PCNs) or efficient PCN routing policies to reduce the fee. In this paper, we investigate the PCN routing from a different perspective by answering whether the routing fee of transactions can be saved by being a bit more patient. The key idea is to reorder the processing sequence of atomic transactions, other than to handle each of them separately and immediately. We present two mechanisms, one is periodic transaction processing assisted by a PCN broker and the other is purely strategic waiting. In the former, all the incoming transactions in a short time interval are processed collectively. We formulate an optimization model to minimize their total routing fee and derive the optimal permutation of processing transactions as well as the routing policy for each of them. A Shapley value based scheme is presented to redistribute the benefit of reordering among the transactions efficiently and fairly. In the latter, we model the waiting time of a strategic transaction on a single payment channel as the first passage time problem in queueing theory when the transaction value is higher than the edge capacity upon its arrival. By capturing the capacity dynamics, we are able to calculate the recursive expression of waiting for time distribution that is useful to gauge a user's cost of patience. Experimental results manifest that our cost redistribution mechanism can effectively save routing fees for all the transactions, and the waiting time distribution coincides with the model well.


title: Polynomial Anonymous Dynamic Distributed Computing without a Unique Leader

abstract: Counting the number of nodes in Anonymous Dynamic Networks is enticing from an algorithmic perspective: an important computation in a restricted platform with promising applications. Starting with Michail, Chatzigiannakis, and Spirakis [19], a flurry of papers sped up the running time guarantees from doubly-exponential to polynomial [16]. There is a common theme across all those works: a distinguished node is assumed to be present, because Counting cannot be solved deterministically without at least one. In the present work we study challenging questions that naturally follow: how to efficiently count with more than one distinguished node, or how to count without any distinguished node. More importantly, what is the minimal information needed about these distinguished nodes and what is the best we can aim for (count precision, stochastic guarantees, etc.) without any. We present negative and positive results to answer these questions. To the best of our knowledge, this is the first work that addresses them.


title: Deep Interpretable Models of Theory of Mind

abstract: When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) not interpretable and 2) only model external behavior, ignoring internal mental states, which potentially limits their capability for assistance, interventions, discovering false beliefs, etc. To this end, we develop an interpretable modular neural framework for modeling the intentions of other observed entities. We demonstrate the efficacy of our approach with experiments on data from human participants on a search and rescue task in Minecraft, and show that incorporating interpretability can significantly increase predictive performance under the right conditions.


title: OpenGAN: Open-Set Recognition via Open Data Generation

abstract: Real-world machine learning systems need to analyze test data that may differ from training data. In K-way classification, this is crisply formulated as open-set recognition, core to which is the ability to discriminate open-set data outside the K closed-set classes. Two conceptually elegant ideas for open-set discrimination are: 1) discriminatively learning an open-vs-closed binary discriminator by exploiting some outlier data as the open-set, and 2) unsupervised learning the closed-set data distribution with a GAN, using its discriminator as the open-set likelihood function. However, the former generalizes poorly to diverse open test data due to overfitting to the training outliers, which are unlikely to exhaustively span the open-world. The latter does not work well, presumably due to the instable training of GANs. Motivated by the above, we propose OpenGAN, which addresses the limitation of each approach by combining them with several technical insights. First, we show that a carefully selected GAN-discriminator on some real outlier data already achieves the state-of-the-art. Second, we augment the available set of real open training examples with adversarially synthesized "fake" data. Third and most importantly, we build the discriminator over the features computed by the closed-world K-way networks. This allows OpenGAN to be implemented via a lightweight discriminator head built on top of an existing K-way network. Extensive experiments show that OpenGAN significantly outperforms prior open-set methods.


title: A Southern-Hemisphere all-sky radio transient monitor for SKA-Low prototype stations

abstract: We present the first southern-hemisphere all-sky imager and radio-transient monitoring system implemented on two prototype stations of the low-frequency component of the Square Kilometre Array. Since its deployment the system has been used for real-time monitoring of the recorded commissioning data. Additionally, a transient searching algorithm has been executed on the resulting all-sky images. It uses a difference imaging technique, and has enabled identification of a wide variety of transient classes, ranging from human-made radio-frequency interference to genuine astrophysical events. Observations at the frequency 159.4 MHz and higher in a single coarse channel (0.926 MHz) were made with 2s time resolution, and multiple nights were analysed. Despite having modest sensitivity (~few Jy/beam), using a single coarse channel and 2-s imaging, the system detected bright transients from PSR B0950+08, proving that it can be used to detect bright transients of an astrophysical origin. The unusual, extreme activity of the pulsar PSR B0950+08 (up to ~155 Jy/beam) was initially detected in a "blind" search in the 2020-04-10/11 data and later assigned to this specific pulsar. The limitations of our data, however, prevent use from making firm conclusions of the effect being due to a combination of refractive and diffractive scintillation or intrinsic emission mechanisms. The system can routinely collect data over many days without interruptions; the large amount of recorded data at 159.4 and 229.7 MHz allowed us to determine a preliminary transient surface density upper limit of $1.32 \times 10^{-9} \text{deg}^{-2}$ for a timescale and limiting flux density of 2s and 42 Jy, respectively. We plan to extend the observing bandwidth to tens of MHz and improve time resolution to tens of milliseconds in order to increase the sensitivity and enable detections of Fast Radio Bursts below 300 MHz.


title: A Machine-Learning Surrogate Model for ab initio Electronic Correlations at Extreme Conditions

abstract: The electronic structure in matter under extreme conditions is a challenging complex system prevalent in astrophysical objects and highly relevant for technological applications. We show how machine-learning surrogates in terms of neural networks have a profound impact on the efficient modeling of matter under extreme conditions. We demonstrate the utility of a surrogate model that is trained on \emph{ab initio} quantum Monte Carlo data for various applications in the emerging field of warm dense matter research.


title: Comparing formulas for type $GL_n$ Macdonald polynomials

abstract: The paper compares (and reproves) the alcove walk and the nonattacking fillings formulas for type $GL_n$ Macdonald polynomials which were given in Haglund-Haiman-Loehr arXiv:math.CO/0601693, Alexandersson arXiv:1602.05153 and Ram-Yip arXiv:0803.1146. The "compression" relating the two formulas in this paper is the same as that of Lenart arXiv:0804.4716. We have reformulated it so that it holds without conditions and so that the proofs of the alcove walk formula and the nonattacking fillings formula are parallel. This reformulation highlights the role of the double affine Hecke algebra and Cherednik's intertwiners. An exposition of the type $GL_n$ double affine braid group, double affine Hecke algebra, and all definitions and proofs regarding Macdonald polynomials are provided to make this paper self contained.


title: Concentration Inequalities for Two-Sample Rank Processes with Application to Bipartite Ranking

abstract: The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in signal processing to information retrieval, through medical diagnosis. Most practical performance measures used in scoring/ranking applications such as the AUC, the local AUC, the p-norm push, the DCG and others, can be viewed as summaries of the ROC curve. In this paper, the fact that most of these empirical criteria can be expressed as two-sample linear rank statistics is highlighted and concentration inequalities for collections of such random variables, referred to as two-sample rank processes here, are proved, when indexed by VC classes of scoring functions. Based on these nonasymptotic bounds, the generalization capacity of empirical maximizers of a wide class of ranking performance criteria is next investigated from a theoretical perspective. It is also supported by empirical evidence through convincing numerical experiments.


title: Algebras of Reduced $E$-Fountain Semigroups and the Generalized Ample Identity

abstract: Let $S$ be a reduced $E$-Fountain semigroup. If $S$ satisfies the congruence condition, there is a natural construction of a category $\mathcal{C}$ associated with $S$. We define a $\Bbbk$-module homomorphism $\varphi:\Bbbk S\to\Bbbk\mathcal{C}$ (where $\Bbbk$ is any unital commutative ring). With some assumptions, we prove that $\varphi$ is an isomorphism of $\Bbbk$-algebras if and only if some weak form of the right ample identity holds in $S$. This gives a unified generalization for a result of the author on right restriction $E$-Ehresmann semigroups and a result of Margolis and Steinberg on the Catalan monoid.


title: Optimal Control for Structurally Sparse Systems using Graphical Inference

abstract: Dynamical systems with a distributed yet interconnected structure, like multi-rigid-body robots or large-scale multi-agent systems, introduce valuable sparsity into the system dynamics that can be exploited in an optimal control setting for speeding up computation and improving numerical conditioning. Conventional approaches for solving the Optimal Control Problem (OCP) rarely capitalize on such structural sparsity, and hence suffer from a cubic computational complexity growth as the dimensionality of the system scales. In this paper, we present an OCP formulation that relies on graphical models to capture the sparsely-interconnected nature of the system dynamics. Such a representational choice allows the use of contemporary graphical inference algorithms that enable our solver to achieve a linear time complexity in the state and control dimensions as well as the time horizon. We demonstrate the numerical and computational advantages of our approach on a canonical dynamical system in simulation.


title: Role of triaxiality in deformed halo nuclei

abstract: It is known that nuclear deformation plays an important role in inducing the halo structure in neutron-rich nuclei by mixing several angular momentum components. While previous theoretical studies on this problem in the literature assume axially symmetric deformation, we here consider non-axially symmetric deformations. With triaxial deformation, the $\Omega$ quantum number is admixed in a single-particle wave function, where $\Omega$ is the projection of the single-particle angular momentum on the symmetric axis, and the halo structure may arise even when it is absent with the axially symmetric deformation. In this way, the area of halo nuclei may be extended when triaxial deformation is considered. We demonstrate this idea using a deformed Woods-Saxon potential for nuclei with neutron number N=13 and 43.


title: Distantly Supervised Transformers For E-Commerce Product QA

abstract: We propose a practical instant question answering (QA) system on product pages of ecommerce services, where for each user query, relevant community question answer (CQA) pairs are retrieved. User queries and CQA pairs differ significantly in language characteristics making relevance learning difficult. Our proposed transformer-based model learns a robust relevance function by jointly learning unified syntactic and semantic representations without the need for human labeled data. This is achieved by distantly supervising our model by distilling from predictions of a syntactic matching system on user queries and simultaneously training with CQA pairs. Training with CQA pairs helps our model learning semantic QA relevance and distant supervision enables learning of syntactic features as well as the nuances of user querying language. Additionally, our model encodes queries and candidate responses independently allowing offline candidate embedding generation thereby minimizing the need for real-time transformer model execution. Consequently, our framework is able to scale to large e-commerce QA traffic. Extensive evaluation on user queries shows that our framework significantly outperforms both syntactic and semantic baselines in offline as well as large scale online A/B setups of a popular e-commerce service.


title: Nanobubble-induced flow of immersed glassy polymer films

abstract: We study the free-surface deformation dynamics of an immersed glassy thin polymer film supported on a substrate, induced by an air nanobubble at the free surface.We combine analytical and numerical treatments of the glassy thin film equation, resulting from the lubrication approximation applied to the surface mobile layer of the glassy film, under the driving of an axisymmetric step function in the pressure term accounting for the nanobubble's Laplace pressure. Using the method of Green's functions, we derive a general solution for the film profile. We show that the lateral extent of the surface perturbation follows an asymptotic viscocapillary power-law behaviour in time, and that the film's central height decays logarithmically in time in this regime. This process eventually leads to film rupture and dewetting at finite time, for which we provide an analytical prediction exhibiting explicitly the dependencies in surface mobility, film thickness and bubble size, among others. Finally, using finite-element numerical integration, we discuss how non-linear effects induced by the curvature and film profile can affect the evolution.


title: Laplace-aided variational inference for differential equation models

abstract: An ordinary differential equation (ODE) model, whose regression curves are a set of solution curves for some ODEs, poses a challenge in parameter estimation. The challenge, due to the frequent absence of analytic solutions and the complicated likelihood surface, tends to be more severe especially for larger models with many parameters and variables. Yang and Lee (2021) proposed a state-space model with variational Bayes (SSVB) for ODE, capable of fast and stable estimation in somewhat large ODE models. The method has shown excellent performance in parameter estimation but has a weakness of underestimation of the posterior covariance, which originates from the mean-field variational method. This paper proposes a way to overcome the weakness by using the Laplace approximation. In numerical experiments, the covariance modified by the Laplace approximation showed a high degree of improvement when checked against the covariances obtained by a standard Markov chain Monte Carlo method. With the improved covariance estimation, the SSVB renders fairly accurate posterior approximations.


title: Multivariate fractal interpolation functions: Some approximation aspects and an associated fractal interpolation operator

abstract: The natural kinship between classical theories of interpolation and approximation is well explored. In contrast to this, the interrelation between interpolation and approximation is subtle and this duality is relatively obscure in the context of fractal interpolation. The notion of $\alpha$-fractal function provides a proper foundation for the approximation theoretic facet of univariate fractal interpolation functions (FIFs). However, no comparable approximation theoretic aspects of FIFs has been developed for functions of several variables. The current article intends to open the door for intriguing interaction between approximation theory and multivariate FIFs. To this end, in the first part of this article, we develop a general framework to construct multivariate FIF, which is amenable to provide a multivariate analogue of the $\alpha$-fractal function. Multivariate $\alpha$-fractal functions provide a parameterized family of fractal approximants associated to a given multivariate continuous function. Some elementary aspects of the multivariate fractal nonlinear (not necessarily linear) interpolation operator that sends a continuous function defined on a hyper-rectangle to its fractal analogue is studied.


title: A hybrid inference system for improved curvature estimation in the level-set method using machine learning

abstract: We present a novel hybrid strategy based on machine learning to improve curvature estimation in the level-set method. The proposed inference system couples enhanced neural networks with standard numerical schemes to compute curvature more accurately. The core of our hybrid framework is a switching mechanism that relies on well established numerical techniques to gauge curvature. If the curvature magnitude is larger than a resolution-dependent threshold, it uses a neural network to yield a better approximation. Our networks are multilayer perceptrons fitted to synthetic data sets composed of sinusoidal- and circular-interface samples at various configurations. To reduce data set size and training complexity, we leverage the problem's characteristic symmetry and build our models on just half of the curvature spectrum. These savings lead to a powerful inference system able to outperform any of its numerical or neural component alone. Experiments with stationary, smooth interfaces show that our hybrid solver is notably superior to conventional numerical methods in coarse grids and along steep interface regions. Compared to prior research, we have observed outstanding gains in precision after training the regression model with data pairs from more than a single interface type and transforming data with specialized input preprocessing. In particular, our findings confirm that machine learning is a promising venue for reducing or removing mass loss in the level-set method.


title: Modelling rebrightenings, reflares, and echoes in dwarf nova outbursts

abstract: The disc instability model accounts well for most of the observed properties of dwarf novae and soft X-ray transients, but the rebrightenings, reflares, and echoes occurring at the end of outbursts or shortly after in WZ Sge stars or soft X-ray transients have not yet been convincingly explained by any model. We determine the additional ingredients that must be added to the DIM to account for the observed rebrightenings. We analyse in detail a recently discovered system, TCP J21040470+4631129, which has shown very peculiar rebrightenings, model its light curve using our numerical code including mass transfer variations from the secondary, inner-disc truncation, disc irradiation by a hot white dwarf and, in some cases, the mass-transfer stream over(under)flow. We show that the luminosity in quiescence is dominated by a hot white dwarf that cools down on time scales of months. The mass transfer rate from the secondary has to increase by several orders of magnitudes during the initial superoutburst for a reason that remains elusive, slowly returning to its secular average, causing the observed succession of outbursts with increasing quiescence durations, until the disc can be steady, cold, and neutral; its inner parts being truncated either by the white dwarf magnetic field or by evaporation. The very short, quiescence phases between reflares are reproduced when the mass-transfer stream overflows the disc. Using similar additions to the DIM, we have also produced light curves close to those observed in two WZ Sge stars, the prototype and EG Cnc. Our model successfully explains the reflares observed in WZ Sge systems. It requires, however, the inner disc truncation in dwarf novae to be due not (only) to the white dwarf magnetic field but, as in X-ray binaries, rather to evaporation of the inner disc. A similar model could also explain reflares observed in soft X-ray transients.


title: Mott insulator tuning via structural distortion in monolayer 1T-NbSe2

abstract: Mott state in 1T-TaS2 is predicted to host quantum spin liquids (QSL). However, its insulating mechanism is controversial due to complications from interlayer coupling. Here, we study the Mott state in monolayer 1T-NbSe2, an electronic analogy to TaS2 exempt from interlayer coupling, using spectroscopic imaging scanning tunneling microscopy and first principles calculations. Monolayer NbSe2 surprisingly displays two types of Star-of-David (SD) motifs with different Mott gap sizes, that are interconvertible via temperature variation. And, bilayer 1T-NbSe2 shows Mott collapse by interlayer coupling. Our calculation unveils the two types of SDs possess distinct structural distortions, altering the effective Coulomb energies of the central Nb orbital. Our calculation suggests the Mott gap, the same parameter for determining the QSL regime, is tunable with strain. This finding offers a general strategy for manipulating the Mott state in 1T-NbSe2 and related systems via structural distortions, which may be tuned into the potential QSL regime.


title: Revisiting the third-order elastic constants of diamond: the higher-order effect

abstract: In this letter, we study the higher-order effect on the third-order elastic constants (TOECs) of diamond using longitudinal stress-uniaxial strain (LSUS) approach based on density functional theory. The result shows that the higher-order effect on TOECs is not negligible in the shock wave experiments and similar calculations. By taking the higher-order elastic response (up to fifth order) into consideration, the convergence of TOECs against maximum stain gets improved significantly and resolves the discrepancy of several different theoretical methods and experiments.


title: Avoiding local minima in Variational Quantum Algorithms with Neural Networks

abstract: Variational Quantum Algorithms have emerged as a leading paradigm for near-term quantum computation. In such algorithms, a parameterized quantum circuit is controlled via a classical optimization method that seeks to minimize a problem-dependent cost function. Although such algorithms are powerful in principle, the non-convexity of the associated cost landscapes and the prevalence of local minima means that local optimization methods such as gradient descent typically fail to reach good solutions. In this work we suggest a method to improve gradient-based approaches to variational quantum circuit optimization, which involves coupling the output of the quantum circuit to a classical neural network. The effect of this neural network is to peturb the cost landscape as a function of its parameters, so that local minima can be escaped or avoided via a modification to the cost landscape itself. We present two algorithms within this framework and numerically benchmark them on small instances of the Max-Cut optimization problem. We show that the method is able to reach deeper minima and lower cost values than standard gradient descent based approaches. Moreover, our algorithms require essentially the same number of quantum circuit evaluations per optimization step as the standard approach since, unlike the gradient with respect to the circuit, the neural network updates can be estimated in parallel via the backpropagation method. More generally, our approach suggests that relaxing the cost landscape is a fruitful path to improving near-term quantum computing algorithms.


title: Exploring the design space for nonlinear buckling of composite thin-walled lenticular tubes under pure bending

abstract: This paper presents an automatic finite element simulation scheme accounting for high geometric nonlinearity and the difference between linear and nonlinear buckling of composite thin-walled lenticular tubes (CTLTs). Parameterizing of cross-section shapes and generation of design space for CTLTs with both circular and parabolic arcs were accomplished, and several key factors were identified, in particular the contrary effect of lumbus length and parabolic coefficient on the bending stiffness anisotropy. The first quantitative comparison of triangular rollable and collapsible (TRAC) booms and CTLTs is given in terms of bending performance in two directions, showing that the optimal CTLT carefully selected from the design space demonstrates a comparable or even better performance than the TRAC boom. This is of great importance from both academic and engineering perspectives. Our efforts enhance the understanding of nonlinear buckling and post-buckling behavior of CTLTs, and provide guidelines for future design of CTLTs with desirable performance.


title: Conductance-based Dynamic Causal Modeling: A mathematical review of its application to cross-power spectral densities

abstract: Dynamic Causal Modeling (DCM) is a Bayesian framework for inferring on hidden (latent) neuronal states, based on measurements of brain activity. Since its introduction in 2003 for functional magnetic resonance imaging data, DCM has been extended to electrophysiological data, and several variants have been developed. Their biophysically motivated formulations make these models promising candidates for providing a mechanistic understanding of human brain dynamics, both in health and disease. However, due to their complexity and reliance on concepts from several fields, fully understanding the mathematical and conceptual basis behind certain variants of DCM can be challenging. At the same time, a solid theoretical knowledge of the models is crucial to avoid pitfalls in the application of these models and interpretation of their results. In this paper, we focus on one of the most advanced formulations of DCM, i.e. conductance-based DCM for cross-spectral densities, whose components are described across multiple technical papers. The aim of the present article is to provide an accessible exposition of the mathematical background, together with an illustration of the model's behavior. To this end, we include step-by-step derivations of the model equations, point to important aspects in the software implementation of those models, and use simulations to provide an intuitive understanding of the type of responses that can be generated and the role that specific parameters play in the model. Furthermore, all code utilized for our simulations is made publicly available alongside the manuscript to allow readers an easy hands-on experience with conductance-based DCM.


title: Gravitino Cosmology Helped by a Right Handed (S)Neutrino

abstract: In this paper, we discuss interesting scenarios resulting from the interplay between the gravitino and the lightest right-handed (s)neutrino. We consider two gravitino mass regimes vastly separated, that is, $m_{3/2}=\mathcal{O}(100){\rm eV}$ and $m_{3/2}\simeq100{\rm GeV}$. For the former case, a significant amount of the entropy production in the cosmological history to dilute the gravitino relic abundance is unavoidable for consistency with the number of satellite galaxies in the Milky way. We will show that the right-handed (s)neutrino can play the role of the heavy particle whose late time decay provides such an additional radiation. For the later case, the gravitino of $m_{3/2}\simeq100{\rm GeV}$ may resolve the $S_{8}$ tension as a decaying dark matter. We will show how the lightest right-handed neutrino and its superpartner can help the gravitino decaying dark matter be equipped with a long enough life time and mass degeneracy with a massive decay product to address the $S_{8}$ tension.


title: The Emergence of Abstract and Episodic Neurons in Episodic Meta-RL

abstract: In this work, we analyze the reinstatement mechanism introduced by Ritter et al. (2018) to reveal two classes of neurons that emerge in the agent's working memory (an epLSTM cell) when trained using episodic meta-RL on an episodic variant of the Harlow visual fixation task. Specifically, Abstract neurons encode knowledge shared across tasks, while Episodic neurons carry information relevant for a specific episode's task.


title: Community Detection with Contextual Multilayer Networks

abstract: In this paper, we study community detection when we observe $m$ sparse networks and a high dimensional covariate matrix, all encoding the same community structure among $n$ subjects. In the asymptotic regime where the number of features $p$ and the number of subjects $n$ grows proportionally, we derive an exact formula of asymptotic minimum mean square error (MMSE) for estimating the common community structure in the balanced two block case. The formula implies the necessity of integrating information from multiple data sources. Consequently, it induces a sharp threshold of phase transition between the regime where detection (i.e., weak recovery) is possible and the regime where no procedure performs better than a random guess. The asymptotic MMSE depends on the covariate signal-to-noise ratio in a more subtle way than the phase transition threshold does. In the special case of $m=1$, our asymptotic MMSE formula complements the pioneering work of Deshpande et. al. (2018) which found the sharp threshold when $m=1$.


title: Hysteresis in Two Dimensional Arrays of Magnetic Nanoparticles

abstract: We perform computer simulations to probe the magnetic hysteresis in a two-dimensional ($L^{}_x\times L^{}_y$) assembly of magnetic nanoparticles as a function of dipolar interaction strength $h^{}_d$, temperature $T$, aspect ratio $A^{}_r=L^{}_y/L^{}_x$, and the applied alternating magnetic field's direction. In the absence of magnetic interaction ($h^{}_d\approx0$) and thermal fluctuations ($T=0$ K), the hysteresis follows the Stoner and Wohlfarth model, as expected. For weak dipolar interaction and substantial temperature, the hysteresis has the dominance of superparamagnetic behaviour, irrespective of the applied magnetic field's direction and $A^{}_r$. Interestingly, the hysteresis curve has all the characteristics of antiferromagnetic interaction dominance for $A^{}_r\leq6$ and considerable dipolar interaction strength ($h^{}_d>0.2)$, which is independent of applied magnetic direction. When the magnetic field is applied along the system's shorter axis ($x$-direction), a non-hysteresis straight line is observed with large $h^{}_d$. In the case of the magnetic field applied along the long axis of the sample ($y$-direction), ferromagnetic interaction dominates the hysteresis for large $h^{}_d$ and $A^{}_r>6$. Irrespective of $h^{}_d$ and applied magnetic field's direction, the coercive field $\mu^{}_oH^{}_c$ and remanence $M^{}_r$ are minimal for $A^{}_r\leq6$ and significant temperature. They are found to increase with $h^{}_d$ when $A^{}_r$ is enormous. Remarkably, the variation of hysteresis loop area $E^{}_H$ as a function of these parameters is the same as that of the coercive field variation. We believe that the concepts presented in this work are relevant in various technological applications such as spintronics and magnetic hyperthermia, in which such self-assembled nanoparticle arrays are ubiquitous.


title: DyGCN: Dynamic Graph Embedding with Graph Convolutional Network

abstract: Graph embedding, aiming to learn low-dimensional representations (aka. embeddings) of nodes, has received significant attention recently. Recent years have witnessed a surge of efforts made on static graphs, among which Graph Convolutional Network (GCN) has emerged as an effective class of models. However, these methods mainly focus on the static graph embedding. In this work, we propose an efficient dynamic graph embedding approach, Dynamic Graph Convolutional Network (DyGCN), which is an extension of GCN-based methods. We naturally generalizes the embedding propagation scheme of GCN to dynamic setting in an efficient manner, which is to propagate the change along the graph to update node embeddings. The most affected nodes are first updated, and then their changes are propagated to the further nodes and leads to their update. Extensive experiments conducted on various dynamic graphs demonstrate that our model can update the node embeddings in a time-saving and performance-preserving way.


title: The art of defense: letting networks fool the attacker

abstract: Robust environment perception is critical for autonomous cars, and adversarial defenses are the most effective and widely studied ways to improve the robustness of environment perception. However, all of previous defense methods decrease the natural accuracy, and the nature of the DNNs itself has been overlooked. To this end, in this paper, we propose a novel adversarial defense for 3D point cloud classifier that makes full use of the nature of the DNNs. Due to the disorder of point cloud, all point cloud classifiers have the property of permutation invariant to the input point cloud. Based on this nature, we design invariant transformations defense (IT-Defense). We show that, even after accounting for obfuscated gradients, our IT-Defense is a resilient defense against state-of-the-art (SOTA) 3D attacks. Moreover, IT-Defense do not hurt clean accuracy compared to previous SOTA 3D defenses. Our code is available at: {\footnotesize{\url{https://github.com/cuge1995/IT-Defense}}}.


title: Numerics for Stochastic Distributed Parameter Control Systems: a Finite Transposition Method

abstract: In this chapter, we present some recent progresses on the numerics for stochastic distributed parameter control systems, based on the \emph{finite transposition method} introduced in our previous works. We first explain how to reduce the numerics of some stochastic control problems in this respect to the numerics of backward stochastic evolution equations. Then we present a method to find finite transposition solutions to such equations. At last, we give an illuminating example.


title: Role of Exchange Interactions in the Magnetic Response and Intermolecular Recognition of Chiral Molecules

abstract: The physical origin of the so-called chirality-induced spin selectivity (CISS) effect has puzzled experimental and theoretical researchers over the past few years. Early experiments were interpreted in terms of unconventional spin-orbit interactions mediated by the helical geometry. However, more recent experimental studies have clearly revealed that electronic exchange interactions also play a key role in the magnetic response of chiral molecules in singlet states. In this investigation, we use spin-polarized closed shell density functional theory calculations to address the influence of exchange contributions to the interaction between helical molecules as well as of helical molecules with magnetized substrates. We show that exchange effects result in differences in the interaction properties with magnetized surfaces, shedding light into the possible origin of two recent important experimental results: enantiomer separation and magnetic exchange force microscopy with AFM tips functionalized with helical peptides.


title: An almost globally convergent observer for visual SLAM without persistent excitation

abstract: In this paper we propose a novel observer to solve the problem of visual simultaneous localization and mapping (SLAM), only using the information from a single monocular camera and an inertial measurement unit (IMU). The system state evolves on the manifold $SE(3)\times \mathbb{R}^{3n}$, on which we design dynamic extensions carefully in order to generate an invariant foliation, such that the problem is reformulated into online \emph{constant parameter} identification. Then, following the recently introduced parameter estimation-based observer (PEBO) and the dynamic regressor extension and mixing (DREM) procedure, we provide a new simple solution. A notable merit is that the proposed observer guarantees almost global asymptotic stability requiring neither persistency of excitation nor uniform complete observability, which, however, are widely adopted in most existing works with guaranteed stability.


title: ACM-Net: Action Context Modeling Network for Weakly-Supervised Temporal Action Localization

abstract: Weakly-supervised temporal action localization aims to localize action instances temporal boundary and identify the corresponding action category with only video-level labels. Traditional methods mainly focus on foreground and background frames separation with only a single attention branch and class activation sequence. However, we argue that apart from the distinctive foreground and background frames there are plenty of semantically ambiguous action context frames. It does not make sense to group those context frames to the same background class since they are semantically related to a specific action category. Consequently, it is challenging to suppress action context frames with only a single class activation sequence. To address this issue, in this paper, we propose an action-context modeling network termed ACM-Net, which integrates a three-branch attention module to measure the likelihood of each temporal point being action instance, context, or non-action background, simultaneously. Then based on the obtained three-branch attention values, we construct three-branch class activation sequences to represent the action instances, contexts, and non-action backgrounds, individually. To evaluate the effectiveness of our ACM-Net, we conduct extensive experiments on two benchmark datasets, THUMOS-14 and ActivityNet-1.3. The experiments show that our method can outperform current state-of-the-art methods, and even achieve comparable performance with fully-supervised methods. Code can be found at https://github.com/ispc-lab/ACM-Net


title: Demonstrating Cloth Folding to Robots: Design and Evaluation of a 2D and a 3D User Interface

abstract: An appropriate user interface to collect human demonstration data for deformable object manipulation has been mostly overlooked in the literature. We present an interaction design for demonstrating cloth folding to robots. Users choose pick and place points on the cloth and can preview a visualization of a simulated cloth before real-robot execution. Two interfaces are proposed: A 2D display-and-mouse interface where points are placed by clicking on an image of the cloth, and a 3D Augmented Reality interface where the chosen points are placed by hand gestures. We conduct a user study with 18 participants, in which each user completed two sequential folds to achieve a cloth goal shape. Results show that while both interfaces were acceptable, the 3D interface was found to be more suitable for understanding the task, and the 2D interface suitable for repetition. Results also found that fold previews improve three key metrics: task efficiency, the ability to predict the final shape of the cloth and overall user satisfaction.


title: A flexible Gaussian process reconstruction method and the mass function of the coalescing binary black hole systems

abstract: We develop a new method based on Gaussian process to reconstruct the mass distribution of binary black holes (BBHs). Instead of prespecifying the formalisms of mass distribution, we introduce a more flexible and nonparametric model with which the distribution can be mainly determined by the observed data. We first test our method with simulated data, and find that it can well recover the injected distribution. Then we apply this method to analyze the data of BBHs' observations from LIGO-Virgo Gravitational-Wave Transient Catalog 2. By reconstructing the chirp mass distribution, we find that there is a peak or a platform locating at $20-30\,M_{\odot}$ rather than a single-power-law-like decrease from low mass to high mass. Moreover, one or two peaks in the chirp mass range of $\mathcal{M}<20\,M_{\odot}$ may be favored by the data. Assuming a mass-independent mass ratio distribution of $p(q)\propto q^{1.4}$, we further obtain a distribution of primary mass, and find that there is a feature locating in the range of $(30, 40)\,M_{\odot}$, which can be related to \textsc{Broken Power Law} and \textsc{Power Law + Peak} distributions described in The LIGO Scientific Collaboration et al. (2020). Besides, the merger rate of BBHs is estimated to $\mathcal{R} = 26.29^{+14.21}_{-8.96}~{\rm Gpc^{-3}~yr^{-1}}$ supposing there is no redshift evolution.


title: Switchable Rashba Anisotropy in Two-dimensional Hybrid Organic-Inorganic Perovskite by Hybrid Improper Ferroelectricity

abstract: Two-dimensional (2D) hybrid organic-inorganic perovskites (HOIPs) are introducing new directions in the 2D materials landscape. The coexistence of ferroelectricity and spin-orbit interactions play a key role in their optoelectronic properties. We perform a detailed study on a recently synthesized ferroelectric 2D-HOIP, (AMP)PbI$_4$ (AMP = 4-aminomethyl-piperidinium). The calculated polarization and Rashba parameter are in excellent agreement with experimental values. We report a striking new effect, i.e., an extraordinarily large Rashba anisotropy that is tunable by ferroelectric polarization: as polarization is reversed, not only the spin texture chirality is inverted, but also the major and minor axes of the Rashba anisotropy ellipse in k-space are interchanged - a pseudo rotation. A $k \cdot p$ model Hamiltonian and symmetry-mode analysis reveal a quadrilinear coupling between the cation-rotation modes responsible for the Rashba ellipse pseudo-rotation, the framework rotation, and the polarization. These findings may provide new avenues for spin-optoelectronic devices such as spin valves or spin FETs.


title: MPN: Multimodal Parallel Network for Audio-Visual Event Localization

abstract: Audio-visual event localization aims to localize an event that is both audible and visible in the wild, which is a widespread audio-visual scene analysis task for unconstrained videos. To address this task, we propose a Multimodal Parallel Network (MPN), which can perceive global semantics and unmixed local information parallelly. Specifically, our MPN framework consists of a classification subnetwork to predict event categories and a localization subnetwork to predict event boundaries. The classification subnetwork is constructed by the Multimodal Co-attention Module (MCM) and obtains global contexts. The localization subnetwork consists of Multimodal Bottleneck Attention Module (MBAM), which is designed to extract fine-grained segment-level contents. Extensive experiments demonstrate that our framework achieves the state-of-the-art performance both in fully supervised and weakly supervised settings on the Audio-Visual Event (AVE) dataset.


title: Self-supervised Learning of Depth Inference for Multi-view Stereo

abstract: Recent supervised multi-view depth estimation networks have achieved promising results. Similar to all supervised approaches, these networks require ground-truth data during training. However, collecting a large amount of multi-view depth data is very challenging. Here, we propose a self-supervised learning framework for multi-view stereo that exploit pseudo labels from the input data. We start by learning to estimate depth maps as initial pseudo labels under an unsupervised learning framework relying on image reconstruction loss as supervision. We then refine the initial pseudo labels using a carefully designed pipeline leveraging depth information inferred from higher resolution images and neighboring views. We use these high-quality pseudo labels as the supervision signal to train the network and improve, iteratively, its performance by self-training. Extensive experiments on the DTU dataset show that our proposed self-supervised learning framework outperforms existing unsupervised multi-view stereo networks by a large margin and performs on par compared to the supervised counterpart. Code is available at https://github.com/JiayuYANG/Self-supervised-CVP-MVSNet.


title: Active learning using weakly supervised signals for quality inspection

abstract: Because manufacturing processes evolve fast, and since production visual aspect can vary significantly on a daily basis, the ability to rapidly update machine vision based inspection systems is paramount. Unfortunately, supervised learning of convolutional neural networks requires a significant amount of annotated images for being able to learn effectively from new data. Acknowledging the abundance of continuously generated images coming from the production line and the cost of their annotation, we demonstrate it is possible to prioritize and accelerate the annotation process. In this work, we develop a methodology for learning actively, from rapidly mined, weakly (i.e. partially) annotated data, enabling a fast, direct feedback from the operators on the production line and tackling a big machine vision weakness: false positives. We also consider the problem of covariate shift, which arises inevitably due to changing conditions during data acquisition. In that regard, we show domain-adversarial training to be an efficient way to address this issue.


title: Printed tapered leaky-wave antennas for W-band frequencies

abstract: Despite their great potential in communication and sensing applications, printed leaky-wave antennas have rarely been reported at mm-wave frequencies. In this paper, tapered leaky-wave antennas operating at 80 GHz are designed, fabricated and experimentally characterized. While most continuous leaky-wave antennas use subwavelength strips or other comparably small elements, in this work, the surface impedance is discretized very coarsely using only three square patches per period. With this architecture, a wide range of surface reactance can be achieved while maintaining a minimum feature size of the metallic pattern that is feasible for printed circuit fabrication. As the analytical solution for the bandstructure of sinusoidally modulated reactance surfaces is inaccurate for coarse discretization, we find it using full-wave simulation. In order to control side lobes effectively, we use a tapered aperture illumination according to the Taylor one-parameter distribution. A comprehensive experimental demonstration is presented, including near-field and far-field measurements. Therewith, we verify the designed aperture illumination and we reveal the origin of spurious far-field features. Side lobes are effectively suppressed and spurious radiation is reduced to -18 dB compared to the main lobe.


title: A quantum binary classifier based on cosine similarity

abstract: We introduce the quantum implementation of a binary classifier based on cosine similarity between data vectors. The proposed quantum algorithm evaluates the classifier on a set of data vectors with time complexity that is logarithmic in the product of the set cardinality and the dimension of the vectors. It is based just on a suitable state preparation like the retrieval from a QRAM, a SWAP test circuit (two Hadamard gates and one Fredkin gate), and a measurement process on a single qubit. Furthermore we present a simple implementation of the considered classifier on the IBM quantum processor ibmq_16_melbourne. Finally we describe the combination of the classifier with the quantum version of a K-nearest neighbors algorithm within a hybrid quantum-classical structure.


title: Fundamental mechanism of the creation of chemical bimodality in the Milky Way disc in the cold accretion theory

abstract: Chemical bimodality of the Milky Way (MW) disc stars constitutes one of the most remarkable properties of MW. The cold accretion theory for the cosmological gas accretion provides one viable explanation to this phenomenon. In this scenario, the rapid cold-mode accretion in the early epoch creates the first generation stars relatively rich in $\alpha$-elements(O,Mg,Si,S,Ca,etc) and later cooling flow produces iron-rich second generation stars, creating the bimodality in the [$\alpha$/Fe] ratio. We employ a cosmologically motivated chemical evolution model for disc galaxies to elucidate the role played by type Ia supernovae (SNIa), which serve as the major source of iron, in the creation of the bimodality. To this end, we divide SNIa into two groups, those formed from the 1st generation stars (the first SNIa) and those formed from the 2nd generation stars (the second SNIa). The model with the first SNIa suppressed during the {\it second} star formation stage produces stars having high [$\alpha$/Fe] in the early phase of this stage, whereas the model which prohibits the second SNIa produces high [$\alpha$/Fe] stars in the late phase. Both models fail to create a well-defined bimodality. We thus conclude that the cooperation of the first and the second SNIa plays a crucial role in creating the bimodality by maintaining rich iron content in the interstellar gas throughout the second star formation stage.


title: The impact of Kelvin probe force microscopy operation modes and environment on grain boundary band bending in perovskite and Cu(In,Ga)Se2 solar cells

abstract: An in-depth understanding of the electronic properties of grain boundaries (GB) in polycrystalline semiconductor absorbers is of high importance since their charge carrier recombination rates may be very high and hence limit the solar cell device performance. Kelvin Probe Force Microscopy (KPFM) is the method of choice to investigate GB band bending on the nanometer scale and thereby helps to develop passivation strategies. Here, it is shown that amplitude modulation AM-KPFM, which is by far the most common KPFM measurement mode, is not suitable to measure workfunction variations at GBs on rough samples, such as Cu(In,Ga)Se2 and CH3NH3PbI3. This is a direct consequence of a change in the cantilever-sample distance that varies on rough samples. Furthermore, we critically discuss the impact of different environments (air versus vacuum) and show that air exposure alters the GB and facet contrast, which leads to erroneous interpretations of the GB physics. Frequency modulation FM-KPFM measurements on non-air-exposed CIGSe and perovskite absorbers show that the amount of band bending measured at the GB is negligible and that the electronic landscape of the semiconductor surface is dominated by facet-related contrast due to the polycrystalline nature of the absorbers.


title: Fast Convergence on Perfect Classification for Functional Data

abstract: We investigate the availability of approaching perfect classification on functional data with finite samples. The seminal work (Delaigle and Hall (2012)) showed that perfect classification for functional data is easier to achieve than for finite-dimensional data. This result is based on their finding that a sufficient condition for the existence of a perfect classifier, named a Delaigle--Hall condition, is only available for functional data. However, there is a danger that a large sample size is required to achieve the perfect classification even though the Delaigle--Hall condition holds, because a minimax convergence rate of errors with functional data has a logarithm order in sample size. This study solves this complication by proving that the Delaigle--Hall condition also achieves fast convergence of the misclassification error in sample size, under the bounded entropy condition on functional data. We study a reproducing kernel Hilbert space-based classifier under the Delaigle--Hall condition, and show that a convergence rate of its misclassification error has an exponential order in sample size. Technically, our proof is based on (i) connecting the Delaigle--Hall condition and a margin of classifiers, and (ii) handling metric entropy of functional data. Our experiments support our result, and also illustrate that some other classifiers for functional data have a similar property.


title: Few-Shot Meta-Learning on Point Cloud for Semantic Segmentation

abstract: The promotion of construction robots can solve the problem of human resource shortage and improve the quality of decoration. To help the construction robots obtain environmental information, we need to use 3D point cloud, which is widely used in robotics, autonomous driving, and so on. With a good understanding of environmental information, construction robots can work better. However, the dynamic changes of 3D point cloud data may bring difficulties for construction robots to understand environmental information, such as when construction robots renovate houses. The paper proposes a semantic segmentation method for point cloud based on meta-learning. The method includes a basic learning module and a meta-learning module. The basic learning module is responsible for learning data features and evaluating the model, while the meta-learning module is responsible for updating the parameters of the model and improving the model generalization ability. In our work, we pioneered the method of producing datasets for meta-learning in 3D scenes, as well as demonstrated that the Model-Agnostic Meta-Learning (MAML) algorithm can be applied to process 3D point cloud data. At the same time, experiments show that our method can allow the model to be quickly applied to new environments with a few samples. Our method has important applications.


title: Synthetic training data generation for deep learning based quality inspection

abstract: Deep learning is now the gold standard in computer vision-based quality inspection systems. In order to detect defects, supervised learning is often utilized, but necessitates a large amount of annotated images, which can be costly: collecting, cleaning, and annotating the data is tedious and limits the speed at which a system can be deployed as everything the system must detect needs to be observed first. This can impede the inspection of rare defects, since very few samples can be collected by the manufacturer. In this work, we focus on simulations to solve this issue. We first present a generic simulation pipeline to render images of defective or healthy (non defective) parts. As metallic parts can be highly textured with small defects like holes, we design a texture scanning and generation method. We assess the quality of the generated images by training deep learning networks and by testing them on real data from a manufacturer. We demonstrate that we can achieve encouraging results on real defect detection using purely simulated data. Additionally, we are able to improve global performances by concatenating simulated and real data, showing that simulations can complement real images to boost performances. Lastly, using domain adaptation techniques helps improving slightly our final results.


title: Reinforcement Learning with a Disentangled Universal Value Function for Item Recommendation

abstract: In recent years, there are great interests as well as challenges in applying reinforcement learning (RL) to recommendation systems (RS). In this paper, we summarize three key practical challenges of large-scale RL-based recommender systems: massive state and action spaces, high-variance environment, and the unspecific reward setting in recommendation. All these problems remain largely unexplored in the existing literature and make the application of RL challenging. We develop a model-based reinforcement learning framework, called GoalRec. Inspired by the ideas of world model (model-based), value function estimation (model-free), and goal-based RL, a novel disentangled universal value function designed for item recommendation is proposed. It can generalize to various goals that the recommender may have, and disentangle the stochastic environmental dynamics and high-variance reward signals accordingly. As a part of the value function, free from the sparse and high-variance reward signals, a high-capacity reward-independent world model is trained to simulate complex environmental dynamics under a certain goal. Based on the predicted environmental dynamics, the disentangled universal value function is related to the user's future trajectory instead of a monolithic state and a scalar reward. We demonstrate the superiority of GoalRec over previous approaches in terms of the above three practical challenges in a series of simulations and a real application.


title: Leptoquark Option for $B$-meson Anomalies and Leptonic Signatures

abstract: We entertain the option of scalar leptoquarks to explain the anomalies in the semi-leptonic decays of $B$-mesons and the discrepancies in the lepton $(g-2)_l$'s including the recent results at Fermilab E989. The $R_{K^{(*)}}$ and $R_{D^{(*)}}$ anomalies can be accommodated by the specific couplings for triplet and singlet leptoquarks, respectively, subject to the bounds from $B\to K\nu{\bar\nu}$. We discuss the correlation between the leptonic signatures from leptoquarks such as $\mu\to e\gamma$ and the electric dipole moment of electron and show that desirable neutrino masses can be generated dominantly by top-quark loops in the extension of the model with several doublet leptoquarks.


title: Optimal fire allocation in a combat model of mixed NCW type

abstract: In this work, we introduce a nonlinear Lanchester model of NCW-type and study a problem of finding the optimal fire allocation for this model. A Blue party $B$ will fight against a Red party consisting of $A$ and $R$, where $A$ is an independent force and $R$ fights with supports from a supply unit $N$. A battle may consist of several stages but we consider the problem of finding optimal fire allocation for $B$ in the first stage only. Optimal fire allocation is a set of three non-negative numbers whose sum equals to one, such that the remaining force of $B$ is maximal at any instants. In order to tackle this problem, we introduce the notion of \textit{threatening rates} which are computed for $A, R, N$ at the beginning of the battle. Numerical illustrations are presented to justify the theoretical findings.


title: [RE] CNN-generated images are surprisingly easy to spot...for now

abstract: This work evaluates the reproducibility of the paper "CNN-generated images are surprisingly easy to spot... for now" by Wang et al. published at CVPR 2020. The paper addresses the challenge of detecting CNN-generated imagery, which has reached the potential to even fool humans. The authors propose two methods which help an image classifier to generalize from being trained on one specific CNN to detecting imagery produced by unseen architectures, training methods, or data sets. The paper proposes two methods to help a classifier generalize: (i) utilizing different kinds of data augmentations and (ii) using a diverse data set. This report focuses on assessing if these techniques indeed help the generalization process. Furthermore, we perform additional experiments to study the limitations of the proposed techniques.


title: Schoenberg correspondence for multifaced independence

abstract: We extend the Schoenberg correspondence for universal independences by Sch\"urmann and Vo{\ss} to the multivariate setting of Manzel and Sch\"urmann, covering, e.g., Voiculescu's bifreeness as well as Bo\.zejko and Speicher's c-free independence. At the same time, we free the proof in the univariate situation from its dependence on Muraki's classification theorem (which states that there are only five univariate independences: tensor, free, Boolean, monotone, and antimonotone independence). In contrast to the univariate case, the class of multivariate independences considered here is infinite and not yet fully understood. Furthermore, helpful tools such quantum stochastic calculi and Fock space constructions, which are used by Sch\"urmann and Vo{\ss} to prove Schoenberg correspondence in the univariate case, are not available in general. This problem is overcome by relating convolution exponentials with respect to different independences to each other, which ultimately allows to reduce all Schoenberg correspondences for multivariate independences to the case of convolution semigroups on *-bialgebras.


title: Single-qubit remote manipulation by magnetic solitons

abstract: Magnetic solitons can constitute a means for manipulating qubits from a distance. This would overcome the necessity of directly applying selective magnetic fields, which is unfeasible in the case of a matrix of qubits embedded in a solid-state quantum device. If the latter contained one-dimensional Heisenberg spin chains coupled to each qubit, one can originate a soliton in a selected chain by applying a time-dependent field at one end of it, far from the qubits. The generation of realistic solitons has been simulated. When a suitable soliton passes by, the coupled qubit undergoes nontrivial operations, even in the presence of moderate thermal noise.


title: Plinius: Secure and Persistent Machine Learning Model Training

abstract: With the increasing popularity of cloud based machine learning (ML) techniques there comes a need for privacy and integrity guarantees for ML data. In addition, the significant scalability challenges faced by DRAM coupled with the high access-times of secondary storage represent a huge performance bottleneck for ML systems. While solutions exist to tackle the security aspect, performance remains an issue. Persistent memory (PM) is resilient to power loss (unlike DRAM), provides fast and fine-granular access to memory (unlike disk storage) and has latency and bandwidth close to DRAM (in the order of ns and GB/s, respectively). We present PLINIUS, a ML framework using Intel SGX enclaves for secure training of ML models and PM for fault tolerance guarantees. P LINIUS uses a novel mirroring mechanism to create and maintain (i) encrypted mirror copies of ML models on PM, and (ii) encrypted training data in byte-addressable PM, for near-instantaneous data recovery after a system failure. Compared to disk-based checkpointing systems,PLINIUS is 3.2x and 3.7x faster respectively for saving and restoring models on real PM hardware, achieving robust and secure ML model training in SGX enclaves.


title: Optimal Algorithms for Differentially Private Stochastic Monotone Variational Inequalities and Saddle-Point Problems

abstract: In this work, we conduct the first systematic study of stochastic variational inequality (SVI) and stochastic saddle point (SSP) problems under the constraint of differential privacy (DP). We propose two algorithms: Noisy Stochastic Extragradient (NSEG) and Noisy Inexact Stochastic Proximal Point (NISPP). We show that a stochastic approximation variant of these algorithms attains risk bounds vanishing as a function of the dataset size, with respect to the strong gap function; and a sampling with replacement variant achieves optimal risk bounds with respect to a weak gap function. We also show lower bounds of the same order on weak gap function. Hence, our algorithms are optimal. Key to our analysis is the investigation of algorithmic stability bounds, both of which are new even in the nonprivate case. The dependence of the running time of the sampling with replacement algorithms, with respect to the dataset size $n$, is $n^2$ for NSEG and $\tilde{O}(n^{3/2})$ for NISPP.


title: The influence of the secular perturbation of an intermediate-mass companion: II. Ejection of hypervelocity stars from the Galactic Center

abstract: There is a population of stars with velocities in excess of 500 km s$^{-1}$ relative to the Galactic center. Many, perhaps most, of these hyper-velocity stars (HVSs) are B stars, similar to the disk and S stars in a nuclear cluster around a super-massive black hole (SMBH) near $\rm Sgr~A^{\star}$. In the paper I of this series, we showed that the eccentricity of the stars emerged from a hypothetical disk around the SMBH can be rapidly excited by the secular perturbation of its intermediate-mass companion (IMC), and we suggested IRS 13E as a potential candidate for the IMC. Here, we show that this process leads to an influx of stars on parabolic orbits to the proximity of $\rm Sgr~A^{\star}$ on a secular timescale of a few Myr. This timescale is much shorter than the diffusion timescale into the lost cone through either the classical or the resonant relaxation. Precession of the highly-eccentric stars' longitude of periastron, relative to that of the IMC, brings them to its proximity within a few Myr. The IMC's gravitational perturbation scatters a fraction of the stars from nearly parabolic to hyperbolic orbits, with respect to the SMBH. Their follow-up close encounters with the SMBH induce them to escape with hyper-velocity. This scenario is a variant of the hypothesis proposed by Hills based on the anticipated breakup of some progenitor binary stars in the proximity of the SMBH, and its main objective is to account for the limited lifespan of the known HVSs. We generalize our previous numerical simulations of this process with a much wider range of orbital configurations. We demonstrate the robustness and evaluate the efficiency of this channel of HVS formation. From these numerical simulations, we infer observable kinematic properties for the HVSs.


title: Ultralow-noise frequency-agile photonic integrated lasers

abstract: Low-noise lasers are of central importance in a wide variety of applications, including high spectral-efficiency coherent communication protocols, distributed fibre sensing, and long distance coherent LiDAR. In addition to low phase noise, frequency agility, that is, the ability to achieve high-bandwidth actuation of the laser frequency, is imperative for triangular chirping in frequency-modulated continuous-wave (FMCW) based ranging or any optical phase locking as routinely used in metrology. While integrated silicon-based lasers have experienced major advances and are now employed on a commercial scale in data centers, integrated lasers with sub-100 Hz-level intrinsic linewidth are based on optical feedback from photonic circuits that lack frequency agility. Here, we demonstrate a wafer-scale-manufacturing-compatible hybrid photonic integrated laser that exhibits ultralow intrinsic linewidth of 25 Hz while offering unsurpassed megahertz actuation bandwidth, with a tuning range larger than 1 GHz. Our approach uses ultralow-loss (1 dB/m) Si$_3$N$_4$ photonic microresonators, combined with aluminium nitride (AlN) or lead zirconium titanate (PZT) microelectromechanical systems (MEMS) based stress-optic actuation. Electrically driven low-phase noise lasing is attained by self-injection locking of an Indium Phosphide (InP) laser chip and only limited by fundamental thermo-refractive noise. By utilizing difference drive and apodization of the photonic chip, a flat actuation response up to 10 MHz is achieved. We leverage this capability to demonstrate a compact coherent LiDAR engine that can generate up to 800 kHz FMCW triangular optical chirp signals, requiring neither any active linearization nor predistortion compensation, and perform a 10 m optical ranging experiment, with a resolution of 12.5 cm.


title: Quantifying the Classification of Exoplanets: in Search for the Right Habitability Metric

abstract: What is habitability? Can we quantify it? What do we mean under the term habitable or potentially habitable planet? With estimates of the number of planets in our Galaxy alone running into billions, possibly a number greater than the number of stars, it is high time to start characterizing them, sorting them into classes/types just like stars, to better understand their formation paths, their properties and, ultimately, their ability to beget or sustain life. After all, we do have life thriving on one of these billions of planets, why not on others? Which planets are better suited for life and which ones are definitely not worth spending expensive telescope time on? We need to find sort of quick assessment score, a metric, using which we can make a list of promising planets and dedicate our efforts to them. Exoplanetary habitability is a transdisciplinary subject integrating astrophysics, astrobiology, planetary science, even terrestrial environmental sciences. We review the existing metrics of habitability and the new classification schemes of extrasolar planets and provide an exposition of the use of computational intelligence techniques to evaluate habitability scores and to automate the process of classification of exoplanets. We examine how solving convex optimization techniques, as in computing new metrics such as CDHS and CEESA, cross-validates ML-based classification of exoplanets. Despite the recent criticism of exoplanetary habitability ranking, this field has to continue and evolve to use all available machinery of astroinformatics, artificial intelligence and machine learning. It might actually develop into a sort of same scale as stellar types in astronomy, to be used as a quick tool of screening exoplanets in important characteristics in search for potentially habitable planets for detailed follow-up targets.


title: Quantum phase transitions and superconductivity in the pressurized heavy-fermion compound CeCuP2

abstract: The tilted balance among competing interactions can yield a rich variety of ground states of quantum matter. In most Ce-based heavy fermion systems, this can often be qualitatively described by the famous Doniach phase diagram, owing to the competition between the Kondo screening and the Ruderman-Kittel-Kasuya-Yoshida exchange interaction. Here, we report an unusual pressure-temperature phase diagram beyond the Doniach one in CeCuP2. At ambient pressure, CeCuP2 displays typical heavy-fermion behavior, albeit with a very low carrier density. With lowering temperature, it shows a crossover from a non Fermi liquid to a Fermi liquid at around 2.4 K. But surprisingly, the Kondo coherence temperature decreases with increasing pressure, opposite to that in most Ce-based heavy fermion compounds. Upon further compression, two superconducting phases are revealed. At 48.0 GPa, the transition temperature reaches 6.1 K, the highest among all Ce-based heavy fermion superconductors. We argue for possible roles of valence tuning and fluctuations associated with its special crystal structure in addition to the hybridization effect. These unusual phase diagrams suggest that CeCuP2 is a novel platform for studying the rich heavy fermions physics beyond the conventional Doniach paradigm.


title: The homomorphism defect of an extended Levine-Tristram signature via twisted homology

abstract: Taking the Levine-Tristram signature of the closure of a braid defines a map from the braid group to the integers. A formula of Gambaudo and Ghys provides an evaluation of the homomorphism defect of this map in terms of the Burau representation and the Meyer cocycle. In 2017 Cimasoni and Conway generalized this formula to the multivariable signature of the closure of coloured tangles. In the present paper, we extend even further their result by using a different 4-dimensional interpretation of the signature. We obtain an evaluation of the additivity defect in terms of the Maslov index and the isotropic functor $\mathscr{F}_\omega$. We also show that in the case of coloured braids this defect can be rewritten in terms of the Meyer cocycle and the coloured Gassner representation, making it a direct generalization of the formula of Gambaudo and Ghys.


title: On almost $p$-rational characters of $p'$-degree

abstract: Let $p$ be a prime and $G$ a finite group. A complex character of $G$ is called almost $p$-rational if its values belong to a cyclotomic field $\mathbb{Q}(e^{2\pi i/n})$ for some $n\in \mathbb{Z}^+$ prime to $p$ or precisely divisible by $p$. We prove that, in contrast to usual $p$-rational characters, there are always "many" almost $p$-rational irreducible characters in finite groups. We obtain both explicit and asymptotic bounds for the number of almost $p$-rational irreducible characters of $G$ in terms of $p$. In fact, motivated by the McKay-Navarro conjecture, we obtain the same bound for the number of such characters of $p'$-degree and prove that, in the minimal situation, the number of almost $p$-rational irreducible $p'$-characters of $G$ coincides with that of $N_G(P)$ for $P\in\mathrm{Syl}_p(G)$. Lastly, we propose a new way to detect the cyclicity of Sylow $p$-subgroups of a finite group $G$ from its character table, using almost $p$-rational irreducible $p'$-characters and the blockwise refinement of the McKay-Navarro conjecture.


title: Theoretically Improving Graph Neural Networks via Anonymous Walk Graph Kernels

abstract: Graph neural networks (GNNs) have achieved tremendous success in graph mining. However, the inability of GNNs to model substructures in graphs remains a significant drawback. Specifically, message-passing GNNs (MPGNNs), as the prevailing type of GNNs, have been theoretically shown unable to distinguish, detect or count many graph substructures. While efforts have been paid to complement the inability, existing works either rely on pre-defined substructure sets, thus being less flexible, or are lacking in theoretical insights. In this paper, we propose GSKN, a GNN model with a theoretically stronger ability to distinguish graph structures. Specifically, we design GSKN based on anonymous walks (AWs), flexible substructure units, and derive it upon feature mappings of graph kernels (GKs). We theoretically show that GSKN provably extends the 1-WL test, and hence the maximally powerful MPGNNs from both graph-level and node-level viewpoints. Correspondingly, various experiments are leveraged to evaluate GSKN, where GSKN outperforms a wide range of baselines, endorsing the analysis.


title: Generalized shifts through derivations' concept in $\ell^p(\tau)$ spaces

abstract: In the following text for $p\in[1,\infty]$, nonzero cardinal number $\tau$, self--map $\varphi:\tau\to\tau$ if there exists $N\in\mathbb{N}$ such that $\varphi^{-1}(\alpha)$ has at most $N$ elements for each $\alpha<\tau$, and operators $\psi,\lambda:\ell^p\tau)\to\ell^p(\tau)$ we prove the generalized shift $\mathop{\sigma_\varphi\restriction_{\ell^p(\tau)}:\ell^p(\tau)\to\ell^p(\tau)\:\:\:\:\:\:\:\:\:}\limits_{\:\:\:\:\:\:\:\:\: (x_\alpha)_{\alpha<\tau}\mapsto (x_{\varphi(\alpha)})_{\alpha<\tau}}$: $\bullet$ is a $(\psi,\lambda)-$derivation if and only if there exists $\mathsf{r}\in{\mathbb C}^\tau$ with $\psi={\mathsf r}\sigma_\varphi\restriction_{\ell^p(\tau)}$ and $\lambda=((1)_{\alpha<\tau}-{\mathsf r})\sigma_\varphi\restriction_{\ell^p(\tau)}$, $\bullet$ is a $\psi-$derivation if and only if $\psi=\frac12\sigma_\varphi\restriction_{\ell^p(\tau)}$, $\bullet$ is not a (Jordan, Jordan triple) derivation, $\bullet$ is a generalized (Jordan, Jordan triple) derivation if and only if $\varphi=id_\tau$.


title: On the Power of Refined Skat Selection

abstract: Skat is a fascinating combinatorial card game, show-casing many of the intrinsic challenges for modern AI systems such as cooperative and adversarial behaviors (among the players), randomness (in the deal), and partial knowledge (due to hidden cards). Given the larger number of tricks and higher degree of uncertainty, reinforcement learning is less effective compared to classical board games like Chess and Go. As within the game of Bridge, in Skat we have a bidding and trick-taking stage. Prior to the trick-taking and as part of the bidding process, one phase in the game is to select two skat cards, whose quality may influence subsequent playing performance drastically. This paper looks into different skat selection strategies. Besides predicting the probability of winning and other hand strength functions we propose hard expert-rules and a scoring functions based on refined skat evaluation features. Experiments emphasize the impact of the refined skat putting algorithm on the playing performance of the bots, especially for AI bidding and AI game selection.


title: Parameterized Complexity of Elimination Distance to First-Order Logic Properties

abstract: The elimination distance to some target graph property P is a general graph modification parameter introduced by Bulian and Dawar. We initiate the study of elimination distances to graph properties expressible in first-order logic. We delimit the problem's fixed-parameter tractability by identifying sufficient and necessary conditions on the structure of prefixes of first-order logic formulas. Our main result is the following meta-theorem: for every graph property P expressible by a first order-logic formula \phi\in \Sigma_3, that is, of the form \phi=\exists x_1\exists x_2\cdots \exists x_r \forall y_1\forall y_2\cdots \forall y_s \exists z_1\exists z_2\cdots \exists z_t \psi, where \psi is a quantifier-free first-order formula, checking whether the elimination distance of a graph to P does not exceed k, is fixed-parameter tractable parameterized by k. Properties of graphs expressible by formulas from \Sigma_3 include being of bounded degree, excluding a forbidden subgraph, or containing a bounded dominating set. We complement this theorem by showing that such a general statement does not hold for formulas with even slightly more expressive prefix structure: there are formulas \phi\in \Pi_3, for which computing elimination distance is W[2]-hard.


title: A Cycle Joining Construction of the Prefer-Max De Bruijn Sequence

abstract: We propose a novel construction for the well-known prefer-max De Bruijn sequence, based on the cycle joining technique. We further show that the construction implies known results from the literature in a straightforward manner. First, it implies the correctness of the onion theorem, stating that, effectively, the reverse of prefer-max is in fact an infinite De Bruijn sequence. Second, it implies the correctness of recently discovered shift rules for prefer-max, prefer-min, and their reversals. Lastly, it forms an alternative proof for the seminal FKM-theorem.


title: Universal Adversarial Training with Class-Wise Perturbations

abstract: Despite their overwhelming success on a wide range of applications, convolutional neural networks (CNNs) are widely recognized to be vulnerable to adversarial examples. This intriguing phenomenon led to a competition between adversarial attacks and defense techniques. So far, adversarial training is the most widely used method for defending against adversarial attacks. It has also been extended to defend against universal adversarial perturbations (UAPs). The SOTA universal adversarial training (UAT) method optimizes a single perturbation for all training samples in the mini-batch. In this work, we find that a UAP does not attack all classes equally. Inspired by this observation, we identify it as the source of the model having unbalanced robustness. To this end, we improve the SOTA UAT by proposing to utilize class-wise UAPs during adversarial training. On multiple benchmark datasets, our class-wise UAT leads superior performance for both clean accuracy and adversarial robustness against universal attack.


title: On the origin of the asymmetry of the ejecta structure and explosion of G350.1$-$0.3

abstract: We present X-ray analysis of the ejecta of supernova remnant G350.1$-$0.3 observed with Chandra and Suzaku, and clarify the ejecta's kinematics over a decade and obtain a new observational clue to understanding the origin of the asymmetric explosion. Two images of Chandra X-ray Observatory taken in 2009 and 2018 are analyzed in several methods, and enable us to measure the velocities in the plane of the sky. A maximum velocity is 4640$\pm$290 km s$^{-1}$ (0.218$\pm$0.014 arcsec yr$^{-1}$) in the eastern region in the remnant. These findings trigger us to scrutinize the Doppler effects in the spectra of the thermal emission, and the velocities in the line-of-sight direction are estimated to be a thousand km s$^{-1}$. The results are confirmed by analyzing the spectra of Suzaku. Combining the proper motions and line-of-sight velocities, the ejecta's three-dimensional velocities are $\sim$3000-5000 km s$^{-1}$. The center of the explosion is more stringently constrained by finding the optimal time to reproduce the observed spatial expansion. Our findings that the age of the SNR is estimated at most to be 655 years, and the CCO is observed as a point source object against the SNR strengthen the 'hydrodynamical kick' hypothesis on the origin of the remnant.


title: CNN Based Segmentation of Infarcted Regions in Acute Cerebral Stroke Patients From Computed Tomography Perfusion Imaging

abstract: More than 13 million people suffer from ischemic cerebral stroke worldwide each year. Thrombolytic treatment can reduce brain damage but has a narrow treatment window. Computed Tomography Perfusion imaging is a commonly used primary assessment tool for stroke patients, and typically the radiologists will evaluate resulting parametric maps to estimate the affected areas, dead tissue (core), and the surrounding tissue at risk (penumbra), to decide further treatments. Different work has been reported, suggesting thresholds, and semi-automated methods, and in later years deep neural networks, for segmenting infarction areas based on the parametric maps. However, there is no consensus in terms of which thresholds to use, or how to combine the information from the parametric maps, and the presented methods all have limitations in terms of both accuracy and reproducibility. We propose a fully automated convolutional neural network based segmentation method that uses the full four-dimensional computed tomography perfusion dataset as input, rather than the pre-filtered parametric maps. The suggested network is tested on an available dataset as a proof-of-concept, with very encouraging results. Cross-validated results show averaged Dice score of 0.78 and 0.53, and an area under the receiver operating characteristic curve of 0.97 and 0.94 for penumbra and core respectively


title: RAFTER: Ring Astrometric Field Telescope for Exo-planets and Relativity

abstract: High precision astrometry aims at source position determination to a very small fraction of the diffraction image size, in high SNR regime. One of the key limitations to such goal is the optical response variation of the telescope over a sizeable FOV, required to ensure bright reference objects to any selected target. The issue translates into severe calibration constraints, and/or the need for complex telescope and focal plane metrology. We propose an innovative system approach derived from the established TMA telescope concept, extended to achieve high filling factor of an annular field of view around the optical axis of the telescope. The proposed design is a very compact, 1 m class telescope compatible with modern CCD and CMOS detectors (EFL = 15 m). We describe the concept implementation guidelines and the optical performance of the current optical design. The diffraction limited FOV exceeds 1.25 square degrees, and the detector occupies the best 0.25 square degree with 66 devices.


title: Siamese Neural Network with Joint Bayesian Model Structure for Speaker Verification

abstract: Generative probability models are widely used for speaker verification (SV). However, the generative models are lack of discriminative feature selection ability. As a hypothesis test, the SV can be regarded as a binary classification task which can be designed as a Siamese neural network (SiamNN) with discriminative training. However, in most of the discriminative training for SiamNN, only the distribution of pair-wised sample distances is considered, and the additional discriminative information in joint distribution of samples is ignored. In this paper, we propose a novel SiamNN with consideration of the joint distribution of samples. The joint distribution of samples is first formulated based on a joint Bayesian (JB) based generative model, then a SiamNN is designed with dense layers to approximate the factorized affine transforms as used in the JB model. By initializing the SiamNN with the learned model parameters of the JB model, we further train the model parameters with the pair-wised samples as a binary discrimination task for SV. We carried out SV experiments on data corpus of speakers in the wild (SITW) and VoxCeleb. Experimental results showed that our proposed model improved the performance with a large margin compared with state of the art models for SV.


title: Antioxidant activity and toxicity study of cerium oxide nanoparticles stabilized with innovative functional copolymers

abstract: Oxidative stress, which is one of the main harmful mechanisms of pathologies including is-chemic stroke, contributes to both neurons and endothelial cell damages, leading to vascular lesions. Although many antioxidants have been tested in preclinical studies, no treatment is currently available for stroke patients. Since cerium oxide nanoparticles (CNPs) exhibit remarkable antioxidant capacities, our objective is to develop an innovative coating to enhance CNPs biocompatibility without disrupting their antioxidant capacities or enhance their toxicity. This study reports the synthesis and characterization of functional polymers and their impact on the enzyme-like catalytic activity of CNPs. To study the toxicity and the antioxidant properties of CNPs for stroke and particularly endothelial damages, in vitro studies are conducted on a cerebral endothelial cell line (bEnd.3). Despite their internalization in bEnd.3 cells, coated CNPs are devoid of cytotoxicity. Microscopy studies report an intracellular localization of CNPs, more precisely in endosomes. All CNPs reduces glutamate-induced intracellular production of ROS in endothelial cells but one CNP significantly reduces both the production of mitochondrial super-oxide anion and DNA oxidation. In vivo studies report a lack of toxicity in mice. This study there-fore describes and identifies biocompatible CNPs with interesting antioxidant properties for ischemic stroke and related pathologies.


title: Librispeech Transducer Model with Internal Language Model Prior Correction

abstract: We present our transducer model on Librispeech. We study variants to include an external language model (LM) with shallow fusion and subtract an estimated internal LM. This is justified by a Bayesian interpretation where the transducer model prior is given by the estimated internal LM. The subtraction of the internal LM gives us over 14% relative improvement over normal shallow fusion. Our transducer has a separate probability distribution for the non-blank labels which allows for easier combination with the external LM, and easier estimation of the internal LM. We additionally take care of including the end-of-sentence (EOS) probability of the external LM in the last blank probability which further improves the performance. All our code and setups are published.


title: Representative & Fair Synthetic Data

abstract: Algorithms learn rules and associations based on the training data that they are exposed to. Yet, the very same data that teaches machines to understand and predict the world, contains societal and historic biases, resulting in biased algorithms with the risk of further amplifying these once put into use for decision support. Synthetic data, on the other hand, emerges with the promise to provide an unlimited amount of representative, realistic training samples, that can be shared further without disclosing the privacy of individual subjects. We present a framework to incorporate fairness constraints into the self-supervised learning process, that allows to then simulate an unlimited amount of representative as well as fair synthetic data. This framework provides a handle to govern and control for privacy as well as for bias within AI at its very source: the training data. We demonstrate the proposed approach by amending an existing generative model architecture and generating a representative as well as fair version of the UCI Adult census data set. While the relationships between attributes are faithfully retained, the gender and racial biases inherent in the original data are controlled for. This is further validated by comparing propensity scores of downstream predictive models that are trained on the original data versus the fair synthetic data. We consider representative & fair synthetic data a promising future building block to teach algorithms not on historic worlds, but rather on the worlds that we strive to live in.


title: FedFace: Collaborative Learning of Face Recognition Model

abstract: DNN-based face recognition models require large centrally aggregated face datasets for training. However, due to the growing data privacy concerns and legal restrictions, accessing and sharing face datasets has become exceedingly difficult. We propose FedFace, a federated learning (FL) framework for collaborative learning of face recognition models in a privacy-aware manner. FedFace utilizes the face images available on multiple clients to learn an accurate and generalizable face recognition model where the face images stored at each client are neither shared with other clients nor the central host and each client is a mobile device containing face images pertaining to only the owner of the device (one identity per client). Our experiments show the effectiveness of FedFace in enhancing the verification performance of pre-trained face recognition system on standard face verification benchmarks namely LFW, IJB-A, and IJB-C.


title: The AS-NU System for the M2VoC Challenge

abstract: This paper describes the AS-NU systems for two tracks in MultiSpeaker Multi-Style Voice Cloning Challenge (M2VoC). The first track focuses on using a small number of 100 target utterances for voice cloning, while the second track focuses on using only 5 target utterances for voice cloning. Due to the serious lack of data in the second track, we selected the speaker most similar to the target speaker from the training data of the TTS system, and used the speaker's utterances and the given 5 target utterances to fine-tune our model. The evaluation results show that our systems on the two tracks perform similarly in terms of quality, but there is still a clear gap between the similarity score of the second track and the similarity score of the first track.


title: Ethical User Interfaces: Exploring the Effects of Dark Patterns on Facebook

abstract: Many researchers have been concerned with whether social media has a negative impact on the well-being of their audience. With the popularity of social networking sites (SNS) steadily increasing, psychological and social sciences have shown great interest in their effects and consequences on humans. In this work, we investigate Facebook using the tools of HCI to find connections between interface features and the concerns raised by these domains. Using an empirical design analysis, we identify interface interferences impacting users' online privacy. Through a subsequent survey (n=116), we find usage behaviour changes due to increased privacy concerns and report individual cases of addiction and mental health issues. These observations are the results of a rapidly changing SNS creating a gap of understanding between users' interactions with the platform and future consequences. We explore how HCI can help close this gap and work towards more ethical user interfaces in the future.