title: User-specific Adaptive Fine-tuning for Cross-domain Recommendations

abstract: Making accurate recommendations for cold-start users has been a longstanding and critical challenge for recommender systems (RS). Cross-domain recommendations (CDR) offer a solution to tackle such a cold-start problem when there is no sufficient data for the users who have rarely used the system. An effective approach in CDR is to leverage the knowledge (e.g., user representations) learned from a related but different domain and transfer it to the target domain. Fine-tuning works as an effective transfer learning technique for this objective, which adapts the parameters of a pre-trained model from the source domain to the target domain. However, current methods are mainly based on the global fine-tuning strategy: the decision of which layers of the pre-trained model to freeze or fine-tune is taken for all users in the target domain. In this paper, we argue that users in RS are personalized and should have their own fine-tuning policies for better preference transfer learning. As such, we propose a novel User-specific Adaptive Fine-tuning method (UAF), selecting which layers of the pre-trained network to fine-tune, on a per-user basis. Specifically, we devise a policy network with three alternative strategies to automatically decide which layers to be fine-tuned and which layers to have their parameters frozen for each user. Extensive experiments show that the proposed UAF exhibits significantly better and more robust performance for user cold-start recommendation.


title: Noradrenergic neuromodulation of nonlinear bursting neurons controls critical dynamics

abstract: In order to remain adaptable to a dynamic environment, neural activity must be simultaneously both sensitive and stable. To solve this problem, the brain has been hypothesised to sit near a critical boundary. Yet, precisely how criticality and these opposing information processing modes are implemented in the brain remains elusive. A potential solution to this problem involves modulating intrinsically nonlinear neurons within the cerebral cortex with neuromodulatory neurotransmitters such as noradrenaline, a highly-conserved chemical released from the pontine locus coeruleus. Here we confirm that neuronal spiking in mice is poised close to the critical point of a branching process and that time-varying signatures of criticality fluctuate with neuromodulatory tone, as assessed by dynamic alterations in pupil diameter. We explore these results theoretically by creating a dual-compartment model of non-linear pyramidal neurons - capable of both regular spike and bursting modes - that replicates our main empirical findings of slightly subcritical dynamics. We then probe our model at a resolution impossible in vivo to demonstrate that noradrenaline differentially alters spiking- and bursting-criticality to facilitate sensitive and stable dynamics following an inverted-U profile that peaks at intermediate noradrenergic tone. Finally, we demonstrate that this intermediate noradrenergic regime displays burst avalanches with power-law size and duration distributions and scaling relationship belonging to the universality class of self-organized criticality. Our results confirm that the noradrenergic ascending arousal system acts as a control parameter for emergent critical dynamics in the brain. This methodology could be extended to explore other neuromodulators as control parameters of the brain.


title: Fogging Jyaguchi Services in Tensai Gothalo

abstract: This paper describes the efficient method of fogging in Tensai Gothalo. Tensai Gothalo is a novel dynamic router device developed in Gautam-Asami Laboratory of Wakkanai Hokusei Gakuen University which has sensing, actuating, monitoring and movable capability. Similarly, fogging is a new concept of cloud computing at which the data plane is defined in user device. In this paper we would like to present the stepwise explanation about how to fog in Tensai Gothalo. Furthermore, we will elaborate a technique to decentralize data with improvement in QoS and reducing latency without affecting the legacy services of clouds that can still work together while needed.


title: Defending Touch-based Continuous Authentication Systems from Active Adversaries Using Generative Adversarial Networks

abstract: Previous studies have demonstrated that commonly studied (vanilla) touch-based continuous authentication systems (V-TCAS) are susceptible to population attack. This paper proposes a novel Generative Adversarial Network assisted TCAS (G-TCAS) framework, which showed more resilience to the population attack. G-TCAS framework was tested on a dataset of 117 users who interacted with a smartphone and tablet pair. On average, the increase in the false accept rates (FARs) for V-TCAS was much higher (22%) than G-TCAS (13%) for the smartphone. Likewise, the increase in the FARs for V-TCAS was 25% compared to G-TCAS (6%) for the tablet.


title: Voting for the right answer: Adversarial defense for speaker verification

abstract: Automatic speaker verification (ASV) is a well developed technology for biometric identification, and has been ubiquitous implemented in security-critic applications, such as banking and access control. However, previous works have shown that ASV is under the radar of adversarial attacks, which are very similar to their original counterparts from human's perception, yet will manipulate the ASV render wrong prediction. Due to the very late emergence of adversarial attacks for ASV, effective countermeasures against them are limited. Given that the security of ASV is of high priority, in this work, we propose the idea of "voting for the right answer" to prevent risky decisions of ASV in blind spot areas, by employing random sampling and voting. Experimental results show that our proposed method improves the robustness against both the limited-knowledge attackers by pulling the adversarial samples out of the blind spots, and the perfect-knowledge attackers by introducing randomness and increasing the attackers' budgets.


title: Scalable higher-order exceptional surface with passive resonators

abstract: The sensitivity of perturbation sensing can be effectively enhanced with higher-order exceptional points due to the nonlinear response to frequency splitting. However, the experimental implementation is challenging since all the parameters need to be precisely prepared. The emergence of exceptional surface (ES) improves the robustness of the system to the external environment, while maintaining the same sensitivity. Here, we propose the first scalable protocol for realizing photonic high-order exceptional surface with passive resonators. By adding one or more additional passive resonators in the low-order ES photonic system, the 3- or arbitrary N-order ES is constructed and proved to be easily realized in experiment. We show that the sensitivity is enhanced and experimental demonstration is more resilent against the fabrication errors. The additional phase-modulation effect is also investigated.


title: Implementation of Optimal Thermal Radiation Pumps using Adiabatically Modulated Photonic Cavities

abstract: We numerically implement the concept of thermal radiation pumps in realistic photonic circuits and demonstrate their efficiency to control the radiation current, emitted between two reservoirs with equal temperature. The proposed pumping scheme involves a cyclic adiabatic modulation of two parameters that control the spectral characteristics of the photonic circuit. We show that the resulting pumping cycle exhibits maximum radiation current when a cyclic modulation of the system is properly engineered to be in the proximity of a resonance degeneracy in the parameter space of the photonic circuit. A developed Floquet scattering framework, which in the adiabatic limit boils down to the analysis of an instantaneous scattering matrix, is offering an engineering tool for designing and predicting the performance of such thermal pumps. Our predictions are confirmed by time-domain simulations invoking an adiabatically driven photonic cavity.


title: Express the number of spanning trees in term of degrees

abstract: It is well-known that the number of spanning trees, denoted by $\tau(G)$, in a connected multi-graph $G$ can be calculated by the Matrix-Tree theorem and Tutte's deletion-contraction theorem. In this short note, we find an alternate method to compute $\tau(G)$ by degrees of vertices.


title: Planar multi-aperture fish-eye lens using metagrating

abstract: The design of compact optical systems with large field of view has been difficult due to the requirement of many elements or a curved focal plane to reduce off-axis aberration. We propose a multi-aperture lens design to effectively resolve these issues. Metagrating-based deflectors are placed near entrance pupils of multi-aperture lens array to enhance field of view. A systematic design method is given in details. In design examples, a $\pm$80$^\circ$ field of view using only two planar optical elements is achieved. Also, the system is extremely compact with total track lengths an order of magnitude smaller than conventional fish-eye lenses, while the imaging performance is comparable with conventional designs.


title: Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images

abstract: State-of-the-art (SOTA) Generative Models (GMs) can synthesize photo-realistic images that are hard for humans to distinguish from genuine photos. Identifying and understanding manipulated media are crucial to mitigate the social concerns on the potential misuse of GMs. We propose to perform reverse engineering of GMs to infer model hyperparameters from the images generated by these models. We define a novel problem, ``model parsing", as estimating GM network architectures and training loss functions by examining their generated images -- a task seemingly impossible for human beings. To tackle this problem, we propose a framework with two components: a Fingerprint Estimation Network (FEN), which estimates a GM fingerprint from a generated image by training with four constraints to encourage the fingerprint to have desired properties, and a Parsing Network (PN), which predicts network architecture and loss functions from the estimated fingerprints. To evaluate our approach, we collect a fake image dataset with $100$K images generated by $116$ different GMs. Extensive experiments show encouraging results in parsing the hyperparameters of the unseen models. Finally, our fingerprint estimation can be leveraged for deepfake detection and image attribution, as we show by reporting SOTA results on both the deepfake detection (Celeb-DF) and image attribution benchmarks.


title: Towards the Objective Speech Assessment of Smoking Status based on Voice Features: A Review of the Literature

abstract: In smoking cessation clinical research and practice, objective validation of self-reported smoking status is crucial for ensuring the reliability of the primary outcome, that is, smoking abstinence. Speech signals convey important information about a speaker, such as age, gender, body size, emotional state, and health state. We investigated (1) if smoking could measurably alter voice features, (2) if smoking cessation could lead to changes in voice, and therefore (3) if the voice-based smoking status assessment has the potential to be used as an objective smoking cessation validation method.


title: S-LIME: Stabilized-LIME for Model Explanation

abstract: An increasing number of machine learning models have been deployed in domains with high stakes such as finance and healthcare. Despite their superior performances, many models are black boxes in nature which are hard to explain. There are growing efforts for researchers to develop methods to interpret these black-box models. Post hoc explanations based on perturbations, such as LIME, are widely used approaches to interpret a machine learning model after it has been built. This class of methods has been shown to exhibit large instability, posing serious challenges to the effectiveness of the method itself and harming user trust. In this paper, we propose S-LIME, which utilizes a hypothesis testing framework based on central limit theorem for determining the number of perturbation points needed to guarantee stability of the resulting explanation. Experiments on both simulated and real world data sets are provided to demonstrate the effectiveness of our method.


title: Vision-Language Navigation with Random Environmental Mixup

abstract: Vision-language Navigation (VLN) tasks require an agent to navigate step-by-step while perceiving the visual observations and comprehending a natural language instruction. Large data bias, which is caused by the disparity ratio between the small data scale and large navigation space, makes the VLN task challenging. Previous works have proposed various data augmentation methods to reduce data bias. However, these works do not explicitly reduce the data bias across different house scenes. Therefore, the agent would overfit to the seen scenes and achieve poor navigation performance in the unseen scenes. To tackle this problem, we propose the Random Environmental Mixup (REM) method, which generates cross-connected house scenes as augmented data via mixuping environment. Specifically, we first select key viewpoints according to the room connection graph for each scene. Then, we cross-connect the key views of different scenes to construct augmented scenes. Finally, we generate augmented instruction-path pairs in the cross-connected scenes. The experimental results on benchmark datasets demonstrate that our augmentation data via REM help the agent reduce its performance gap between the seen and unseen environment and improve the overall performance, making our model the best existing approach on the standard VLN benchmark. The code have released: https://github.com/LCFractal/VLNREM.


title: Learning Revenue-Maximizing Auctions With Differentiable Matching

abstract: We propose a new architecture to approximately learn incentive compatible, revenue-maximizing auctions from sampled valuations. Our architecture uses the Sinkhorn algorithm to perform a differentiable bipartite matching which allows the network to learn strategyproof revenue-maximizing mechanisms in settings not learnable by the previous RegretNet architecture. In particular, our architecture is able to learn mechanisms in settings without free disposal where each bidder must be allocated exactly some number of items. In experiments, we show our approach successfully recovers multiple known optimal mechanisms and high-revenue, low-regret mechanisms in larger settings where the optimal mechanism is unknown.


title: Some signed graphs whose eigenvalues are main

abstract: Let $G$ be a graph. For a subset $X$ of $V(G)$, the switching $\sigma$ of $G$ is the signed graph $G^{\sigma}$ obtained from $G$ by reversing the signs of all edges between $X$ and $V(G)\setminus X$. Let $A(G^{\sigma})$ be the adjacency matrix of $G^{\sigma}$. An eigenvalue of $A(G^{\sigma})$ is called a main eigenvalue if it has an eigenvector the sum of whose entries is not equal to zero. Let $S_{n,k}$ be the graph obtained from the complete graph $K_{n-r}$ by attaching $r$ pendent edges at some vertex of $K_{n-r}$. In this paper we prove that there exists a switching $\sigma$ such that all eigenvalues of $G^{\sigma}$ are main when $G$ is a complete multipartite graph, or $G$ is a harmonic tree, or $G$ is $S_{n,k}$. These results partly confirm a conjecture of Akbari et al.


title: A Lightweight ReLU-Based Feature Fusion for Aerial Scene Classification

abstract: In this paper, we propose a transfer-learning based model construction technique for the aerial scene classification problem. The core of our technique is a layer selection strategy, named ReLU-Based Feature Fusion (RBFF), that extracts feature maps from a pretrained CNN-based single-object image classification model, namely MobileNetV2, and constructs a model for the aerial scene classification task. RBFF stacks features extracted from the batch normalization layer of a few selected blocks of MobileNetV2, where the candidate blocks are selected based on the characteristics of the ReLU activation layers present in those blocks. The feature vector is then compressed into a low-dimensional feature space using dimension reduction algorithms on which we train a low-cost SVM classifier for the classification of the aerial images. We validate our choice of selected features based on the significance of the extracted features with respect to our classification pipeline. RBFF remarkably does not involve any training of the base CNN model except for a few parameters for the classifier, which makes the technique very cost-effective for practical deployments. The constructed model despite being lightweight outperforms several recently proposed models in terms of accuracy for a number of aerial scene datasets.


title: Scaling Neural Tangent Kernels via Sketching and Random Features

abstract: The Neural Tangent Kernel (NTK) characterizes the behavior of infinitely-wide neural networks trained under least squares loss by gradient descent. Recent works also report that NTK regression can outperform finitely-wide neural networks trained on small-scale datasets. However, the computational complexity of kernel methods has limited its use in large-scale learning tasks. To accelerate learning with NTK, we design a near input-sparsity time approximation algorithm for NTK, by sketching the polynomial expansions of arc-cosine kernels: our sketch for the convolutional counterpart of NTK (CNTK) can transform any image using a linear runtime in the number of pixels. Furthermore, we prove a spectral approximation guarantee for the NTK matrix, by combining random features (based on leverage score sampling) of the arc-cosine kernels with a sketching algorithm. We benchmark our methods on various large-scale regression and classification tasks and show that a linear regressor trained on our CNTK features matches the accuracy of exact CNTK on CIFAR-10 dataset while achieving 150x speedup.


title: Mixed Model OCR Training on Historical Latin Script for Out-of-the-Box Recognition and Finetuning

abstract: In order to apply Optical Character Recognition (OCR) to historical printings of Latin script fully automatically, we report on our efforts to construct a widely-applicable polyfont recognition model yielding text with a Character Error Rate (CER) around 2% when applied out-of-the-box. Moreover, we show how this model can be further finetuned to specific classes of printings with little manual and computational effort. The mixed or polyfont model is trained on a wide variety of materials, in terms of age (from the 15th to the 19th century), typography (various types of Fraktur and Antiqua), and languages (among others, German, Latin, and French). To optimize the results we combined established techniques of OCR training like pretraining, data augmentation, and voting. In addition, we used various preprocessing methods to enrich the training data and obtain more robust models. We also implemented a two-stage approach which first trains on all available, considerably unbalanced data and then refines the output by training on a selected more balanced subset. Evaluations on 29 previously unseen books resulted in a CER of 1.73%, outperforming a widely used standard model with a CER of 2.84% by almost 40%. Training a more specialized model for some unseen Early Modern Latin books starting from our mixed model led to a CER of 1.47%, an improvement of up to 50% compared to training from scratch and up to 30% compared to training from the aforementioned standard model. Our new mixed model is made openly available to the community.


title: Do the Hodge spectra distinguish orbifolds from manifolds? Part 1

abstract: We examine the relationship between the singular set of a compact Riemannian orbifold and the spectrum of the Hodge Laplacian on $p$-forms by computing the heat invariants associated to the $p$-spectrum. We show that the heat invariants of the $0$-spectrum together with those of the $1$-spectrum for the corresponding Hodge Laplacians are sufficient to distinguish orbifolds with singularities from manifolds as long as the singular sets have codimension $\le 3.$ This is enough to distinguish orbifolds from manifolds for dimension $\le 3.$


title: Deuterated Polycyclic Aromatic Hydrocarbons in the Interstellar Medium: The C--D Band Strengths of Multi-Deuterated Species

abstract: Observationally, the interstellar gas-phase abundance of deuterium (D) is considerably depleted and the missing D atoms are often postulated to have been locked up into carbonaceous solids and polycyclic aromatic hydrocarbon (PAH) molecules. An accurate knowledge of the fractional amount of D (relative to H) tied up in carbon dust and PAHs has important cosmological implications since D originated exclusively from the Big Bang and the present-day D abundance, after accounting for the astration it has experienced during the Galactic evolution, provides essential clues to the primordial nucleosynthesis and the cosmological parameters. To quantitatively explore the extent to which PAHs could possibly accommodate the observed D depletion, we have previously quantum-chemically computed the infrared vibrational spectra of mono-deuterated PAHs and derived the mean intrinsic band strengths of the 3.3 $\mu$m C--H stretch (A$_{3.3}$) and the 4.4 $\mu$m C--D stretch (A$_{4.4}$). Here we extend our previous work to multi-deuterated PAH species of different deuterations, sizes and structures. We find that both the intrinsic band strengths A$_{3.3}$ and A$_{4.4}$ and their ratios A$_{4.4}$/A$_{3.3}$ not only show little variations among PAHs of different deuterations, sizes and structures, they are also closely similar to that of mono-deuterated PAHs. Therefore, a PAH deuteration level (i.e., the fraction of peripheral atoms attached to C atoms in the form of D) of ~2.4% previously estimated from the observed 4.4 $\mu$m to 3.3 $\mu$m band ratio based on the A$_{4.4}$/A$_{3.3}$ ratio of mono-deuterated PAHs is robust.


title: Quantum Turing bifurcation: Transition from quantum amplitude death to quantum oscillation death

abstract: An important transition from a homogeneous steady state to an inhomogeneous steady state via the Turing bifurcation in coupled oscillators was reported in [Phys. Rev. Lett. {\bf 111}, 024103 (2013)]. However, the same in the quantum domain is yet to be observed. In this paper, we discover the quantum analogue of the Turing bifurcation in coupled quantum oscillators. We show that a homogeneous steady state is transformed into an inhomogeneous steady state through this bifurcation in coupled quantum van der Pol oscillators. We demonstrate our results by a direct simulation of the quantum master equation in the Lindblad form. We further support our observations through an analytical treatment of the noisy classical model. Our study explores the paradigmatic Turing bifurcation at the quantum-classical interface and opens up the door towards its broader understanding.

categories: quant-ph cond-mat.stat-mech nlin.CD nlin.PS physics.optics


title: Signatures of deconfined quark phases in binary neutron star mergers

abstract: (abridged) We investigate the quark deconfinement phase transition in the context of binary neutron star (BNS) mergers. We employ a new finite-temperature composition-dependent equation of state (EOS) with a first order phase transition between hadrons and deconfined quarks to perform numerical relativity simulations of BNS mergers. The softening of the EOS due to the phase transition causes the merger remnants to be more compact and to collapse to a black hole (BH) at earlier times. The phase transition is imprinted on the postmerger gravitational wave (GW) signal duration, amplitude, and peak frequency. However, this imprint is only detectable for binaries with sufficiently long-lived remnants. Moreover, the phase transition does not result in significant deviations from quasi-universal relations for the postmerger GW peak frequency. We also study the impact of the phase transition on dynamical ejecta, remnant accretion disk masses, r-process nucleosynthetic yields and associated electromagnetic (EM) counterparts. While there are differences in the EM counterparts and nucleosynthesis yields between the purely hadronic models and the models with phase transitions, these can be primarily ascribed to the difference in remnant collapse time between the two. An exception is the non-thermal afterglow caused by the interaction of the fastest component of the dynamical ejecta and the interstellar medium, which is systematically boosted in the binaries with phase transition as a consequence of the more violent merger they experience.


title: MLP Singer: Towards Rapid Parallel Korean Singing Voice Synthesis

abstract: Recent developments in deep learning have significantly improved the quality of synthesized singing voice audio. However, prominent neural singing voice synthesis systems suffer from slow inference speed due to their autoregressive design. Inspired by MLP-Mixer, a novel architecture introduced in the vision literature for attention-free image classification, we propose MLP Singer, a parallel Korean singing voice synthesis system. To the best of our knowledge, this is the first work that uses an entirely MLP-based architecture for voice synthesis. Listening tests demonstrate that MLP Singer outperforms a larger autoregressive GAN-based system, both in terms of audio quality and synthesis speed. In particular, MLP Singer achieves a real-time factor of up to 200 and 3400 on CPUs and GPUs respectively, enabling order of magnitude faster generation on both environments.


title: Credit Assignment in Neural Networks through Deep Feedback Control

abstract: The success of deep learning sparked interest in whether the brain learns by using similar techniques for assigning credit to each synaptic weight for its contribution to the network output. However, the majority of current attempts at biologically-plausible learning methods are either non-local in time, require highly specific connectivity motives, or have no clear link to any known mathematical optimization method. Here, we introduce Deep Feedback Control (DFC), a new learning method that uses a feedback controller to drive a deep neural network to match a desired output target and whose control signal can be used for credit assignment. The resulting learning rule is fully local in space and time and approximates Gauss-Newton optimization for a wide range of feedback connectivity patterns. To further underline its biological plausibility, we relate DFC to a multi-compartment model of cortical pyramidal neurons with a local voltage-dependent synaptic plasticity rule, consistent with recent theories of dendritic processing. By combining dynamical system theory with mathematical optimization theory, we provide a strong theoretical foundation for DFC that we corroborate with detailed results on toy experiments and standard computer-vision benchmarks.


title: Polyharmonic hypersurfaces into pseudo-Riemannian space forms

abstract: In this paper we shall assume that the ambient manifold is a pseudo-Riemannian space form $N^{m+1}_t(c)$ of dimension $m+1$ and index $t$ ($m\geq2$ and $1 \leq t\leq m$). We shall study hypersurfaces $M^{m}_{t'}$ which are polyharmonic of order $r$ (briefly, $r$-harmonic), where $r\geq 3$ and either $t'=t$ or $t'=t-1$. Let $A$ denote the shape operator of $M^{m}_{t'}$. Under the assumptions that $M^{m}_{t'}$ is CMC and $Tr A^2$ is a constant, we shall obtain the general condition which determines that $M^{m}_{t'}$ is $r$-harmonic. As a first application, we shall deduce the existence of several new families of proper $r$-harmonic hypersurfaces with diagonalizable shape operator, and we shall also obtain some results in the direction that our examples are the only possible ones provided that certain assumptions on the principal curvatures hold. Next, we focus on the study of isoparametric hypersurfaces whose shape operator is non-diagonalizable and also in this context we shall prove the existence of some new examples of proper $r$-harmonic hypersurfaces ($r \geq 3$). Finally, we shall obtain the complete classification of proper $r$-harmonic isoparametric pseudo-Riemannian surfaces into a $3$-dimensional Lorentz space form.


title: UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation

abstract: Most neural vocoders employ band-limited mel-spectrograms to generate waveforms. If full-band spectral features are used as the input, the vocoder can be provided with as much acoustic information as possible. However, in some models employing full-band mel-spectrograms, an over-smoothing problem occurs as part of which non-sharp spectrograms are generated. To address this problem, we propose UnivNet, a neural vocoder that synthesizes high-fidelity waveforms in real time. Inspired by works in the field of voice activity detection, we added a multi-resolution spectrogram discriminator that employs multiple linear spectrogram magnitudes computed using various parameter sets. Using full-band mel-spectrograms as input, we expect to generate high-resolution signals by adding a discriminator that employs spectrograms of multiple resolutions as the input. In an evaluation on a dataset containing information on hundreds of speakers, UnivNet obtained the best objective and subjective results among competing models for both seen and unseen speakers. These results, including the best subjective score for text-to-speech, demonstrate the potential for fast adaptation to new speakers without a need for training from scratch.


title: An enriched category theory of language: from syntax to semantics

abstract: State of the art language models return a natural language text continuation from any piece of input text. This ability to generate coherent text extensions implies significant sophistication, including a knowledge of grammar and semantics. In this paper, we propose a mathematical framework for passing from probability distributions on extensions of given texts, such as the ones learned by today's large language models, to an enriched category containing semantic information. Roughly speaking, we model probability distributions on texts as a category enriched over the unit interval. Objects of this category are expressions in language, and hom objects are conditional probabilities that one expression is an extension of another. This category is syntactical -- it describes what goes with what. Then, via the Yoneda embedding, we pass to the enriched category of unit interval-valued copresheaves on this syntactical category. This category of enriched copresheaves is semantic -- it is where we find meaning, logical operations such as entailment, and the building blocks for more elaborate semantic concepts.


title: Film strains enhance the reversible cycling of intercalation electrodes

abstract: A key cause of chemo-mechanical degradation in battery electrodes is that they undergo abrupt phase transformation during the charging/discharging cycle. This phase transformation is accompanied by lattice misfit strains that nucleate microcracks, induce fracture and, in extreme cases, amorphize the intercalation electrode. In this work, we propose a strategy to prevent the chemo-mechanical degradation of intercalation electrodes: we show that by engineering suitable film strains we can regulate the phase transformations in thin-film intercalation electrodes and circumvent the large volume changes. We test this strategy using a combination of theory and experiment: we first analytically derive the effect of film strain on the electrochemical response of a thin-film intercalation electrode and next apply our analytical model to a representative example (LixV2O5 with multiple phase transformations). We then test our theoretical predictions experimentally. Specifically, we electrochemically cycle thin-film V2O5 electrodes with different film strains and measure their structure, voltage, and stress responses. Our findings show that tensile film strains lower the voltage for phase transformations in thin-film V2O5 electrodes and facilitate their reversible cycling across a wider voltage window without chemo-mechanical degradation. These results suggest that film strain engineering is an alternative approach to preventing chemo-mechanical degradation in intercalation electrodes. Beyond thin-film electrodes, our findings from this study are applicable to the study of stress-induced phase transformations in particle-based electrodes and the thin surface layers forming on cathode particles.


title: Towards Safe Control of Continuum Manipulator Using Shielded Multiagent Reinforcement Learning

abstract: Continuum robotic manipulators are increasingly adopted in minimal invasive surgery. However, their nonlinear behavior is challenging to model accurately, especially when subject to external interaction, potentially leading to poor control performance. In this letter, we investigate the feasibility of adopting a model-free multiagent reinforcement learning (RL), namely multiagent deep Q network (MADQN), to control a 2-degree of freedom (DoF) cable-driven continuum surgical manipulator. The control of the robot is formulated as a one-DoF, one agent problem in the MADQN framework to improve the learning efficiency. Combined with a shielding scheme that enables dynamic variation of the action set boundary, MADQN leads to efficient and importantly safer control of the robot. Shielded MADQN enabled the robot to perform point and trajectory tracking with submillimeter root mean square errors under external loads, soft obstacles, and rigid collision, which are common interaction scenarios encountered by surgical manipulators. The controller was further proven to be effective in a miniature continuum robot with high structural nonlinearitiy, achieving trajectory tracking with submillimeter accuracy under external payload.


title: A General Purpose Transpiler for Fully Homomorphic Encryption

abstract: Fully homomorphic encryption (FHE) is an encryption scheme which enables computation on encrypted data without revealing the underlying data. While there have been many advances in the field of FHE, developing programs using FHE still requires expertise in cryptography. In this white paper, we present a fully homomorphic encryption transpiler that allows developers to convert high-level code (e.g., C++) that works on unencrypted data into high-level code that operates on encrypted data. Thus, our transpiler makes transformations possible on encrypted data. Our transpiler builds on Google's open-source XLS SDK (https://github.com/google/xls) and uses an off-the-shelf FHE library, TFHE (https://tfhe.github.io/tfhe/), to perform low-level FHE operations. The transpiler design is modular, which means the underlying FHE library as well as the high-level input and output languages can vary. This modularity will help accelerate FHE research by providing an easy way to compare arbitrary programs in different FHE schemes side-by-side. We hope this lays the groundwork for eventual easy adoption of FHE by software developers. As a proof-of-concept, we are releasing an experimental transpiler (https://github.com/google/fully-homomorphic-encryption/tree/main/transpiler) as open-source software.


title: S2Engine: A Novel Systolic Architecture for Sparse Convolutional Neural Networks

abstract: Convolutional neural networks (CNNs) have achieved great success in performing cognitive tasks. However, execution of CNNs requires a large amount of computing resources and generates heavy memory traffic, which imposes a severe challenge on computing system design. Through optimizing parallel executions and data reuse in convolution, systolic architecture demonstrates great advantages in accelerating CNN computations. However, regular internal data transmission path in traditional systolic architecture prevents the systolic architecture from completely leveraging the benefits introduced by neural network sparsity. Deployment of fine-grained sparsity on the existing systolic architectures is greatly hindered by the incurred computational overheads. In this work, we propose S2Engine $-$ a novel systolic architecture that can fully exploit the sparsity in CNNs with maximized data reuse. S2Engine transmits compressed data internally and allows each processing element to dynamically select an aligned data from the compressed dataflow in convolution. Compared to the naive systolic array, S2Engine achieves about $3.2\times$ and about $3.0\times$ improvements on speed and energy efficiency, respectively.


title: CAN-LOC: Spoofing Detection and Physical Intrusion Localization on an In-Vehicle CAN Bus Based on Deep Features of Voltage Signals

abstract: The Controller Area Network (CAN) is used for communication between in-vehicle devices. The CAN bus has been shown to be vulnerable to remote attacks. To harden vehicles against such attacks, vehicle manufacturers have divided in-vehicle networks into sub-networks, logically isolating critical devices. However, attackers may still have physical access to various sub-networks where they can connect a malicious device. This threat has not been adequately addressed, as methods proposed to determine physical intrusion points have shown weak results, emphasizing the need to develop more advanced techniques. To address this type of threat, we propose a security hardening system for in-vehicle networks. The proposed system includes two mechanisms that process deep features extracted from voltage signals measured on the CAN bus. The first mechanism uses data augmentation and deep learning to detect and locate physical intrusions when the vehicle starts; this mechanism can detect and locate intrusions, even when the connected malicious devices are silent. This mechanism's effectiveness (100% accuracy) is demonstrated in a wide variety of insertion scenarios on a CAN bus prototype. The second mechanism is a continuous device authentication mechanism, which is also based on deep learning; this mechanism's robustness (99.8% accuracy) is demonstrated on a real moving vehicle.


title: Unusual competition of superconductivity and charge-density-wave state in a compressed topological kagome metal

abstract: Understanding the competition between superconductivity and other ordered states (such as antiferromagnetic or charge-density-wave (CDW) state) is a central issue in condensed matter physics. The recently discovered layered kagome metal AV3Sb5 (A = K, Rb, and Cs) provides us a new playground to study the interplay of superconductivity and CDW state by involving nontrivial topology of band structures. Here, we conduct high-pressure electrical transport and magnetic susceptibility measurements to study CsV3Sb5 with the highest Tc of 2.7 K in AV3Sb5 family. While the CDW transition is monotonically suppressed by pressure, superconductivity is enhanced with increasing pressure up to P1~0.7 GPa, then an unexpected suppression on superconductivity happens until pressure around 1.1 GPa, after that, Tc is enhanced with increasing pressure again. The CDW is completely suppressed at a critical pressure P2~2 GPa together with a maximum Tc of about 8 K. In contrast to a common dome-like behavior, the pressure-dependent Tc shows an unexpected double-peak behavior. The unusual suppression of Tc at P1 is concomitant with the rapidly damping of quantum oscillations, sudden enhancement of the residual resistivity and rapid decrease of magnetoresistance. Our discoveries indicate an unusual competition between superconductivity and CDW state in pressurized kagome lattice.


title: On the multiparameter Falconer distance problem

abstract: We study an extension of the Falconer distance problem in the multiparameter setting. Given $\ell\geq 1$ and $\mathbb{R}^{d}=\mathbb{R}^{d_1}\times\cdots \times\mathbb{R}^{d_\ell}$, $d_i\geq 2$. For any compact set $E\subset \mathbb{R}^{d}$ with Hausdorff dimension larger than $d-\frac{\min(d_i)}{2}+\frac{1}{4}$ if $\min(d_i) $ is even, $d-\frac{\min(d_i)}{2}+\frac{1}{4}+\frac{1}{4\min(d_i)}$ if $\min(d_i) $ is odd, we prove that the multiparameter distance set of $E$ has positive $\ell$-dimensional Lebesgue measure. A key ingredient in the proof is a new multiparameter radial projection theorem for fractal measures.


title: Divergence Frontiers for Generative Models: Sample Complexity, Quantization Effects, and Frontier Integrals

abstract: The spectacular success of deep generative models calls for quantitative tools to measure their statistical performance. Divergence frontiers have recently been proposed as an evaluation framework for generative models, due to their ability to measure the quality-diversity trade-off inherent to deep generative modeling. We establish non-asymptotic bounds on the sample complexity of divergence frontiers. We also introduce frontier integrals which provide summary statistics of divergence frontiers. We show how smoothed estimators such as Good-Turing or Krichevsky-Trofimov can overcome the missing mass problem and lead to faster rates of convergence. We illustrate the theoretical results with numerical examples from natural language processing and computer vision.


title: Charging batteries with quantum squeezing

abstract: We present a scheme for the charging of a quantum battery based on the dynamics of an open quantum system undergoing coherent quantum squeezing and affected by an incoherent squeezed thermal bath. We show that quantum coherence, as instigated by the application of coherent squeezing, are key in the determination of the performance of the charging process, which is efficiency-enhanced at low environmental temperature and under a strong squeezed driving.


title: ATD: Augmenting CP Tensor Decomposition by Self Supervision

abstract: Tensor decompositions are powerful tools for dimensionality reduction and feature interpretation of multidimensional data such as signals. Existing tensor decomposition objectives (e.g., Frobenius norm) are designed for fitting raw data under statistical assumptions, which may not align with downstream classification tasks. In practice, raw input tensors can contain irrelevant information while data augmentation techniques may be used to smooth out class-irrelevant noise in samples. This paper addresses the above challenges by proposing augmented tensor decomposition (ATD), which effectively incorporates data augmentations and self-supervised learning (SSL) to boost downstream classification. To address the non-convexity of the new augmented objective, we develop an iterative method that enables the optimization to follow an alternating least squares (ALS) fashion. We evaluate our proposed ATD on multiple datasets. It can achieve 0.8% - 2.5% accuracy gain over tensor-based baselines. Also, our ATD model shows comparable or better performance (e.g., up to 15% in accuracy) over self-supervised and autoencoder baselines while using less than 5% of learnable parameters of these baseline models


title: FIGARO Simulation: FIlaments & GAlactic RadiO Simulation

abstract: We produce the first low to mid frequency radio simulation that incorporates both traditional extragalactic radio sources as well as synchrotron cosmic web emission. The FIlaments \& GAlactic RadiO (FIGARO) simulation includes ten unique \SI{4x4}{\degree} fields, incorporating active galactic nucleii (AGNs), star forming galaxies (SFGs) and synchrotron cosmic web emission out to a redshift of $z = 0.8$ and over the frequency range 100-1400 MHz. To do this, the simulation brings together a recent $100^3$ Mpc$^3$ magneto-hydrodynamic simulation (Vazza et al., 2019), calibrated to match observed radio relic population statistics, alongside updated `T-RECS' code for simulating extragalactic radio sources (Bonaldi et al., 2019). Uniquely, the AGNs and SFGs are populated and positioned in accordance with the underlying matter density of the cosmological simulation. In this way, the simulation provides an accurate understanding of the apparent morphology, angular scales, and brightness of the cosmic web as well as -- crucially -- the clustering properties of the cosmic web with respect to the embedded extragalactic radio population. We find that the synchrotron cosmic web does not closely trace the underlying mass distribution of the cosmic web, but is instead dominated by shocked shells of emission surrounding dark matter halos and resembles a large, undetected population of radio relics. We also show that, with accurate kernels, the cosmic web radio emission is clearly detectable by cross-correlation techniques and this signal is separable from the embedded extragalactic radio population. We offer the simulation as a public resource towards the development of techniques for detecting and measuring the synchrotron cosmic web.


title: Mid-$J$ CO Line Observations of Protostellar Outflows in the Orion Molecular Clouds

abstract: Ten protostellar outflows in the Orion molecular clouds were mapped in the $^{12}$CO/$^{13}$CO ${J=6\rightarrow5}$ and $^{12}$CO ${J=7\rightarrow6}$ lines. The maps of these mid-$J$ CO lines have an angular resolution of about 10$''$ and a typical field size of about 100$''$. Physical parameters of the molecular outflows were derived, including mass transfer rates, kinetic luminosities, and outflow forces. The outflow sample was expanded by re-analyzing archival data of nearby low-luminosity protostars, to cover a wide range of bolometric luminosities. Outflow parameters derived from other transitions of CO were compared. The mid-$J$ ($J_{\rm up} \approx 6$) and low-$J$ ($J_{\rm up} \leq 3$) CO line wings trace essentially the same outflow component. By contrast, the high-$J$ (up to $J_{\rm up} \approx 50$) line-emission luminosity of CO shows little correlation with the kinetic luminosity from the ${J=6\rightarrow5}$ line, which suggests that they trace distinct components. The low/mid-$J$ CO line wings trace long-term outflow behaviors while the high-$J$ CO lines are sensitive to short-term activities. The correlations between the outflow parameters and protostellar properties are presented, which shows that the strengths of molecular outflows increase with bolometric luminosity and envelope mass.


title: Robust Out-of-Distribution Detection on Deep Probabilistic Generative Models

abstract: Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample. However, such models frequently assign a suspiciously high likelihood to a specific outlier. Several recent works have addressed this issue by training a neural network with auxiliary outliers, which are generated by perturbing the input data. In this paper, we discover that these approaches fail for certain OOD datasets. Thus, we suggest a new detection metric that operates without outlier exposure. We observe that our metric is robust to diverse variations of an image compared to the previous outlier-exposing methods. Furthermore, our proposed score requires neither auxiliary models nor additional training. Instead, this paper utilizes the likelihood ratio statistic in a new perspective to extract genuine properties from the given single deep probabilistic generative model. We also apply a novel numerical approximation to enable fast implementation. Finally, we demonstrate comprehensive experiments on various probabilistic generative models and show that our method achieves state-of-the-art performance.


title: Probabilistic Margins for Instance Reweighting in Adversarial Training

abstract: Reweighting adversarial data during training has been recently shown to improve adversarial robustness, where data closer to the current decision boundaries are regarded as more critical and given larger weights. However, existing methods measuring the closeness are not very reliable: they are discrete and can take only a few values, and they are path-dependent, i.e., they may change given the same start and end points with different attack paths. In this paper, we propose three types of probabilistic margin (PM), which are continuous and path-independent, for measuring the aforementioned closeness and reweighting adversarial data. Specifically, a PM is defined as the difference between two estimated class-posterior probabilities, e.g., such the probability of the true label minus the probability of the most confusing label given some natural data. Though different PMs capture different geometric properties, all three PMs share a negative correlation with the vulnerability of data: data with larger/smaller PMs are safer/riskier and should have smaller/larger weights. Experiments demonstrate that PMs are reliable measurements and PM-based reweighting methods outperform state-of-the-art methods.


title: Non-Gradient Manifold Neural Network

abstract: Deep neural network (DNN) generally takes thousands of iterations to optimize via gradient descent and thus has a slow convergence. In addition, softmax, as a decision layer, may ignore the distribution information of the data during classification. Aiming to tackle the referred problems, we propose a novel manifold neural network based on non-gradient optimization, i.e., the closed-form solutions. Considering that the activation function is generally invertible, we reconstruct the network via forward ridge regression and low rank backward approximation, which achieve the rapid convergence. Moreover, by unifying the flexible Stiefel manifold and adaptive support vector machine, we devise the novel decision layer which efficiently fits the manifold structure of the data and label information. Consequently, a jointly non-gradient optimization method is designed to generate the network with closed-form results. Eventually, extensive experiments validate the superior performance of the model.


title: On the merit of hot ion mode for tearing mode stabilization

abstract: The stabilization of tearing modes with rf driven current benefits from the cooperative feedback loop between rf power deposition and electron temperature within the island. This effect, termed rf current condensation, can greatly enhance and localize current driven within magnetic islands. It has previously been shown that the condensation effect opens the possibility of passive stabilization with broad rf profiles, as would be typical of LHCD for steady state operation. Here we show that this self-healing effect can be dramatically amplified by operation in a hot ion mode, due to the additional electron heat source provided by the hotter ions.


title: Rice's theorem for generic limit sets of cellular automata

abstract: The generic limit set of a cellular automaton is a topologically dened set of congurations that intends to capture the asymptotic behaviours while avoiding atypical ones. It was dened by Milnor then studied by Djenaoui and Guillon rst, and by T{\"o}rm{\"a} later. They gave properties of this set related to the dynamics of the cellular automaton, and the maximal complexity of its language. In this paper, we prove that every non trivial property of these generic limit sets of cellular automata is undecidable.


title: Machine learning-based conditional mean filter: a generalization of the ensemble Kalman filter for nonlinear data assimilation

abstract: This paper presents the machine learning-based ensemble conditional mean filter (ML-EnCMF) -- a filtering method based on the conditional mean filter (CMF) previously introduced in the literature. The updated mean of the CMF matches that of the posterior, obtained by applying Bayes' rule on the filter's forecast distribution. Moreover, we show that the CMF's updated covariance coincides with the expected conditional covariance. Implementing the EnCMF requires computing the conditional mean (CM). A likelihood-based estimator is prone to significant errors for small ensemble sizes, causing the filter divergence. We develop a systematical methodology for integrating machine learning into the EnCMF based on the CM's orthogonal projection property. First, we use a combination of an artificial neural network (ANN) and a linear function, obtained based on the ensemble Kalman filter (EnKF), to approximate the CM, enabling the ML-EnCMF to inherit EnKF's advantages. Secondly, we apply a suitable variance reduction technique to reduce statistical errors when estimating loss function. Lastly, we propose a model selection procedure for element-wisely selecting the applied filter, i.e., either the EnKF or ML-EnCMF, at each updating step. We demonstrate the ML-EnCMF performance using the Lorenz-63 and Lorenz-96 systems and show that the ML-EnCMF outperforms the EnKF and the likelihood-based EnCMF.


title: Evaluating the Effect of the Financial Status to the Mobility Customs

abstract: In this article, we explore the relationship between cellular phone data and housing prices in Budapest, Hungary. We determine mobility indicators from one months of Call Detail Records (CDR) data, while the property price data are used to characterize the socioeconomic status at the Capital of Hungary. First, we validated the proposed methodology by comparing the Home and Work locations estimation and the commuting patterns derived from the cellular network dataset with reports of the national mini census. We investigated the statistical relationships between mobile phone indicators, such as Radius of Gyration, the distance between Home and Work locations or the Entropy of visited cells, and measures of economic status based on housing prices. Our findings show that the mobility correlates significantly with the socioeconomic status. We performed Principal Component Analysis (PCA) on combined vectors of mobility indicators in order to characterize the dependence of mobility habits on socioeconomic status. The results of the PCA investigation showed remarkable correlation of housing prices and mobility customs.


title: Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration

abstract: Background: Underwater images, in general, suffer from low contrast and high color distortions due to the non-uniform attenuation of the light as it propagates through the water. In addition, the degree of attenuation varies with the wavelength resulting in the asymmetric traversing of colors. Despite the prolific works for underwater image restoration (UIR) using deep learning, the above asymmetricity has not been addressed in the respective network engineering. Contributions: As the first novelty, this paper shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain for the task of UIR. Further, it is important to suppress the irrelevant multi-contextual features and increase the representational power of the model. Therefore, as a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions. An extensive set of experiments have been carried out to show the efficacy of the proposed scheme over existing best-published literature on benchmark datasets. More importantly, we have demonstrated a comprehensive validation of enhanced images across various high-level vision tasks, e.g., underwater image semantic segmentation, and diver's 2D pose estimation. A sample video to exhibit our real-world performance is available at \url{https://tinyurl.com/yzcrup9n}. Also, we have open-sourced our framework at \url{https://github.com/pksvision/Deep-WaveNet-UnderwaterImage-Restoration}.


title: Non-asymptotic convergence bounds for Wasserstein approximation using point clouds

abstract: Several issues in machine learning and inverse problems require to generate discrete data, as if sampled from a model probability distribution. A common way to do so relies on the construction of a uniform probability distribution over a set of $N$ points which minimizes the Wasserstein distance to the model distribution. This minimization problem, where the unknowns are the positions of the atoms, is non-convex. Yet, in most cases, a suitably adjusted version of Lloyd's algorithm -- in which Voronoi cells are replaced by Power cells -- leads to configurations with small Wasserstein error. This is surprising because, again, of the non-convex nature of the problem, as well as the existence of spurious critical points. We provide explicit upper bounds for the convergence speed of this Lloyd-type algorithm, starting from a cloud of points sufficiently far from each other. This already works after one step of the iteration procedure, and similar bounds can be deduced, for the corresponding gradient descent. These bounds naturally lead to a modified Poliak-Lojasiewicz inequality for the Wasserstein distance cost, with an error term depending on the distances between Dirac masses in the discrete distribution.


title: Variational Quantum Anomaly Detection: Unsupervised mapping of phase diagrams on a physical quantum computer

abstract: One of the most promising applications of quantum computing is simulating quantum many-body systems. However, there is still a need for methods to efficiently investigate these systems in a native way, capturing their full complexity. Here, we propose variational quantum anomaly detection, an unsupervised quantum machine learning algorithm to analyze quantum data from quantum simulation. The algorithm is used to extract the phase diagram of a system with no prior physical knowledge and can be performed end-to-end on the same quantum device that the system is simulated on. We showcase its capabilities by mapping out the phase diagram of the one-dimensional extended Bose Hubbard model with dimerized hoppings, which exhibits a symmetry protected topological phase. Further, we show that it can be used with readily accessible devices nowadays and perform the algorithm on a real quantum computer.


title: Gate control of spin-layer-locking FETs and application to monolayer LuIO

abstract: A recent 2D spinFET concept proposes to switch electrostatically between two separate sublayers with strong and opposite intrinsic Rashba effects. This concept exploits the spin-layer locking mechanism present in centrosymmetric materials with local dipole fields, where a weak electric field can easily manipulate just one of the spin channels. Here, we propose a novel monolayer material within this family, lutetium oxide iodide (LuIO). It displays one of the largest Rashba effects among 2D materials (up to $k_R = 0.08$ {\AA}$^{-1}$), leading to a $\pi/2$ rotation of the spins over just 1 nm. The monolayer had been predicted to be exfoliable from its experimentally-known 3D bulk counterpart, with a binding energy even lower than graphene. We characterize and model with first-principles simulations the interplay of the two gate-controlled parameters for such devices: doping and spin channel selection. We show that the ability to split the spin channels in energy diminishes with doping, leading to specific gate-operation guidelines that can apply to all devices based on spin-layer locking.


title: Control Variates for Slate Off-Policy Evaluation

abstract: We study the problem of off-policy evaluation from batched contextual bandit data with multidimensional actions, often termed slates. The problem is common to recommender systems and user-interface optimization, and it is particularly challenging because of the combinatorially-sized action space. Swaminathan et al. (2017) have proposed the pseudoinverse (PI) estimator under the assumption that the conditional mean rewards are additive in actions. Using control variates, we consider a large class of unbiased estimators that includes as specific cases the PI estimator and (asymptotically) its self-normalized variant. By optimizing over this class, we obtain new estimators with risk improvement guarantees over both the PI and the self-normalized PI estimators. Experiments with real-world recommender data as well as synthetic data validate these improvements in practice.


title: Enhanced transport of ions by tuning surface properties of the nanochannel

abstract: We revisit the theory of ion transport in parallel-plate channels and also discuss how the wettability of a solid and the mobility of adsorbed surface charges impact the transport of ions. It is shown that depending on the ratio of the electrostatic disjoining pressure to the excess osmotic pressure at the walls two different regimes occur. In the thick channel regime this ratio is small and the channel effectively behaves as thick, even when the diffuse layers strongly overlap. The latter is possible for highly charged channels only. In the thin channel regime the disjoining pressure is comparable to the excess osmotic pressure at the wall, which implies relatively weakly charged walls. We derive simple expressions for the mean conductivity of the channel in these two regimes, highlighting the role of electrostatic and electro-hydrodynamic boundary conditions. Our theory provides a simple explanation of the high conductivity observed experimentally in hydrophilic channels, and allows one to obtain rigorous bounds on its attainable value and scaling with salt concentration. Our results also show that further dramatic amplification of conductivity is possible if hydrophobic slip is involved, but only in the thick channel regime provided the walls are sufficiently highly charged and the most of adsorbed charges are immobile. However, for weakly charged surfaces the massive conductivity amplification due to hydrodynamic slip is impossible in both regimes. Interestingly, in this case the moderate slip-driven contribution to conductivity can monotonously decrease with the fraction of immobile adsorbed charges. These results provide a framework for tuning the conductivity of nanochannels by adjusting their surface properties and bulk electrolyte concentrations.


title: Encouraging Intra-Class Diversity Through a Reverse Contrastive Loss for Better Single-Source Domain Generalization

abstract: Traditional deep learning algorithms often fail to generalize when they are tested outside of the domain of the training data. The issue can be mitigated by using unlabeled data from the target domain at training time, but because data distributions can change dynamically in real-life applications once a learned model is deployed, it is critical to create networks robust to unknown and unforeseen domain shifts. In this paper we focus on one of the reasons behind the inability of neural networks to be so: deep networks focus only on the most obvious, potentially spurious, clues to make their predictions and are blind to useful but slightly less efficient or more complex patterns. This behaviour has been identified and several methods partially addressed the issue. To investigate their effectiveness and limits, we first design a publicly available MNIST-based benchmark to precisely measure the ability of an algorithm to find the ''hidden'' patterns. Then, we evaluate state-of-the-art algorithms through our benchmark and show that the issue is largely unsolved. Finally, we propose a partially reversed contrastive loss to encourage intra-class diversity and find less strongly correlated patterns, whose efficiency is demonstrated by our experiments.


title: Type II superstring field theory revisited

abstract: We reconstruct a complete type II superstring field theory with L-infinity structure in a symmetric way concerning the left- and right-moving sectors. Based on the new construction, we show again that the tree-level S-matrix agrees with that obtained using the first-quantization method. Not only is this a simple and elegant reconstruction, but it also enables the action to be mapped to that in the WZW-like superstring field theory, which has not yet been constructed and fills the only gap in the WZW-like formulation.


title: Crystals of Lakshmibai-Seshadri paths and extremal weight modules over quantum hyperbolic Kac-Moody algebras of rank 2

abstract: Let $\mathfrak{g}$ be a hyperbolic Kac-Moody algebra of rank $2$, and let $\lambda$ be an arbitrary integral weight. We denote by $\mathbb{B}(\lambda)$ the crystal of all Lakshmibai-Seshadri paths of shape $\lambda$. Let $V(\lambda)$ be the extremal weight module of extremal weight $\lambda$ generated by the (cyclic) extremal weight vector $v_\lambda$ of weight $\lambda$, and let $\mathcal{B}(\lambda)$ be the crystal basis of $V(\lambda)$ with $u_\lambda \in \mathcal{B}(\lambda)$ the element corresponding to $v_\lambda$. We prove that the connected component $\mathcal{B}_0(\lambda)$ of $\mathcal{B}(\lambda)$ containing $u_\lambda$ is isomorphic, as a crystal, to the connected component $\mathbb{B}_0(\lambda)$ of $\mathbb{B}(\lambda)$ containing the straight line $\pi_\lambda$. Furthermore, we prove that if $\lambda$ satisfies a special condition, then the crystal basis $\mathcal{B}(\lambda)$ is isomorphic, as a crystal, to the crystal $\mathbb{B}(\lambda)$. As an application of these results, we obtain an algorithm for computing the number of elements of weight $\mu$ in $\mathcal{B}(\Lambda_1-\Lambda_2)$, where $\Lambda_1, \Lambda_2$ are the fundamental weights, in the case that $\mathfrak{g}$ is symmetric.


title: A stochastic metapopulation state-space approach to modeling and estimating Covid-19 spread

abstract: Mathematical models are widely recognized as an important tool for analyzing and understanding the dynamics of infectious disease outbreaks, predict their future trends, and evaluate public health intervention measures for disease control and elimination. We propose a novel stochastic metapopulation state-space model for COVID-19 transmission, based on a discrete-time spatio-temporal susceptible/exposed/infected/recovered/deceased (SEIRD) model. The proposed framework allows the hidden SEIRD states and unknown transmission parameters to be estimated from noisy, incomplete time series of reported epidemiological data, by application of unscented Kalman filtering (UKF), maximum-likelihood adaptive filtering, and metaheuristic optimization. Experiments using both synthetic data and real data from the Fall 2020 Covid-19 wave in the state of Texas demonstrate the effectiveness of the proposed model.


title: Lattice Formulas For Rational SFT Capacities

abstract: We initiate the study of the rational SFT capacities of Siegel using tools in toric algebraic geometry. In particular, we derive new (often sharp) bounds for the RSFT capacities of a strongly convex toric domain in dimension $4$. These bounds admit descriptions in terms of both lattice optimization and (toric) algebraic geometry. Applications include (a) an extremely simple lattice formula for for many RSFT capacities of a large class of convex toric domains, (b) new computations of the Gromov width of a class of product symplectic manifolds and (c) an asymptotics law for the RSFT capacities of all strongly convex toric domains.


title: Diagnosing the Impact of AI on Radiology in China

abstract: Artificial Intelligence will significantly impact the work environment of radiologists. I suggest that up to 50% of a radiologists work in 2021 will be performed by AI-models in 2025. However, it won't increase beyond that 50% level, as radiologists remain key for human-centered aspects of their job. I project that few to no radiologists will be laid off in China due to the existing supply shortage of radiology services in 2021. The application of AI in radiology could contribute 1.7 billion USD to China's GDP in 2025. It will further allow radiologists to start productive work up to four years earlier. AI in radiology will positively impact the health of patients and radiologists themselves.


title: An Automated Quality Evaluation Framework of Psychotherapy Conversations with Local Quality Estimates

abstract: Text-based computational approaches for assessing the quality of psychotherapy are being developed to support quality assurance and clinical training. However, due to the long durations of typical conversation based therapy sessions, and due to limited annotated modeling resources, computational methods largely rely on frequency-based lexical features or dialogue acts to assess the overall session level characteristics. In this work, we propose a hierarchical framework to automatically evaluate the quality of transcribed Cognitive Behavioral Therapy (CBT) interactions. Given the richly dynamic nature of the spoken dialog within a talk therapy session, to evaluate the overall session level quality, we propose to consider modeling it as a function of local variations across the interaction. To implement that empirically, we divide each psychotherapy session into conversation segments and initialize the segment-level qualities with the session-level scores. First, we produce segment embeddings by fine-tuning a BERT-based model, and predict segment-level (local) quality scores. These embeddings are used as the lower-level input to a Bidirectional LSTM-based neural network to predict the session-level (global) quality estimates. In particular, we model the global quality as a linear function of the local quality scores, which allows us to update the segment-level quality estimates based on the session-level quality prediction. These newly estimated segment-level scores benefit the BERT fine-tuning process, which in turn results in better segment embeddings. We evaluate the proposed framework on automatically derived transcriptions from real-world CBT clinical recordings to predict session-level behavior codes. The results indicate that our approach leads to improved evaluation accuracy for most codes when used for both regression and classification tasks.


title: External-level assisted cooling by measurement

abstract: A quantum resonator in a thermal-equilibrium state with a high temperature has a large average population and is featured with significant occupation over Fock states with a high excitation number. The resonator could be cooled down via continuous measurements on the ground state of a coupled two-level system (qubit). We find, however, that the measurement-induced cooling might become inefficient in the high-temperature regime. Beyond the conventional strategy, we introduce strong driving between the excited state of the qubit and an external level. It can remarkably broaden the cooling range in regard to the non-vanishing populated Fock states of the resonator. Without any precooling procedure, our strategy allows a significant reduction of the populations over Fock states with a high excitation number, giving rise to nondeterministic ground-state cooling after a sequence of measurements. The driving-induced fast transition constrains the resonator and the ancillary qubit at their ground state upon measurement and then simulates the quantum Zeno effect. Our protocol is applied to cool down a high-temperature magnetic resonator. Additionally, it is generalized to a hybrid cooling protocol by interpolating the methods with and without strong driving, which can accelerate the cooling process and increase the overlap between the final state of the resonator and its ground state.


title: Improving Search by Utilizing State Information in OPTIC Planners Compilation to LP

abstract: Automated planners are computer tools that allow autonomous agents to make strategies and decisions by determining a set of actions for the agent that to take, which will carry a system from a given initial state to the desired goal state. Many planners are domain-independent, allowing their deployment in a variety of domains. Such is the broad family of OPTIC planners. These planners perform Forward Search and call a Linear Programming (LP) solver multiple times at every state to check for consistency and to set bounds on the numeric variables. These checks can be computationally costly, especially in real-life applications. This paper suggests a method for identifying information about the specific state being evaluated, allowing the formulation of the equations to facilitate better solver selection and faster LP solving. The usefulness of the method is demonstrated in six domains and is shown to enhance performance significantly.


title: Machine Learning with Electronic Health Records is vulnerable to Backdoor Trigger Attacks

abstract: Electronic Health Records (EHRs) provide a wealth of information for machine learning algorithms to predict the patient outcome from the data including diagnostic information, vital signals, lab tests, drug administration, and demographic information. Machine learning models can be built, for example, to evaluate patients based on their predicted mortality or morbidity and to predict required resources for efficient resource management in hospitals. In this paper, we demonstrate that an attacker can manipulate the machine learning predictions with EHRs easily and selectively at test time by backdoor attacks with the poisoned training data. Furthermore, the poison we create has statistically similar features to the original data making it hard to detect, and can also attack multiple machine learning models without any knowledge of the models. With less than 5% of the raw EHR data poisoned, we achieve average attack success rates of 97% on mortality prediction tasks with MIMIC-III database against Logistic Regression, Multilayer Perceptron, and Long Short-term Memory models simultaneously.


title: Using the photo-induced $L_3$ resonance shift in Fe and Ni as time reference for ultrafast experiments at low flux soft X-ray sources

abstract: We study the optical-pump induced ultrafast transient change of the X-ray absorption at the $L_3$ absorption resonances of the transition metals Ni and Fe in Fe$_{0.5}$Ni$_{0.5}$ alloy. We find the effect for both elements to occur simultaneously on a femtosecond timescale. This effect may hence be used as a handy cross-correlation scheme providing a time-zero reference for ultrafast optical-pump soft X-ray-probe measurement. The method benefits from a relatively simple experimental setup as the sample itself acts as time-reference tool. In particular, this technique works with low flux ultrafast soft X-ray sources. The measurements are compared to the cross-correlation method introduced in an earlier publication.


title: ReS2tAC -- UAV-Borne Real-Time SGM Stereo Optimized for Embedded ARM and CUDA Devices

abstract: With the emergence of low-cost robotic systems, such as unmanned aerial vehicle, the importance of embedded high-performance image processing has increased. For a long time, FPGAs were the only processing hardware that were capable of high-performance computing, while at the same time preserving a low power consumption, essential for embedded systems. However, the recently increasing availability of embedded GPU-based systems, such as the NVIDIA Jetson series, comprised of an ARM CPU and a NVIDIA Tegra GPU, allows for massively parallel embedded computing on graphics hardware. With this in mind, we propose an approach for real-time embedded stereo processing on ARM and CUDA-enabled devices, which is based on the popular and widely used Semi-Global Matching algorithm. In this, we propose an optimization of the algorithm for embedded CUDA GPUs, by using massively parallel computing, as well as using the NEON intrinsics to optimize the algorithm for vectorized SIMD processing on embedded ARM CPUs. We have evaluated our approach with different configurations on two public stereo benchmark datasets to demonstrate that they can reach an error rate as low as 3.3%. Furthermore, our experiments show that the fastest configuration of our approach reaches up to 46 FPS on VGA image resolution. Finally, in a use-case specific qualitative evaluation, we have evaluated the power consumption of our approach and deployed it on the DJI Manifold 2-G attached to a DJI Matrix 210v2 RTK unmanned aerial vehicle (UAV), demonstrating its suitability for real-time stereo processing onboard a UAV.


title: Long-Range Orbital Magnetoelectric Torque in Ferromagnets

abstract: While it is often assumed that the orbital response is suppressed and short-ranged due to strong crystal field potential and orbital quenching, we show that the orbital magnetoelectric response can be remarkably long-ranged in ferromagnets. In a bilayer consisting of a nonmagnet and a ferromagnet, spin injection from the interface results in spin accumulation and torque in the ferromagnet, which rapidly oscillate and decay by spin dephasing. In contrast, we find that even when an external electric field is applied only on the nonmagnet, we find substantially long-ranged orbital magnetoelectric response in the FM, which can go far beyond the spin dephasing length. This unusual feature is attributed to nearly degenerate orbital characters imposed by the crystal symmetry, which form hotspots for the intrinsic orbital response. Because only the states near the hotspots contribute dominantly, the induced orbital angular momentum does not exhibit destructive interference among states with different momentum as in the case of the spin dephasing. This gives rise to a distinct type of orbital torque on the magnetization, increasing with the thickness of the ferromagnet. Such behavior may serve as critical long-sought evidence of orbital transport to be directly tested in experiments. Our findings open the possibility of using long-range orbital magnetoelectric effect in orbitronic device applications.


title: Image Feature Information Extraction for Interest Point Detection: A Review

abstract: Interest point detection is one of the most fundamental and critical problems in computer vision and image processing. In this paper, we carry out a comprehensive review on image feature information (IFI) extraction techniques for interest point detection. To systematically introduce how the existing interest point detection methods extract IFI from an input image, we propose a taxonomy of the IFI extraction techniques for interest point detection. According to this taxonomy, we discuss different types of IFI extraction techniques for interest point detection. Furthermore, we identify the main unresolved issues related to the existing IFI extraction techniques for interest point detection and any interest point detection methods that have not been discussed before. The existing popular datasets and evaluation standards are provided and the performances for eighteen state-of-the-art approaches are evaluated and discussed. Moreover, future research directions on IFI extraction techniques for interest point detection are elaborated.


title: Language Tags Matter for Zero-Shot Neural Machine Translation

abstract: Multilingual Neural Machine Translation (MNMT) has aroused widespread interest due to its efficiency. An exciting advantage of MNMT models is that they could also translate between unsupervised (zero-shot) language directions. Language tag (LT) strategies are often adopted to indicate the translation directions in MNMT. In this paper, we demonstrate that the LTs are not only indicators for translation directions but also crucial to zero-shot translation qualities. Unfortunately, previous work tends to ignore the importance of LT strategies. We demonstrate that a proper LT strategy could enhance the consistency of semantic representations and alleviate the off-target issue in zero-shot directions. Experimental results show that by ignoring the source language tag (SLT) and adding the target language tag (TLT) to the encoder, the zero-shot translations could achieve a +8 BLEU score difference over other LT strategies in IWSLT17, Europarl, TED talks translation tasks.


title: Does your robot know? Enhancing children's information retrieval through spoken conversation with responsible robots

abstract: In this paper, we identify challenges in children's current information retrieval process, and propose conversational robots as an opportunity to ease this process in a responsible way. Tools children currently use in this process, such as search engines on a computer or voice agents, do not always meet their specific needs. The conversational robot we propose maintains context, asks clarifying questions, and gives suggestions in order to better meet children's needs. Since children are often too trusting of robots, we propose to have the robot measure, monitor and adapt to the trust the child has in the robot. This way, we hope to induce a critical attitude with the children during their information retrieval process.


title: Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention

abstract: Clinical notes are unstructured text generated by clinicians during patient encounters. Clinical notes are usually accompanied by a set of metadata codes from the International Classification of Diseases(ICD). ICD code is an important code used in various operations, including insurance, reimbursement, medical diagnosis, etc. Therefore, it is important to classify ICD codes quickly and accurately. However, annotating these codes is costly and time-consuming. So we propose a model based on bidirectional encoder representations from transformers (BERT) using the sequence attention method for automatic ICD code assignment. We evaluate our approach on the medical information mart for intensive care III (MIMIC-III) benchmark dataset. Our model achieved performance of macro-averaged F1: 0.62898 and micro-averaged F1: 0.68555 and is performing better than a performance of the state-of-the-art model using the MIMIC-III dataset. The contribution of this study proposes a method of using BERT that can be applied to documents and a sequence attention method that can capture important sequence in-formation appearing in documents.


title: Micro/nanoliter droplet extraction by controlling acoustic vortex with miniwatt

abstract: Micro/nanoliter droplet is capable of achieving versatile applications with tiny volume and substantial surface energy, which is a big plus over bulk liquid. Yet, the contradiction of elaborate manipulation and enough power is still a challenge. Here, we unleash the potential of our miniwatt aspirators pumping up liquid and creating droplets with the help of acoustic vortex beams, inspired by the power mechanism that spirals are significant for most mollusks that live in water. These droplet aspirators produce very large interface deformations by small radiation pressures with orbit angular momentum from spiral-electrode transducers. The precisely contactless manipulation of physical, chemical and biological objects at micrometric down to nanometric scales, promises tremendous development in fields as diverse as microrobotics, nanoreactors, or nanoassemblies.


title: Aether SUSY breaking: Can aether be alternative to F-term SUSY breaking?

abstract: We investigate supersymmetry (SUSY) breaking scenarios where both SUSY and Lorentz symmetry are broken spontaneously. For concreteness, we propose models in which scalar fluid or vector condensation breaks Lorentz symmetry and accordingly SUSY. Then, we examine whether such scenarios are viable for realistic model buildings. We find, however, that the scalar fluid model suffers from several issues. Then, we extend it to a vector condensation model, which avoids the issues in the scalar fluid case. We show that accelerated expansion and soft SUSY breaking in matter sector can be achieved. In our simple setup, the soft SUSY breaking is constrained to be less than $\mathcal{O}(100)$TeV from the constraints on modification of gravity.


title: BERT Embeddings for Automatic Readability Assessment

abstract: Automatic readability assessment (ARA) is the task of evaluating the level of ease or difficulty of text documents for a target audience. For researchers, one of the many open problems in the field is to make such models trained for the task show efficacy even for low-resource languages. In this study, we propose an alternative way of utilizing the information-rich embeddings of BERT models with handcrafted linguistic features through a combined method for readability assessment. Results show that the proposed method outperforms classical approaches in readability assessment using English and Filipino datasets, obtaining as high as 12.4% increase in F1 performance. We also show that the general information encoded in BERT embeddings can be used as a substitute feature set for low-resource languages like Filipino with limited semantic and syntactic NLP tools to explicitly extract feature values for the task.


title: Modeling morphology with Linear Discriminative Learning: considerations and design choices

abstract: This study addresses a series of methodological questions that arise when modeling inflectional morphology with Linear Discriminative Learning. Taking the semi-productive German noun system as example, we illustrate how decisions made about the representation of form and meaning influence model performance. We clarify that for modeling frequency effects in learning, it is essential to make use of incremental learning rather than the endstate of learning. We also discuss how the model can be set up to approximate the learning of inflected words in context. In addition, we illustrate how in this approach the wug task can be modeled in considerable detail. In general, the model provides an excellent memory for known words, but appropriately shows more limited performance for unseen data, in line with the semi-productivity of German noun inflection and generalization performance of native German speakers.


title: A quantum Monte Carlo method on asymptotic Lefschetz thimbles for quantum spin systems: An application to the Kitaev model in a magnetic field

abstract: The quantum Monte Carlo method on asymptotic Lefschetz thimbles is a numerical algorithm devised specifically for alleviation of the sign problem appearing in the simulations of quantum many-body systems. In this method, the sign problem is alleviated by shifting the integration domain for the auxiliary fields, appearing for example in the conventional determinant quantum Monte Carlo method, from real space to an appropriate manifold in complex space. Here we extend this method to quantum spin models with generic two-spin interactions, by using the Hubbard-Stratonovich transformation to decouple the exchange interactions and the Popov-Fedotov transformation to map the quantum spins to complex fermions. As a demonstration, we apply the method to the Kitaev model in a magnetic field whose ground state is predicted to deliver a topological quantum spin liquid with non-Abelian anyonic excitations. To illustrate how the sign problem is alleviated in this method, we visualize the asymptotic Lefschetz thimbles in complex space, together with the saddle points and the zeros of the fermion determinant. We benchmark our method in the low-temperature region in a magnetic field and show that the sign of the action is recovered considerably and unbiased numerical results are obtained with sufficient precision.


title: User Pairing and Power Allocation for IRS-Assisted NOMA Systems with Imperfect Phase Compensation

abstract: In this letter, we analyze the performance of the intelligent reflecting surface (IRS) assisted downlink non-orthogonal multiple access (NOMA) systems in the presence of imperfect phase compensation. We derive an upper bound on the imperfect phase compensation to achieve minimum required data rates for each user. Using this bound, we propose an adaptive user pairing algorithm to maximize the network throughput. We then derive bounds on the power allocation factors and propose power allocation algorithms for the paired users to achieve the maximum sum rate or ensure fairness. Through extensive simulations, we show that the proposed algorithms significantly outperform the state-of-the-art algorithms.


title: Attention-based distributed speech enhancement for unconstrained microphone arrays with varying number of nodes

abstract: Speech enhancement promises higher efficiency in ad-hoc microphone arrays than in constrained microphone arrays thanks to the wide spatial coverage of the devices in the acoustic scene. However, speech enhancement in ad-hoc microphone arrays still raises many challenges. In particular, the algorithms should be able to handle a variable number of microphones, as some devices in the array might appear or disappear. In this paper, we propose a solution that can efficiently process the spatial information captured by the different devices of the microphone array, while being robust to a link failure. To do this, we use an attention mechanism in order to put more weight on the relevant signals sent throughout the array and to neglect the redundant or empty channels.


title: Frustrated mixed-spin ladders: Evidence for a bond order wave phase between rung-singlet and Haldane phases

abstract: In frustrated spin ladders the interplay of frustration and correlations leads to the familiar Haldane (H) and rung-singlet (RS) phases. The nature of the transition between these two phases is still under debate. In this paper we tackle this issue using tools of quantum information theory. We consider frustrated mixed-spin-(1, 1/2) ladders with antiferromagnetic leg, rung and diagonal couplings, and calculate various quantities, such as the entanglement entropy (EE), the Schmidt gap, and the level degeneracy of the entanglement spectrum (ES). We use two numerical techniques, the infinite time-evolving block decimation (iTEBD) and the density matrix renormalization group (DMRG). We demonstrate that there exists an intermediate phase in which the ES levels do not exhibit the characteristic degeneracies of the H and RS phases. To understand the underlying physics in this phase, we investigate short-range spin correlations along legs, rungs and diagonals and show that in this intermediate phase long-wavelength modulations occur, akin to bond order waves.


title: Direction-aware Feature-level Frequency Decomposition for Single Image Deraining

abstract: We present a novel direction-aware feature-level frequency decomposition network for single image deraining. Compared with existing solutions, the proposed network has three compelling characteristics. First, unlike previous algorithms, we propose to perform frequency decomposition at feature-level instead of image-level, allowing both low-frequency maps containing structures and high-frequency maps containing details to be continuously refined during the training procedure. Second, we further establish communication channels between low-frequency maps and high-frequency maps to interactively capture structures from high-frequency maps and add them back to low-frequency maps and, simultaneously, extract details from low-frequency maps and send them back to high-frequency maps, thereby removing rain streaks while preserving more delicate features in the input image. Third, different from existing algorithms using convolutional filters consistent in all directions, we propose a direction-aware filter to capture the direction of rain streaks in order to more effectively and thoroughly purge the input images of rain streaks. We extensively evaluate the proposed approach in three representative datasets and experimental results corroborate our approach consistently outperforms state-of-the-art deraining algorithms.


title: Electrically tuneable nonequilibrium optical response of graphene

abstract: The ability to tune the optical response of a material via electrostatic gating is crucial for optoelectronic applications, such as electro-optic modulators, saturable absorbers, optical limiters, photodetectors and transparent electrodes. The band structure of single layer graphene (SLG), with zero-gap, linearly dispersive conduction and valence bands, enables an easy control of the Fermi energy E$_F$ and of the threshold for interband optical absorption. Here, we report the tunability of the SLG non-equilibrium optical response in the near-infrared (1000-1700nm/0.729-1.240eV), exploring a range of E$_F$ from -650 to 250 meV by ionic liquid gating. As E$_F$ increases from the Dirac point to the threshold for Pauli blocking of interband absorption, we observe a slow-down of the photobleaching relaxation dynamics, which we attribute to the quenching of optical phonon emission from photoexcited charge carriers. For E$_F$ exceeding the Pauli blocking threshold, photobleaching eventually turns into photoinduced absorption, due to hot electrons' excitation increasing SLG absorption. The ability to control both recovery time and sign of nonequilibrium optical response by electrostatic gating makes SLG ideal for tunable saturable absorbers with controlled dynamics.


title: A Fast-Detection and Fault-Correction Algorithm against Persistent Fault Attack

abstract: Persistent Fault Attack (PFA) is a recently proposed Fault Attack (FA) method in CHES 2018. It is able to recover full AES secret key in the Single-Byte-Fault scenario. It is demonstrated that classical FA countermeasures, such as Dual Modular Redundancy (DMR) and mask protection, are unable to thwart PFA. In this paper, we propose a fast-detection and faultcorrection algorithm to prevent PFA. We construct a fixed input and output pair to detect faults rapidly. Then we build two extra redundant tables to store the relationship between the adjacent elements in the S-box, by which the algorithm can correct the faulty elements in the S-box. Our experimental results show that our algorithm can effectively prevent PFA in both Single-ByteFault and Multiple-Bytes-Faults scenarios. Compared with the classical FA countermeasures, our algorithm has a much better effect against PFA. Further, the time cost of our algorithm is 40% lower than the classical FA countermeasures.


title: Simplifying Robot Programming using Augmented Reality and End-User Development

abstract: Robots are widespread across diverse application contexts. Teaching robots to perform tasks, in their respective contexts, demands a high domain and programming expertise. However, robot programming faces high entry barriers due to the complexity of robot programming itself. Even for experts robot programming is a cumbersome and error-prone task where faulty robot programs can be created, causing damage when being executed on a real robot. To simplify the process of robot programming, we combine Augmented Reality (AR) with principles of end-user development. By combining them, the real environment is extended with useful virtual artifacts that can enable experts as well as non-professionals to perform complex robot programming tasks. Therefore, Simple Programming Environment in Augmented Reality with Enhanced Debugging (SPEARED) was developed as a prototype for an AR-assisted robot programming environment. SPEARED makes use of AR to project a robot as well as a programming environment onto the target working space. To evaluate our approach, expert interviews with domain experts from the area of industrial automation, robotics, and AR were performed. The experts agreed that SPEARED has the potential to enrich and ease current robot programming processes.


title: Simulations of quantum nonlocality with local negative bits

abstract: We propose a simple simulation of nonlocal quantum correlations among $N$ qubits using a local hidden variable source with a positive probability distribution, given that each the $N$ observers has access to a local negative bit. Notably, unlike the Toner-Bacon protocol, no exchange of classical bits between the observers is required. Moreover, our simulation can be extended to include Popescu-Rohrlich box correlations.


title: On solutions of matrix-valued convolution equations, anisotropic fractional derivatives and their applications in linear and non-linear anisotropic viscoelasticity

abstract: A relation between matrix-valued complete Bernstein functions and matrix-valued Stieltjes functions is applied to prove that the solutions of matricial convolution equations with extended LICM kernels belong to special classes of functions. In particular the cases of the solutions of the viscoelastic duality relation and the solutions of the matricial Sonine equation are discussed, with applications in anisotropic linear viscoelasticity and a generalization of fractional calculus. In the first case it is in particular shown that duality of completely monotone relaxation functions and Bernstein creep functions in general requires inclusion in the relaxation function of a Newtonian viscosity term in addition to the memory effects represented by the completely monotone kernel. We define anisotropic generalized fractional derivatives (GFD) by replacing the kernel $t^{-\alpha}/\Gamma(1-\alpha)$ of the Caputo derivatives with completely monotone matrix-valued kernels which are weakly singular at 0.


title: Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selection

abstract: One of the long-standing challenges in lexical semantics consists in learning representations of words which reflect their semantic properties. The remarkable success of word embeddings for this purpose suggests that high-quality representations can be obtained by summarizing the sentence contexts of word mentions. In this paper, we propose a method for learning word representations that follows this basic strategy, but differs from standard word embeddings in two important ways. First, we take advantage of contextualized language models (CLMs) rather than bags of word vectors to encode contexts. Second, rather than learning a word vector directly, we use a topic model to partition the contexts in which words appear, and then learn different topic-specific vectors for each word. Finally, we use a task-specific supervision signal to make a soft selection of the resulting vectors. We show that this simple strategy leads to high-quality word vectors, which are more predictive of semantic properties than word embeddings and existing CLM-based strategies.