title: Analysing Long Short Term Memory Models for Cricket Match Outcome Prediction

abstract: As the technology advances, an ample amount of data is collected in sports with the help of advanced sensors. Sports Analytics is the study of this data to provide a constructive advantage to the team and its players. The game of international cricket is popular all across the globe. Recently, various machine learning techniques have been used to analyse the cricket match data and predict the match outcome as win or lose. Generally these models make use of the overall match level statistics such as teams, venue, average run rate, win margin, etc to predict the match results before the beginning of the match. However, very few works provide insights based on the ball-by-ball level statistics. Here we propose a novel Recurrent Neural Network model which can predict the win probability of a match at regular intervals given the ball-by-ball statistics. The Long Short Term Memory (LSTM) Model takes as input the ball wise features as well as the match level details available from the training dataset. It gives a prediction of winning the match at any time stamp during the match. This level of insight will help the team to predict the probability of them winning the match after every ball and help them determine the critical in-game changes they should make in their game strategies.


title: Analysis of the Coronal Mass Ejections through Axial Field Direction of Solar Filaments and IMF Bz

abstract: In the past, there have been many studies claiming that the effects of geomagnetic storms strongly depends on the orientation of the magnetic-cloud part of the Coronal Mass Ejections (CMEs). Aparna & Martens (2020), using Halo-CME data from 2007-2017, have shown that the magnetic field orientation of filaments at the location where CMEs originate can be effectively used for predicting the onset of geo-magnetic storms. The purpose of this study is to extend their survey by analyzing the halo-CME data for 1996-2006. The correlation of filament axial direction and their corresponding Bz signatures are used to form a more extensive reasoning for the claims presented by Aparna & Martens before. This study utilizes SOHO EIT 195 \r{A}, MDI magnetogram images, KSO and BBSO H$\alpha$ images for the time period, along with ACE data for inter-planetary magnetic field signatures. Correlating all these, we have found that the trend in Aparna & Martens' study of a high likelihood of the correlation between the axial field direction and Bz orientation, persists for the data between 1996-2006 as well.


title: Effects of Short-Distance Modifications to General Relativity in Spinning Binary Systems

abstract: We investigate the possibility of testing short distance modifications to General Relativity via higher curvature terms in the fundamental gravity Lagrangian by analysing their impact on observations of spinning astronomical binary systems. By using effective field theory methods applied to the 2-body problem, generic lower bounds on the short-distance scale accompanying high curvature terms can be set. In particular we extend known results by deriving spin-dependent effects in binding energy, radiation emission process, and spin precession equations in binary systems, which are the fundamental ingredients to observe spin-dependent effects in gravitational wave detections from compact binary coalescences and spin precession in double binary pulsars.


title: An X-ray and SZ bright diffuse source toward M31: a Local Hot Bridge

abstract: We report a large-scale ($r\approx 20^\circ$) X-ray and Sunyaev-Zeldovich (SZ)-bright diffuse enhancement toward M31, which might be a Local Hot Bridge connecting the Milky Way (MW) with M31. We subtract the Galactic emission from the all-sky O VII and O VIII emission line measurement survey, and find that the emission of these two ions is enhanced within $r\approx20^\circ$ around M31. The mean emission enhancements are $5.6\pm 1.3$ L.U., and $2.8\pm0.6$ L.U. for O VII and O VIII, respectively ($>4\sigma$ for both ions). We also extract the SZ signal around M31, which suggests a surface brightness $y$ of $2-4\times10^{-7}$, an enhancement $>2.5\sigma$ (and a best fit of $5.9\sigma$). These three measurements trace the hot gas with a temperature $\log~T({\rm K})> 6$, showing similar plateau shapes (flat within $\approx15^\circ$, and zero beyond $\approx30^\circ$). A single-phase assumption leads to a temperature of $\log~T({\rm K})=6.34\pm0.03$, which is determined by the O VII/O VIII line ratio. Combining X-ray and SZ measurements, we suggest that this feature is unlikely to be the hot halo around M31 (too massive) or in the MW (too high pressure and X-ray bright). The plateau shape may be explained by a cylinder connecting the MW and M31 (the Local Hot Bridge). We constrain its length to be about 400 kpc, with a radius of 120 kpc, a density of $\approx 2\times10^{-4}-10^{-3} ~\rm cm^{-3}$, and a metallicity of $0.02-0.1~ Z_\odot$. The baryon mass is $\gtrsim10^{11}~M_\odot$, and the oxygen mass is about $\gtrsim10^8~M_\odot$, which contribute to the baryon or metal budget of the Local Group.


title: Incremental Machine Speech Chain Towards Enabling Listening while Speaking in Real-time

abstract: Inspired by a human speech chain mechanism, a machine speech chain framework based on deep learning was recently proposed for the semi-supervised development of automatic speech recognition (ASR) and text-to-speech synthesis TTS) systems. However, the mechanism to listen while speaking can be done only after receiving entire input sequences. Thus, there is a significant delay when encountering long utterances. By contrast, humans can listen to what hey speak in real-time, and if there is a delay in hearing, they won't be able to continue speaking. In this work, we propose an incremental machine speech chain towards enabling machine to listen while speaking in real-time. Specifically, we construct incremental ASR (ISR) and incremental TTS (ITTS) by letting both systems improve together through a short-term loop. Our experimental results reveal that our proposed framework is able to reduce delays due to long utterances while keeping a comparable performance to the non-incremental basic machine speech chain.


title: Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition

abstract: Attention-based sequence-to-sequence automatic speech recognition (ASR) requires a significant delay to recognize long utterances because the output is generated after receiving entire input sequences. Although several studies recently proposed sequence mechanisms for incremental speech recognition (ISR), using different frameworks and learning algorithms is more complicated than the standard ASR model. One main reason is because the model needs to decide the incremental steps and learn the transcription that aligns with the current short speech segment. In this work, we investigate whether it is possible to employ the original architecture of attention-based ASR for ISR tasks by treating a full-utterance ASR as the teacher model and the ISR as the student model. We design an alternative student network that, instead of using a thinner or a shallower model, keeps the original architecture of the teacher model but with shorter sequences (few encoder and decoder states). Using attention transfer, the student network learns to mimic the same alignment between the current input short speech segments and the transcription. Our experiments show that by delaying the starting time of recognition process with about 1.7 sec, we can achieve comparable performance to one that needs to wait until the end.


title: Cross-Lingual Machine Speech Chain for Javanese, Sundanese, Balinese, and Bataks Speech Recognition and Synthesis

abstract: Even though over seven hundred ethnic languages are spoken in Indonesia, the available technology remains limited that could support communication within indigenous communities as well as with people outside the villages. As a result, indigenous communities still face isolation due to cultural barriers; languages continue to disappear. To accelerate communication, speech-to-speech translation (S2ST) technology is one approach that can overcome language barriers. However, S2ST systems require machine translation (MT), speech recognition (ASR), and synthesis (TTS) that rely heavily on supervised training and a broad set of language resources that can be difficult to collect from ethnic communities. Recently, a machine speech chain mechanism was proposed to enable ASR and TTS to assist each other in semi-supervised learning. The framework was initially implemented only for monolingual languages. In this study, we focus on developing speech recognition and synthesis for these Indonesian ethnic languages: Javanese, Sundanese, Balinese, and Bataks. We first separately train ASR and TTS of standard Indonesian in supervised training. We then develop ASR and TTS of ethnic languages by utilizing Indonesian ASR and TTS in a cross-lingual machine speech chain framework with only text or only speech data removing the need for paired speech-text data of those ethnic languages.


title: DIPol-UF: simultaneous three-color ($BVR$) polarimeter with EM CCDs

abstract: We describe a new instrument capable of high precision ($10^{-5}$) polarimetric observations simultaneously in three passbands ($BVR$). The instrument utilizes electron-multiplied EM CCD cameras for high efficiency and fast image readout. The key features of DIPol-UF are: (i) optical design with high throughput and inherent stability; (ii) great versatility which makes the instrument optimally suitable for observations of bright and faint targets; (iii) control system which allows using the polarimeter remotely. Examples are given of the first results obtained from high signal-to-noise observations of bright nearby stars and of fainter sources such as X-ray binaries in their quiescent states


title: The Chebyshev-Frobenius homomorphism for stated skein modules of 3-manifolds

abstract: We study the stated skein modules of marked 3-manifolds. We generalize the splitting homomorphism for stated skein algebras of surfaces to a splitting homomorphism for stated skein modules of 3-manifolds. We show that there exists a Chebyshev-Frobenius homomorphism for the stated skein modules of 3-manifolds which extends the Chebyshev homomorphism of the skein algebras of unmarked surfaces originally constructed by Bonahon and Wong. Additionally, we show that the Chebyshev-Frobenius map commutes with the splitting homomorphism. This is then used to show that in the case of the stated skein algebra of a surface, the Chebyshev-Frobenius map is the unique extension of the dual Frobenius map (in the sense of Lusztig) of $\mathcal{O}_{q^2}(SL(2))$ through the triangular decomposition afforded by an ideal triangulation of the surface. In particular, this gives a skein theoretic construction of the Hopf dual of Lusztig's Frobenius homomorphism. A second conceptual framework is given, which shows that the Chebyshev-Frobenius homomorphism for the stated skein algebra of a surface is the unique restriction of the Frobenius homomorphism of quantum tori through the quantum trace map.


title: DESNet: A Multi-channel Network for Simultaneous Speech Dereverberation, Enhancement and Separation

abstract: In this paper, we propose a multi-channel network for simultaneous speech dereverberation, enhancement and separation (DESNet). To enable gradient propagation and joint optimization, we adopt the attentional selection mechanism of the multi-channel features, which is originally proposed in end-to-end unmixing, fixed-beamforming and extraction (E2E-UFE) structure. Furthermore, the novel deep complex convolutional recurrent network (DCCRN) is used as the structure of the speech unmixing and the neural network based weighted prediction error (WPE) is cascaded beforehand for speech dereverberation. We also introduce the staged SNR strategy and symphonic loss for the training of the network to further improve the final performance. Experiments show that in non-dereverberated case, the proposed DESNet outperforms DCCRN and most state-of-the-art structures in speech enhancement and separation, while in dereverberated scenario, DESNet also shows improvements over the cascaded WPE-DCCRN networks.


title: Multi-Modal Transformers Utterance-Level Code-Switching Detection

abstract: An utterance that contains speech from multiple languages is known as a code-switched sentence. In this work, we propose a novel technique to predict whether given audio is mono-lingual or code-switched. We propose a multi-modal learning approach by utilising the phoneme information along with audio features for code-switch detection. Our model consists of a Phoneme Network that processes phoneme sequence and Audio Network(AN), which processes the mfcc features. We fuse representation learned from both the Networks to predict if the utterance is code-switched or not. The Audio Network and Phonetic Network consist of initial convolution, Bi-LSTM, and transformer encoder layers. The transformer encoder layer helps in selecting important and relevant features for better classification by using self-attention. We show that utilising the phoneme sequence of the utterance along with the mfcc features improves the performance of code-switch detection significantly. We train and evaluate our model on Microsoft code-switching challenge datasets for Telugu, Tamil, and Gujarati languages. Our experiments show that the multi-modal learning approach significantly improved accuracy over the uni-modal approaches for Telugu-English, Gujarati-English, and Tamil-English datasets. We also study the system performance using different neural layers and show that the transformers help obtain better performance.


title: Generalized Casimir Operators for Lie Superalgebras

abstract: In this paper, we define generalized Casimir operators for a loop contragredient Lie superalgebra and prove that they commute with the underlying Lie superalgebra. These operators have applications in the decomposition of tensor product modules. We further introduce the notion of generalized Gelfand invariants for the loop general linear Lie superalgebra and show that they also commute with the underlying Lie superalgebra. These operators when applied to a highest weight vector in a tensor product module again induces a new highest weight vector.


title: N-pure ideals and mid rings

abstract: In this paper, we introduce the concept of N-pure ideal as a generalization of pure ideal. Using this concept, a new and interesting type of rings is presented, we call it mid ring. Also, we provide new characterizations for von Neumann regular and zero-dimensional rings. Moreover, some results about mp-ring are given. Finally, a characterization for mid rings is provided. Then it is shown that the class of mid rings is strictly between the class of reduced mp-rings (p.f. rings) and the class of mp-rings.


title: Planning to Chronicle

abstract: An important class of applications entails a robot monitoring, scrutinizing, or recording the evolution of an uncertain time-extended process. This sort of situation leads an interesting family of planning problems in which the robot is limited in what it sees and must, thus, choose what to pay attention to. The distinguishing characteristic of this setting is that the robot has influence over what it captures via its sensors, but exercises no causal authority over the evolving process. As such, the robot's objective is to observe the underlying process and to produce a `chronicle' of occurrent events, subject to a goal specification of the sorts of event sequences that may be of interest. This paper examines variants of such problems when the robot aims to collect sets of observations to meet a rich specification of their sequential structure. We study this class of problems by modeling a stochastic process via a variant of a hidden Markov model, and specify the event sequences of interest as a regular language, developing a vocabulary of `mutators' that enable sophisticated requirements to be expressed. Under different suppositions about the information gleaned about the Markov model, we formulate and solve different planning problems. The core underlying idea is the construction of a product between the event model and a specification automaton. The paper reports and compares performance metrics by drawing on some small case studies analyzed in depth in simulation.


title: Interpretable Representation Learning for Speech and Audio Signals Based on Relevance Weighting

abstract: The learning of interpretable representations from raw data presents significant challenges for time series data like speech. In this work, we propose a relevance weighting scheme that allows the interpretation of the speech representations during the forward propagation of the model itself. The relevance weighting is achieved using a sub-network approach that performs the task of feature selection. A relevance sub-network, applied on the output of first layer of a convolutional neural network model operating on raw speech signals, acts as an acoustic filterbank (FB) layer with relevance weighting. A similar relevance sub-network applied on the second convolutional layer performs modulation filterbank learning with relevance weighting. The full acoustic model consisting of relevance sub-networks, convolutional layers and feed-forward layers is trained for a speech recognition task on noisy and reverberant speech in the Aurora-4, CHiME-3 and VOiCES datasets. The proposed representation learning framework is also applied for the task of sound classification in the UrbanSound8K dataset. A detailed analysis of the relevance weights learned by the model reveals that the relevance weights capture information regarding the underlying speech/audio content. In addition, speech recognition and sound classification experiments reveal that the incorporation of relevance weighting in the neural network architecture improves the performance significantly.


title: Additive Grothendieck pretopologies and presentations of tensor categories

abstract: We define a notion on preadditive categories which plays a role similar to the notion of a Grothendieck pretopology on an unenriched category. Each such additive pretopology defines an additive Grothendieck topology and suffices to define the sheaf category. This new notion allows us to study the noetherian and subcanonical nature of topologies, to describe easily the meet of a family of topologies and to identify useful universal properties of the sheaf category. As our main application we derive in which ways one can present a tensor category and show that such presentations lead to remarkable universal properties.


title: Spectral Efficiency of Dense Multicell Massive MIMO Networks in Spatially Correlated Channels

abstract: This paper is on the spectral efficiency (SE) of a dense multi-cell massive multiple-input multiple-output (MIMO). The channels are spatially correlated and the multi-slope path loss model is considered. In our framework, the channel state information is obtained by using pilot sequences and the BSs are deployed randomly. First, we study the channel estimation accuracy and its impact on the SE as the BS density increases and the network becomes densified. Second, we consider the special case of uncorrelated channels for which the stochastic geometry framework helps us to simplify the SE expressions and obtain the minimum value of antenna-UE ratio over which the pilot contamination is dominant rather than the inter- and intra-cell interference. Finally, we provide some insights into the obtained SE for the spatially correlated channels, from a multi-cell processing scheme as well as the single-cell ones in terms of the BS density. Our results show that while all the detectors result in non-increasing SE in terms of the BS density, their area SE increases exponentially as the network becomes densified. Moreover, we conclude that in order to achieve a given SE, the required value of antenna-UE ratio decreases as the level of channel correlation increases.


title: Reeder's Conjecture for Even Orthogonal Lie algebras

abstract: In the paper we complete a case by case proof of Reeder's Conjecture started in our previous work, proving the conjecture for simple Lie algebras of type $D$ and for the exceptional cases.


title: Two Strong $3$-Flow Theorems for Planar Graphs

abstract: In 1972, Tutte posed the $3$-Flow Conjecture: that all $4$-edge-connected graphs have a nowhere zero $3$-flow. This was extended by Jaeger et al.(1992) to allow vertices to have a prescribed, possibly non-zero difference (modulo $3$) between the inflow and outflow. They conjectured that all $5$-edge-connected graphs with a valid prescription function have a nowhere zero $3$-flow meeting that prescription (we call this the Strong $3$-Flow Conjecture). Kochol (2001) showed that replacing $4$-edge-connected with $5$-edge-connected would suffice to prove the $3$-Flow Conjecture and Lov\'asz et al.(2013) showed that the $3$-Flow and Strong $3$-Flow Conjectures hold if the edge connectivity condition is relaxed to $6$-edge-connected. Both problems are still open for $5$-edge-connected graphs. The $3$-Flow Conjecture was known to hold for planar graphs, as it is the dual of Gr\"otzsch's Colouring Theorem. Steinberg and Younger (1989) provided the first direct proof using flows for planar graphs, as well as a proof for projective planar graphs. Richter et al.(2016) provided the first direct proof using flows of the Strong $3$-Flow Conjecture for planar graphs. We provide two extensions to their result, that we developed in order to prove the Strong $3$-Flow Conjecture for projective planar graphs.


title: Control with adaptive Q-learning

abstract: This paper evaluates adaptive Q-learning (AQL) and single-partition adaptive Q-learning (SPAQL), two algorithms for efficient model-free episodic reinforcement learning (RL), in two classical control problems (Pendulum and Cartpole). AQL adaptively partitions the state-action space of a Markov decision process (MDP), while learning the control policy, i. e., the mapping from states to actions. The main difference between AQL and SPAQL is that the latter learns time-invariant policies, where the mapping from states to actions does not depend explicitly on the time step. This paper also proposes the SPAQL with terminal state (SPAQL-TS), an improved version of SPAQL tailored for the design of regulators for control problems. The time-invariant policies are shown to result in a better performance than the time-variant ones in both problems studied. These algorithms are particularly fitted to RL problems where the action space is finite, as is the case with the Cartpole problem. SPAQL-TS solves the OpenAI Gym Cartpole problem, while also displaying a higher sample efficiency than trust region policy optimization (TRPO), a standard RL algorithm for solving control tasks. Moreover, the policies learned by SPAQL are interpretable, while TRPO policies are typically encoded as neural networks, and therefore hard to interpret. Yielding interpretable policies while being sample-efficient are the major advantages of SPAQL.


title: Not fit for Purpose: A critical analysis of the 'Five Safes'

abstract: Adopted by government agencies in Australia, New Zealand and the UK as policy instrument or as embodied into legislation, the 'Five Safes' framework aims to manage risks of releasing data derived from personal information. Despite its popularity, the Five Safes has undergone little legal or technical critical analysis. We argue that the Fives Safes is fundamentally flawed: from being disconnected from existing legal protections and appropriation of notions of safety without providing any means to prefer strong technical measures, to viewing disclosure risk as static through time and not requiring repeat assessment. The Five Safes provides little confidence that resulting data sharing is performed using 'safety' best practice or for purposes in service of public interest.


title: Conditioned Text Generation with Transfer for Closed-Domain Dialogue Systems

abstract: Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which, although less accurate than human supervision, has the advantage of being cheap and fast. Our contribution is twofold. First we show how to optimally train and control the generation of intent-specific sentences using a conditional variational autoencoder. Then we introduce a new protocol called query transfer that allows to leverage a large unlabelled dataset, possibly containing irrelevant queries, to extract relevant information. Comparison with two different baselines shows that this method, in the appropriate regime, consistently improves the diversity of the generated queries without compromising their quality. We also demonstrate the effectiveness of our generation method as a data augmentation technique for language modelling tasks.


title: Topological analysis of chemical bonding in the layered FePSe3 upon pressure-induced phase transitions

abstract: Two pressure-induced phase transitions have been theoretically studied in the layered iron phosphorus triselenide (FePSe3). Topological analysis of chemical bonding in FePSe3 has been performed based on the results of first-principles calculations within the periodic linear combination of atomic orbitals (LCAO) method with hybrid Hartree-Fock-DFT B3LYP functional. The first transition at about 6 GPa is accompanied by the symmetry change from R-3 to C2/m, whereas the semiconductor-to-metal transition (SMT) occurs at about 13 GPa leading to the symmetry change from C2/m to P-31m. We found that the collapse of the band gap at about 13 GPa occurs due to changes in the electronic structure of FePSe3 induced by relative displacements of phosphorus or selenium atoms along the c-axis direction under pressure. The results of the topological analysis of the electron density and its Laplacian demonstrate that the pressure changes not only the interatomic distances but also the bond nature between the intralayer and interlayer phosphorus atoms. The interlayer P-P interactions are absent in two non-metallic FePSe3 phases while after SMT the intralayer P-P interactions weaken and the interlayer P-P interactions appear.


title: First-passage processes and the target-based accumulation of resources

abstract: Random search for one or more targets in a bounded domain occurs widely in nature, with examples ranging from animal foraging to the transport of vesicles within cells. Most theoretical studies take a searcher-centric viewpoint, focusing on the first passage time (FTP) problem to find a target. This single search-and-capture event then triggers a downstream process or provides the searcher with some resource such as food. In this paper we take a target-centric viewpoint, by considering the accumulation of resources in one or more targets due to multiple rounds of search-and-capture events combined with resource degradation; whenever a searcher finds a target it delivers a resource packet to the target, after which it escapes and returns to its initial position. The searcher is then resupplied with cargo and a new search process is initiated after a random delay. It has previously been show how queuing theory can be used to derive general expressions for the steady-state mean and variance of the resulting resource distributions. Here we apply the theory to some classical FPT problems involving diffusion in simple geometries with absorbing boundaries, including concentric spheres, wedge domains, and branching networks. In each case, we determine how the resulting Fano factor depends on the degradation rate, the delay distribution, and various geometric parameters. We thus establish that the Fano factor can deviate significantly from Poisson statistics and exhibits a non-trivial dependence on model parameters, including non-monotonicity and crossover behavior. This indicates the non-trivial nature of the higher-order statistics of resource accumulation.


title: Deep Image Compositing

abstract: Image compositing is a task of combining regions from different images to compose a new image. A common use case is background replacement of portrait images. To obtain high quality composites, professionals typically manually perform multiple editing steps such as segmentation, matting and foreground color decontamination, which is very time consuming even with sophisticated photo editing tools. In this paper, we propose a new method which can automatically generate high-quality image compositing without any user input. Our method can be trained end-to-end to optimize exploitation of contextual and color information of both foreground and background images, where the compositing quality is considered in the optimization. Specifically, inspired by Laplacian pyramid blending, a dense-connected multi-stream fusion network is proposed to effectively fuse the information from the foreground and background images at different scales. In addition, we introduce a self-taught strategy to progressively train from easy to complex cases to mitigate the lack of training data. Experiments show that the proposed method can automatically generate high-quality composites and outperforms existing methods both qualitatively and quantitatively.


title: Capped norm linear discriminant analysis and its applications

abstract: Classical linear discriminant analysis (LDA) is based on squared Frobenious norm and hence is sensitive to outliers and noise. To improve the robustness of LDA, in this paper, we introduce capped l_{2,1}-norm of a matrix, which employs non-squared l_2-norm and "capped" operation, and further propose a novel capped l_{2,1}-norm linear discriminant analysis, called CLDA. Due to the use of capped l_{2,1}-norm, CLDA can effectively remove extreme outliers and suppress the effect of noise data. In fact, CLDA can be also viewed as a weighted LDA. CLDA is solved through a series of generalized eigenvalue problems with theoretical convergency. The experimental results on an artificial data set, some UCI data sets and two image data sets demonstrate the effectiveness of CLDA.


title: Hidden time-reversal symmetry, quantum detailed balance and exact solutions of driven-dissipative quantum systems

abstract: Driven-dissipative quantum systems generically do not satisfy simple notions of detailed balance based on the time symmetry of correlation functions. We show that such systems can nonetheless exhibit a hidden time-reversal symmetry which most directly manifests itself in a doubled version of the original system prepared in an appropriate entangled thermofield double state. This hidden time-reversal symmetry has a direct operational utility: it provides a general method for finding exact solutions of non-trivial steady states. Special cases of this approach include the coherent quantum absorber and complex-$P$ function methods from quantum optics. We also show that hidden TRS has observable consequences even in single-system experiments, and can be broken by the non-trivial combination of nonlinearity, thermal fluctuations, and driving. To illustrate our ideas, we analyze concrete examples of driven qubits and nonlinear cavities. These systems exhibit hidden time-reversal symmetry but not conventional detailed balance.


title: HypperSteer: Hypothetical Steering and Data Perturbation in Sequence Prediction with Deep Learning

abstract: Deep Recurrent Neural Networks (RNN) continues to find success in predictive decision-making with temporal event sequences. Recent studies have shown the importance and practicality of visual analytics in interpreting deep learning models for real-world applications. However, very limited work enables interactions with deep learning models and guides practitioners to form hypotheticals towards the desired prediction outcomes, especially for sequence prediction. Specifically, no existing work has addressed the what-if analysis and value perturbation along different time-steps for sequence outcome prediction. We present a model-agnostic visual analytics tool, HypperSteer, that steers hypothetical testing and allows users to perturb data for sequence predictions interactively. We showcase how HypperSteer helps in steering patient data to achieve desired treatment outcomes and discuss how HypperSteer can serve as a comprehensive solution for other practical scenarios.


title: EAdam Optimizer: How $\epsilon$ Impact Adam

abstract: Many adaptive optimization methods have been proposed and used in deep learning, in which Adam is regarded as the default algorithm and widely used in many deep learning frameworks. Recently, many variants of Adam, such as Adabound, RAdam and Adabelief, have been proposed and show better performance than Adam. However, these variants mainly focus on changing the stepsize by making differences on the gradient or the square of it. Motivated by the fact that suitable damping is important for the success of powerful second-order optimizers, we discuss the impact of the constant $\epsilon$ for Adam in this paper. Surprisingly, we can obtain better performance than Adam simply changing the position of $\epsilon$. Based on this finding, we propose a new variant of Adam called EAdam, which doesn't need extra hyper-parameters or computational costs. We also discuss the relationships and differences between our method and Adam. Finally, we conduct extensive experiments on various popular tasks and models. Experimental results show that our method can bring significant improvement compared with Adam. Our code is available at https://github.com/yuanwei2019/EAdam-optimizer.


abstract: The framework for Simulation of Human and Artificial Emotion (SHArE) describes the architecture of emotion in terms of parameters transferable between psychology, neuroscience, and artificial intelligence. These parameters can be defined as abstract concepts or granularized down to the voltage levels of individual neurons. This model enables emotional trajectory design for humans which may lead to novel therapeutic solutions for various mental health concerns. For artificial intelligence, this work provides a compact notation which can be applied to neural networks as a means to observe the emotions and motivations of machines.


title: From Practice to Theory: The "Bright Illumination" Attack on Quantum Key Distribution Systems

abstract: The "Bright Illumination" attack [Lydersen et al., Nat. Photon. 4, 686-689 (2010)] is a practical attack, fully implementable against quantum key distribution systems. In contrast to almost all developments in quantum information processing (for example, Shor's factorization algorithm, quantum teleportation, Bennett-Brassard (BB84) quantum key distribution, the "Photon-Number Splitting" attack, and many other examples), for which theory has been proposed decades before a proper implementation, the "Bright Illumination" attack preceded any sign or hint of a theoretical prediction. Here we explain how the "Reversed-Space" methodology of attacks, complementary to the notion of "quantum side-channel attacks" (which is analogous to a similar term in "classical" - namely, non-quantum - computer security), has missed the opportunity of predicting the "Bright Illumination" attack.


title: Intrinsic quasi-metrics

abstract: The point pair function $p_G$ defined in a domain $G\subsetneq\mathbb{R}^n$ is shown to be a quasi-metric and its other properties are studied. For a convex domain $G\subsetneq\mathbb{R}^n$, a new intrinsic quasi-metric called the function $w_G$ is introduced. Several sharp results are established for these two quasi-metrics, and their connection to the triangular ratio metric is studied.


title: Pricing-Driven Service Caching and Task Offloading in Mobile Edge Computing

abstract: Provided with mobile edge computing (MEC) services, wireless devices (WDs) no longer have to experience long latency in running their desired programs locally, but can pay to offload computation tasks to the edge server. Given its limited storage space, it is important for the edge server at the base station (BS) to determine which service programs to cache by meeting and guiding WDs' offloading decisions. In this paper, we propose an MEC service pricing scheme to coordinate with the service caching decisions and control WDs' task offloading behavior. We propose a two-stage dynamic game of incomplete information to model and analyze the two-stage interaction between the BS and multiple associated WDs. Specifically, in Stage I, the BS determines the MEC service caching and announces the service program prices to the WDs, with the objective to maximize its expected profit under both storage and computation resource constraints. In Stage II, given the prices of different service programs, each WD selfishly decides its offloading decision to minimize individual service delay and cost, without knowing the other WDs' desired program types or local execution delays. Despite the lack of WD's information and the coupling of all the WDs' offloading decisions, we derive the optimal threshold-based offloading policy that can be easily adopted by the WDs in Stage II at the Bayesian equilibrium. Then, by predicting the WDs' offloading equilibrium, we jointly optimize the BS' pricing and service caching in Stage I via a low-complexity algorithm. In particular, we study both the uniform and differentiated pricing schemes. For differentiated pricing, we prove that the same price should be charged to the cached programs of the same workload.


title: Do Noises Bother Human and Neural Networks In the Same Way? A Medical Image Analysis Perspective

abstract: Deep learning had already demonstrated its power in medical images, including denoising, classification, segmentation, etc. All these applications are proposed to automatically analyze medical images beforehand, which brings more information to radiologists during clinical assessment for accuracy improvement. Recently, many medical denoising methods had shown their significant artifact reduction result and noise removal both quantitatively and qualitatively. However, those existing methods are developed around human-vision, i.e., they are designed to minimize the noise effect that can be perceived by human eyes. In this paper, we introduce an application-guided denoising framework, which focuses on denoising for the following neural networks. In our experiments, we apply the proposed framework to different datasets, models, and use cases. Experimental results show that our proposed framework can achieve a better result than human-vision denoising network.


title: CoT-AMFlow: Adaptive Modulation Network with Co-Teaching Strategy for Unsupervised Optical Flow Estimation

abstract: The interpretation of ego motion and scene change is a fundamental task for mobile robots. Optical flow information can be employed to estimate motion in the surroundings. Recently, unsupervised optical flow estimation has become a research hotspot. However, unsupervised approaches are often easy to be unreliable on partially occluded or texture-less regions. To deal with this problem, we propose CoT-AMFlow in this paper, an unsupervised optical flow estimation approach. In terms of the network architecture, we develop an adaptive modulation network that employs two novel module types, flow modulation modules (FMMs) and cost volume modulation modules (CMMs), to remove outliers in challenging regions. As for the training paradigm, we adopt a co-teaching strategy, where two networks simultaneously teach each other about challenging regions to further improve accuracy. Experimental results on the MPI Sintel, KITTI Flow and Middlebury Flow benchmarks demonstrate that our CoT-AMFlow outperforms all other state-of-the-art unsupervised approaches, while still running in real time. Our project page is available at https://sites.google.com/view/cot-amflow.


title: The Search for Feebly-Interacting Particles

abstract: At the dawn of a new decade, particle physics faces the challenge of explaining the mystery of dark matter, the origin of matter over antimatter in the Universe, the apparent fine-tuning of the electro-weak scale, and many other aspects of fundamental physics. Perhaps the most striking frontier to emerge in the search for answers involves new physics at mass scales comparable to familiar matter, below the GeV scale, but with very feeble interaction strength. New theoretical ideas to address dark matter and other fundamental questions predict such feebly interacting particles (FIPs) at these scales, and indeed, existing data may even provide hints of this possibility. Emboldened by the lessons of the LHC, a vibrant experimental program to discover such physics is under way, guided by a systematic theoretical approach firmly grounded on the underlying principles of the Standard Model. We give an overview of these efforts, their motivations, and the decadal goals that animate the community involved in the search for FIPs, with special focus on accelerator-based experiments.


title: Activity time series of old stars from late F to early K. V. Effect on exoplanet detectability with high-precision astrometry

abstract: Stellar activity strongly affects and may prevent the detection of Earth-mass planets in the habitable zone of solar-type stars with radial velocity technics. Astrometry is in principle less sensitive to stellar activity because the situation is more favourable: the stellar astrometric signal is expected to be fainter than the planetary astrometric signal compared to radial velocities. We quantify the effect of stellar activity on high-precision astrometry when Earth-mass planets are searched for in the habitable zone around old main-sequence solar-type stars. We used a very large set of magnetic activity synthetic time series to characterise the properties of the stellar astrometric signal. We then studied the detectability of exoplanets based on different approaches: first based on the theoretical level of false positives derived from the synthetic time series, and then with blind tests for old main-sequence F6-K4 stars. The amplitude of the signal can be up to a few times the solar value depending on the assumptions made for activity level, spectral type, and spot contrast. The detection rates for 1 MEarth planets are very good, however, with extremely low false-positive rates in the habitable zone for stars in the F6-K4 range at 10 pc. The standard false-alarm probability using classical bootstrapping on the time series strongly overestimates the false-positive level. This affects the detection rates. We conclude that if technological challenges can be overcome and very high precision is reached, astrometry is much more suitable for detecting Earth-mass planets in the habitable zone around nearby solar-type stars than radial velocity, and detection rates are much higher for this range of planetary masses and periods when astrometric techniques are used than with radial velocity techniques.


title: Reverse engineering learned optimizers reveals known and novel mechanisms

abstract: Learned optimizers are algorithms that can themselves be trained to solve optimization problems. In contrast to baseline optimizers (such as momentum or Adam) that use simple update rules derived from theoretical principles, learned optimizers use flexible, high-dimensional, nonlinear parameterizations. Although this can lead to better performance in certain settings, their inner workings remain a mystery. How is a learned optimizer able to outperform a well tuned baseline? Has it learned a sophisticated combination of existing optimization techniques, or is it implementing completely new behavior? In this work, we address these questions by careful analysis and visualization of learned optimizers. We study learned optimizers trained from scratch on three disparate tasks, and discover that they have learned interpretable mechanisms, including: momentum, gradient clipping, learning rate schedules, and a new form of learning rate adaptation. Moreover, we show how the dynamics of learned optimizers enables these behaviors. Our results help elucidate the previously murky understanding of how learned optimizers work, and establish tools for interpreting future learned optimizers.


title: Data Augmentation for End-to-end Code-switching Speech Recognition

abstract: Training a code-switching end-to-end automatic speech recognition (ASR) model normally requires a large amount of data, while code-switching data is often limited. In this paper, three novel approaches are proposed for code-switching data augmentation. Specifically, they are audio splicing with the existing code-switching data, and TTS with new code-switching texts generated by word translation or word insertion. Our experiments on 200 hours Mandarin-English code-switching dataset show that all the three proposed approaches yield significant improvements on code-switching ASR individually. Moreover, all the proposed approaches can be combined with recent popular SpecAugment, and an addition gain can be obtained. WER is significantly reduced by relative 24.0% compared to the system without any data augmentation, and still relative 13.0% gain compared to the system with only SpecAugment


title: Learned Decimation for Neural Belief Propagation Decoders

abstract: We introduce a two-stage decimation process to improve the performance of neural belief propagation (NBP), recently introduced by Nachmani et al., for short low-density parity-check (LDPC) codes. In the first stage, we build a list by iterating between a conventional NBP decoder and guessing the least reliable bit. The second stage iterates between a conventional NBP decoder and learned decimation, where we use a neural network to decide the decimation value for each bit. For a (128,64) LDPC code, the proposed NBP with decimation outperforms NBP decoding by 0.75 dB and performs within 1 dB from maximum-likelihood decoding at a block error rate of $10^{-4}$.


title: Connectivity in Semi-Algebraic Sets I

abstract: A semi-algebraic set is a subset of the real space defined by polynomial equations and inequalities having real coefficients and is a union of finitely many maximally connected components. We consider the problem of deciding whether two given points in a semi-algebraic set are connected; that is, whether the two points lie in the same connected component. In particular, we consider the semi-algebraic set defined by f <> 0 where f is a given polynomial with integer coefficients. The motivation comes from the observation that many important or non-trivial problems in science and engineering can be often reduced to that of connectivity. Due to its importance, there has been intense research effort on the problem. We will describe a symbolic-numeric method based on gradient ascent. The method will be described in two papers. The first paper (the present one) will describe the symbolic part and the forthcoming second paper will describe the numeric part. In the present paper, we give proofs of correctness and termination for the symbolic part and illustrate the efficacy of the method using several non-trivial examples.


title: The entropy of entire transcendental functions

abstract: We use Bowen's definition of topological entropy and Ahlfors five islands theorem, as well as the theory of polynomial-like mappings, to show that the topological entropy of any entire transcendental function is infinity. In addition the entropy is concentrated on the Julia set for each meromorphic function which has no wandering domains.


title: An Improved Attention for Visual Question Answering

abstract: We consider the problem of Visual Question Answering (VQA). Given an image and a free-form, open-ended, question, expressed in natural language, the goal of VQA system is to provide accurate answer to this question with respect to the image. The task is challenging because it requires simultaneous and intricate understanding of both visual and textual information. Attention, which captures intra- and inter-modal dependencies, has emerged as perhaps the most widely used mechanism for addressing these challenges. In this paper, we propose an improved attention-based architecture to solve VQA. We incorporate an Attention on Attention (AoA) module within encoder-decoder framework, which is able to determine the relation between attention results and queries. Attention module generates weighted average for each query. On the other hand, AoA module first generates an information vector and an attention gate using attention results and current context; and then adds another attention to generate final attended information by multiplying the two. We also propose multimodal fusion module to combine both visual and textual information. The goal of this fusion module is to dynamically decide how much information should be considered from each modality. Extensive experiments on VQA-v2 benchmark dataset show that our method achieves the state-of-the-art performance.


title: Quantum Speedup of Monte Carlo Integration with respect to the Number of Dimensions and its Application to Finance

abstract: Monte Carlo integration using quantum computers has been widely investigated, including applications to concrete problems. It is known that quantum algorithms based on quantum amplitude estimation (QAE) can compute an integral with a smaller number of iterative calls of the quantum circuit which calculates the integrand, than classical methods call the integrand subroutine. However, the issues about the iterative operations in the integrand circuit have not been discussed so much. That is, in the high-dimensional integration, many random numbers are used for calculation of the integrand and in some cases similar calculations are repeated to obtain one sample value of the integrand. In this paper, we point out that we can reduce the number of such repeated operations by a combination of the nested QAE and the use of pseudorandom numbers (PRNs), if the integrand has the separable form with respect to contributions from distinct random numbers. The use of PRNs, which the authors originally proposed in the context of the quantum algorithm for Monte Carlo, is the key factor also in this paper, since it enables parallel computation of the separable terms in the integrand. Furthermore, we pick up one use case of this method in finance, the credit portfolio risk measurement, and estimate to what extent the complexity is reduced.


title: DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search

abstract: The convolutional neural network has achieved great success in fulfilling computer vision tasks despite large computation overhead against efficient deployment. Structured (channel) pruning is usually applied to reduce the model redundancy while preserving the network structure, such that the pruned network can be easily deployed in practice. However, existing structured pruning methods require hand-crafted rules which may lead to tremendous pruning space. In this paper, we introduce Differentiable Annealing Indicator Search (DAIS) that leverages the strength of neural architecture search in the channel pruning and automatically searches for the effective pruned model with given constraints on computation overhead. Specifically, DAIS relaxes the binarized channel indicators to be continuous and then jointly learns both indicators and model parameters via bi-level optimization. To bridge the non-negligible discrepancy between the continuous model and the target binarized model, DAIS proposes an annealing-based procedure to steer the indicator convergence towards binarized states. Moreover, DAIS designs various regularizations based on a priori structural knowledge to control the pruning sparsity and to improve model performance. Experimental results show that DAIS outperforms state-of-the-art pruning methods on CIFAR-10, CIFAR-100, and ImageNet.


title: BaFFLe: Backdoor detection via Feedback-based Federated Learning

abstract: Recent studies have shown that federated learning (FL) is vulnerable to poisoning attacks that inject a backdoor into the global model. These attacks are effective even when performed by a single client, and undetectable by most existing defensive techniques. In this paper, we propose Backdoor detection via Feedback-based Federated Learning (BAFFLE), a novel defense to secure FL against backdoor attacks. The core idea behind BAFFLE is to leverage data of multiple clients not only for training but also for uncovering model poisoning. We exploit the availability of diverse datasets at the various clients by incorporating a feedback loop into the FL process, to integrate the views of those clients when deciding whether a given model update is genuine or not. We show that this powerful construct can achieve very high detection rates against state-of-the-art backdoor attacks, even when relying on straightforward methods to validate the model. Through empirical evaluation using the CIFAR-10 and FEMNIST datasets, we show that by combining the feedback loop with a method that suspects poisoning attempts by assessing the per-class classification performance of the updated model, BAFFLE reliably detects state-of-the-art backdoor attacks with a detection accuracy of 100% and a false-positive rate below 5%. Moreover, we show that our solution can detect adaptive attacks aimed at bypassing the defense.


title: Learning in your voice: Non-parallel voice conversion based on speaker consistency loss

abstract: In this paper, we propose a novel voice conversion strategy to resolve the mismatch between the training and conversion scenarios when parallel speech corpus is unavailable for training. Based on auto-encoder and disentanglement frameworks, we design the proposed model to extract identity and content representations while reconstructing the input speech signal itself. Since we use other speaker's identity information in the training process, the training philosophy is naturally matched with the objective of voice conversion process. In addition, we effectively design the disentanglement framework to reliably preserve linguistic information and to enhance the quality of converted speech signals. The superiority of the proposed method is shown in subjective listening tests as well as objective measures.


title: A geometric analysis of the SIRS epidemiological model on a homogeneous network

abstract: We study a fast-slow version of an SIRS epidemiological model on homogeneous graphs, obtained through the application of the moment closure method. We use GSPT to study the model, taking into account that the infection period is much shorter than the average duration of immunity. We show that the dynamics occurs through a sequence of fast and slow flows, that can be described through 2-dimensional maps that, under some assumptions, can be approximated as 1-dimensional maps. Using this method, together with numerical bifurcation tools, we show that the model can give rise to periodic solutions, differently from the corresponding model based on homogeneous mixing.


title: Structure of Virasoro tensor categories at central charge $13-6p-6p^{-1}$ for integers $p > 1$

abstract: Let $\mathcal{O}_c$ be the category of finite-length central-charge-$c$ modules for the Virasoro Lie algebra whose composition factors are irreducible quotients of reducible Verma modules. Recently, it has been shown that $\mathcal{O}_c$ admits vertex algebraic tensor category structure for any $c\in\mathbb{C}$. Here, we determine the structure of this tensor category when $c=13-6p-6p^{-1}$ for an integer $p>1$. For such $c$, we prove that $\mathcal{O}_{c}$ is rigid, and we construct projective covers of irreducible modules in a natural tensor subcategory $\mathcal{O}_{c}^0$. We then compute all tensor products involving irreducible modules and their projective covers. Using these tensor product formulas, we show that $\mathcal{O}_c$ has a semisimplification which, as an abelian category, is the Deligne product of two tensor subcategories that are tensor equivalent to the Kazhdan-Lusztig categories for affine $\mathfrak{sl}_2$ at levels $-2+p^{\pm 1}$. Next, as a straightforward consequence of the braided tensor category structure on $\mathcal{O}_c$ together with the theory of vertex operator algebra extensions, we rederive known results for triplet vertex operator algebras $\mathcal{W}(p)$, including rigidity, fusion rules, and construction of projective covers. Finally, we prove a recent conjecture of Negron that $\mathcal{O}_c^0$ is braided tensor equivalent to the $PSL(2,\mathbb{C})$-equivariantization of the category of $\mathcal{W}(p)$-modules.


title: Critical exponents and transport properties near the QCD critical endpoint from the statistical bootstrap model

abstract: We present an estimate of the behaviour of the shear and bulk viscosity coefficients when the QCD critical point is approached from the hadronic side, describing hadronic matter within the statistical bootstrap model (SBM) of strong interactions. The boostrap model shows critical behavior near the quark-hadron transition temperature if the parameter characterizing the degeneracy of Hagedorn states is properly chosen. We calculate the critical exponents and amplitudes of relevant thermodynamic quantities near the QCD critical point and combine them with an Ansatz for the shear and bulk viscosity coefficients to derive the behavior of these coefficients near the critical point. The shear viscosity to entropy density ratio is found to decrease when the temperature is increased, and to approach the Kovtun-Son-Starinets bound 1/(4{\pi}) faster near the critical point, while the bulk viscosity coefficient is found to rise very rapidly.


title: Leveraging Temporal Joint Depths for Improving 3D Human Pose Estimation in Video

abstract: The effectiveness of the approaches to predict 3D poses from 2D poses estimated in each frame of a video has been demonstrated for 3D human pose estimation. However, 2D poses without appearance information of persons have much ambiguity with respect to the joint depths. In this paper, we propose to estimate a 3D pose in each frame of a video and refine it considering temporal information. The proposed approach reduces the ambiguity of the joint depths and improves the 3D pose estimation accuracy.


title: Neural text normalization leveraging similarities of strings and sounds

abstract: We propose neural models that can normalize text by considering the similarities of word strings and sounds. We experimentally compared a model that considers the similarities of both word strings and sounds, a model that considers only the similarity of word strings or of sounds, and a model without the similarities as a baseline. Results showed that leveraging the word string similarity succeeded in dealing with misspellings and abbreviations, and taking into account the sound similarity succeeded in dealing with phonetic substitutions and emphasized characters. So that the proposed models achieved higher F$_1$ scores than the baseline.


title: The fluid dynamics of collective vortex structures of plant-animal worms

abstract: Circular milling, a stunning manifestation of collective motion, is found across the natural world, from fish shoals to army ants. It has been observed recently that the plant-animal worm $Symsagittifera~roscoffensis$ exhibits circular milling behaviour, both in shallow pools at the beach and in Petri dishes in the laboratory. Here we investigate this phenomenon, through experiment and theory, from a fluid dynamical viewpoint, focusing on the effect that an established circular mill has on the surrounding fluid. Unlike systems such as confined bacterial suspensions and collections of molecular motors and filaments that exhibit spontaneous circulatory behaviour, and which are modelled as force dipoles, the front-back symmetry of individual worms precludes a stresslet contribution. Instead, singularities such as source dipoles and Stokes quadrupoles are expected to dominate. A series of models is analyzed to understand the contributions of these singularities to the azimuthal flow fields generated by a mill, in light of the particular boundary conditions that hold for flow in a Petri dish. A model that treats a circular mill as a rigid rotating disc that generates a Stokes flow is shown to capture basic experimental results well, and gives insights into the emergence and stability of multiple mill systems.


title: Between proper and strong edge-colorings of subcubic graphs

abstract: In a proper edge-coloring the edges of every color form a matching. A matching is induced if the end-vertices of its edges induce a matching. A strong edge-coloring is an edge-coloring in which the edges of every color form an induced matching. We consider intermediate types of edge-colorings, where edges of some colors are allowed to form matchings, and the remaining form induced matchings. Our research is motivated by the conjecture proposed in a recent paper of Gastineau and Togni on S-packing edge-colorings (On S-packing edge-colorings of cubic graphs, Discrete Appl. Math. 259 (2019), 63-75) asserting that by allowing three additional induced matchings, one is able to save one matching color. We prove that every graph with maximum degree 3 can be decomposed into one matching and at most 8 induced matchings, and two matchings and at most 5 induced matchings. We also show that if a graph is in class I, the number of induced matchings can be decreased by one, hence confirming the above-mentioned conjecture for class I graphs.


title: The electron-capture origin of supernova 2018zd

abstract: In the transitional mass range ($\sim$ 8-10 solar masses) between white dwarf formation and iron core-collapse supernovae, stars are expected to produce an electron-capture supernova. Theoretically, these progenitors are thought to be super-asymptotic giant branch stars with a degenerate O+Ne+Mg core, and electron capture onto Ne and Mg nuclei should initiate core collapse. However, no supernovae have unequivocally been identified from an electron-capture origin, partly because of uncertainty in theoretical predictions. Here we present six indicators of electron-capture supernovae and show that supernova 2018zd is the only known supernova having strong evidence for or consistent with all six: progenitor identification, circumstellar material, chemical composition, explosion energy, light curve, and nucleosynthesis. For supernova 2018zd, we infer a super-asymptotic giant branch progenitor based on the faint candidate in the pre-explosion images and the chemically-enriched circumstellar material revealed by the early ultraviolet colours and flash spectroscopy. The light-curve morphology and nebular emission lines can be explained with the low explosion energy and neutron-rich nucleosynthesis produced in an electron-capture supernova. This identification provides insights into the complex stellar evolution, supernova physics, cosmic nucleosynthesis, and remnant populations in the transitional mass range.


title: Diversity Aware Relevance Learning for Argument Search

abstract: In this work, we focus on the problem of retrieving relevant arguments for a query claim covering diverse aspects. State-of-the-art methods rely on explicit mappings between claims and premises, and thus are unable to utilize large available collections of premises without laborious and costly manual annotation. Their diversity approach relies on removing duplicates via clustering which does not directly ensure that the selected premises cover all aspects. This work introduces a new multi-step approach for the argument retrieval problem. Rather than relying on ground-truth assignments, our approach employs a machine learning model to capture semantic relationships between arguments. Beyond that, it aims to cover diverse facets of the query, instead of trying to identify duplicates explicitly. Our empirical evaluation demonstrates that our approach leads to a significant improvement in the argument retrieval task even though it requires less data.


title: On the extension of Whitney ultrajets of Beurling type

abstract: We prove a version of Whitney's extension theorem in the ultradifferentiable Beurling setting with controlled loss of regularity. As a by-product we show the existence of continuous linear extension operators on certain spaces of Whitney ultrajets on arbitrary closed sets in $\mathbb R^n$.


title: Node-Centric Graph Learning from Data for Brain State Identification

abstract: Data-driven graph learning models a network by determining the strength of connections between its nodes. The data refers to a graph signal which associates a value with each graph node. Existing graph learning methods either use simplified models for the graph signal, or they are prohibitively expensive in terms of computational and memory requirements. This is particularly true when the number of nodes is high or there are temporal changes in the network. In order to consider richer models with a reasonable computational tractability, we introduce a graph learning method based on representation learning on graphs. Representation learning generates an embedding for each graph node, taking the information from neighbouring nodes into account. Our graph learning method further modifies the embeddings to compute the graph similarity matrix. In this work, graph learning is used to examine brain networks for brain state identification. We infer time-varying brain graphs from an extensive dataset of intracranial electroencephalographic (iEEG) signals from ten patients. We then apply the graphs as input to a classifier to distinguish seizure vs. non-seizure brain states. Using the binary classification metric of area under the receiver operating characteristic curve (AUC), this approach yields an average of 9.13 percent improvement when compared to two widely used brain network modeling methods.


title: Helioseismic finite-frequency sensitivity kernels for flows in spherical geometry including systematic effects

abstract: Helioseismic inferences of large-scale flows in the solar interior necessitate accounting for the curvature of the Sun, both in interpreting systematic trends introduced in measurements as well as the sensitivity kernel that relates photospheric measurements to subsurface flow velocities. Additionally the inverse problem that relates measurements to model parameters needs to be well-posed to obtain accurate inferences, which necessitates a sparse set of parameters. Further, the sensitivity functions need to be computationally easy to evaluate. In this work we address these issues by demonstrating that the sensitivity kernels for flow velocities may be computed efficiently in a basis of vector spherical harmonics. We are also able to account for line-of-sight projections in Doppler measurements, as well as center-to-limb differences in line-formation heights. We show that given the assumed spherical symmetry of the background model, it is often cheap to simultaneously compute the kernels for pairs of observation points that are related by a rotation. Such an approach is therefore particularly well-suited to inverse problems for large-scale flows in the Sun, such as meridional circulation.


title: Graphene-based optical sensors for the pre-vention of SARS-CoV-2 viral dissemination

abstract: What level of scientific knowledge has been gained against COVID-19 during the months of the pandemic? Are current technologies able to keep up with the advances in virology research? Historically, disease outbreaks due to pathogenic microorganisms have killed many more people than wars have, and the ability that viral genes have displayed to rapidly change and adapt has forced new studies. Early detection is most important for timely management of any biological attack, whether natural or intentional, and rapid detection systems are essential to counter the effects of viral disease. Optical sensors have several advantages in this field, such as simple and label-free protocols. In this letter, the role of layer materials, such as graphene, is presented. Graphene has unique and excellent optical properties for plasmonics and Raman scattering. Finally, a method of Covid-19 detection on graphene sensors is proposed via a plasmon-molecular orbital interaction that provides a unique signature of the S-protein of the virus.


title: A Multi-Resolution Frontier-Based Planner for Autonomous 3D Exploration

abstract: In this paper we propose a planner for 3D exploration that is suitable for applications using state-of-the-art 3D sensors such as lidars, which produce large point clouds with each scan. The planner is based on the detection of a frontier - a boundary between the explored and unknown part of the environment - and consists of the algorithm for detecting frontier points, followed by clustering of frontier points and selecting the best frontier point to be explored. Compared to existing frontier-based approaches, the planner is more scalable, i.e. it requires less time for the same data set size while ensuring similar exploration time. Performance is achieved by not relying on data obtained directly from the 3D sensor, but on data obtained by a mapping algorithm. In order to cluster the frontier points, we use the properties of the Octree environment representation, which allows easy analysis with different resolutions. The planner is tested in the simulation environment and in an outdoor test area with a UAV equipped with a lidar sensor. The results show the advantages of the approach.


title: Cable Loop Calibration System for Jiangmen Underground Neutrino Observatory

abstract: A cable loop source calibration system is developed for the Jiangmen Underground Neutrino Observatory, a 20 kton spherical liquid scintillator neutrino experiment. This system is capable of deploying radioactive sources into different positions of the detector in a vertical plane with a few-cm position accuracy. The design and the performance of the prototype are reported in this paper.


title: Domain Growth in Ferronematics: Slaved Coarsening, Emergent Morphologies and Growth Laws

abstract: Ferronematics (FNs) are suspensions of magnetic nanoparticles in nematic liquid crystals (NLCs). They have attracted much experimental attention, and are of great interest both scientifically and technologically. There are very few theoretical studies of FNs, even in equilibrium. In this paper, we study the non-equilibrium phenomenon of domain growth after a thermal quench (or coarsening) in this coupled system. Our modeling is based on coupled time-dependent Ginzburg-Landau (TDGL) equations for two order parameters: the LC tensor order parameter ${\bf Q}$, and the magnetization ${\bf M}$. We consider both shallow and deep quenches from a high-temperature disordered phase. The system coarsens by the collision and annihilation of topological defects. We focus on slaved coarsening, where a disordered ${\bf Q}$ (or ${\bf M}$) field is driven to coarsen by an ordered ${\bf M}$ (or ${\bf Q}$) field. We present detailed results for the morphologies and growth laws, which exhibit unusual features purely due to the magneto-nematic coupling. To the best of our knowledge, this is the first study of non-equilibrium phenomena in FNs.


title: Hilbert series of typical representations for Lie superalgebras

abstract: Let g be a basic classical Lie superalgebra over C. In the case of a typical weight whose every nonnegative integer multiple is also typical, we compute a closed form for the Hilbert series whose coefficients encode the dimensions of finite-dimensional irreducible typical g-representations. We give a formula for this Hilbert series in terms of elementary symmetric polynomials and Eulerian polynomials. Additionally, we show a simple closed form in terms of differential operators.


title: Vertical engineering for large stimulated Brillouin scattering in unreleased silicon-based waveguides

abstract: Strong acousto-optic interaction in silicon-based waveguides generally requires releasing of the silicon core to avoid mechanical leakage into the underlying silica substrate. This complicates fabrication, limits thermalization, reduces the mechanical robustness and hinders large area optomechanical devices on a single chip. Here, we overcome this limitation by employing vertical photonic-phononic engineering. Specifically, the insertion of a thick silicon nitride layer between the silicon guiding core and the silica substrate contributes to reduce GHz-frequencies phonon leakage enabling large values of the Brillouin gain in an unreleased platform. We get values of the Brillouin gain around 300 (Wm)$^{-1}$ for different configurations, which could be further increased by operation at cryogenic temperatures. These values should enable to observe Brillouin-related phenomena in cm-scale waveguides or in more compact ring resonators. This finding could pave the way towards large-area unreleased cavity and waveguide optomechanics on silicon chips.


title: Strichartz Estimates with Broken Symmetries

abstract: In this note we study the eigenvalue problem for a quadratic form associated with Strichartz estimates for the Schr\"{o}dinger equation, proving in particular a sharp Strichartz inequality for the case of odd initial data. We also describe an alternative method that is applicable to a wider class of matrix problems.


title: Hyperspectral classification of blood-like substances using machine learning methods combined with genetic algorithms in transductive and inductive scenarios

abstract: This study is focused on applying genetic algorithms (GA) to model and band selection in hyperspectral image classification. We use a forensic-inspired data set of seven hyperspectral images with blood and five visually similar substances to test GA-optimised classifiers in two scenarios: when the training and test data come from the same image and when they come from different images, which is a more challenging task due to significant spectra differences. In our experiments we compare GA with a classic model optimisation through grid search. Our results show that GA-based model optimisation can reduce the number of bands and create an accurate classifier that outperforms the GS-based reference models, provided that during model optimisation it has access to examples similar to test data. We illustrate this with experiment highlighting the importance of a validation set.


title: Global Mittag-Leffler stability of Fractional-Order Projection Neural Networks with Impulses

abstract: This paper is about the study of a new class of fractional-order projection neural networks with impulses which capture the desired features of both the variational inequality and the fractional-order impulsive dynamical systems within the same framework. We obtain the existence and boundedness of solutions for such fractional-order projection neural networks under mild conditions. Moreover, we give some sufficient conditions for ensuring the global Mittag-Leffler stability of the equilibrium point for such fractional-order projection neural networks by utilizing a general quadratic Lyapunov function. Finally, we provide two numerical examples to illustrate the validity and feasibility of the main results.


title: A Self-stabilizing Control Plane for the Edge and Fog Ecosystems

abstract: Fog Computing is now emerging as the dominating paradigm bridging the compute and connectivity gap between sensing devices (a.k.a. "things") and latency-sensitive services. However, as fog deployments scale by accumulating numerous devices interconnected over highly dynamic and volatile network fabrics, the need for self-configuration and self-healing in the presence of failures is more evident now than ever. Using the prevailing methodology of self-stabilization, we propose a fault-tolerant framework for distributed control planes that enables fog services to cope and recover from a very broad fault model. Specifically, our model considers network uncertainties, packet drops, node fail-stop failures, and violations of the assumptions according to which the system was designed to operate, such as an arbitrary corruption of the system state. Our self-stabilizing algorithms guarantee automatic recovery within a constant number of communication rounds without the need for external (human) intervention. To showcase the framework's effectiveness, the correctness proof of the proposed self-stabilizing algorithmic process is accompanied by a comprehensive evaluation featuring an open and reproducible testbed utilizing real-world data from the intelligent transportation domain. Results show that our framework ensures a fog ecosystem recovery from faults in constant time, analytics are computed correctly, while the overhead to the system's control plane scales linearly towards the IoT load.


title: An optics-free computational spectrometer using a broadband and tunable dynamic detector

abstract: Optical spectrometers are the central instruments for exploring the interaction between light and matter. The current pursuit of the field is to design a spectrometer without the need for wavelength multiplexing optics to effectively reduce the complexity and physical size of the hardware. Based on computational spectroscopic results and combining a broadband-responsive dynamic detector, we successfully demonstrate an optics-free single-detector spectrometer that maps the tunable quantum efficiency of a superconducting nanowire into an ill-conditioned matrix to build a solvable inverse mathematical equation. Such a spectrometer can realize a broadband spectral responsivity ranging from 660 to 1900 nm. The spectral resolution at the telecom is 6 nm, exceeding the energy resolving capacity of existing infrared single-photon detectors. Meanwhile, benefiting from the optics-free setup, precise time-of-flight measurements can be simultaneously achieved. We have demonstrated a spectral LiDAR with 8 spectral channels. This work provides a concise method for building multifunctional spectrometers and paves the way for applying superconducting nanowire detectors in spectroscopy.


title: $\mathfrak{sl}(2)$-type singular fibres of the symplectic and odd orthogonal Hitchin system

abstract: We define and parametrise so-called $\mathfrak{sl}(2)$-type fibres of the $\mathsf{Sp}(2n,\mathbb{C})$- and $\mathsf{SO}(2n+1,\mathbb{C})$-Hitchin system. These are (singular) Hitchin fibres, where the spectral curve induces a two-sheeted covering of a second Riemann surface $Y$. This identifies the $\mathfrak{sl}(2)$-type Hitchin fibres with fibres of an $\mathsf{SL}(2,\mathbb{C})$- respectively $\mathsf{PSL}(2,\mathbb{C})$-Hitchin map on $Y$. We give a stratification of these singular spaces by semi-abelian spectral data, study their irreducible components and obtain a global description of the first degenerations. Comparing the semi-abelian spectral data of $\mathfrak{sl}(2)$-type Hitchin fibres for the two Langlands dual groups, we extend the well-known Langlands duality of regular Hitchin fibres to $\mathfrak{sl}(2)$-type Hitchin fibres. Finally, we construct solutions to the decoupled Hitchin equation for Higgs bundles of $\mathfrak{sl}(2)$-type. We conjecture these to be limiting metrics along rays to the ends of the moduli space.


title: Weed Density and Distribution Estimation for Precision Agriculture using Semi-Supervised Learning

abstract: Uncontrolled growth of weeds can severely affect the crop yield and quality. Unrestricted use of herbicide for weed removal alters biodiversity and cause environmental pollution. Instead, identifying weed-infested regions can aid selective chemical treatment of these regions. Advances in analyzing farm images have resulted in solutions to identify weed plants. However, a majority of these approaches are based on supervised learning methods which requires huge amount of manually annotated images. As a result, these supervised approaches are economically infeasible for the individual farmer because of the wide variety of plant species being cultivated. In this paper, we propose a deep learning-based semi-supervised approach for robust estimation of weed density and distribution across farmlands using only limited color images acquired from autonomous robots. This weed density and distribution can be useful in a site-specific weed management system for selective treatment of infected areas using autonomous robots. In this work, the foreground vegetation pixels containing crops and weeds are first identified using a Convolutional Neural Network (CNN) based unsupervised segmentation. Subsequently, the weed infected regions are identified using a fine-tuned CNN, eliminating the need for designing hand-crafted features. The approach is validated on two datasets of different crop/weed species (1) Crop Weed Field Image Dataset (CWFID), which consists of carrot plant images and the (2) Sugar Beets dataset. The proposed method is able to localize weed-infested regions a maximum recall of 0.99 and estimate weed density with a maximum accuracy of 82.13%. Hence, the proposed approach is shown to generalize to different plant species without the need for extensive labeled data.


title: Gravitation radiation from the collision of particles

abstract: At the present moment, there is an unresolved problem in the physics of cosmic rays. The problem concerns the origin of the ultrahigh energy cosmic rays. One of the possible mechanisms of the particle's birth with such energy is bound to the processes occurring in the active nuclei of the galaxies. In this paper, we have examined a collision of superheavy particles. Using the Weinberg formalism, we have estimated gravitational radiation emitted during the collision in the first approximation. It was shown that, for a certain collision time, the energy lost by the ultrarelativistic particle is less than the value of the energy of the mass center of the collision and the mass of the colliding particles.


title: Correlation based Multi-phasal models for improved imagined speech EEG recognition

abstract: Translation of imagined speech electroencephalogram(EEG) into human understandable commands greatly facilitates the design of naturalistic brain computer interfaces. To achieve improved imagined speech unit classification, this work aims to profit from the parallel information contained in multi-phasal EEG data recorded while speaking, imagining and performing articulatory movements corresponding to specific speech units. A bi-phase common representation learning module using neural networks is designed to model the correlation and reproducibility between an analysis phase and a support phase. The trained Correlation Network is then employed to extract discriminative features of the analysis phase. These features are further classified into five binary phonological categories using machine learning models such as Gaussian mixture based hidden Markov model and deep neural networks. The proposed approach further handles the non-availability of multi-phasal data during decoding. Topographic visualizations along with result-based inferences suggest that the multi-phasal correlation modelling approach proposed in the paper enhances imagined-speech EEG recognition performance.


title: Linearly-constrained Linear Quadratic Regulator from the viewpoint of kernel methods

abstract: The linear quadratic regulator problem is central in optimal control and was investigated since the very beginning of control theory. Nevertheless, when it includes affine state constraints, it remains very challenging from the classical ``maximum principle`` perspective. In this study we present how matrix-valued reproducing kernels allow for an alternative viewpoint. We show that the quadratic objective paired with the linear dynamics encode the relevant kernel, defining a Hilbert space of controlled trajectories. Drawing upon kernel formalism, we introduce a strengthened continuous-time convex optimization problem which can be tackled exactly with finite dimensional solvers, and which solution is interior to the constraints. When refining a time-discretization grid, this solution can be made arbitrarily close to the solution of the state-constrained Linear Quadratic Regulator. We illustrate the implementation of this method on a path-planning problem.


title: Affine invariant triangulations

abstract: We study affine invariant 2D triangulation methods. That is, methods that produce the same triangulation for a point set $S$ for any (unknown) affine transformation of $S$. Our work is based on a method by Nielson [A characterization of an affine invariant triangulation. Geom. Mod, 191-210. Springer, 1993] that uses the inverse of the covariance matrix of $S$ to define an affine invariant norm, denoted $A_{S}$, and an affine invariant triangulation, denoted ${DT}_{A_{S}}[S]$. We revisit the $A_{S}$-norm from a geometric perspective, and show that ${DT}_{A_{S}}[S]$ can be seen as a standard Delaunay triangulation of a transformed point set based on $S$. We prove that it retains all of its well-known properties such as being 1-tough, containing a perfect matching, and being a constant spanner of the complete geometric graph of $S$. We show that the $A_{S}$-norm extends to a hierarchy of related geometric structures such as the minimum spanning tree, nearest neighbor graph, Gabriel graph, relative neighborhood graph, and higher order versions of these graphs. In addition, we provide different affine invariant sorting methods of a point set $S$ and of the vertices of a polygon $P$ that can be combined with known algorithms to obtain other affine invariant triangulation methods of $S$ and of $P$.


title: IEEE SLT 2021 Alpha-mini Speech Challenge: Open Datasets, Tracks, Rules and Baselines

abstract: The IEEE Spoken Language Technology Workshop (SLT) 2021 Alpha-mini Speech Challenge (ASC) is intended to improve research on keyword spotting (KWS) and sound source location (SSL) on humanoid robots. Many publications report significant improvements in deep learning based KWS and SSL on open source datasets in recent years. For deep learning model training, it is necessary to expand the data coverage to improve the robustness of model. Thus, simulating multi-channel noisy and reverberant data from single-channel speech, noise, echo and room impulsive response (RIR) is widely adopted. However, this approach may generate mismatch between simulated data and recorded data in real application scenarios, especially echo data. In this challenge, we open source a sizable speech, keyword, echo and noise corpus for promoting data-driven methods, particularly deep-learning approaches on KWS and SSL. We also choose Alpha-mini, a humanoid robot produced by UBTECH equipped with a built-in four-microphone array on its head, to record development and evaluation sets under the actual Alpha-mini robot application scenario, including noise as well as echo and mechanical noise generated by the robot itself for model evaluation. Furthermore, we illustrate the rules, evaluation methods and baselines for researchers to quickly assess their achievements and optimize their models.


title: Multiscale study of the dynamic friction coefficient due to asperity plowing

abstract: A macroscopically nominal flat surface is rough at the nanoscale level and consists of nanoasperities. Therefore, the frictional properties of the macroscale-level rough surface are determined by the mechanical behaviors of nanoasperity contact pairs under shear. In this work, we first used molecular dynamics simulations to study the non-adhesive shear between single contact pairs. Subsequently, to estimate the friction coefficient of rough surfaces, we implemented the frictional behavior of a single contact pair into a Greenwood-Williamson-type statistical model. By employing the present multiscale approach, we used the size, rate, and orientation effects, which originated from nanoscale dislocation plasticity, to determine the dependence of the macroscale friction coefficient on system parameters, such as the surface roughness and separation, loading velocity, and direction. Our model predicts an unconventional dependence of the friction coefficient on the normal contact load, which has been observed in nanoscale frictional tests. Therefore, this model represents one step toward understanding some of the relevant macroscopic phenomena of surface friction at the nanoscale level.


title: Scaling properties of a spatial one-particle density-matrix entropy in many-body localized systems

abstract: We investigate a spatial subsystem entropy extracted from the one-particle density matrix (OPDM) in one-dimensional disordered interacting fermions that host a many-body localized (MBL) phase. Deep in the putative MBL regime, this OPDM entropy exhibits the salient features of localization, despite not being a proper entanglement measure. We numerically show that the OPDM entropy of the eigenstates obeys an area law. Similar to the von-Neumann entropy, the OPDM entropy grows logarithmically with time after a quantum quench, albeit with a different prefactor. Both these features survive at moderately large interactions and well towards the transition into the ergodic phase. The computational cost to calculate the OPDM entropy scales only polynomially with the system size, suggesting that the OPDM provides a promising starting point for developing diagnostic tools for MBL in simulations and experiments.

categories: cond-mat.str-el cond-mat.dis-nn cond-mat.quant-gas cond-mat.stat-mech quant-ph


title: Predicting the flow stress and dominant yielding mechanisms: analytical models based on discrete dislocation plasticity

abstract: Dislocations are the carriers of plasticity in crystalline materials. Their collective interaction behavior is dependent on the strain rate and sample size. In small specimens, details of the nucleation process are of particular importance. In the present work, discrete dislocation dynamics (DDD) simulations are performed to investigate the dominant yielding mechanisms in single crystalline copper pillars with diameters ranging from 100 to 800 nm. Based on our simulations with different strain rates and sample size, we observe a transition of the relevant nucleation mechanism from "dislocation multiplication" to "surface nucleation". Two physics-based analytical models are established to quantitatively predict this transition, showing a good agreement for different strain rates with our DDD simulation data and with available experimental data. Therefore, the proposed analytical models help to understand the interplay between different physical parameters and nucleation mechanisms and are well suitable to estimate the material strength for different material properties and under given loading conditions.


title: Mapping current and activity fluctuations in exclusion processes: consequences and open questions

abstract: Considering the large deviations of activity and current in the Asymmetric Simple Exclusion Process (ASEP), we show that there exists a non-trivial correspondence between the joint scaled cumulant generating functions of activity and current of two ASEPs with different parameters. This mapping is obtained by applying a similarity transform on the deformed Markov matrix of the source model in order to obtain the deformed Markov matrix of the target model. We first derive this correspondence for periodic boundary conditions, and show in the diffusive scaling limit (corresponding to the Weakly Asymmetric Simple Exclusion Processes, or WASEP) how the mapping is expressed in the language of Macroscopic Fluctuation Theory (MFT). As an interesting specific case, we map the large deviations of current in the ASEP to the large deviations of activity in the SSEP, thereby uncovering a regime of Kardar-Parisi-Zhang in the distribution of activity in the SSEP. At large activity, particle configurations exhibit hyperuniformity [Jack et al., PRL 114 060601 (2015)]. Using results from quantum spin chain theory, we characterize the hyperuniform regime by evaluating the small wavenumber asymptotic behavior of the structure factor at half-filling. Conversely, we formulate from the MFT results a conjecture for a correlation function in spin chains at any fixed total magnetization (in the thermodynamic limit). In addition, we generalize the mapping to the case of two open ASEPs with boundary reservoirs, and we apply it in the WASEP limit in the MFT formalism. This mapping also allows us to find a symmetry-breaking dynamical phase transition (DPT) in the WASEP conditioned by activity, from the prior knowledge of a DPT in the WASEP conditioned by the current.


title: Latent Causal Invariant Model

abstract: Current supervised learning can learn spurious correlation during the data-fitting process, imposing issues regarding interpretability, out-of-distribution (OOD) generalization, and robustness. To avoid spurious correlation, we propose a Latent Causal Invariance Model (LaCIM) which pursues causal prediction. Specifically, we introduce latent variables that are separated into (a) output-causative factors and (b) others that are spuriously correlated to the output via confounders, to model the underlying causal factors. We further assume the generating mechanisms from latent space to observed data to be causally invariant. We give the identifiable claim of such invariance, particularly the disentanglement of output-causative factors from others, as a theoretical guarantee for precise inference and avoiding spurious correlation. We propose a Variational-Bayesian-based method for estimation and to optimize over the latent space for prediction. The utility of our approach is verified by improved interpretability, prediction power on various OOD scenarios (including healthcare) and robustness on security.


title: Effect of hyperons on f-mode oscillations in Neutron Stars

abstract: As the densities in the interior of neutron stars exceed those of terrestrial nuclear experiments, they provide a scope for studying the nature of dense matter under extreme conditions. The composition of the inner core of neutron stars is highly uncertain, and it is speculated that exotic forms of matter such as hyperons may appear there. Gravitational waves emitted by unstable oscillation modes in neutron stars contain information about their interior composition and therefore allow us to probe the interior directly. Recently, a systematic investigation of f-mode oscillations in neutron stars revealed the role of the uncertainty in nuclear saturation parameters, particularly the effective nucleon mass, on its frequency. In this work, we study the influence of the appearance of hyperons on f-mode oscillation frequencies and therefore on the emission of gravitational waves. We also speculate whether a future detection of f-mode frequencies could provide a possibility of probing the presence of hyperons in the neutron star core.


title: Completeness of logics with the transitive closure modality and related logics

abstract: We give a sufficient condition for Kripke completeness of modal logics enriched with the transitive closure modality. More precisely, we show that if a logic admits what we call definable filtration (ADF), then such an expansion of the logic is complete; in addition, has the finite model property, and again ADF. This argument can be iterated, and as an application we obtain the finite model property for PDL-like expansions of logics that ADF.


title: Few-Shot Font Generation with Deep Metric Learning

abstract: Designing fonts for languages with a large number of characters, such as Japanese and Chinese, is an extremely labor-intensive and time-consuming task. In this study, we addressed the problem of automatically generating Japanese typographic fonts from only a few font samples, where the synthesized glyphs are expected to have coherent characteristics, such as skeletons, contours, and serifs. Existing methods often fail to generate fine glyph images when the number of style reference glyphs is extremely limited. Herein, we proposed a simple but powerful framework for extracting better style features. This framework introduces deep metric learning to style encoders. We performed experiments using black-and-white and shape-distinctive font datasets and demonstrated the effectiveness of the proposed framework.


title: Extracting Chemical-Protein Interactions via Calibrated Deep Neural Network and Self-training

abstract: The extraction of interactions between chemicals and proteins from several biomedical articles is important in many fields of biomedical research such as drug development and prediction of drug side effects. Several natural language processing methods, including deep neural network (DNN) models, have been applied to address this problem. However, these methods were trained with hard-labeled data, which tend to become over-confident, leading to degradation of the model reliability. To estimate the data uncertainty and improve the reliability, "calibration" techniques have been applied to deep learning models. In this study, to extract chemical--protein interactions, we propose a DNN-based approach incorporating uncertainty information and calibration techniques. Our model first encodes the input sequence using a pre-trained language-understanding model, following which it is trained using two calibration methods: mixup training and addition of a confidence penalty loss. Finally, the model is re-trained with augmented data that are extracted using the estimated uncertainties. Our approach has achieved state-of-the-art performance with regard to the Biocreative VI ChemProt task, while preserving higher calibration abilities than those of previous approaches. Furthermore, our approach also presents the possibilities of using uncertainty estimation for performance improvement.