title: SN-Graph: a Minimalist 3D Object Representation for Classification

abstract: Using deep learning techniques to process 3D objects has achieved many successes. However, few methods focus on the representation of 3D objects, which could be more effective for specific tasks than traditional representations, such as point clouds, voxels, and multi-view images. In this paper, we propose a Sphere Node Graph (SN-Graph) to represent 3D objects. Specifically, we extract a certain number of internal spheres (as nodes) from the signed distance field (SDF), and then establish connections (as edges) among the sphere nodes to construct a graph, which is seamlessly suitable for 3D analysis using graph neural network (GNN). Experiments conducted on the ModelNet40 dataset show that when there are fewer nodes in the graph or the tested objects are rotated arbitrarily, the classification accuracy of SN-Graph is significantly higher than the state-of-the-art methods.


title: Two Coupled Rejection Metrics Can Tell Adversarial Examples Apart

abstract: Correctly classifying adversarial examples is an essential but challenging requirement for safely deploying machine learning models. As reported in RobustBench, even the state-of-the-art adversarially trained models struggle to exceed 67% robust test accuracy on CIFAR-10, which is far from practical. A complementary way towards robustness is to introduce a rejection option, allowing the model to not return predictions on uncertain inputs, where confidence is a commonly used certainty proxy. Along with this routine, we find that confidence and a rectified confidence (R-Con) can form two coupled rejection metrics, which could provably distinguish wrongly classified inputs from correctly classified ones. This intriguing property sheds light on using coupling strategies to better detect and reject adversarial examples. We evaluate our rectified rejection (RR) module on CIFAR-10, CIFAR-10-C, and CIFAR-100 under several attacks including adaptive ones, and demonstrate that the RR module is compatible with different adversarial training frameworks on improving robustness, with little extra computation. The code is available at https://github.com/P2333/Rectified-Rejection.


title: Thermodynamics of the system of massive Dirac fermions in a uniform magnetic field

abstract: We construct the grand partition function of the system of massive Dirac fermions in a uniform magnetic field from Landau levels, through which all thermodynamic quantities can be obtained. Making use of the Abel-Plana formula, these thermodynamic quantities can be expanded as power series with respect to the dimensionless variable $b=2eB/T^{2}$. The zero-field magnetic susceptibility is expanded at zero mass, and the leading order term is logarithmic. We also calculate scalar, vector current, axial vector current and energy-momentum tensor of the system through ensemble average approach. Mass correction to chiral separation effect is discussed. For massless chiral fermions, our results recover the chiral magnetic effect for right- and left-handed fermions, as well as chiral separation effect.


title: Voice of Your Brain: Cognitive Representations of Imagined Speech,Overt Speech, and Speech Perception Based on EEG

abstract: Every people has their own voice, likewise, brain signals dis-play distinct neural representations for each individual. Al-though recent studies have revealed the robustness of speech-related paradigms for efficient brain-computer interface, the dis-tinction on their cognitive representations with practical usabil-ity still remains to be discovered. Herein, we investigate the dis-tinct brain patterns from electroencephalography (EEG) duringimagined speech, overt speech, and speech perception in termsof subject variations with its practical use of speaker identifica-tion from single channel EEG. We performed classification ofnine subjects using deep neural network that captures temporal-spectral-spatial features from EEG of imagined speech, overtspeech, and speech perception. Furthermore, we demonstratedthe underlying neural features of individual subjects while per-forming imagined speech by comparing the functional connec-tivity and the EEG envelope features. Our results demonstratethe possibility of subject identification from single channel EEGof imagined speech and overt speech. Also, the comparison ofthe three speech-related paradigms will provide valuable infor-mation for the practical use of speech-related brain signals inthe further studies.


title: Hash function based on controlled alternate quantum walks with memory

abstract: We propose a new hash function QHFM based on controlled alternate quantum walks with memory on cycles, where the jth message bit decides whether to run quantum walk with one-step memory or to run quantum walk with two-step memory at the jth time step, and the hash value is calculated from the resulting probability distribution of the walker. Numerical simulation shows that the proposed hash function has near-ideal statistical performance and is at least on a par with the state-of-the-art hash functions based on quantum walks in terms of sensitivity of hash value to message, diffusion and confusion properties, uniform distribution property, and collision resistance property; and theoretical analysis indicates that the time and space complexity of the new scheme are not greater than those of its peers. The good performance of QHFM suggests that quantum walks that differ not only in coin operators but also in memory lengths can be combined to build good hash functions, which, in turn, enriches the construction of controlled alternate quantum walks.


title: The ALPINE-ALMA [CII] survey: Dust mass budget in the early Universe

abstract: The dust content of normal galaxies and the dust mass density (DMD) at high-z (z>4) are unconstrained given the source confusion and the sensitivity limitations of previous observations. The ALMA Large Program to INvestigate [CII] at Early Times (ALPINE), which targeted 118 UV-selected star-forming galaxies at 4.4<z<5.9, provides a new opportunity to tackle this issue for the first time with a statistically robust dataset. We have exploited the rest-frame far-infrared (FIR) fluxes of the 23 continuum individually detected galaxies and stacks of continuum images to measure the dust content of the 118 UV-selected ALPINE galaxies. We have focused on the dust scaling relations and, by comparing them with predictions from chemical evolution models, we have probed the evolutionary stage of UV-selected galaxies at high-z. By using the observed correlation between the UV-luminosity and the dust mass, we have estimated the DMD of UV-selected galaxies at z~5, weighting the galaxies by means of the UV-luminosity function (UVLF). The derived DMD has been compared with the value we have estimated from the 10 ALPINE far-IR continuum blindly detected galaxies at the redshift of the ALPINE targets. The comparison of the observed dust scaling relations with chemical evolution models suggests that ALPINE galaxies are not likely progenitors of disc galaxies, but of intermediate and low mass proto-spheroids, resulting in present-day bulges of spiral or elliptical galaxies. Interestingly, this conclusion is in line with the independent morphological analysis, that shows that the majority (~70\%) of the dust-continuum detected galaxies have a disturbed morphology. The DMD obtained at z~5 from UV-selected sources is ~30% of the value obtained from blind far-IR selected sources, showing that the UV-selection misses the most dust-rich, UV-obscured galaxies.


title: Predicting Driver Intention Using Deep Neural Network

abstract: To improve driving safety and avoid car accidents, Advanced Driver Assistance Systems (ADAS) are given significant attention. Recent studies have focused on predicting driver intention as a key part of these systems. In this study, we proposed new framework in which 4 inputs are employed to anticipate diver maneuver using Brain4Cars dataset and the maneuver prediction is achieved from 5, 4, 3, 2, 1 seconds before the actual action occurs. We evaluated our framework in three scenarios: using only 1) inside view 2) outside view and 3) both inside and outside view. We divided the dataset into training, validation and test sets, also K-fold cross validation is utilized. Compared with state-of-the-art studies, our architecture is faster and achieved higher performance in second and third scenario. Accuracy, precision, recall and f1-score as evaluation metrics were utilized and the result of 82.41%, 82.28%, 82,42% and 82.24% for outside view and 98.90%, 98.96%, 98.90% and 98.88% for both inside and outside view were gained, respectively.


title: The Ferroelectric Point Contact

abstract: We formulate a scattering theory of polarization and heat transport through a ballistic ferroelectric point contact. We predict a polarization current under either an electric field or a temperature difference that depends strongly on the direction of the ferroelectric order and can be detected by its magnetic stray field and associated thermovoltage and Peltier effect.


title: Quantum Groups and Polymer Quantum Mechanics

abstract: In Polymer Quantum Mechanics, a quantization scheme that naturally emerges from Loop Quantum Gravity, position and momentum operators cannot be both well-defined on the Hilbert space ( H_Poly ). It is henceforth deemed impossible to define standard creation and annihilation operators. In this letter we show that a q-oscillator structure, and hence q-deformed creation/annihilation operators, can be naturally defined on H_Poly , which is then mapped into the sum of many copies of the q-oscillator Hilbert space. This shows that the q-calculus is a natural calculus for Polymer Quantum Mechanics. Moreover, we show that the inequivalence of different superselected sectors of H Poly is of topological nature.


title: Groupoids and Hermitian Banach *-algebras

abstract: We study when the twisted groupoid Banach $*$-algebra $L^1(\mathcal{G},\sigma)$ is Hermitian. In particular, we prove that Hermitian groupoids satisfy the weak containment property. Furthermore, we find that for $L^1(\mathcal{G},\sigma)$ to be Hermitian it is sufficient that $L^1 (\mathcal{G}_\sigma)$ is Hermitian. Moreover, if $\mathcal{G}$ is ample, we find necessary conditions for $L^1(\mathcal{G},\sigma)$ to be Hermitian in terms of the fibers $\mathcal{G}^x_x$.


title: Kurtosis-limited Sphere Shaping for Nonlinear Interference Noise Reduction in Optical Channels

abstract: Nonlinear interference (NLI) generated during the propagation of an optical waveform through the fiber depends on the fourth order standardized moment of the channel input distribution, also known as kurtosis. Probabilistically-shaped inputs optimized for the linear Gaussian channel have a Gaussian-like distribution with high kurtosis. For optical channels, this leads to an increase in NLI power and consequently, a decrease in effective signal-to-noise ratio (SNR). In this work, we propose kurtosis-limited enumerative sphere shaping (K-ESS) as an algorithm to generate low-kurtosis shaped inputs. Numerical simulations at a shaping blocklength of 108 amplitudes demonstrate that with K-ESS, it is possible to increase the effective SNRs by 0.4 dB in a single-span single-channel scenario at 400 Gbit/s. K-ESS offers also a twofold decrease in frame error rate with respect to Gaussian-channel-optimal sphere shaping.


title: Hyperbolic 5-manifolds that fiber over $S^1$

abstract: We exhibit some finite-volume cusped hyperbolic 5-manifolds that fiber over the circle. These include the smallest hyperbolic 5-manifold known, discovered by Ratcliffe and Tschantz. As a consequence, we build a finite type subgroup of a hyperbolic group that is not hyperbolic.


title: Improving Tree-Structured Decoder Training for Code Generation via Mutual Learning

abstract: Code generation aims to automatically generate a piece of code given an input natural language utterance. Currently, among dominant models, it is treated as a sequence-to-tree task, where a decoder outputs a sequence of actions corresponding to the pre-order traversal of an Abstract Syntax Tree. However, such a decoder only exploits the preorder traversal based preceding actions, which are insufficient to ensure correct action predictions. In this paper, we first throughly analyze the context modeling difference between neural code generation models with different traversals based decodings (preorder traversal vs breadth-first traversal), and then propose to introduce a mutual learning framework to jointly train these models. Under this framework, we continuously enhance both two models via mutual distillation, which involves synchronous executions of two one-to-one knowledge transfers at each training step. More specifically, we alternately choose one model as the student and the other as its teacher, and require the student to fit the training data and the action prediction distributions of its teacher. By doing so, both models can fully absorb the knowledge from each other and thus could be improved simultaneously. Experimental results and in-depth analysis on several benchmark datasets demonstrate the effectiveness of our approach. We release our code at https://github.com/DeepLearnXMU/CGML.


title: RED : Looking for Redundancies for Data-Free Structured Compression of Deep Neural Networks

abstract: Deep Neural Networks (DNNs) are ubiquitous in today's computer vision land-scape, despite involving considerable computational costs. The mainstream approaches for runtime acceleration consist in pruning connections (unstructured pruning) or, better, filters (structured pruning), both often requiring data to re-train the model. In this paper, we present RED, a data-free structured, unified approach to tackle structured pruning. First, we propose a novel adaptive hashing of the scalar DNN weight distribution densities to increase the number of identical neurons represented by their weight vectors. Second, we prune the network by merging redundant neurons based on their relative similarities, as defined by their distance. Third, we propose a novel uneven depthwise separation technique to further prune convolutional layers. We demonstrate through a large variety of benchmarks that RED largely outperforms other data-free pruning methods, often reaching performance similar to unconstrained, data-driven methods.


title: Hidden, entangled and resonating order

abstract: In condensed matter systems, the atoms, electrons or spins can sometimes arrange themselves in ways that result in unexpected properties but that cannot be detected by conventional experimental probes. Several historical and contemporary examples of such hidden orders are known and more are awaiting discovery, perhaps in the form of more complex composite, entangled or dynamical hidden orders.


title: Resultant-based Elimination in Ore Algebra

abstract: We consider resultant-based methods for elimination of indeterminates of Ore polynomial systems in Ore algebra. We start with defining the concept of resultant for bivariate Ore polynomials then compute it by the Dieudonne determinant of the polynomial coefficients. Additionally, we apply noncommutative versions of evaluation and interpolation techniques to the computation process to improve the efficiency of the method. The implementation of the algorithms will be performed in Maple to evaluate the performance of the approaches.


title: Implications of Dynamical Dark Energy in the expansion of the Universe and the Structure Formation

abstract: In this PhD thesis a wide variety of cosmological models beyond the $\Lambda$CDM are studied in detail. Great emphasis is put on the running vacuum models (RVM's), which can be motivated in the context of Quantum Field Theory in curved spacetime. They consider the possibility of a smoothly evolving vacuum energy density that inherits its time-dependence from cosmological variables, such as the Hubble rate and its time derivative. The analysis presented, however, is not limited only to the dynamical vacuum models but considers also models of dark energy such as the Peebles \& Ratra scalar field model or simple parameterizations like the XCDM or the CPL. Their theoretical predictions are tested against the wealth of cosmological data and a fitting procedure is carried out in order to obtain constraints over the free parameters that characterize the models under study. Finally, an extended discussion about the $\sigma_8$ and $H_0$ tensions is provided and a possible solution for both of them is described within the framework of Brans and Dicke gravity with a cosmological constant, which mimics the RVM with a mild time-evolving gravitational coupling $G$. The main conclusion of this study is that appreciable signals in favour of a time-evolving dark energy density are found in the current data.


title: On the investigation of properties of superfluid $^4$He turbulence using a hot-wire signal

abstract: We report hot-wire measurements performed in two very different, co- and counter-rotating flows, in normal and superfluid helium at 1.6 K, 2 K, and 2.3 K. As recently reported, the power spectrum of the hot-wire signal in superfluid flows exhibits a significant bump at high frequency (Diribarne et al. [1]). We confirm that the bump frequency does not depend significantly on the temperature and further extend the previous analysis of the velocity dependence of the bump, over more than one decade of velocity. The main result is that the bump frequency depends on the turbulence intensity of the flow, and that using the turbulent Reynolds number rather than the velocity as a control parameter collapses results from both co- and counter-rotating flows. The vortex shedding model previously proposed, in its current form, does not account for this observation. This suggests that the physical origin of the bump is related to the small scale turbulence properties of the flow. We finally propose some qualitative physical mechanism by which the smallest structures of the flow, at intervortex distance, could affect the heat flux of the hot-wire.


title: On Compositional Generalization of Neural Machine Translation

abstract: Modern neural machine translation (NMT) models have achieved competitive performance in standard benchmarks such as WMT. However, there still exist significant issues such as robustness, domain generalization, etc. In this paper, we study NMT models from the perspective of compositional generalization by building a benchmark dataset, CoGnition, consisting of 216k clean and consistent sentence pairs. We quantitatively analyze effects of various factors using compound translation error rate, then demonstrate that the NMT model fails badly on compositional generalization, although it performs remarkably well under traditional metrics.


title: Gradient-based Data Subversion Attack Against Binary Classifiers

abstract: Machine learning based data-driven technologies have shown impressive performances in a variety of application domains. Most enterprises use data from multiple sources to provide quality applications. The reliability of the external data sources raises concerns for the security of the machine learning techniques adopted. An attacker can tamper the training or test datasets to subvert the predictions of models generated by these techniques. Data poisoning is one such attack wherein the attacker tries to degrade the performance of a classifier by manipulating the training data. In this work, we focus on label contamination attack in which an attacker poisons the labels of data to compromise the functionality of the system. We develop Gradient-based Data Subversion strategies to achieve model degradation under the assumption that the attacker has limited-knowledge of the victim model. We exploit the gradients of a differentiable convex loss function (residual errors) with respect to the predicted label as a warm-start and formulate different strategies to find a set of data instances to contaminate. Further, we analyze the transferability of attacks and the susceptibility of binary classifiers. Our experiments show that the proposed approach outperforms the baselines and is computationally efficient.


title: Scene-aware Generative Network for Human Motion Synthesis

abstract: We revisit human motion synthesis, a task useful in various real world applications, in this paper. Whereas a number of methods have been developed previously for this task, they are often limited in two aspects: focusing on the poses while leaving the location movement behind, and ignoring the impact of the environment on the human motion. In this paper, we propose a new framework, with the interaction between the scene and the human motion taken into account. Considering the uncertainty of human motion, we formulate this task as a generative task, whose objective is to generate plausible human motion conditioned on both the scene and the human initial position. This framework factorizes the distribution of human motions into a distribution of movement trajectories conditioned on scenes and that of body pose dynamics conditioned on both scenes and trajectories. We further derive a GAN based learning approach, with discriminators to enforce the compatibility between the human motion and the contextual scene as well as the 3D to 2D projection constraints. We assess the effectiveness of the proposed method on two challenging datasets, which cover both synthetic and real world environments.


title: Circulant decomposition of a matrix and the eigenvalues of Toeplitz type matrices

abstract: We begin by showing that any $n \times n$ matrix can be decomposed into a sum of $n$ circulant matrices with periodic relaxations on the unit circle. This decomposition is orthogonal with respect to a Frobenius inner product, allowing recursive iterations for these circulant components. It is also shown that the dominance of a few circulant components in the matrix allows sparse similarity transformations using Fast-Fourier-transform (FFT) operations. This enables the evaluation of all eigenvalues of dense Toeplitz, block-Toeplitz, and other periodic or quasi-periodic matrices, to a reasonable approximation in $\mathcal{O}(n^2)$ arithmetic operations. The utility of the approximate similarity transformation in preconditioning linear solvers is also demonstrated.


title: Aluminium Alloy Design and Discovery using Machine Learning

abstract: The traditional design and development of metallic alloys has taken a hill-climbing approach to date, with incremental advances. Throughout the last century, aluminium (Al) alloy design has been essentially empirical and iterative, based on lessons learned from in service use and human experience. Incremental alloy development is costly, slow, and doesn't fully harness the data that exists in the field of Al-alloy metallurgy. In the present work, an attempt has been made to utilise a data science approach to develop a machine learning (ML) model for Al-alloy design. An objective-optimisation process has also been developed, to exploit the ML model, for user experience and practical application. A successful model was developed and presented herein, along with the open-access software.


abstract: We carry out an in-depth study of Martin compactifications of affine buildings, that is, from the viewpoint of potential theory and random walks. This work does not use any group action on buildings, although in the end all the results can be stated within the framework of the Bruhat-Tits theory of semisimple groups over non-Archimedean local fields. This choice should allow the use of these building compactifications in intriguing geometric group theory situations, where only lattice actions are available. The choice avoiding the use of a group action requires going back to certain more classical compactification procedures. The compactified spaces we obtain use and, at the same time, make it possible to understand geometrically the descriptions of asymptotic behavior of kernels resulting from the non-Archimedean harmonic analysis on affine buildings.


title: N=1,2,3 l-conformal Galilei superalgebras

abstract: The issue of constructing N=1,2,3 supersymmetric extensions of the l-conformal Galilei algebra is reconsidered following the approach in [JHEP 1709 (2017) 131]. Drawing a parallel between acceleration generators entering the superalgebra and irreducible supermultiplets of d=1, N-extended superconformal group, a new N=1 l-conformal Galilei superalgebra, two new N=2 variants, and two new N=3 versions are built. Realisations in terms of differential operators in superspace are given.


title: Transfer Learning for Sequence Generation: from Single-source to Multi-source

abstract: Multi-source sequence generation (MSG) is an important kind of sequence generation tasks that takes multiple sources, including automatic post-editing, multi-source translation, multi-document summarization, etc. As MSG tasks suffer from the data scarcity problem and recent pretrained models have been proven to be effective for low-resource downstream tasks, transferring pretrained sequence-to-sequence models to MSG tasks is essential. Although directly finetuning pretrained models on MSG tasks and concatenating multiple sources into a single long sequence is regarded as a simple method to transfer pretrained models to MSG tasks, we conjecture that the direct finetuning method leads to catastrophic forgetting and solely relying on pretrained self-attention layers to capture cross-source information is not sufficient. Therefore, we propose a two-stage finetuning method to alleviate the pretrain-finetune discrepancy and introduce a novel MSG model with a fine encoder to learn better representations in MSG tasks. Experiments show that our approach achieves new state-of-the-art results on the WMT17 APE task and multi-source translation task using the WMT14 test set. When adapted to document-level translation, our framework outperforms strong baselines significantly.


title: Estimates of the order of approximation of functions of several variables in the generalized Lorentz space

abstract: In this paper we consider $ X(\bar\varphi)$ anisotropic symmetric space $ 2\pi$ of periodic functions of $m$ variables, in particular, the generalized Lorentz space $L_{\bar{\psi},\bar{\tau}}^{*}(\mathbb{T}^{m})$ and Nikol'skii--Besov's class $S_{X(\bar{\varphi}),\bar{\theta}}^{\bar r}B$. The article proves an embedding theorem for the Nikol'skii - Besov class in the generalized Lorentz space and establishes an upper bound for the best approximations by trigonometric polynomials with harmonic numbers from the hyperbolic cross of functions from the class $S_{X(\bar{\varphi}),\bar{\theta}}^{\bar r}B$.


title: A simple numerical method for Hele-Shaw type problems by the method of fundamental solutions

abstract: Hele-Shaw flows with time-dependent gaps create fingering patterns, and magnetic fluids in Hele-Shaw cells create intriguing patterns.We propose a simple numerical method for Hele-Shaw type problems by the method of fundamental solutions.The method of fundamental solutions is one of the mesh-free numerical solvers for potential problems, which provides a highly accurate approximate solution despite its simplicity.Moreover, combining with the asymptotic uniform distribution method, the numerical method satisfies the volume-preserving property.We use Amano's method to arrange the singular points in the method of fundamental solutions.We show several numerical results to exemplify the effectiveness of our numerical scheme.


title: Computation of open-loop inputs for uniformly ensemble controllable systems

abstract: This paper presents computational methods for families of linear systems depending on a parameter. Such a family is called ensemble controllable if for any family of parameter-dependent target states and any neighborhood of it there is a parameter-independent input steering the origin into the neighborhood. Assuming that a family of systems is ensemble controllable we present methods to construct suitable open-loop input functions. Our approach to solve this infinite-dimensional task is based on a combination of methods from the theory of linear integral equations and finite-dimensional control theory.


title: Exploration and Exploitation: Two Ways to Improve Chinese Spelling Correction Models

abstract: A sequence-to-sequence learning with neural networks has empirically proven to be an effective framework for Chinese Spelling Correction (CSC), which takes a sentence with some spelling errors as input and outputs the corrected one. However, CSC models may fail to correct spelling errors covered by the confusion sets, and also will encounter unseen ones. We propose a method, which continually identifies the weak spots of a model to generate more valuable training instances, and apply a task-specific pre-training strategy to enhance the model. The generated adversarial examples are gradually added to the training set. Experimental results show that such an adversarial training method combined with the pretraining strategy can improve both the generalization and robustness of multiple CSC models across three different datasets, achieving stateof-the-art performance for CSC task.


title: A Note on Terai's Conjecture Concerning the Exponential Diophantine Equation x^{2}+b^{y}=c^{z}

abstract: Let (a,b,c) be a primitive Pythagorean triple, i.e., a^{2}+b^{2}=c^{2} with gcd(a,b,c)=1, a even and b odd. Terai's conjecture says that the Diophantine equation x^{2}+b^{y}=c^{z} has only the positive integer solutions (x,y,z)=(a,2,2). In this study, we prove that Terai's conjecture is true when b is a product of two primes and c=5(mod8).


title: Supporting Cognitive and Emotional Empathic Writing of Students

abstract: We present an annotation approach to capturing emotional and cognitive empathy in student-written peer reviews on business models in German. We propose an annotation scheme that allows us to model emotional and cognitive empathy scores based on three types of review components. Also, we conducted an annotation study with three annotators based on 92 student essays to evaluate our annotation scheme. The obtained inter-rater agreement of {\alpha}=0.79 for the components and the multi-{\pi}=0.41 for the empathy scores indicate that the proposed annotation scheme successfully guides annotators to a substantial to moderate agreement. Moreover, we trained predictive models to detect the annotated empathy structures and embedded them in an adaptive writing support system for students to receive individual empathy feedback independent of an instructor, time, and location. We evaluated our tool in a peer learning exercise with 58 students and found promising results for perceived empathy skill learning, perceived feedback accuracy, and intention to use. Finally, we present our freely available corpus of 500 empathy-annotated, student-written peer reviews on business models and our annotation guidelines to encourage future research on the design and development of empathy support systems.


title: Ultrasonic Array Characterization in Multiscattering and Attenuating Media Using Pin Targets

abstract: This paper presents an approach to characterize ultrasonic imaging arrays using pin targets in commercial test phantoms. We used a 128-element phased array transducer operating at 7.5 MHz with a fractional bandwidth of %70. We also used a tissue-mimicking phantom in the measurements. This phantom consists of pin targets with a 50-micrometer diameter. We excited the transducer with pulsed and coded signals. We used Complementary Golay Sequences to code the transmitted signal and Binary Phase Shift Keying for modulation. We characterized the transducer array using the transfer function, line spread function, range resolution, and beam width in an attenuating and scattering medium. We showed that the pin targets, which are very thin compared to the diffraction-limited focus of the transducer array, are suitable for the transducer characterization under weak reflected signal conditions.


title: SQUADfps: Integrated Model-Based Machine Safety and Product Quality for Flexible Production Systems

abstract: Growing individualization of products up to lot-size-1 and high volatility of product mixes lead to new challenges in the manufacturing domain, including the need for frequent reconfiguration of the system and reacting to changing orders. Thus, apart from functional aspects, safety aspects of the production system as well as product quality assurance aspects must be addressed for flexible and reconfigurable manufacturing systems at runtime. To cope with the mentioned challenges, we present an integrated model-based approach SQUADfps (machine Safety and product QUAlity for flexible proDuction systems) to support the automatic conduct of the risk assessment of flexible production scenarios in terms of safety as well as the process-FMEA to ensure that the requirements w.r.t. the quality of the production process and the resulting product are met. Our approach is based on a meta-model which captures all information needed to conduct both risk assessment and process-FMEA dynamically during the runtime, and thus enables flexible manufacturing scenarios with frequent changes of the production system and orders up to a lot-size of one while guaranteeing safety and product quality requirements. The automatically generated results will assist human in making further decisions. To demonstrate the feasibility of our approach, we apply it to a case study.


title: Redacting Transactions from Execute-Order-Validate Blockchains

abstract: As user privacy gains popularity and attention, and starts to shape relations between users and service providers, blockchain based solutions thrive for ways to relax immutability without sacrificing consistency. This work answers that need and presents the first design for a redactable execute-order-validate blockchain, that grants users with the \emph{right to be forgotten}. The design is easy to adopt, as we exemplify by implementing it on top of Hyperledger Fabric. It modifies the block structure and extracts user data from the hash-chain without loosening any correctness or liveness criteria. We evaluate our design and show that it provides compliance with only a minimal performance overhead, making it a feasible add-on to any execute-order-validate blockchain system.


title: Difficulties in reconciling non-negligible differences between the local and cosmological values of the gravitational coupling in extended Brans-Dicke theories

abstract: Recent studies by Sol\`a Peracaula, G\'omez-Valent, de Cruz P\'erez and Moreno-Pulido (2019,2020) have pointed out the intriguing possibility that Brans-Dicke cosmology with constant vacuum energy density (BD-$\Lambda$CDM) may be able to alleviate the $H_0$ and $\sigma_8$ tensions that are found in the framework of the concordance cosmological model (GR-$\Lambda$CDM). The fitting analyses presented in these works indicate a preference for values of the effective gravitational coupling appearing in the Friedmann equation, $G$, about $4-9\%$ larger than Newton's constant (as measured on Earth), and mildy evolving with the expansion of the universe. The signal reaches the $\sim 3.5\sigma$ c.l. when the prior on $H_0$ from SH0ES and the angular diameter distances to strong gravitationally lensed quasars measured by H0LICOW are considered, and the $\sim 3\sigma$ c.l. when only the former is included. Thus, the improvement in the description of the cosmological datasets relies on the existence of a mechanism capable of screening the modified gravity effects at those scales where deviations from standard General Relativity (GR) are highly constrained, as in the Solar System. In this paper we explore several extensions of BD-$\Lambda$CDM that can leave the cosmological evolution basically unaltered at the background and linear perturbations level, while being able to screen the Brans-Dicke effects inside the regions of interest, leading to standard GR. We search for weak-field solutions around spherical static massive objects with no internal pressure and show that, unfortunately, these mechanisms can only explain very tiny departures of the effective cosmological gravitational coupling from the one measured locally. This might hinder the ability of BD-$\Lambda$CDM to alleviate the cosmological tensions.


title: An exact counterfactual-example-based approach to tree-ensemble models interpretability

abstract: Explaining the decisions of machine learning models is becoming a necessity in many areas where trust in ML models decision is key to their accreditation/adoption. The ability to explain models decisions also allows to provide diagnosis in addition to the model decision, which is highly valuable in scenarios such as fault detection. Unfortunately, high-performance models do not exhibit the necessary transparency to make their decisions fully understandable. And the black-boxes approaches, which are used to explain such model decisions, suffer from a lack of accuracy in tracing back the exact cause of a model decision regarding a given input. Indeed, they do not have the ability to explicitly describe the decision regions of the model around that input, which is necessary to determine what influences the model towards one decision or the other. We thus asked ourselves the question: is there a category of high-performance models among the ones currently used for which we could explicitly and exactly characterise the decision regions in the input feature space using a geometrical characterisation? Surprisingly we came out with a positive answer for any model that enters the category of tree ensemble models, which encompasses a wide range of high-performance models such as XGBoost, LightGBM, random forests ... We could derive an exact geometrical characterisation of their decision regions under the form of a collection of multidimensional intervals. This characterisation makes it straightforward to compute the optimal counterfactual (CF) example associated with a query point. We demonstrate several possibilities of the approach, such as computing the CF example based only on a subset of features. This allows to obtain more plausible explanations by adding prior knowledge about which variables the user can control. An adaptation to CF reasoning on regression problems is also envisaged.


title: Lagrangian Cobordisms in Liouville manifolds

abstract: Floer theory for Lagrangian cobordisms was developed by Biran and Cornea to study the triangulated structure of the derived Fukaya category of monotone symplectic manifolds. This paper explains how to use the language of stops to study Lagrangian cobordisms in Liouville manifolds and the associated exact triangles in the derived wrapped Fukaya category. Furthermore, we compute the cobordism groups of non-compact Riemann surfaces of finite type.


title: Effective Batching for Recurrent Neural Network Grammars

abstract: As a language model that integrates traditional symbolic operations and flexible neural representations, recurrent neural network grammars (RNNGs) have attracted great attention from both scientific and engineering perspectives. However, RNNGs are known to be harder to scale due to the difficulty of batched training. In this paper, we propose effective batching for RNNGs, where every operation is computed in parallel with tensors across multiple sentences. Our PyTorch implementation effectively employs a GPU and achieves x6 speedup compared to the existing C++ DyNet implementation with model-independent auto-batching. Moreover, our batched RNNG also accelerates inference and achieves x20-150 speedup for beam search depending on beam sizes. Finally, we evaluate syntactic generalization performance of the scaled RNNG against the LSTM baseline, based on the large training data of 100M tokens from English Wikipedia and the broad-coverage targeted syntactic evaluation benchmark. Our RNNG implementation is available at https://github.com/aistairc/rnng-pytorch/.


title: Generalized KG-oscillator with a uniform magnetic field under the influence of Coulomb-type potentials in cosmic string space-time and Aharonov-Bohm effect

abstract: We solve a generalized Klein-Gordon oscillator (KGO) in the presence of a uniform magnetic field including quantum flux under the effects of a scalar and vector potentials of Coulomb-types in the static cosmic string space-time. We obtain the energy eigenvalues and corresponding eigenfunctions, and analyze a relativistic analogue of the Aharonov-Bohm effect for bound states


title: Bounded logit attention: Learning to explain image classifiers

abstract: Explainable artificial intelligence is the attempt to elucidate the workings of systems too complex to be directly accessible to human cognition through suitable side-information referred to as "explanations". We present a trainable explanation module for convolutional image classifiers we call bounded logit attention (BLA). The BLA module learns to select a subset of the convolutional feature map for each input instance, which then serves as an explanation for the classifier's prediction. BLA overcomes several limitations of the instancewise feature selection method "learning to explain" (L2X) introduced by Chen et al. (2018): 1) BLA scales to real-world sized image classification problems, and 2) BLA offers a canonical way to learn explanations of variable size. Due to its modularity BLA lends itself to transfer learning setups and can also be employed as a post-hoc add-on to trained classifiers. Beyond explainability, BLA may serve as a general purpose method for differentiable approximation of subset selection. In a user study we find that BLA explanations are preferred over explanations generated by the popular (Grad-)CAM method.


title: Charging of colloidal nanoplatelets: effect of Coulomb repulsion on spin and optoelectronic properties

abstract: Colloidal semiconductor nanoplatelets combine weak lateral confinement with strong Coulomb interactions, enhanced by dielectric confinement. When the platelets are charged with carriers of the same sign, this results in severe Coulomb repulsions which shape the electronic structure. To illustrate this point, the shell filling of type-I (CdSe/CdS) and type-II (CdSe/CdTe) core/crown nanoplatelets with up to 4 electrons or holes is investigated theoretically. We find that Coulomb repulsions enable addition energies exceeding room temperature thermal energy and promote the occupation of high-spin states. For charged excitons and biexcitons in CdSe/CdTe nanoplatelets, the repulsions further give rise to multi-peaked emission spectra with widely tunable (over 100 meV) energy, and a transition from type-II to quasi-type-II band profile as the number of electrons confined in the core increases. We conclude that the number of excess carriers injected in nanoplatelets is a versatile degree of freedom to modulate their magnetic and optoelectronic properties.


title: PF-Net: Personalized Filter for Speaker Recognition from Raw Waveform

abstract: Speaker recognition using i-vector has been replaced by speaker recognition using deep learning. Speaker recognition based on Convolutional Neural Networks (CNNs) has been widely used in recent years, which learn low-level speech representations from raw waveforms. On this basis, a CNN architecture called SincNet proposes a kind of unique convolutional layer, which has achieved band-pass filters. Compared with standard CNNs, SincNet learns the low and high cut-off frequencies of each filter. This paper proposes an improved CNNs architecture called PF-Net, which encourages the first convolutional layer to implement more personalized filters than SincNet. PF-Net parameterizes the frequency domain shape and can realize band-pass filters by learning some deformation points in frequency domain. Compared with standard CNN, PF-Net can learn the characteristics of each filter. Compared with SincNet, PF-Net can learn more characteristic parameters, instead of only low and high cut-off frequencies. This provides a personalized filter bank for different tasks. As a result, our experiments show that the PF-Net converges faster than standard CNN and performs better than SincNet. Our code is available at github.com/TAN-OpenLab/PF-NET.


title: Numerical study on the performance of a glazed photovoltaic thermal system integrated with phase change material (GPVT/PCM): on the contribution of PCM volumetric fraction and environmental temperature

abstract: In the present article, performance of a glazed photovoltaic thermal system integrated with phase change materials (GPVT/PCM) is numerically examined based on both energy and exergy viewpoints. The effect of PCM volumetric fraction and environmental temperature on thermal and electrical characteristics of the system is evaluated. A three-dimensional model of the system is simulated transiently in the ANSYS Fluent 18.2 using pressure-based finite volume method and SIMPLE algorithm selected for coupling pressure and velocity components. Validity of the numerical results is confirmed based on available data. The results indicate that PCM melting is more likely far from the riser tube and absorption of thermal energy be the PCM is mostly effective for filling the PCM container by around 2/3 of the volume. Increase of the PCM volumetric fraction reduces the module temperature and enhances the electrical performance of the system in terms of both energy and exergy efficiencies, while it decreases the thermal efficiency. An opposite trend is experienced by increase of the environmental temperature in which the thermal efficiency enhances and the electrical efficiency declines.


title: From Schouten to Mackenzie: notes on brackets

abstract: In this paper, dedicated to the memory of Kirill Mackenzie, I relate the origins and early development of the theory of graded Lie brackets, first in the publications on differential geometry of Schouten, Nijenhuis, and Fr\"olicher--Nijenhuis, then in the work of Gerstenhaber and Nijenhuis--Richardson in cohomology theory.


title: Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulation

abstract: Despite the success of reinforcement learning methods, they have yet to have their breakthrough moment when applied to a broad range of robotic manipulation tasks. This is partly due to the fact that reinforcement learning algorithms are notoriously difficult and time consuming to train, which is exacerbated when training from images rather than full-state inputs. As humans perform manipulation tasks, our eyes closely monitor every step of the process with our gaze focusing sequentially on the objects being manipulated. With this in mind, we present our Attention-driven Robotic Manipulation (ARM) algorithm, which is a general manipulation algorithm that can be applied to a range of sparse-rewarded tasks, given only a small number of demonstrations. ARM splits the complex task of manipulation into a 3 stage pipeline: (1) a Q-attention agent extracts relevant pixel locations from RGB and point cloud inputs, (2) a next-best pose agent that accepts crops from the Q-attention agent and outputs poses, and (3) a control agent that takes the goal pose and outputs joint actions. We show that current learning algorithms fail on a range of RLBench tasks, whilst ARM is successful.


title: Advantages of NOMA for Multi-User BackCom Networks

abstract: Ambient backscatter communication (BackCom) is faced with the challenge that a single BackCom device can occupy multiple orthogonal resource blocks unintentionally. As a result, in order to avoid co-channel interference, a conventional approach is to serve multiple BackCom devices in different time slots, which reduces both spectral efficiency and connectivity. This letter demonstrates that the use of non-orthogonal multiple access (NOMA) can efficiently improve the system throughput and support massive connectivity in ambient BackCom networks. In particular, two transceiver design approaches are developed in the letter to realize different tradeoffs between system performance and complexity.


title: Insights into the performance of loosely-coupled FSI schemes based on Robin boundary conditions

abstract: Robin boundary conditions are a natural consequence of employing Nitsche's method for imposing the kinematic velocity constraint at the fluid-solid interface. Loosely-coupled FSI schemes based on Dirichlet-Robin or Robin-Robin coupling have been demonstrated to improve the stability of such schemes with respect to added-mass. This paper aims to offer some numerical insights into the performance characteristics of such loosely-coupled FSI schemes based on Robin boundary conditions. Using numerical examples, we demonstrate that the improved stability due to the added damping term is actually at the expense of important dynamic characteristics of the structural sub-problem.


title: Imaging moving atoms by holographically reconstructing the dragged slow light

abstract: The propagation of light in moving media is dragged by atomic motion. The light-drag effect can be dramatically enhanced by reducing the group velocity with electro-magnetically induced transparency (EIT). We develop a systematic procedure to accurately reconstruct the complex wavefront of the slow light with single-shot measurements, enabling precise, photon shot-noise limited spectroscopic measurements of atomic response across EIT even in presence of generic atomic number fluctuations. Applying the technique to an expanding cloud of cold atoms, we demonstrate simultaneous inference of the atomic density distribution and the velocity field from the complex imaging data. This inline imaging technique may assist a wide range of cold atom experiments to access spectroscopic and phase space information with in situ and minimally destructive measurements.


title: Ultrafast Proton Transport between a Hydroxy Acid and a Nitrogen Base along Solvent Bridges Governed by Hydroxide/Methoxide Transfer Mechanism

abstract: Aqueous proton transport plays a key role in acid-base neutralization, and energy transport through biological membranes and hydrogen fuel cells. Extensive experimental and theoretical studies have resulted in a highly detailed elucidation of one of the underlying microscopic mechanisms for aqueous excess proton transport, known as the von Grotthuss mechanism, involving different hydrated proton configurations with associated high fluxional structural dynamics. Hydroxide transport, with approximately two-fold lower bulk diffusion rates than those of excess protons, has received much less attention. We present femtosecond UV/IR pump-probe experiments and ab initio molecular dynamics simulations of different proton transport pathways of the bifunctional photoacid 7-hydroxyquinoline (7HQ) in water-methanol mixtures. For 7HQ solvent-dependent photoacidity, free energy-reactivity correlation behaviour and QM/MM trajectories point to a dominant OH-/CH3O- transport pathway, for all water-methanol mixing ratios investigated. This provides conclusive evidence for the hydrolysis/methanolysis acid-base neutralization pathway formulated by Manfred Eigen half a century ago.


title: Wilsonian Effective Action and Entanglement Entropy

abstract: This is a continuation of our previous works on entanglement entropy (EE) in interacting field theories. In arXiv:2103.05303, we have proposed the notion of $\mathbb{Z}_M$ gauge theory on Feynman diagrams to calculate EE in quantum field theories and shown that EE consists of two particular contributions from propagators and vertices. As shown in the next paper arXiv:2105.02598, the purely non-Gaussian contributions from interaction vertices can be interpreted as renormalized correlation functions of composite operators. In this paper, we will first provide a unified matrix form of EE containing both contributions from propagators and (classical) vertices, and then extract further non-Gaussian contributions based on the framework of the Wilsonian renormalization group. It is conjectured that the EE in the infrared is given by a sum of all the vertex contributions in the Wilsonian effective action.


title: Towards Lower Bounds on the Depth of ReLU Neural Networks

abstract: We contribute to a better understanding of the class of functions that can be represented by a neural network with ReLU activations and a given architecture. Using techniques from mixed-integer optimization, polyhedral theory, and tropical geometry, we provide a mathematical counterbalance to the universal approximation theorems which suggest that a single hidden layer is sufficient for learning any function. In particular, we investigate whether the class of exactly representable functions strictly increases by adding more layers (with no restrictions on size). As a by-product of our investigations, we settle an old conjecture about piecewise linear functions by Wang and Sun (2005) in the affirmative. We also present upper bounds on the sizes of neural networks required to represent functions with logarithmic depth.


title: The eclipsing binary systems with $\delta$ Scuti component. I. KIC 10661783

abstract: We present a comprehensive study of the eclipsing binary system KIC 10661783. The analysis of the whole Kepler light curve, corrected for the binary effects, reveals a rich oscillation spectrum with 590 significant frequency peaks, 207 of which are independent. In addition to typical $\delta$ Sct frequencies, we find small-amplitude signals in the low-frequency range that, most probably, are a manifestation of gravity-mode pulsations. We perform binary-evolution computations for this system in order to find an acceptable model describing its current stage. Our models show that the binary KIC 10661783 was formed by a rapid, almost conservative, mass transfer that heavily affected the evolution of both components in the past. One of the most important effects of binary evolution is the enormous enrichment of the outer layers of the main component with helium. This fact profoundly influences the pulsational properties of $\delta$ Scuti star models. For the first time, we demonstrate the effect of binary evolution on pulsational instability. We construct pulsational models of the main component in order to account for the mode instability of the observed frequencies. Whereas the single-star evolution model is pulsational stable in the whole frequency range, its binary-evolution counterpart has unstable modes, both, in high and low-frequency range. However, to obtain instability in almost a whole range of the observed frequencies, the modification of the mean opacity at the depth corresponding to temperatures log T = 4.69 K and log T = 5.06 K was necessary.


title: Hedgehogs in Lehmer's problem

abstract: Motivated by a famous question of Lehmer about the Mahler measure we study and solve its analytic analogue.


title: Does the Venue of Scientific Conferences Leverage their Impact? A Large Scale study on Computer Science Conferences

abstract: Background: Conferences bring scientists together and provide one of the most timely means for disseminating new ideas and cutting-edge works.The importance of conferences in scientific areas is testified by quantitative indicators. In Computer Science, for instance, almost two out of three papers published on Scopus are conference papers. Objective/Purpose: The main goal of this paper is to investigate a novel research question: is there any correlation between the impact of a scientific conference and the venue where it took place? Approach: In order to measure the impact of conferences we conducted a large scale analysis on the bibliographic data extracted from 3,838 Computer Science conference series and over 2.5 million papers spanning more than 30 years of research. To quantify the "touristicity" of a venue we exploited some indicators such as the size of the Wikipedia page for the city hosting the venue and other indexes from reports of the World Economic Forum. Results/Findings: We found out that the two aspects are related, and the correlation with conference impact is stronger when considering country-wide touristic indicators, such as the Travel&Tourism Competitiveness Index. More-over the almost linear correlation with the Tourist Service Infrastructure index attests the specific importance of tourist/accommodation facilities in a given country. Conclusions: This is the first attempt to focus on the relationship of venue characteristics to conference papers. The results open up new possibilities, such as allowing conference organizers and authors to estimate in advance the impact of conferences, thus supporting them in their decisions.


title: Greedy-layer Pruning: Speeding up Transformer Models for Natural Language Processing

abstract: Fine-tuning transformer models after unsupervised pre-training reaches a very high performance on many different natural language processing tasks. Unfortunately, transformers suffer from long inference times which greatly increases costs in production. One possible solution is to use knowledge distillation, which solves this problem by transferring information from large teacher models to smaller student models. Knowledge distillation maintains high performance and reaches high compression rates, nevertheless, the size of the student model is fixed after pre-training and can not be changed individually for a given downstream task and use-case to reach a desired performance/speedup ratio. Another solution to reduce the size of models in a much more fine-grained and computationally cheaper fashion is to prune layers after the pre-training. The price to pay is that the performance of layer-wise pruning algorithms is not on par with state-of-the-art knowledge distillation methods. In this paper, Greedy-layer pruning is introduced to (1) outperform current state-of-the-art for layer-wise pruning, (2) close the performance gap when compared to knowledge distillation, while (3) providing a method to adapt the model size dynamically to reach a desired performance/speedup tradeoff without the need of additional pre-training phases. Our source code is available on https://github.com/deepopinion/greedy-layer-pruning.


title: Elegant elaboration with function invocation

abstract: We present an elegant design of the core language in a dependently-typed lambda calculus with $\delta$-reduction and an elaboration algorithm.


title: Dwork crystals III: from excellent Frobenius lifts towards supercongruences

abstract: This paper is a continuation of our Dwork crystals series. Here we exploit the Cartier operation to prove supercongruences for expansion coefficients of rational functions. In the process it appears that excellent Frobenius lifts are a driving force behind supercongruences. Originally introduced by Dwork, these excellent lifts have occurred rather infrequently in the literature, and only in the context of families of elliptic curves and abelian varieties. In the final sections of this paper we present a list of examples that occur in the case of families of Calabi-Yau varieties.


title: Relation between scattering matrix topological invariants and conductance in Floquet Majorana systems

abstract: We analyze the conductance of a one-dimensional topological superconductor periodically driven to host Floquet Majorana zero-modes for different configurations of coupling to external leads. We compare the conductance of constantly coupled leads, as in standard transport experiments, with the stroboscopic conductance of pulsed coupling to leads used to identify a scattering matrix topological index for periodically driven systems. We find that the sum of DC conductance at voltages multiples of the driving frequency is quantitatively close to the stroboscopic conductance at all voltage biases. This is consistent with previous work which indicated that the summed conductance at zero/pi resonance is quantized. We quantify the difference between the two in terms of the width of their respective resonances and analyze that difference for two different stroboscopic driving protocols of the Kitaev chain. While the quantitative differences are protocol-dependent, we find that generically the discrepancy is larger when the zero mode weight at the end of the chain depends strongly on the offset time between the driving cycle and the pulsed coupling period.


title: Chern currents of coherent sheaves

abstract: Given a finite locally free resolution of a coherent analytic sheaf $\mathcal F$, equipped with Hermitian metrics and connections, we construct an explicit current, obtained as the limit of certain smooth Chern forms of $\mathcal F$, that represents the Chern class of $\mathcal F$ and has support on the support of $\mathcal F$. If the connections are $(1,0)$-connections and $\mathcal F$ has pure dimension, then the first nontrivial component of this Chern current coincides with (a constant times) the fundamental cycle of $\mathcal F$. The proof of this goes through a generalized Poincar\'e-Lelong formula, previously obtained by the authors, and a result that relates the Chern current to the residue current associated with the locally free resolution.


title: Demographic Fairness in Biometric Systems: What do the Experts say?

abstract: Algorithmic decision systems have frequently been labelled as "biased", "racist", "sexist", or "unfair" by numerous media outlets, organisations, and researchers. There is an ongoing debate whether such assessments are justified and whether citizens and policymakers should be concerned. These and other related matters have recently become a hot topic in the context of biometric technologies, which are ubiquitous in personal, commercial, and governmental applications. Biometrics represent an essential component of many surveillance, access control, and operational identity management systems, thus directly or indirectly affecting billions of people all around the world. In order to provide a forum for experts in the field, the European Association for Biometrics organised an event series with "demographic fairness in biometric systems" as an overarching theme. The events featured presentations by international experts from academic, industry, and governmental organisations and facilitated interactions and discussions between the experts and the audience. Further consultation of experts was undertaken by means of a questionnaire. This work summarises opinions of experts and findings of said events on the topic of demographic fairness in biometric systems including several important aspects such as the developments of evaluation metrics and standards as well as related issues, e.g. the need for transparency and explainability in biometric systems or legal and ethical issues.


title: With Great Freedom Comes Great Opportunity: Rethinking Resource Allocation for Serverless Functions

abstract: Current serverless offerings give users a limited degree of flexibility for configuring the resources allocated to their function invocations by either coupling memory and CPU resources together or providing no knobs at all. These configuration choices simplify resource allocation decisions on behalf of users, but at the same time, create deployments that are resource inefficient. In this paper, we take a principled approach to the problem of resource allocation for serverless functions, allowing this choice to be made in an automatic way that leads to the best combination of performance and cost. In particular, we systematically explore the opportunities that come with decoupling memory and CPU resource allocations and also enabling the use of different VM types. We find a rich trade-off space between performance and cost. The provider can use this in a number of ways: from exposing all these parameters to the user, to eliciting preferences for performance and cost from users, or by simply offering the same performance with lower cost. This flexibility can also enable the provider to optimize its resource utilization and enable a cost-effective service with predictable performance. Our results show that, by decoupling memory and CPU allocation, there is potential to have up to 40% lower execution cost than the preset coupled configurations that are the norm in current serverless offerings. Similarly, making the correct choice of VM instance type can provide up to 50% better execution time. Furthermore, we demonstrate that providers can utilize different instance types for the same functions to maximize resource utilization while providing performance within 10-20% of the best resource configuration for each respective function.


title: A Stably Irrational (2,3)-Complete Intersection Fourfold over $\mathbb{Q}$

abstract: We apply the specialization technique based on the decomposition of the diagonal to find an explicit example over $\mathbb{Q}$ of a quadric and cubic hypersurface in $\mathbb{P}^6$ such that their intersection is a smooth stably irrational fourfold. Using the same degeneration, Nicaise and Ottem have already proven that the the very general complete intersection of this type is stably irrational using the motivic volume.


title: $L^{p}$ Positivity Preserving and a conjecture by M. Braverman, O. Milatovic and M. Shubin

abstract: In this paper we prove that a complete Riemannian manifold is $L^p$-positivity preserving for any $p\in(1,\infty)$. This means that any $L^p$ function which solves $(-\Delta + 1)u\ge 0$ in the sense of distributions is necessarily non-negative. In particular, the case $p=2$ of our result answers in the affermative a conjecture formulated by M. Braverman, O. Milatovic and M. Shubin in 2002. The two main ingredients are a new a-priori regularity result for positive subharmonic distributions, which in turn permits to prove a Liouville type theorem, and a Brezis-Kato inequality on Riemannian manifolds. Both these results rely on a smooth monotonic approximation of distributional solutions of $\Delta u \ge \lambda(x) u$ of independent interest.


title: Refined Deep Neural Network and U-Net for Polyps Segmentation

abstract: The Medico: Multimedia Task 2020 focuses on developing an efficient and accurate computer-aided diagnosis system for automatic segmentation [3]. We participate in task 1, Polyps segmentation task, which is to develop algorithms for segmenting polyps on a comprehensive dataset. In this task, we propose methods combining Residual module, Inception module, Adaptive Convolutional neural network with U-Net model, and PraNet for semantic segmentation of various types of polyps in endoscopic images. We select 5 runs with different architecture and parameters in our methods. Our methods show potential results in accuracy and efficiency through multiple experiments, and our team is in the Top 3 best results with a Jaccard index of 0.765.


title: Why does CTC result in peaky behavior?

abstract: The peaky behavior of CTC models is well known experimentally. However, an understanding about why peaky behavior occurs is missing, and whether this is a good property. We provide a formal analysis of the peaky behavior and gradient descent convergence properties of the CTC loss and related training criteria. Our analysis provides a deep understanding why peaky behavior occurs and when it is suboptimal. On a simple example which should be trivial to learn for any model, we prove that a feed-forward neural network trained with CTC from uniform initialization converges towards peaky behavior with a 100% error rate. Our analysis further explains why CTC only works well together with the blank label. We further demonstrate that peaky behavior does not occur on other related losses including a label prior model, and that this improves convergence.

categories: cs.LG cs.AI cs.CL cs.NE cs.SD eess.AS math.ST stat.TH


title: Cascaded Head-colliding Attention

abstract: Transformers have advanced the field of natural language processing (NLP) on a variety of important tasks. At the cornerstone of the Transformer architecture is the multi-head attention (MHA) mechanism which models pairwise interactions between the elements of the sequence. Despite its massive success, the current framework ignores interactions among different heads, leading to the problem that many of the heads are redundant in practice, which greatly wastes the capacity of the model. To improve parameter efficiency, we re-formulate the MHA as a latent variable model from a probabilistic perspective. We present cascaded head-colliding attention (CODA) which explicitly models the interactions between attention heads through a hierarchical variational distribution. We conduct extensive experiments and demonstrate that CODA outperforms the transformer baseline, by $0.6$ perplexity on \texttt{Wikitext-103} in language modeling, and by $0.6$ BLEU on \texttt{WMT14 EN-DE} in machine translation, due to its improvements on the parameter efficiency.\footnote{Our implementation is publicly available at \url{https://github.com/LZhengisme/CODA}.}


title: Transiting Exoplanet Monitoring Project (TEMP). VI. The Homogeneous Refinement of System Parameters for 39 Transiting Hot Jupiters with 127 New Light Curves

abstract: We present 127 new transit light curves for 39 hot Jupiter systems, obtained over the span of five years by two ground-based telescopes. A homogeneous analysis of these newly collected light curves together with archived spectroscopic, photometric, and Doppler velocimetric data using EXOFASTv2 leads to a significant improvement in the physical and orbital parameters of each system. All of our stellar radii are constrained to accuracies of better than 3\%. The planetary radii for 37 of our 39 targets are determined to accuracies of better than $5\%$. Compared to our results, the literature eccentricities are preferentially overestimated due to the Lucy-Sweeney bias. Our new photometric observations therefore allow for significant improvement in the orbital ephemerides of each system. Our correction of the future transit window amounts to a change exceeding $10\,{\rm min}$ for ten targets at the time of JWST's launch, including a $72\,{\rm min}$ change for WASP-56. The measured transit mid-times for both literature light curves and our new photometry show no significant deviations from the updated linear ephemerides, ruling out in each system the presence of companion planets with masses greater than $0.39 - 5.0\, rm M_{\oplus}$, $1.23 - 14.36\, \rm M_{\oplus}$, $1.65 - 21.18\, \rm M_{\oplus}$, and $0.69 - 6.75\, \rm M_{\oplus}$ near the 1:2, 2:3, 3:2, and 2:1 resonances with the hot Jupiters , respectively, at a confidence level of $\pm 1\,\sigma$. The absence of resonant companion planets in the hot Jupiter systems is inconsistent with the conventional expectation from disk migration.


title: $A_\infty$ condition for general bases revisited: complete classification of definitions

abstract: We refer to the discussion on different characterizations of the $A_\infty$ class of weights, initiated by Duoandikoetxea, Mart\'in-Reyes, and Ombrosi. Twelve definitions of the $A_\infty$ condition are considered. For cubes in $\mathbb{R}^d$ every two conditions are known to be equivalent, while for general bases we have a trichotomy: equivalence, one-way implication, or no dependency may occur. In most cases the relations between different conditions have already been established. Here all the unsolved cases are treated and, as a result, a full diagram of the said relations is presented.


title: Coherent superposition of orthogonal modes

abstract: The coherent superposition of orthogonal modes can result in transverse offsets, variations of the Rayleigh length and a reduction of the beam quality factor of the coherent sum of modes in comparison to the incoherent sum. Relations for first and second order moments, the beam quality and the Rayleigh length for the superposition of Hermite-Gauss modes are derived. The Courant-Snyder formalism, which was originally developed in the context of charged particle optics, is applied to propagate an arbitrary coherent sum of orthogonal modes through a lens system. Relations of generating and observable optical functions are highlighted. In the last part of the report the elegant Hermite-Gauss solution is interpreted in terms of generating and observable functions and the solution is decomposed into a sum of standard Hermite-Gauss modes.


title: $Z$-boson production via the weak process $e^+e^- \to \mu^+\mu^-$ in the presence of a circularly polarized laser field

abstract: In the centre of mass frame, we have studied theoretically the $Z$-boson resonant production in the presence of an intense laser field via the weak process $e^+e^- \to \mu^+\mu^-$. Dressing the incident particles by a Circularly Polarized laser field (CP-laser field), at the first step, shows that for a given laser field's parameters, the $Z$- boson cross section decreases by several orders of magnitude. We have compared the the Total Cross Section (TCS) obtained by using the scattering matrix method with that given by the Breit-Wigner approach in the presence of a CP-laser field and the results are found to be very consistent. This result indicates that Breit-Wigner formula is valid not only for the laser-free process but also in the presence of a CP-laser field. The dependence of the laser-assisted differential cross section on the Centre of Mass Energy (CME) for different scattering angles proves that it reaches its maximum for small and high scattering angles. At the next step and by dressing both incident and scattered particles, we have shown that the CP-laser field largely affects the TCS, especially when its strength reaches $10^{9}\,V.cm^{-1}$. This result confirms that obtained for the elastic electron-proton scattering in the presence of a CP-laser field [I. Dahiri et al., arXiv:2102.00722v1]. It is interpreted by the fact that heavy interacting particles require high laser field's intensity to affect the collision's cross section.


title: Effect of pressure on thermalization of one-dimensional nonlinear chains

abstract: Pressure plays a vital role in changing the transport properties of matter. To understand this phenomenon at a microscopic level, we here focus on a more fundamental problem, i.e., how pressure affects the thermalization properties of solids. As illustrating examples, we study the thermalization behavior of the monatomic chain and the mass-disordered chain of Fermi-Pasta-Ulam-Tsingou-$\beta$ under different strains in the thermodynamic limit. It is found that the pressure-induced change in nonintegrability results in qualitatively different thermalization processes for the two kinds of chains. However, for both cases, the thermalization time follows the same law -- it is inversely proportional to the square of the nonintegrability strength. This result suggests that pressure can significantly change the integrability of a system, which provides a new perspective for understanding the pressure-dependent thermal transport behavior.


title: 3-facial edge-coloring of plane graphs

abstract: An $\ell$-facial edge-coloring of a plane graph is a coloring of its edges such that any two edges at distance at most $\ell$ on a boundary walk of any face receive distinct colors. It is the edge-coloring variant of the $\ell$-facial vertex coloring, which arose as a generalization of the well-known cyclic coloring. It is conjectured that at most $3\ell + 1$ colors suffice for an $\ell$-facial edge-coloring of any plane graph. The conjecture has only been confirmed for $\ell \le 2$, and in this paper, we prove its validity for $\ell = 3$.


title: Learning Free-Form Deformation for 3D Face Reconstruction from In-The-Wild Images

abstract: The 3D Morphable Model (3DMM), which is a Principal Component Analysis (PCA) based statistical model that represents a 3D face using linear basis functions, has shown promising results for reconstructing 3D faces from single-view in-the-wild images. However, 3DMM has restricted representation power due to the limited number of 3D scans and the global linear basis. To address the limitations of 3DMM, we propose a straightforward learning-based method that reconstructs a 3D face mesh through Free-Form Deformation (FFD) for the first time. FFD is a geometric modeling method that embeds a reference mesh within a parallelepiped grid and deforms the mesh by moving the sparse control points of the grid. As FFD is based on mathematically defined basis functions, it has no limitation in representation power. Thus, we can recover accurate 3D face meshes by estimating appropriate deviation of control points as deformation parameters. Although both 3DMM and FFD are parametric models, it is difficult to predict the effect of the 3DMM parameters on the face shape, while the deformation parameters of FFD are interpretable in terms of their effect on the final shape of the mesh. This practical advantage of FFD allows the resulting mesh and control points to serve as a good starting point for 3D face modeling, in that ordinary users can fine-tune the mesh by using widely available 3D software tools. Experiments on multiple datasets demonstrate how our method successfully estimates the 3D face geometry and facial expressions from 2D face images, achieving comparable performance to the state-of-the-art methods.


title: Numerical investigation of three-dimensional partial cavitation in a Venturi geometry

abstract: Sheet cavitation appears in many hydraulic applicationss and can lead to technical issues. Some fundamental outcomes such as the complex topology of 3-Dimensional cavitation pockets and their associated dynamics need to be carefully visited.In the present paper, the dynamics of partial cavitation developing in a 3-D Venturi geometry and the interaction with sidewalls are numerically investigated. The simulations are performed usinf a one-fluid compressible Reynolds-Averaged Navier-Stokes (RANS solver associated to a non-linear turbulence model and a void transport-equation model. A detailed analysis of this cavitating flow is carried out using innovative tools such as Spectral Proper Orthogonal Decompositions. Particular attenttion is paid in the study of 3-D effects by comparing numerical results obtained with sidewalls and periodic conditions. A three-dimensional dynamics of the sheet cavitation, unrelated to the presence of sidewalls, is identified and discussed.


title: Consistency Regularization for Variational Auto-Encoders

abstract: Variational auto-encoders (VAEs) are a powerful approach to unsupervised learning. They enable scalable approximate posterior inference in latent-variable models using variational inference (VI). A VAE posits a variational family parameterized by a deep neural network called an encoder that takes data as input. This encoder is shared across all the observations, which amortizes the cost of inference. However the encoder of a VAE has the undesirable property that it maps a given observation and a semantics-preserving transformation of it to different latent representations. This "inconsistency" of the encoder lowers the quality of the learned representations, especially for downstream tasks, and also negatively affects generalization. In this paper, we propose a regularization method to enforce consistency in VAEs. The idea is to minimize the Kullback-Leibler (KL) divergence between the variational distribution when conditioning on the observation and the variational distribution when conditioning on a random semantic-preserving transformation of this observation. This regularization is applicable to any VAE. In our experiments we apply it to four different VAE variants on several benchmark datasets and found it always improves the quality of the learned representations but also leads to better generalization. In particular, when applied to the Nouveau Variational Auto-Encoder (NVAE), our regularization method yields state-of-the-art performance on MNIST and CIFAR-10. We also applied our method to 3D data and found it learns representations of superior quality as measured by accuracy on a downstream classification task.


title: Definability Results for Top-Down Tree Transducers

abstract: We prove that for a given deterministic top-down transducer with look-ahead it is decidable whether or not its translation is definable (1)~by a linear top-down tree transducer or (2)~by a tree homomorphism. We present algorithms that construct equivalent such transducers if they exist.


title: Quantization of Out-of-Time-Ordered Correlators in non-Hermitian Chaotic Systems

abstract: This letter reports the findings of the late time behavior of the out-of-time-ordered correlators (OTOCs) via a quantum kicked rotor model with $\cal{PT}$-symmetric driving potential. An analytical expression of the OTOCs' quadratic growth with time is yielded as $C(t)=G(K)t^2$. Interestingly, the growth rate $G$ features a quantized response to the increase of the kick strength $K$, which indicates the chaos-assisted quantization in the OTOCs' dynamics. The physics behind this is the quantized absorption of energy from the non-Hermitian driving potential. This discovery and the ensuing establishment of the quantization mechanism in the dynamics of quantum chaos with non-Hermiticity will provide insights in chaotic dynamics, promising unprecedented observations in updated experiments.


title: Coulomb Effects on time-trajectory-resolved high-order harmonic generation

abstract: We study the effect of Coulomb potential on high-order harmonic generation (HHG) numerically and analytically. We focus on the influence of Coulomb potential on emission times of HHG associated with specific electron trajectories. By using a numerical procedure based on numerical solution of time-dependent Schr\"{o}dinger equation (TDSE) in three dimensions, we extract the HHG emission times both for long and short electron trajectories. We compare TDSE predictions with those of a Coulomb-modified model arising from strong-field approximation (SFA). We show that the Coulomb effect induces earlier HHG emission times than those predicted by the general SFA model without considering the Coulomb potential. In particular, this effect influences differently on long and short electron trajectories and is more remarkable for low-energy harmonics than high ones. It also changes the HHG amplitudes for long and short electron trajectories. We validate our discussions with diverse laser parameters and forms of Coulomb potential. Our results strongly support a four-step model of HHG.


title: Notes in Pure Mathematics & Mathematical Structures in Physics

abstract: These Notes deal with various areas of mathematics, and seek reciprocal combinations, explore mutual relations, ranging from abstract objects to problems in physics.


title: Single-Hole Pump in Germanium

abstract: Single-charge pumps are the main candidates for quantum-based standards of the unit ampere because they can generate accurate and quantized electric currents. In order to approach the metrological requirements in terms of both accuracy and speed of operation, in the past decade there has been a focus on semiconductor-based devices. The use of a variety of semiconductor materials enables the universality of charge pump devices to be tested, a highly desirable demonstration for metrology, with GaAs and Si pumps at the forefront of these tests. Here, we show that pumping can be achieved in a yet unexplored semiconductor, i.e. germanium. We realise a single-hole pump with a tunable-barrier quantum dot electrostatically defined at a Ge/SiGe heterostructure interface. We observe quantized current plateaux by driving the system with a single sinusoidal drive up to a frequency of 100 MHz. The operation of the prototype was affected by accidental formation of multiple dots, probably due to disorder potential, and random charge fluctuations. We suggest straightforward refinements of the fabrication process to improve pump characteristics in future experiments.


title: Classification problems from the descriptive set theoretical perspective

abstract: Twenty years have passed since Kechris' seminal survey paper [A. S. Kechris, New directions in descriptive set theory. Bull. Symbolic Logic, 5(2):161-174, 1999]. As a follow-up of that work, we review some ot the (anti-)classification results that have been obtained in the last decade using Borel reducibility and its generalizations to uncountable cardinals.


title: Variational Autoencoders: A Harmonic Perspective

abstract: In this work we study Variational Autoencoders (VAEs) from the perspective of harmonic analysis. By viewing a VAE's latent space as a Gaussian Space, a variety of measure space, we derive a series of results that show that the encoder variance of a VAE controls the frequency content of the functions parameterised by the VAE encoder and decoder neural networks. In particular we demonstrate that larger encoder variances reduce the high frequency content of these functions. Our analysis allows us to show that increasing this variance effectively induces a soft Lipschitz constraint on the decoder network of a VAE, which is a core contributor to the adversarial robustness of VAEs. We further demonstrate that adding Gaussian noise to the input of a VAE allows us to more finely control the frequency content and the Lipschitz constant of the VAE encoder networks. To support our theoretical analysis we run experiments with VAEs with small fully-connected neural networks and with larger convolutional networks, demonstrating empirically that our theory holds for a variety of neural network architectures.


title: Accurate and Efficient Time Series Matching by Season- and Trend-aware Symbolic Approximation -- Extended Version Including Additional Evaluation and Proofs

abstract: Processing and analyzing time series data\-sets have become a central issue in many domains requiring data management systems to support time series as a native data type. A crucial prerequisite of these systems is time series matching, which still is a challenging problem. A time series is a high-dimensional data type, its representation is storage-, and its comparison is time-consuming. Among the representation techniques that tackle these challenges, the symbolic aggregate approximation (SAX) is the current state of the art. This technique reduces a time series to a low-dimensional space by segmenting it and discretizing each segment into a small symbolic alphabet. However, SAX ignores the deterministic behavior of time series such as cyclical repeating patterns or trend component affecting all segments and leading to a distortion of the symbolic distribution. In this paper, we present a season- and a trend-aware symbolic approximation. We show that this improves the symbolic distribution and increase the representation accuracy without increasing its memory footprint. Most importantly, this enables a more efficient time series matching by providing a match up to three orders of magnitude faster than SAX.


title: Improved Lang--Weil bounds for a geometrically irreducible hypersurface over a finite field

abstract: We sharpen to nearly optimal the known asymptotic and explicit bounds for the number of $\mathbb{F}_q$-rational points on a geometrically irreducible hypersurface over a (large) finite field. The proof involves a Bertini-type probabilistic combinatorial technique. Namely, we study the number of $\mathbb{F}_q$-points on the intersection of the given hypersurface with a random plane.


title: Collective Information Security in Large-Scale Urban Protests: the Case of Hong Kong

abstract: The Anti-Extradition Law Amendment Bill protests in Hong Kong present a rich context for exploring information security practices among protesters due to their large-scale urban setting and highly digitalised nature. We conducted in-depth, semi-structured interviews with 11 participants of these protests. Research findings reveal how protesters favoured Telegram and relied on its security for internal communication and organisation of on-the-ground collective action; were organised in small private groups and large public groups to enable collective action; adopted tactics and technologies that enable pseudonymity; and developed a variety of strategies to detect compromises and to achieve forms of forward secrecy and post-compromise security when group members were (presumed) arrested. We further show how group administrators had assumed the roles of leaders in these 'leaderless' protests and were critical to collective protest efforts.


title: Surjective isometries between unitary sets of unital JB$^*$-algebras

abstract: This paper is, in a first stage, devoted to establish a topological--algebraic characterization of the principal component, $\mathcal{U}^0 (M)$, of the set of unitary elements, $\mathcal{U} (M)$, in a unital JB$^*$-algebra $M$. We arrive to the conclusion that, as in the case of unital C$^*$-algebras, $$\begin{aligned}\mathcal{U}^0(M) &= M^{-1}_{\textbf{1}}\cap\mathcal{U} (M) =\left\lbrace U_{e^{i h_n}}\cdots U_{e^{i h_1}}(\textbf{1}) \colon \begin{array}{c} n\in \mathbb{N}, \ h_j\in M_{sa} \forall\ 1\leq j \leq n \end{array} \right\rbrace \end{aligned}$$ is analytically arcwise connected. Our second goal is to provide a complete description of the surjective isometries between the principal components of two unital JB$^*$-algebras $M$ and $N$. Contrary to the case of unital C$^*$-algebras, we shall deduce the existence of connected components in $\mathcal{U} (M)$ which are not isometric as metric spaces. We shall also establish necessary and sufficient conditions to guarantee that a surjective isometry $\Delta: \mathcal{U}(M)\to \mathcal{U} (N)$ admits an extension to a surjective linear isometry between $M$ and $N$, a conclusion which is not always true. Among the consequences it is proved that $M$ and $N$ are Jordan $^*$-isomorphic if, and only if, their principal components are isometric as metric spaces if, and only if, there exists a surjective isometry $\Delta: \mathcal{U}(M)\to \mathcal{U}(N)$ mapping the unit of $M$ to an element in $\mathcal{U}^0(N)$. These results provide an extension to the setting of unital JB$^*$-algebras of the results obtained by O. Hatori for unital C$^*$-algebras.


title: Subdiffusive Activity Spreading in the Diffusive Epidemic Process

abstract: The diffusive epidemic process is a paradigmatic example of an absorbing state phase transition in which healthy and infected individuals spread with different diffusion constants. Using stochastic activity spreading simulations in combination with finite-size scaling analyses we reveal two qualitatively different processes that characterize the critical dynamics: subdiffusive propagation of infection clusters and diffusive fluctuations in the healthy population. This suggests the presence of a strong-coupling regime and sheds new light on a longstanding debate about the theoretical classification of the system.


title: Davenport and Hasse's theorems and lifts of multiplication matrices of Gaussian periods

abstract: Let $e \geq 2$ be an integer, $p^r$ be a prime power with $p^r \equiv 1\ ({\rm mod}\ e)$ and $\eta_r(i)$ be Gaussian periods of degree $e$ for ${\mathbb F}_{p^r}$. By the dual form of Davenport and Hasse's lifting theorem on Gauss sums, we establish lifts of the multiplication matrices of the Gaussian periods $\eta_r(0),\ldots,\eta_r(e-1)$ which are defined by F. Thaine. We also give some examples of the explicit lifts for prime degree $e$ with $3\leq e\leq 23$ which also illustrate relations among lifts of Jacobi sums, Gaussian periods and multiplication matrices of Gaussian periods.


title: Revisiting the Plasmon Radiation Damping of Gold Nanorods

abstract: Noble metal nanoparticles have been utilized for a vast amount of optical applications. For the applications that used metal nanoparticles as nanosensors and optical labeling, larger radiation damping is preferred (higher optical signal). To get a deeper knowledge about the radiation damping of noble metal nanoparticles, we used gold nanorods with different geometry factors (aspect ratios) as the model system to study. We investigated theoretically how the radiation damping of a nanorod depends on the material, and shape of the particle. Surprisingly, a simple analytical equation describes radiation damping very accurately and allow to disentangle the maximal radiation damping parameter for gold nanorod with resonance energy E_res around 1.81 eV (685 nm). We found very good agreement with theoretical predictions and experimental data obtained by single-particle spectroscopy. Our results and approaches may pave the way for designing and optimizing gold nanostructure with higher optical signal and better sensing performance.


title: BiasRV: Uncovering Biased Sentiment Predictions at Runtime

abstract: Sentiment analysis (SA) systems, though widely applied in many domains, have been demonstrated to produce biased results. Some research works have been done in automatically generating test cases to reveal unfairness in SA systems, but the community still lacks tools that can monitor and uncover biased predictions at runtime. This paper fills this gap by proposing BiasRV, the first tool to raise an alarm when a deployed SA system makes a biased prediction on a given input text. To implement this feature, BiasRV dynamically extracts a template from an input text and from the template generates gender-discriminatory mutants (semantically-equivalent texts that only differ in gender information). Based on popular metrics used to evaluate the overall fairness of an SA system, we define distributional fairness property for an individual prediction of an SA system. This property specifies a requirement that for one piece of text, mutants from different gender classes should be treated similarly as a whole. Verifying the distributional fairness property causes much overhead to the running system. To run more efficiently, BiasRV adopts a two-step heuristic: (1) sampling several mutants from each gender and checking if the system predicts them as of the same sentiment, (2) checking distributional fairness only when sampled mutants have conflicting results. Experiments show that compared to directly checking the distributional fairness property for each input text, our two-step heuristic can decrease overhead used for analyzing mutants by 73.81% while only resulting in 6.7% of biased predictions being missed. Besides, BiasRV can be used conveniently without knowing the implementation of SA systems. Future researchers can easily extend BiasRV to detect more types of bias, e.g. race and occupation.


title: Bangla Natural Language Processing: A Comprehensive Analysis of Classical, Machine Learning, and Deep Learning Based Methods

abstract: The Bangla language is the seventh most spoken language, with 265 million native and non-native speakers worldwide. However, English is the predominant language for online resources and technical knowledge, journals, and documentation. Consequently, many Bangla-speaking people, who have limited command of English, face hurdles to utilize English resources. To bridge the gap between limited support and increasing demand, researchers conducted many experiments and developed valuable tools and techniques to create and process Bangla language materials. Many efforts are also ongoing to make it easy to use the Bangla language in the online and technical domains. There are some review papers to understand the past, previous, and future Bangla Natural Language Processing (BNLP) trends. The studies are mainly concentrated on the specific domains of BNLP, such as sentiment analysis, speech recognition, optical character recognition, and text summarization. There is an apparent scarcity of resources that contain a comprehensive review of the recent BNLP tools and methods. Therefore, in this paper, we present a thorough analysis of 75 BNLP research papers and categorize them into 11 categories, namely Information Extraction, Machine Translation, Named Entity Recognition, Parsing, Parts of Speech Tagging, Question Answering System, Sentiment Analysis, Spam and Fake Detection, Text Summarization, Word Sense Disambiguation, and Speech Processing and Recognition. We study articles published between 1999 to 2021, and 50% of the papers were published after 2015. Furthermore, we discuss Classical, Machine Learning and Deep Learning approaches with different datasets while addressing the limitations and current and future trends of the BNLP.


title: Fast, Accurate and Interpretable Time Series Classification Through Randomization

abstract: Time series classification (TSC) aims to predict the class label of a given time series, which is critical to a rich set of application areas such as economics and medicine. State-of-the-art TSC methods have mostly focused on classification accuracy and efficiency, without considering the interpretability of their classifications, which is an important property required by modern applications such as appliance modeling and legislation such as the European General Data Protection Regulation. To address this gap, we propose a novel TSC method - the Randomized-Supervised Time Series Forest (r-STSF). r-STSF is highly efficient, achieves state-of-the-art classification accuracy and enables interpretability. r-STSF takes an efficient interval-based approach to classify time series according to aggregate values of discriminatory sub-series (intervals). To achieve state-of-the-art accuracy, r-STSF builds an ensemble of randomized trees using the discriminatory sub-series. It uses four time series representations, nine aggregation functions and a supervised binary-inspired search combined with a feature ranking metric to identify highly discriminatory sub-series. The discriminatory sub-series enable interpretable classifications. Experiments on extensive datasets show that r-STSF achieves state-of-the-art accuracy while being orders of magnitude faster than most existing TSC methods. It is the only classifier from the state-of-the-art group that enables interpretability. Our findings also highlight that r-STSF is the best TSC method when classifying complex time series datasets.