title: Distance Guided Channel Weighting for Semantic Segmentation

abstract: Recent works have achieved great success in improving the performance of multiple computer vision tasks by capturing features with a high channel number utilizing deep neural networks. However, many channels of extracted features are not discriminative and contain a lot of redundant information. In this paper, we address above issue by introducing the Distance Guided Channel Weighting (DGCW) Module. The DGCW module is constructed in a pixel-wise context extraction manner, which enhances the discriminativeness of features by weighting different channels of each pixel's feature vector when modeling its relationship with other pixels. It can make full use of the high-discriminative information while ignore the low-discriminative information containing in feature maps, as well as capture the long-range dependencies. Furthermore, by incorporating the DGCW module with a baseline segmentation network, we propose the Distance Guided Channel Weighting Network (DGCWNet). We conduct extensive experiments to demonstrate the effectiveness of DGCWNet. In particular, it achieves 81.6% mIoU on Cityscapes with only fine annotated data for training, and also gains satisfactory performance on another two semantic segmentation datasets, i.e. Pascal Context and ADE20K. Code will be available soon at https://github.com/LanyunZhu/DGCWNet.


title: Learning discrete distributions with infinite support

abstract: We present a novel approach to estimating discrete distributions with (potentially) infinite support in the total variation metric. In a departure from the established paradigm, we make no structural assumptions whatsoever on the sampling distribution. In such a setting, distribution-free risk bounds are impossible, and the best one could hope for is a fully empirical data-dependent bound. We derive precisely such bounds, and demonstrate that these are, in a well-defined sense, the best possible. Our main discovery is that the half-norm of the empirical distribution provides tight upper and lower estimates on the empirical risk. Furthermore, this quantity decays at a nearly optimal rate as a function of the true distribution. The optimality follows from a minimax result, of possible independent interest. Additional structural results are provided, including an exact Rademacher complexity calculation and apparently a first connection between the total variation risk and the missing mass.


title: Lexically Constrained Neural Machine Translation with Levenshtein Transformer

abstract: This paper proposes a simple and effective algorithm for incorporating lexical constraints in neural machine translation. Previous work either required re-training existing models with the lexical constraints or incorporating them during beam search decoding with significantly higher computational overheads. Leveraging the flexibility and speed of a recently proposed Levenshtein Transformer model (Gu et al., 2019), our method injects terminology constraints at inference time without any impact on decoding speed. Our method does not require any modification to the training procedure and can be easily applied at runtime with custom dictionaries. Experiments on English-German WMT datasets show that our approach improves an unconstrained baseline and previous approaches.


title: On the Complexity of Linear Temporal Logic with Team Semantics

abstract: A specification given as a formula in linear temporal logic (LTL) defines a system by its set of traces. However, certain features such as information flow security constraints are rather modeled as so-called hyperproperties, which are sets of sets of traces. One logical approach to this is team logic, which is a logical framework for the specification of dependence and independence of information. LTL with team semantics has recently been discovered as a logic for hyperproperties. We study the complexity theoretic aspects of LTL with so-called synchronous team semantics and Boolean negation, and prove that both its model checking and satisfiability problems are highly undecidable, and equivalent to the decision problem of third-order arithmetic. Furthermore, we prove that this complexity already appears at small temporal depth and with only the "future" modality F. Finally, we also introduce a team-semantical generalization of stutter-invariance.


title: Approximate Turing Kernelization for Problems Parameterized by Treewidth

abstract: We extend the notion of lossy kernelization, introduced by Lokshtanov et al. [STOC 2017], to approximate Turing kernelization. An $\alpha$-approximate Turing kernel for a parameterized optimization problem is a polynomial-time algorithm that, when given access to an oracle that outputs $c$-approximate solutions in $O(1)$ time, obtains an $(\alpha \cdot c)$-approximate solution to the considered problem, using calls to the oracle of size at most $f(k)$ for some function $f$ that only depends on the parameter. Using this definition, we show that Independent Set parameterized by treewidth $\ell$ has a $(1+\varepsilon)$-approximate Turing kernel with $O(\frac{\ell^2}{\varepsilon})$ vertices, answering an open question posed by Lokshtanov et al. [STOC 2017]. Furthermore, we give $(1+\varepsilon)$-approximate Turing kernels for the following graph problems parameterized by treewidth: Vertex Cover, Edge Clique Cover, Edge-Disjoint Triangle Packing and Connected Vertex Cover. We generalize the result for Independent Set and Vertex Cover, by showing that all graph problems that we will call "friendly" admit $(1+\varepsilon)$-approximate Turing kernels of polynomial size when parameterized by treewidth. We use this to obtain approximate Turing kernels for Vertex-Disjoint $H$-packing for connected graphs $H$, Clique Cover, Feedback Vertex Set and Edge Dominating Set.


title: Age-Aware Status Update Control for Energy Harvesting IoT Sensors via Reinforcement Learning

abstract: We consider an IoT sensing network with multiple users, multiple energy harvesting sensors, and a wireless edge node acting as a gateway between the users and sensors. The users request for updates about the value of physical processes, each of which is measured by one sensor. The edge node has a cache storage that stores the most recently received measurements from each sensor. Upon receiving a request, the edge node can either command the corresponding sensor to send a status update, or use the data in the cache. We aim to find the best action of the edge node to minimize the average long-term cost which trade-offs between the age of information and energy consumption. We propose a practical reinforcement learning approach that finds an optimal policy without knowing the exact battery levels of the sensors.


title: The interpretability logic of all reasonable arithmetical theories

abstract: This paper from 2000 is a presentation of a status qu{\ae}stionis at that tiime, to wit of the problem of the interpretability logic of {\em all}\/ reasonable arithmetical theories. We present both the arithmetical side and the modal side of the question.


title: On the optimality of spatial search by continuous-time quantum walk

abstract: One of the most important algorithmic applications of quantum walks is to solve spatial search problems. A widely used quantum algorithm for this problem, introduced by Childs and Goldstone [Phys. Rev. A 70, 022314 (2004)], finds a marked node on a graph of $n$ nodes via a continuous-time quantum walk. This algorithm is said to be optimal if it can find any of the nodes in $O(\sqrt{n})$ time. However, given a graph, no general conditions for the optimality of the algorithm are known and previous works demonstrating optimal quantum search for certain graphs required an instance-specific analysis. In fact, the demonstration of necessary and sufficient conditions a graph must fulfill for quantum search to be optimal has been a long-standing open problem. In this work, we make significant progress towards solving this problem. We derive general expressions, depending on the spectral properties of the Hamiltonian driving the walk, that predict the performance of this quantum search algorithm provided certain spectral conditions are fulfilled. Our predictions are valid, for example, for (normalized) Hamiltonians whose spectral gap is considerably larger than $n^{-1/2}$. This allows us to derive necessary and sufficient conditions for optimal quantum search in this regime, as well as provide new examples of graphs where quantum search is sub-optimal. In addition, by extending this analysis, we are also able to show the optimality of quantum search for certain graphs with very small spectral gaps, such as graphs that can be efficiently partitioned into clusters. Our results imply that, to the best of our knowledge, all prior results analytically demonstrating the optimality of this algorithm for specific graphs can be recovered from our general results.


title: Quantum incompatibility from the viewpoint of entanglement theory

abstract: In this essay I discuss certain analogies between quantum incompatibility and entanglement. It is an expanded version of my talk presented at Mathematical Foundations of Quantum Mechanics in memoriam Paul Busch, held in York in June 2019.


title: $^{44}\rm Ti$ ejecta in young supernova remnants

abstract: Context: Tracing unstable isotopes produced in supernova nucleosynthesis provides a direct diagnostic of supernova explosion physics. Theoretical models predict an extensive variety of scenarios, which can be constrained through observations of the abundant isotopes $^{56}$Ni and $^{44}$Ti. Direct evidence of the latter was previously found only in two core-collapse supernova events, and appears to be absent in thermonuclear supernovae.Aims: We aim to to constrain the supernova progenitor types of Cas A, SN 1987A, Vela Jr., G1.9+0.3, SN1572, and SN1604 through their $^{44}$Ti ejecta masses and explosion kinematics. Methods: We analyzed INTEGRAL/SPI observations of the candidate sources utilizing an empirically motivated high-precision background model. We analyzed the three dominant spectroscopically resolved de-excitation lines at 68, 78, and 1157\,keV emitted in the decay chain of $^{44}$Ti. The fluxes allow the determination of the production yields of $^{44}$Ti. Remnant kinematics were obtained from the Doppler characteristics of the lines. Results: We find a significant signal for Cas A in all three lines with a combined significance of 5.4$\sigma$. The fluxes are $(3.3 \pm 0.9) \times 10^{-5}$ ph cm$^{-2}$ s$^{-1}$, and $(4.2 \pm 1.0) \times 10^{-5}$ ph cm$^{-2}$ s$^{-1}$ for the $^{44}$Ti and $^{44}$Sc decay, respectively. We obtain higher fluxes for $^{44}$Ti with our analysis of Cas A than were obtained in previous analyses. We discuss potential differences. Conclusions: We obtain a high $^{44}$Ti ejecta mass for Cas A that is in disagreement with ejecta yields from symmetric 2D models. Upper limits for the other core-collapse supernovae are in agreement with model predictions and previous studies. The upper limits we find for the three thermonuclear supernovae consistently exclude the double detonation and pure helium deflagration models as progenitors.


title: Efficient yet Accurate Dispersion-Corrected Semilocal Exchange-Correlation Functionals For Non-Covalent Interactions

abstract: Due to several attractive features, the meta-generalized-gradient approximations (meta-GGAs) are considered to be the most advanced and potentially accurate semilocal exchange-correlation functionals in the rungs of the Jacob's ladder of Density Functional Theory. So far, several meta-GGA are proposed by fitting to the test sets or/and satisfying as many as known exact constraints. Although the density overlap is treated by modern meta-GGA functionals efficiently, for non-covalent interactions, a long-range dispersion correction is essential. In this work, we assess the benchmark performance of different variants of the Tao-Mo semilocal functional (i.e. TM of Phys. Rev. Lett. 117, 073001 (2016) and revTM of J. Phys. Chem. A 123, 6356 (2019)) with Grimme's D3 correction for the several non-covalent interactions, including dispersion and hydrogen bonded systems. We consider the zero, Becke-Johnson(BJ), and optimized power (OP) damping functions within the D3 method, with both TM and revTM functionals. It is observed that the overall performance of the functionals gradually improved from zero to BJ and to OP damping. However, the constructed "OP" corrected (rev)TM+D3(OP) functionals perform considerably better compared to other well-known dispersion corrected functionals. Based on the accuracy of the proposed functionals, the future applicability of these methods is also discussed.


title: Exact continuity equation in a space with minimal length

abstract: We derive continuity equation and exact expression for flow probability density in a space with arbitrary deformed algebra leading to minimal length. In coordinate representation the flow probability density is presented as infinite series over parameter of deformation which in momentum representation can be casted into exact closed form determined by deformed kinetic energy. The flow probability density is calculated explicitly for plane wave and for superposition of two plane waves.


title: Neuromorphic Nearest-Neighbor Search Using Intel's Pohoiki Springs

abstract: Neuromorphic computing applies insights from neuroscience to uncover innovations in computing technology. In the brain, billions of interconnected neurons perform rapid computations at extremely low energy levels by leveraging properties that are foreign to conventional computing systems, such as temporal spiking codes and finely parallelized processing units integrating both memory and computation. Here, we showcase the Pohoiki Springs neuromorphic system, a mesh of 768 interconnected Loihi chips that collectively implement 100 million spiking neurons in silicon. We demonstrate a scalable approximate k-nearest neighbor (k-NN) algorithm for searching large databases that exploits neuromorphic principles. Compared to state-of-the-art conventional CPU-based implementations, we achieve superior latency, index build time, and energy efficiency when evaluated on several standard datasets containing over 1 million high-dimensional patterns. Further, the system supports adding new data points to the indexed database online in O(1) time unlike all but brute force conventional k-NN implementations.


title: k-apices of minor-closed graph classes. II. Parameterized algorithms

abstract: Let ${\cal G}$ be a minor-closed graph class. We say that a graph $G$ is a $k$-apex of ${\cal G}$ if $G$ contains a set $S$ of at most $k$ vertices such that $G\setminus S$ belongs to ${\cal G}$. We denote by ${\cal A}_k ({\cal G})$ the set of all graphs that are $k$-apices of ${\cal G}.$ In the first paper of this series we obtained upper bounds on the size of the graphs in the minor-obstruction set of ${\cal A}_k ({\cal G})$, i.e., the minor-minimal set of graphs not belonging to ${\cal A}_k ({\cal G}).$ In this article we provide an algorithm that, given a graph $G$ on $n$ vertices, runs in $2^{{\sf poly}(k)}\cdot n^3$-time and either returns a set $S$ certifying that $G \in {\cal A}_k ({\cal G})$, or reports that $G \notin {\cal A}_k ({\cal G})$. Here ${\sf poly}$ is a polynomial function whose degree depends on the maximum size of a minor-obstruction of ${\cal G}.$ In the special case where ${\cal G}$ excludes some apex graph as a minor, we give an alternative algorithm running in $2^{{\sf poly}(k)}\cdot n^2$-time.


title: The BIS78 Resistive Plate Chambers upgrade of the ATLAS Muon Spectrometer for the LHC Run-3

abstract: Resistive Plate Chambers are used in the ATLAS experiment for the muon trigger and two coordinate measurements in the central region. In preparation for the coming years of LHC running at higher luminosity, besides the New Small Wheel project which is expected to complement the ATLAS muon spectrometer in the endcap regions, a smaller size project, known as BIS78, is being developed with a foreseen installation during the LHC Long Shutdown 2. The BIS78 project will reinforce the fake muon rejection and the selectivity of the muon trigger in the transition region between the ATLAS barrel and end-caps by adding 32 RPC triplets on the edges of the Inner Barrel even sectors (BIS7 and BIS8) as this region is characterized by high rate due to secondary charged tracks generated by beam halo protons and a lack of detector instrumentation. Due to the narrow available space, the project foresees to replace the existing Monitored Drift Tubes, used for the precise position measurement in this area, with muon stations formed by integrated smaller diameter tubes and a new generation of RPCs, capable of withstanding the higher rates and provide a robust standalone muon confirmation. These new RPCs are based on novel design of the gas volume with a thinner gas gap and resistive electrodes, a lower operating voltage and new high gain front-end electronics with respect to the legacy RPCs. Besides the use in Run-3 and onwards, this project is also of particular relevance as a pilot test for the HL-LHC upgrade when an additional full layer of new RPC triplets is expected to complement the full barrel region in the innermost plane. The core of the project is presented, together with a description of the production and the test results. Details on the detector infrastructure and services along with a roadmap towards the final installation and commissioning during the Long Shutdown 2 are also discussed.


title: Nonsymplectic automorphisms of prime order on O'Grady's sixfolds

abstract: We classify nonsymplectic automorphisms of prime order on irreducible holomorphic symplectic manifolds of O'Grady's 6-dimensional defamation type. More precisely, we give a classification of the invariant and coinvariant sublattices of the second integral cohomology group.


title: Remote Photoplethysmography: Rarely Considered Factors

abstract: Remote Photoplethysmography (rPPG) is a fast-growing technique of vital sign estimation by analyzing video of a person. Several major phenomena affecting rPPG signals have been studied (e.g. video compression, distance from person to camera, skin tone, head motions). However, to develop a highly accurate rPPG method, new, minor, factors should be investigated. First considered factor is irregular frame rate of video recordings. Despite of PPG signal transformation by frame rate irregularity, no significant distortion of PPG signal spectra was found in the experiments. Second factor is rolling shutter effect which generates tiny phase shift of the same PPG signal in different parts of the frame caused by progressive scanning. In particular conditions effect of this artifact could be of the same order of magnitude as physiologically caused phase shifts. Third factor is a size of temporal windows, which could significantly influence the estimated error of vital sign evaluation. It follows that one should account difference in size of processing windows when comparing rPPG methods. Short series of experiments were conducted to estimate importance of these phenomena and to determine necessity of their further comprehensive study.


title: Empirical Bayes Transductive Meta-Learning with Synthetic Gradients

abstract: We propose a meta-learning approach that learns from multiple tasks in a transductive setting, by leveraging the unlabeled query set in addition to the support set to generate a more powerful model for each task. To develop our framework, we revisit the empirical Bayes formulation for multi-task learning. The evidence lower bound of the marginal log-likelihood of empirical Bayes decomposes as a sum of local KL divergences between the variational posterior and the true posterior on the query set of each task. We derive a novel amortized variational inference that couples all the variational posteriors via a meta-model, which consists of a synthetic gradient network and an initialization network. Each variational posterior is derived from synthetic gradient descent to approximate the true posterior on the query set, although where we do not have access to the true gradient. Our results on the Mini-ImageNet and CIFAR-FS benchmarks for episodic few-shot classification outperform previous state-of-the-art methods. Besides, we conduct two zero-shot learning experiments to further explore the potential of the synthetic gradient.


title: Reconstructing normal section profiles of 3D revolving structures via pose-unconstrained multi-line structured-light vision

abstract: The wheel of the train is a 3D revolving geometrical structure. Reconstructing the normal section profile is an effective approach to determine the critical geometric parameter and wear of the wheel in the community of railway safety. The existing reconstruction methods typically require a sensor working in a constrained position and pose, suffering poor flexibility and limited viewangle. This paper proposes a pose-unconstrained normal section profile reconstruction framework for 3D revolving structures via multiple 3D general section profiles acquired by a multi-line structured light vision sensor. First, we establish a model to estimate the axis of 3D revolving geometrical structure and the normal section profile using corresponding points. Then, we embed the model into an iterative algorithm to optimize the corresponding points and finally reconstruct the accurate normal section profile. We conducted real experiment on reconstructing the normal section profile of a 3D wheel. The results demonstrate that our algorithm reaches the mean precision of 0.068mm and good repeatability with the STD of 0.007mm. It is also robust to varying pose variations of the sensor. Our proposed framework and models are generalized to any 3D wheeltype revolving components.


title: A cryogenic magneto-optical device for long wavelength radiation

abstract: We present here a small-scale liquid Helium (LHe) immersion cryostat with an innovative optical setup suitable to work in long wavelength radiation ranges and under applied magnetic field. The cryostat is a multi stage device with several shielding in addition to several optical stages. The system has been designed with an external liquid Nitrogen boiler to reduce the liquid bubbling. The optical and mechanical properties of the optical elements were calculated and optimized for the designed configuration while the optical layout has been simulated and optimized among different configurations based on the geometry of the device. The final design has been optimized for low noise radiation measurements of proximity junction arrays under applied magnetic field in the wavelength range $\lambda$=250-2500 $\mu$m.

categories: physics.ins-det cond-mat.supr-con physics.app-ph physics.optics


title: An Efficient Floating-Point Bit-Blasting API for Verifying C Programs

abstract: We describe a new SMT bit-blasting API for floating-points and evaluate it using different out-of-the-shelf SMT solvers during the verification of several C programs. The new floating-point API is part of the SMT backend in ESBMC, a state-of-the-art bounded model checker for C and C++. For the evaluation, we compared our floating-point API against the native floating-point APIs in Z3 and MathSAT. We show that Boolector, when using floating-point API, outperforms the solvers with native support for floating-points, correctly verifying more programs in less time. Experimental results also show that our floating-point API implemented in ESBMC is on par with other state-of-the-art software verifiers. Furthermore, when verifying programs with floating-point arithmetic, our new floating-point API produced no wrong answers.


title: In-Vehicle Object Detection in the Wild for Driverless Vehicles

abstract: In-vehicle human object identification plays an important role in vision-based automated vehicle driving systems while objects such as pedestrians and vehicles on roads or streets are the primary targets to protect from driverless vehicles. A challenge is the difficulty to detect objects in moving under the wild conditions, while illumination and image quality could drastically vary. In this work, to address this challenge, we exploit Deep Convolutional Generative Adversarial Networks (DCGANs) with Single Shot Detector (SSD) to handle with the wild conditions. In our work, a GAN was trained with low-quality images to handle with the challenges arising from the wild conditions in smart cities, while a cascaded SSD is employed as the object detector to perform with the GAN. We used tested our approach under wild conditions using taxi driver videos on London street in both daylight and night times, and the tests from in-vehicle videos demonstrate that this strategy can drastically achieve a better detection rate under the wild conditions.


title: On Stefan-Boltzmann law and the Casimir effect at finite temperature in the Schwarzschild spacetime

abstract: This paper deals with quantum field theory in curved space-time using the Thermo Field Dynamics. The scalar field is coupled to the Schwarzschild space time and then thermalised. The Stefan-Boltzmann law is established at finite temperature and the entropy of the field is calculated. Then the Casimir energy and pressure are obtained at zero and finite temperature.


title: A Conflict Detection Framework for IoT Services in Multi-resident Smart Homes

abstract: We propose a novel framework to detect conflicts among IoT services in a multi-resident smart home. A novel IoT conflict model is proposed considering the functional and non-functional properties of IoT services. We design a conflict ontology that formally represents different types of conflicts. A hybrid conflict detection algorithm is proposed by combining both knowledge-driven and data-driven approaches. Experimental results on real-world datasets show the efficiency of the proposed approach.


title: On indirect assessment of heart rate in video

abstract: Problem of indirect assessment of heart rate in video is addressed. Several methods of indirect evaluations (adaptive baselines) were examined on Remote Physiological Signal Sensing challenge. Particularly, regression models of dependency of heart rate on estimated age and motion intensity were obtained on challenge's train set. Accounting both motion and age in regression model led to top-quarter position in the leaderboard. Practical value of such adaptive baseline approaches is discussed. Although such approaches are considered as non-applicable in medicine, they are valuable as baseline for the photoplethysmography problem.


title: Semantic Graphs for Generating Deep Questions

abstract: This paper proposes the problem of Deep Question Generation (DQG), which aims to generate complex questions that require reasoning over multiple pieces of information of the input passage. In order to capture the global structure of the document and facilitate reasoning, we propose a novel framework which first constructs a semantic-level graph for the input document and then encodes the semantic graph by introducing an attention-based GGNN (Att-GGNN). Afterwards, we fuse the document-level and graph-level representations to perform joint training of content selection and question decoding. On the HotpotQA deep-question centric dataset, our model greatly improves performance over questions requiring reasoning over multiple facts, leading to state-of-the-art performance. The code is publicly available at https://github.com/WING-NUS/SG-Deep-Question-Generation.


title: A numerical study of the jerky crack growth in elastoplastic materials with localized plasticity

abstract: We present a numerical implementation of a model of quasi-static crack growth in linearly elastic-perfectly plastic materials. We assume that the displacement is antiplane, and that the cracks and the plastic slips are localized on a prescribed path. We provide numerical evidence of the fact that the crack growth is intermittent, with jump characteristics that depend on the material properties.


title: Single-shot d-scan technique for ultrashort laser pulse characterization using transverse second-harmonic generation in random nonlinear crystals

abstract: We demonstrate a novel dispersion-scan (d-scan) scheme for single-shot temporal characterization of ultrashort laser pulses. The novelty of this method relies on the use of a highly dispersive crystal featuring antiparallel nonlinear domains with a random distribution and size. This crystal, capable of generating a transverse second-harmonic signal, acts simultaneously as the dispersive element and the nonlinear medium of the d-scan device. The resulting in-line architecture makes the technique very simple and robust, allowing the acquisition of single-shot d-scan traces in real time. In addition, the technique can be further simplified by avoiding the need of dispersion pre-compensation. The retrieved pulses are in very good agreement with independent FROG measurements. We also apply the new single-shot d-scan to a TW-class laser equipped with a programmable pulse shaper, obtaining an excellent agreement between the applied and the d-scan retrieved dispersions.


title: Scaling laws and dynamics of hashtags on Twitter

abstract: In this paper we quantify the statistical properties and dynamics of the frequency of hashtag use on Twitter. Hashtags are special words used in social media to attract attention and to organize content. Looking at the collection of all hashtags used in a period of time, we identify the scaling laws underpinning the hashtag frequency distribution (Zipf's law), the number of unique hashtags as a function of sample size (Heaps' law), and the fluctuations around expected values (Taylor's law). While these scaling laws appear to be universal, in the sense that similar exponents are observed irrespective of when the sample is gathered, the volume and nature of the hashtags depends strongly on time, with the appearance of bursts at the minute scale, fat-tailed noise, and long-range correlations. We quantify this dynamics by computing the Jensen-Shannon divergence between hashtag distributions obtained $\tau$ times apart and we find that the speed of change decays roughly as $1/\tau$. Our findings are based on the analysis of 3.5 billion hashtags used between 2015 and 2016.


title: Time-Distance Helioseismology of Deep Meridional Circulation

abstract: A key component of solar interior dynamics is the meridional circulation (MC), whose poleward component in the surface layers has been well observed. Time-distance helioseismic studies of the deep structure of MC, however, have yielded conflicting inferences. Here, following a summary of existing results we show how a large center-to-limb systematics (CLS) in the measured travel times of acoustic waves affect the inferences through an analysis of frequency dependence of CLS, using data from the Helioseismic and Doppler Imager (HMI) onboard Solar Dynamics Observatory (SDO). Our results point to the residual systematics in travel times as a major cause of differing inferences on the deep structure of MC.


title: GraftNet: An Engineering Implementation of CNN for Fine-grained Multi-label Task

abstract: Multi-label networks with branches are proved to perform well in both accuracy and speed, but lacks flexibility in providing dynamic extension onto new labels due to the low efficiency of re-work on annotating and training. For multi-label classification task, to cover new labels we need to annotate not only newly collected images, but also the previous whole dataset to check presence of these new labels. Also training on whole re-annotated dataset costs much time. In order to recognize new labels more effectively and accurately, we propose GraftNet, which is a customizable tree-like network with its trunk pretrained with a dynamic graph for generic feature extraction, and branches separately trained on sub-datasets with single label to improve accuracy. GraftNet could reduce cost, increase flexibility, and incrementally handle new labels. Experimental results show that it has good performance on our human attributes recognition task, which is fine-grained multi-label classification.


title: Interior Point Differential Dynamic Programming

abstract: This paper introduces a novel Differential Dynamic Programming (DDP) algorithm for solving discrete-time finite-horizon optimal control problems with inequality constraints. Two variants, namely Feasible- and Infeasible-IPDDP algorithms, are developed using primal-dual interior-point methodology, and their local quadratic convergence properties are characterised. We show that the stationary points of the algorithms are the perturbed KKT points, and thus can be moved arbitrarily close to a locally optimal solution. Being free from the burden of the active-set methods, it can handle nonlinear state and input inequality constraints without a discernible increase in its computational complexity relative to the unconstrained case. The performance of the proposed algorithms is demonstrated using numerical experiments on three different problems: control-limited inverted pendulum, car-parking, and unicycle motion control and obstacle avoidance.


title: On the factorization of three-dimensional terminal flops

abstract: We factorize three-dimensional terminal flops into a composition of divisorial contractions to points and blowing-up smooth curves.


title: On grand Sobolev spaces and pointwise description of Banach function spaces

abstract: We obtain a pointwise description of functions belonging to function spaces with the lattice property. In particular, it is valid for Banach function spaces provided that the Hardy-Littlewood maximal operator is bounded. We also study weighted grand Sobolev spaces, defined on arbitrary open sets (of finite or infinite measure), and provide pointwise description of them.


title: Formal Adventures in Convex and Conical Spaces

abstract: Convex sets appear in various mathematical theories, and are used to define notions such as convex functions and hulls. As an abstraction from the usual definition of convex sets in vector spaces, we formalize in Coq an intrinsic axiomatization of convex sets, namely convex spaces, based on an operation taking barycenters of points. A convex space corresponds to a specific type that does not refer to a surrounding vector space. This simplifies the definitions of functions on it. We show applications including the convexity of information-theoretic functions defined over types of distributions. We also show how convex spaces are embedded in conical spaces, which are abstract real cones, and use the embedding as an effective device to ease calculations.


title: Minimax testing and quadratic functional estimation for circular convolution

abstract: In a circular convolution model, we aim to infer on the density of a circular random variable using observations contaminated by an additive measurement error. We highlight the interplay of the two problems: optimal testing and quadratic functional estimation. Under general regularity assumptions, we determine an upper bound for the minimax risk of estimation for the quadratic functional. The upper bound consists of two terms, one that mimics a classical bias-variance trade-off and a second that causes the typical elbow effect in quadratic functional estimation. Using a minimax optimal estimator of the quadratic functional as a test statistic, we derive an upper bound for the nonasymptotic minimax radius of testing for nonparametric alternatives. Interestingly, the term causing the elbow effect in the estimation case vanishes in the radius of testing. We provide a matching lower bound for the testing problem. By showing that any lower bound for the testing problem also yields a lower bound for the quadratic functional estimation problem, we obtain a lower bound for the risk of estimation. Lastly, we prove a matching lower bound for the term causing the elbow effect in the estimation problem. The results are illustrated considering Sobolev spaces and ordinary or super smooth error densities.


title: A QCD analysis of near-threshold quarkonium leptoproduction at large photon virtualities

abstract: We propose a novel approach to compute the cross section of near-threshold $J/\psi$ and $\Upsilon$ production in electron-proton scattering at large photon virtualities $Q^2$ based on an operator product expansion. We show that the process can be used to extract the gluon part of the D-term gravitational form factor of the proton. At the subleading level, it is also sensitive to the trace anomaly effect of QCD.


title: The Local Partial Autocorrelation Function and Some Applications

abstract: The classical regular and partial autocorrelation functions are powerful tools for stationary time series modelling and analysis. However, it is increasingly recognized that many time series are not stationary and the use of classical global autocorrelations can give misleading answers. This article introduces two estimators of the local partial autocorrelation function and establishes their asymptotic properties. The article then illustrates the use of these new estimators on both simulated and real time series. The examples clearly demonstrate the strong practical benefits of local estimators for time series that exhibit nonstationarities.


title: Stinespring's Theorem for Unbounded Operator valued Local completely positive maps and Its Applications

abstract: Anar A. Dosiev in [Local operator spaces, unbounded operators and multinormed $C^*$-algebras, J. Funct. Anal. 255 (2008), 1724-1760], obtained a Stinespring's theorem for local completely positive maps (in short: local CP-maps) on locally $C^{\ast}$-algebras. In this article a suitable notion of minimality for this construction has been identified so as to ensure uniqueness up to unitary equivalence for the associated representation. Using this a Radon-Nikodym type theorem for local completely positive maps has been proved. Further, a Stinespring's theorem for unbounded operator valued local completely positive maps on Hilbert modules over locally $C^{\ast}$-algebras (also called as local CP-inducing maps) has been presented. Following a construction of M. Joi\c{t}a, a Radon-Nikodym type theorem for local CP-inducing maps has been shown. In both cases the Radon-Nikodym derivative obtained is a positive contraction on some complex Hilbert space with an upward filtered family of reducing subspaces.


title: Prospects for High-Elevation Radio Detection of >100 PeV Tau Neutrinos

abstract: Tau neutrinos are expected to comprise roughly one third of both the astrophysical and cosmogenic neutrino flux, but currently the flavor ratio is poorly constrained and the expected flux at energies above $10^{17}$ eV is low. We present a detector concept aimed at measuring the diffuse flux of tau neutrinos in this energy range via a high-elevation mountaintop detector using the radio technique. The detector searches for radio signals from upgoing air showers generated by Earth-skimming tau neutrinos. Signals from several antennas in a compact array are coherently summed at the trigger level, permitting not only directional masking of anthropogenic backgrounds, but also a low trigger threshold. This design takes advantage of both the large viewing area available at high-elevation sites and the nearly full duty cycle available to radio instruments. We present trade studies that consider the station elevation, frequency band, number of antennas in the array, and the trigger threshold to develop a highly efficient station design. Such a mountaintop detector can achieve a factor of ten improvement in acceptance over existing instruments with 100 independent stations. With 1000 stations and three years of observation, it can achieve a sensitivity to an integrated $\mathcal{E}^{-2}$ flux of $<10^{-9}$ GeV cm$^{-2}$ sr$^{-1}$ s$^{-1}$, in the range of the expected flux of all-flavor cosmogenic neutrinos assuming a pure iron cosmic-ray composition.


title: Doping a lattice-trapped bosonic species with impurities: From ground state properties to correlated tunneling dynamics

abstract: We investigate the ground state properties and the nonequilibrium dynamics of a lattice trapped bosonic mixture consisting of an impurity species and a finite-sized medium. For the case of one as well as two impurities we observe that, depending on the lattice depth and the interspecies interaction strength, a transition from a strongly delocalized to a localized impurity distribution occurs. In the latter regime the two species phase separate, thereby forming a particle-hole pair. For two impurities we find that below a critical lattice depth they are delocalized among two neighboring outer lattice wells and are two-body correlated. This transition is characterized by a crossover from strong to a suppressed interspecies entanglement for increasing impurity-medium repulsion. Turning to the dynamical response of the mixture, upon quenching the interspecies repulsion to smaller values, we reveal that the predominant tunneling process for a single impurity corresponds to that of a particle-hole pair, whose dynamical stability depends strongly on the quench amplitude. During the time-evolution a significant increase of the interspecies entanglement is observed, caused by the build-up of a superposition of states and thus possesses a many-body nature. In the case of two bosonic impurities the particle-hole pair process becomes unstable in the course of the dynamics with the impurities aggregating in adjacent lattice sites while being strongly correlated.


title: On ultrafast polarization switching in ferroelectrics

abstract: Recently, a method of ultrafast polarization switching in ferroelectrics has been suggested. The basic idea of the method is to employ the effect of self-acceleration of polarization dynamics due to a resonator feedback field. This is the idea of principle whose efficiency is demonstrated by an Ising-type model in a transverse field. Of course, the practical realization of the method requires the choice of appropriate materials, which is a separate problem. For example, the standard order-disorder ferroelectrics with spatially symmetric double-well potentials cannot be used for this purpose, since, because of the symmetry, they lack the transverse polarization. However, ferroelectrics with asymmetric potentials, possessing this polarization, can be used. Moreover, if the potential asymmetry, hence the transverse polarization, could be regulated, e.g., by shear stress or shear strain, this could provide a tool for governing the process of polarization switching.


title: Geometric continuity of plane curves in terms of Riordan matrices and an application to the F-chordal problem

abstract: The first goal of this article is to provide an statement of the conditions for geometric continuity of order k, referred in the bibliography as beta-constraints, in terms of Riordan matrices. The second one is to see this new formulation in action to solve a theoretical cuestion about uniqueness of analytic solution for a general and classical problem in plane geometry: the F-chordal problem.


title: Boron Liquid Metal Alloy Ion Sources For Special FIB Applications

abstract: Focused Ion Beam (FIB) processing has been established as a well-suited and promising technique in R&D in nearly all fields of nanotechnology for patterning and prototyping on the micro and nanometer scale and below. Among other concepts, liquid metal alloy ion sources (LMAIS) are one of the alternatives to conventional gallium beams to extend the FIB application field. To meet the rising demand for light ions, different boron containing alloys were investigated in this work. A promising solution was found in a Co31Nd64B5 based LMAIS which will be introduced in more detail. Besides cobalt as a ferromagnetic element and the rare earth element neodymium, boron in particular is of interest for special FIB applications like local p-type doping, for which resolution of about 30 nm has been achieved so far.


title: Functional equations for regularized zeta-functions and diffusion processes

abstract: We discuss modifications in the integral representation of the Riemann zeta-function that lead to generalizations of the Riemann functional equation that preserves the symmetry $s\to (1-s)$ in the critical strip. By modifying one integral representation of the zeta-function with a cut-off that does exhibit the symmetry $x\mapsto 1/x$, we obtain a generalized functional equation involving Bessel functions of second kind. Next, with another cut-off that does exhibit the same symmetry, we obtain a generalization for the functional equation involving only one Bessel function of second kind. Some connection between one regularized zeta-function and the Laplace transform of the heat kernel for the Euclidean and hyperbolic space is discussed.


title: Unsupervised Domain Adaptation with Multiple Domain Discriminators and Adaptive Self-Training

abstract: Unsupervised Domain Adaptation (UDA) aims at improving the generalization capability of a model trained on a source domain to perform well on a target domain for which no labeled data is available. In this paper, we consider the semantic segmentation of urban scenes and we propose an approach to adapt a deep neural network trained on synthetic data to real scenes addressing the domain shift between the two different data distributions. We introduce a novel UDA framework where a standard supervised loss on labeled synthetic data is supported by an adversarial module and a self-training strategy aiming at aligning the two domain distributions. The adversarial module is driven by a couple of fully convolutional discriminators dealing with different domains: the first discriminates between ground truth and generated maps, while the second between segmentation maps coming from synthetic or real world data. The self-training module exploits the confidence estimated by the discriminators on unlabeled data to select the regions used to reinforce the learning process. Furthermore, the confidence is thresholded with an adaptive mechanism based on the per-class overall confidence. Experimental results prove the effectiveness of the proposed strategy in adapting a segmentation network trained on synthetic datasets like GTA5 and SYNTHIA, to real world datasets like Cityscapes and Mapillary.


title: Semantic Neighborhood-Aware Deep Facial Expression Recognition

abstract: Different from many other attributes, facial expression can change in a continuous way, and therefore, a slight semantic change of input should also lead to the output fluctuation limited in a small scale. This consistency is important. However, current Facial Expression Recognition (FER) datasets may have the extreme imbalance problem, as well as the lack of data and the excessive amounts of noise, hindering this consistency and leading to a performance decreasing when testing. In this paper, we not only consider the prediction accuracy on sample points, but also take the neighborhood smoothness of them into consideration, focusing on the stability of the output with respect to slight semantic perturbations of the input. A novel method is proposed to formulate semantic perturbation and select unreliable samples during training, reducing the bad effect of them. Experiments show the effectiveness of the proposed method and state-of-the-art results are reported, getting closer to an upper limit than the state-of-the-art methods by a factor of 30\% in AffectNet, the largest in-the-wild FER database by now.


title: BLEU Neighbors: A Reference-less Approach to Automatic Evaluation

abstract: Evaluation is a bottleneck in the development of natural language generation (NLG) models. Automatic metrics such as BLEU rely on references, but for tasks such as open-ended generation, there are no references to draw upon. Although language diversity can be estimated using statistical measures such as perplexity, measuring language quality requires human evaluation. However, because human evaluation at scale is slow and expensive, it is used sparingly; it cannot be used to rapidly iterate on NLG models, in the way BLEU is used for machine translation. To this end, we propose BLEU Neighbors, a nearest neighbors model for estimating language quality by using the BLEU score as a kernel function. On existing datasets for chitchat dialogue and open-ended sentence generation, we find that -- on average -- the quality estimation from a BLEU Neighbors model has a lower mean squared error and higher Spearman correlation with the ground truth than individual human annotators. Despite its simplicity, BLEU Neighbors even outperforms state-of-the-art models on automatically grading essays, including models that have access to a gold-standard reference essay.


title: Screenplay Summarization Using Latent Narrative Structure

abstract: Most general-purpose extractive summarization models are trained on news articles, which are short and present all important information upfront. As a result, such models are biased on position and often perform a smart selection of sentences from the beginning of the document. When summarizing long narratives, which have complex structure and present information piecemeal, simple position heuristics are not sufficient. In this paper, we propose to explicitly incorporate the underlying structure of narratives into general unsupervised and supervised extractive summarization models. We formalize narrative structure in terms of key narrative events (turning points) and treat it as latent in order to summarize screenplays (i.e., extract an optimal sequence of scenes). Experimental results on the CSI corpus of TV screenplays, which we augment with scene-level summarization labels, show that latent turning points correlate with important aspects of a CSI episode and improve summarization performance over general extractive algorithms leading to more complete and diverse summaries.


title: Nonradiative $\alpha^7m$ QED effects in Lamb shift of helium triplet states

abstract: Theoretical predictions for the Lamb shift in helium are limited by unknown quantum electrodynamic effects of the order $\alpha^7m$, where $\alpha$ is the fine-structure constant and $m$ is the electron mass. We make an important step towards the complete calculation of these effects by deriving the most challenging part, which is induced by the virtual photon exchange between all three helium particles, the two electrons, and the nucleus. The complete calculation of the $\alpha^7m$ effect including the radiative corrections will allow comparing of the nuclear charge radii determined from the electronic and muonic helium atoms and thus provide a stringent test of the Standard Model of fundamental interactions.


title: Single Shot 6D Object Pose Estimation

abstract: In this paper, we introduce a novel single shot approach for 6D object pose estimation of rigid objects based on depth images. For this purpose, a fully convolutional neural network is employed, where the 3D input data is spatially discretized and pose estimation is considered as a regression task that is solved locally on the resulting volume elements. With 65 fps on a GPU, our Object Pose Network (OP-Net) is extremely fast, is optimized end-to-end, and estimates the 6D pose of multiple objects in the image simultaneously. Our approach does not require manually 6D pose-annotated real-world datasets and transfers to the real world, although being entirely trained on synthetic data. The proposed method is evaluated on public benchmark datasets, where we can demonstrate that state-of-the-art methods are significantly outperformed.


title: EAO-SLAM: Monocular Semi-Dense Object SLAM Based on Ensemble Data Association

abstract: Object-level data association and pose estimation play a fundamental role in semantic SLAM, which remain unsolved due to the lack of robust and accurate algorithms. In this work, we propose an ensemble data associate strategy for integrating the parametric and nonparametric statistic tests. By exploiting the nature of different statistics, our method can effectively aggregate the information of different measurements, and thus significantly improve the robustness and accuracy of data association. We then present an accurate object pose estimation framework, in which an outliers-robust centroid and scale estimation algorithm and an object pose initialization algorithm are developed to help improve the optimality of pose estimation results. Furthermore, we build a SLAM system that can generate semi-dense or lightweight object-oriented maps with a monocular camera. Extensive experiments are conducted on three publicly available datasets and a real scenario. The results show that our approach significantly outperforms state-of-the-art techniques in accuracy and robustness. The source code is available on: https://github.com/yanmin-wu/EAO-SLAM.


title: Lifelong Learning Process: Self-Memory Supervising and Dynamically Growing Networks

abstract: From childhood to youth, human gradually come to know the world. But for neural networks, this growing process seems difficult. Trapped in catastrophic forgetting, current researchers feed data of all categories to a neural network which remains the same structure in the whole training process. We compare this training process with human learing patterns, and find two major conflicts. In this paper, we study how to solve these conflicts on generative models based on the conditional variational autoencoder(CVAE) model. To solve the uncontinuous conflict, we apply memory playback strategy to maintain the model's recognizing and generating ability on invisible used categories. And we extend the traditional one-way CVAE to a circulatory mode to better accomplish memory playback strategy. To solve the `dead' structure conflict, we rewrite the CVAE formula then are able to make a novel interpretation about the funtions of different parts in CVAE models. Based on the new understanding, we find ways to dynamically extend the network structure when training on new categories. We verify the effectiveness of our methods on MNIST and Fashion MNIST and display some very insteresting results.


title: Oscillatory orbits in the Restricted Planar 4 Body Problem

abstract: The restricted planar four body problem describes the motion of a massless body under the Newtonian gravitational force of other three bodies (the primaries), of which the motion gives us general solutions of the three body problem. A trajectory is called {\it oscillatory} if it goes arbitrarily faraway but returns infinitely many times to the same bounded region. We prove the existence of such type of trajectories provided the primaries evolve in suitable periodic orbits.


title: Personalized Recommendation of PoIs to People with Autism

abstract: The suggestion of Points of Interest to people with Autism Spectrum Disorder (ASD) challenges recommender systems research because these users' perception of places is influenced by idiosyncratic sensory aversions which can mine their experience by causing stress and anxiety. Therefore, managing individual preferences is not enough to provide these people with suitable recommendations. In order to address this issue, we propose a Top-N recommendation model that combines the user's idiosyncratic aversions with her/his preferences in a personalized way to suggest the most compatible and likable Points of Interest for her/him. We are interested in finding a user-specific balance of compatibility and interest within a recommendation model that integrates heterogeneous evaluation criteria to appropriately take these aspects into account. We tested our model on both ASD and "neurotypical" people. The evaluation results show that, on both groups, our model outperforms in accuracy and ranking capability the recommender systems based on item compatibility, on user preferences, or which integrate these two aspects by means of a uniform evaluation model.


title: An Epistemic Approach to the Formal Specification of Statistical Machine Learning

abstract: We propose an epistemic approach to formalizing statistical properties of machine learning. Specifically, we introduce a formal model for supervised learning based on a Kripke model where each possible world corresponds to a possible dataset and modal operators are interpreted as transformation and testing on datasets. Then we formalize various notions of the classification performance, robustness, and fairness of statistical classifiers by using our extension of statistical epistemic logic (StatEL). In this formalization, we show relationships among properties of classifiers, and relevance between classification performance and robustness. As far as we know, this is the first work that uses epistemic models and logical formulas to express statistical properties of machine learning, and would be a starting point to develop theories of formal specification of machine learning.


title: Fractionally-Spaced Equalization and Decision Feedback Sequence Detection for Diffusive MC

abstract: In this paper, we consider diffusive molecular communication (MC) systems affected by signal-dependent diffusive noise, inter-symbol interference, and external noise. We design linear and nonlinear fractionally-spaced equalization schemes and a detection scheme which combines decision feedback and sequence detection (DFSD). In contrast to the symbol-rate equalization schemes in the MC literature, the proposed equalization and detection schemes exploit multiple samples of the received signal per symbol interval to achieve lower bit error rates (BERs) than existing schemes. The proposed DFSD scheme achieves a BER which is very close to that achieved by maximum likelihood sequence detection, but with lower computational complexity.


title: Limit laws for the norms of extremal samples

abstract: Let denote $S_n(p) = k_n^{-1} \sum_{i=1}^{k_n} \left( \log (X_{n+1-i,n} / X_{n-k_n, n}) \right)^p$, where $p > 0$, $k_n \leq n$ is a sequence of integers such that $k_n \to \infty$ and $k_n / n \to 0$, and $X_{1,n} \leq \ldots \leq X_{n,n}$ is the order statistics of iid random variables with regularly varying upper tail. The estimator $\widehat \gamma(n) = (S_n(p)/\Gamma(p+1))^{1/p}$ is an extension of the Hill estimator. We investigate the asymptotic properties of $S_n(p)$ and $\widehat \gamma(n)$ both for fixed $p > 0$ and for $p = p_n \to \infty$. We prove strong consistency and asymptotic normality under appropriate assumptions. Applied to real data we find that for larger $p$ the estimator is less sensitive to the change in $k_n$ than the Hill estimator.


title: A Bayesian dose-response meta-analysis model: simulation study and application

abstract: Dose-response models express the effect of different dose or exposure levels on a specific outcome. In meta-analysis, where aggregated-level data is available, dose-response evidence is synthesized using either one-stage or two-stage models in a frequentist setting. We propose a hierarchical dose-response model implemented in a Bayesian framework. We present the model with cubic dose-response shapes for a dichotomous outcome and take into account heterogeneity due to variability in the dose-response shape. We develop our Bayesian model assuming normal or binomial likelihood and accounting for exposures grouped in clusters. We implement these models in R using JAGS and we compare our approach to the one-stage dose-response meta-analysis model in a simulation study. We found that the Bayesian dose-response model with binomial likelihood has slightly lower bias than the Bayesian model with the normal likelihood and the frequentist one-stage model. However, all three models perform very well and give practically identical results. We also re-analyze the data from 60 randomized controlled trials (15,984 participants) examining the efficacy (response) of various doses of antidepressant drugs. All models suggest that the dose-response curve increases between zero dose and 40 mg of fluoxetine-equivalent dose, and thereafter is constant. We draw the same conclusion when we take into account the fact that five different antidepressants have been studied in the included trials. We show that implementation of the hierarchical model in Bayesian framework has similar performance to, but overcomes some of the limitations of the frequentist approaches and offers maximum flexibility to accommodate features of the data.


title: Long-range interaction in an open boundary-driven Heisenberg spin lattice: A far-from-equilibrium transition to ballistic transport

abstract: We study an open Heisenberg XXZ spin chain with long-range Ising-type interaction, which is incoherently driven at its boundaries and therefore a far-from-equilibrium steady state current is induced. Quantum Monte Carlo techniques make a regime accessible, where the system size is large enough to examine the transition from a diffusive to a ballistic transport regime. We find that the chain lengths for this transition are increasing with decreasing range of the Ising-type interactions between distant spins, while the strength of the incoherent driving does not have a relevant effect on the transport transition. The transition can be explained by the suppression of ferromagnetic domains at the edges of the chain.


title: Dynamic complexity of Reachability: How many changes can we handle?

abstract: In 2015, it was shown that reachability for arbitrary directed graphs can be updated by first-order formulas after inserting or deleting single edges. Later, in 2018, this was extended for changes of size $\frac{\log n}{\log \log n}$, where $n$ is the size of the graph. Changes of polylogarithmic size can be handled when also majority quantifiers may be used. In this paper we extend these results by showing that, for changes of polylogarithmic size, first-order update formulas suffice for maintaining (1) undirected reachability, and (2) directed reachability under insertions. For classes of directed graphs for which efficient parallel algorithms can compute non-zero circulation weights, reachability can be maintained with update formulas that may use "modulo 2" quantifiers under changes of polylogarithmic size. Examples for these classes include the class of planar graphs and graphs with bounded treewidth. The latter is shown here. As the logics we consider cannot maintain reachability under changes of larger sizes, our results are optimal with respect to the size of the changes.


title: A Complete Proof System for 1-Free Regular Expressions Modulo Bisimilarity

abstract: Robin Milner (1984) gave a sound proof system for bisimilarity of regular expressions interpreted as processes: Basic Process Algebra with unary Kleene star iteration, deadlock 0, successful termination 1, and a fixed-point rule. He asked whether this system is complete. Despite intensive research over the last 35 years, the problem is still open. This paper gives a partial positive answer to Milner's problem. We prove that the adaptation of Milner's system over the subclass of regular expressions that arises by dropping the constant 1, and by changing to binary Kleene star iteration is complete. The crucial tool we use is a graph structure property that guarantees expressibility of a process graph by a regular expression, and is preserved by going over from a process graph to its bisimulation collapse.


title: Assessment of design and analysis frameworks for on-farm experimentation through a simulation study of wheat yield in Japan

abstract: On-farm experiments can provide farmers with information on more efficient crop management in their own fields. Developments in precision agricultural technologies, such as yield monitoring and variable-rate application technology, allow farmers to implement on-farm experiments. Research frameworks including the experimental design and the statistical analysis method strongly influences the precision of the experiment. Conventional statistical approaches (e.g., ordinary least squares regression) may not be appropriate for on-farm experiments because they are not capable of accurately accounting for the underlying spatial variation in a particular response variable (e.g., yield data). The effects of experimental designs and statistical approaches on type I error rates and estimation accuracy were explored through a simulation study hypothetically conducted on experiments in three wheat fields in Japan. Isotropic and anisotropic spatial linear mixed models were established for comparison with ordinary least squares regression models. The repeated designs were not sufficient to reduce both the risk of a type I error and the estimation bias on their own. A combination of a repeated design and an anisotropic model is sometimes required to improve the precision of the experiments. Model selection should be performed to determine whether the anisotropic model is required for analysis of any specific field. The anisotropic model had larger standard errors than the other models, especially when the estimates had large biases. This finding highlights an advantage of anisotropic models since they enable experimenters to cautiously consider the reliability of the estimates when they have a large bias.


title: Hit-time and hit-position reconstruction in strips of plastic scintillators using multi-threshold readouts

abstract: In this article, a new method for the reconstruction of hit-position and hit-time of photons in long scintillator detectors is investigated. This research is motivated by the recent development of the positron emission tomography scanners based on plastic scintillators. The proposed method constitutes a new way of signal processing in Multi-Voltage-Technique. It is based on the determination of the degree of similarity between the registered signals and the synchronized model signals stored in a library. The library was established for a set of well defined hit-positions along the length of the scintillator. The Mahalanobis distance was used as a measure of similarity between the two compared signals. The method was validated on the experimental data measured using two-strips J-PET prototype with dimensions of 5x9x300 mm$^3$. The obtained Time-of-Flight (TOF) and spatial resolutions amount to 325~ps (FWHM) and 25~mm (FWHM), respectively. The TOF resolution was also compared to the results of an analogous study done using Linear Fitting method. The best TOF resolution was obtained with this method at four pre-defined threshold levels which was comparable to the resolution achieved from the Mahalanobis distance at two pre-defined threshold levels. Although the algorithm of Linear Fitting method is much simpler to apply than the Mahalanobis method, the application of the Mahalanobis distance requires a lower number of applied threshold levels and, hence, decreases the costs of electronics used in PET scanner.


title: Effect of disorder on Majorana localization in topological superconductors: a quasiclassical approach

abstract: Two dimensional topological superconductors (TS) host chiral Majorana modes (MMs) localized at the boundaries. In this work, within quasiclassical approximation we study the effect of disorder on the localization length of MMs in two dimensional spin-orbit (SO) coupled superconductors. We find nonmonotonic behavior of the Majorana localization length as a function of disorder strength. At weak disorder, the Majorana localization length decreases with an increasing disorder strength. Decreasing the disorder scattering time below a critical value $\tau_c$, the Majorana localization length starts to increase. The critical scattering time depends on the relative magnitudes of the two ingredients behind TS: SO coupling and exchange field. For dominating SO coupling, $\tau_c$ is small and vice versa for the dominating exchange field.


title: Augmenting Transformers with KNN-Based Composite Memory for Dialogue

abstract: Various machine learning tasks can benefit from access to external information of different modalities, such as text and images. Recent work has focused on learning architectures with large memories capable of storing this knowledge. We propose augmenting generative Transformer neural networks with KNN-based Information Fetching (KIF) modules. Each KIF module learns a read operation to access fixed external knowledge. We apply these modules to generative dialog modeling, a challenging task where information must be flexibly retrieved and incorporated to maintain the topic and flow of conversation. We demonstrate the effectiveness of our approach by identifying relevant knowledge required for knowledgeable but engaging dialog from Wikipedia, images, and human-written dialog utterances, and show that leveraging this retrieved information improves model performance, measured by automatic and human evaluation.


title: Time-Frequency Analysis and Parameterisation of Knee Sounds for Non-invasive Detection of Osteoarthritis

abstract: Objective: In this work the potential of non-invasive detection of knee osteoarthritis is investigated using the sounds generated by the knee joint during walking. Methods: The information contained in the time-frequency domain of these signals and its compressed representations is exploited and their discriminant properties are studied. Their efficacy for the task of normal vs abnormal signal classification is evaluated using a comprehensive experimental framework. Based on this, the impact of the feature extraction parameters on the classification performance is investigated using Classification and Regression Trees (CART), Linear Discriminant Analysis (LDA) and Support Vector Machine (SVM) classifiers. Results: It is shown that classification is successful with an area under the Receiver Operating Characteristic (ROC) curve of 0.92. Conclusion: The analysis indicates improvements in classification performance when using non-uniform frequency scaling and identifies specific frequency bands that contain discriminative features. Significance: Contrary to other studies that focus on sit-to-stand movements and knee flexion/extension, this study used knee sounds obtained during walking. The analysis of such signals leads to non-invasive detection of knee osteoarthritis with high accuracy and could potentially extend the range of available tools for the assessment of the disease as a more practical and cost effective method without requiring clinical setups.


title: The Validity of the Local Density Approximation for Smooth Short Range Interaction Potentials

abstract: In the full quantum theory, the energy of a many-body quantum system with a given one-body density is described by the Levy-Lieb functional. It is exact, but very complicated to compute. For practical computations, it is useful to introduce the Local Density Approximation which is based on the local energy of constant densities. The aim of this paper is to make a rigorous connection between the Levy-Lieb functional theory and the Local Density Approximation. Our justification is valid for fermionic systems with a general class of smooth short range interaction potentials, in the regime of slowly varying densities. We follow a general approach developed by Lewin, Lieb and Seiringer for Coulomb potential, but avoid using any special properties of the potential including the scaling property and screening effects for the localization of the energy.


title: Energy Efficient Software Matching in Distributed Vehicular Fog Based Architecture with Cloud and Fixed Fog Nodes

abstract: The rapid development of vehicles on-board units and the proliferation of autonomous vehicles in modern cities create a potential for a new fog computing paradigm, referred to as vehicular fog computing (VFC). In this paper, we propose an architecture that integrates a vehicular fog (VF) composed of vehicles clustered in a parking lot with a fixed fog node at the access network and the central cloud. We investigate the problem of energy efficient software matching in the VF considering different approaches to deploy software packages in vehicles.


title: Optical spectral properties of radio loud quasars along the main sequence

abstract: We analyze the optical properties of Radio-Loud quasars along the Main Sequence (MS) of quasars. A sample of 355 quasars selected on the basis of radio detection was obtained by cross-matching the FIRST survey at 20cm and the SDSS DR12 spectroscopic survey. We consider the nature of powerful emission at the high-FeII end of the MS. At variance with the classical radio-loud sources which are located in the Population B domain of the MS optical plane, we found evidence indicating a thermal origin of the radio emission of the highly accreting quasars of Population A.


title: The three types of normal sequential effect algebras

abstract: A sequential effect algebra (SEA) is an effect algebra equipped with a sequential product operation modeled after the L\"uders product $(a,b)\mapsto \sqrt{a}b\sqrt{a}$ on C*-algebras. A SEA is called normal when it has all suprema of directed sets, and the sequential product interacts suitably with these suprema. The effects on a Hilbert space and the unit interval of a von Neumann or JBW algebra are examples of normal SEAs that are in addition convex, i.e. possess a suitable action of the real unit interval on the algebra. Complete Boolean algebras form normal SEAs too, which are convex only when $0=1$. We show that any normal SEA $E$ splits as a direct sum $E\equiv E_b\oplus E_c \oplus E_{ac}$ of a complete Boolean algebra $E_b$, a convex normal SEA $E_c$, and a newly identified type of normal SEA $E_{ac}$ we dub purely almost-convex. Along the way we show, among other things, that a SEA which contains only idempotents must be a Boolean algebra; and we establish a spectral theorem using which we settle for the class of normal SEAs a problem of Gudder regarding the uniqueness of square roots. After establishing our main result, we propose a simple extra axiom for normal SEAs that excludes the seemingly pathological a-convex SEAs. We conclude the paper by a study of SEAs with an associative sequential product. We find that associativity forces normal SEAs satisfying our new axiom to be commutative, shedding light on the question of why the sequential product in quantum theory should be non-associative.


title: MATE: A Model-based Algorithm Tuning Engine

abstract: In this paper, we introduce a Model-based Algorithm Turning Engine, namely MATE, where the parameters of an algorithm are represented as expressions of the features of a target optimisation problem. In contrast to most static (feature-independent) algorithm tuning engines such as irace and SPOT, our approach aims to derive the best parameter configuration of a given algorithm for a specific problem, exploiting the relationships between the algorithm parameters and the features of the problem. We formulate the problem of finding the relationships between the parameters and the problem features as a symbolic regression problem and we use genetic programming to extract these expressions. For the evaluation, we apply our approach to configuration of the (1+1) EA and RLS algorithms for the OneMax, LeadingOnes, BinValue and Jump optimisation problems, where the theoretically optimal algorithm parameters to the problems are available as functions of the features of the problems. Our study shows that the found relationships typically comply with known theoretical results, thus demonstrating a new opportunity to consider model-based parameter tuning as an effective alternative to the static algorithm tuning engines.


title: The complement of M(a) in H(b)

abstract: Let $b$ be a nonextreme function in the unit ball of $H^{\infty}$ on the unit disk $\mathbb{D} $ and let $a$ be an outer $H^{\infty}$ function such that $|a|^2+|b|^2=1$ almost everywhere on $\partial \mathbb{D}$. The sufficient and necessary conditions for the orthogonal complement of $\mathcal{M}(a)$ in $\mathcal{H}(b)$ be finite dimensional has been given by D. Sarason . Here we describe this space explicitly.


title: The Gutenberg Dialogue Dataset

abstract: Large datasets are essential for neural modeling of many NLP tasks. Current publicly available open-domain dialogue datasets offer a trade-off between quality (e.g., DailyDialog) and size (e.g., Opensubtitles). We narrow this gap by building a high-quality dataset of 14.8M utterances in English, and smaller datasets in German, Dutch, Spanish, Portuguese, Italian, and Hungarian. We extract and process dialogues from public-domain books made available by Project Gutenberg. We describe our dialogue extraction pipeline, analyze the effects of the various heuristics used, and present an error analysis of extracted dialogues. Finally, we conduct experiments showing that better response quality can be achieved in zero-shot and finetuning settings by training on our data than on the larger but much noisier Opensubtitles dataset. Our open-source pipeline (https://github.com/ricsinaruto/gutenberg-dialog) can be extended to further languages with little additional effort. Researchers can also build their versions of existing datasets by adjusting various trade-off parameters. We also built a web demo for interacting with our models: https://ricsinaruto.github.io/chatbot.html.


title: Dipolar and magnetic properties of strongly absorbing hybrid interlayer excitons in pristine bilayer MoS$_2$

abstract: Van der Waals heterostructures composed of transition metal dichalcogenide monolayers (TMDs) are characterized by their truly rich excitonic properties which are determined by their structural, geometric and electronic properties: In contrast to pure monolayers, electrons and holes can be hosted in different materials, resulting in highly tunable dipolar manyparticle complexes. However, for genuine spatially indirect excitons, the dipolar nature is usually accompanied by a notable quenching of the exciton oscillator strength. Via electric and magnetic field dependent measurements, we demonstrate, that a slightly biased pristine bilayer MoS$_2$ hosts strongly dipolar excitons, which preserve a strong oscillator strength. We scrutinize their giant dipole moment, and shed further light on their orbital- and valley physics via bias-dependent magnetic field measurements.


title: Many-body Dynamics with Time-dependent Interaction

abstract: Recent advances in optical Feshbach resonance technique have enabled the experimental investigation of atomic gases with time-dependent interaction. In this work, we study the many-body dynamics of weakly interacting bosons subject with an arbitrary time varying scattering length. By employing a variational ansatz, we derive an effective Hamiltonian that governs the dynamics of thermal particles. Crucially, we show that there exists a hidden symmetry in this Hamiltonian that can map the many-body dynamics to the precession of an SU(1,1) "spin". As a demonstration, we calculate the situation where the scattering length is sinusoidally modulated. We show that the non-compactness of the SU(1,1) group naturally leads to solutions with exponentially growth of Bogoliubov modes and causes instabilities.


title: Retrospective analysis of a fatal dose-finding trial

abstract: The commonplace description of phase 1 clinical trials in oncology as "primarily concerned with safety" is belied by their near universal adoption of dose-escalation practices which are inherently unsafe. In contrast with dose titration, cohort-wise dose escalation regards patients as exchangeable, an indefensible assumption in the face of widely appreciated inter-individual heterogeneity in pharmacokinetics and pharmacodynamics (PKPD). I have previously advanced this argument in terms of a precautionary coherence principle that brings the well-known coherence notion of Cheung (2005) into contact with modern imperatives of patient-centeredness and precision dosing. Here, however, I explore these matters in some mechanistic detail by analyzing a trial of the bispecific T cell engager AFM11, in which a fatal toxicity occurred. To this end, I develop a Bayesian dose-response model for a single ordinal toxicity. By constructing this model's priors to align with the AFM11 trial as designed and conducted, I demonstrate the incompatibility of that design with any reasonable expectation of safety. Indeed, the model readily yields prospective estimates of toxic response probabilities that suggest the fatality in this trial could have been foreseen as likely.


title: A Centroid Auto-Fused Hierarchical Fuzzy c-Means Clustering

abstract: Like k-means and Gaussian Mixture Model (GMM), fuzzy c-means (FCM) with soft partition has also become a popular clustering algorithm and still is extensively studied. However, these algorithms and their variants still suffer from some difficulties such as determination of the optimal number of clusters which is a key factor for clustering quality. A common approach for overcoming this difficulty is to use the trial-and-validation strategy, i.e., traversing every integer from large number like $\sqrt{n}$ to 2 until finding the optimal number corresponding to the peak value of some cluster validity index. But it is scarcely possible to naturally construct an adaptively agglomerative hierarchical cluster structure as using the trial-and-validation strategy. Even possible, existing different validity indices also lead to different number of clusters. To effectively mitigate the problems while motivated by convex clustering, in this paper we present a Centroid Auto-Fused Hierarchical Fuzzy c-means method (CAF-HFCM) whose optimization procedure can automatically agglomerate to form a cluster hierarchy, more importantly, yielding an optimal number of clusters without resorting to any validity index. Although a recently-proposed robust-learning fuzzy c-means (RL-FCM) can also automatically obtain the best number of clusters without the help of any validity index, so-involved 3 hyper-parameters need to adjust expensively, conversely, our CAF-HFCM involves just 1 hyper-parameter which makes the corresponding adjustment is relatively easier and more operational. Further, as an additional benefit from our optimization objective, the CAF-HFCM effectively reduces the sensitivity to the initialization of clustering performance. Moreover, our proposed CAF-HFCM method is able to be straightforwardly extended to various variants of FCM.


title: Guide to Exact Diagonalization Study of Quantum Thermalization

abstract: Exact diagonalization is a powerful numerical method to study isolated quantum many-body systems. This paper provides a review of numerical algorithms to diagonalize the Hamiltonian matrix. Symmetry and the conservation law help us perform the numerical study efficiently. We explain the method to block-diagonalize the Hamiltonian matrix by using particle number conservation, translational symmetry, particle-hole symmetry, and spatial reflection symmetry in the context of the spin-1/2 XXZ model or the hard-core boson model in a one-dimensional lattice. We also explain the method to study the unitary time evolution governed by the Schr\"odinger equation and to calculate thermodynamic quantities such as the entanglement entropy. As an application, we demonstrate numerical results that support that the eigenstate thermalization hypothesis holds in the XXZ model.


title: Introduction to modified gravity

abstract: This paper is a collection of lecture notes on modified gravity. Various modified gravity models formulated within the Riemannian formalism are discussed.


title: An impurity immersed in a double Fermi Sea

abstract: We present a variational calculation of the energy of an impurity immersed a double Fermi sea of non-interacting Fermions. We show that in the strong-coupling regime, the system undergoes a first order transition between polaronic and trimer states. Our result suggests that the smooth crossover predicted in previous literature for a superfluid background is the consequence of Cooper pairing and is absent in a normal system.


title: Unitary pseudonatural transformations

abstract: We suggest two approaches to a definition of unitarity for pseudonatural transformations between unitary pseudofunctors on pivotal dagger 2-categories. The first is to require that the 2-morphism components of the transformation be unitary. The second is to require that the dagger of the transformation be equal to its inverse. We show that the `inverse' making these definitions equivalent is the right dual of the transformation in the 2-category Fun(C,D) of pseudofunctors C -> D, pseudonatural transformations, and modifications. We show that the subcategory Fun_u(C,D) $\subset$ Fun(C,D) whose objects are unitary pseudofunctors and whose 1-morphisms are unitary pseudonatural transformations is a pivotal dagger 2-category. We apply these results to obtain a Morita-theoretical classification of unitary pseudonatural transformations between fibre functors on the category of representations of a compact quantum group.


title: Unitary transformations of fibre functors

abstract: We study unitary pseudonatural transformations (UPTs) between fibre functors Rep(G) -> Hilb, where G is a compact quantum group. For fibre functors F_1, F_2 we show that the category of UPTs F_1 -> F_2 and modifications is isomorphic to the category of finite-dimensional *-representations of the corresponding bi-Hopf-Galois object. We give a constructive classification of fibre functors accessible by a UPT from the canonical fibre functor, as well as UPTs themselves, in terms of Frobenius algebras in the category Rep(A_G), where A_G is the Hopf *-algebra dual to the compact quantum group. As an example, we show that finite-dimensional quantum isomorphisms from a quantum graph X are UPTs between fibre functors on Rep(G_X), where G_X is the quantum automorphism group of X.


title: Fitness Landscape Analysis of Dimensionally-Aware Genetic Programming Featuring Feynman Equations

abstract: Genetic programming is an often-used technique for symbolic regression: finding symbolic expressions that match data from an unknown function. To make the symbolic regression more efficient, one can also use dimensionally-aware genetic programming that constrains the physical units of the equation. Nevertheless, there is no formal analysis of how much dimensionality awareness helps in the regression process. In this paper, we conduct a fitness landscape analysis of dimensionallyaware genetic programming search spaces on a subset of equations from Richard Feynmans well-known lectures. We define an initialisation procedure and an accompanying set of neighbourhood operators for conducting the local search within the physical unit constraints. Our experiments show that the added information about the variable dimensionality can efficiently guide the search algorithm. Still, further analysis of the differences between the dimensionally-aware and standard genetic programming landscapes is needed to help in the design of efficient evolutionary operators to be used in a dimensionally-aware regression.


title: Three terminal vibron coupled hybrid quantum dot thermoelectric refrigeration

abstract: A three terminal nanoscale refrigeration concept based on a vibron-coupled quantum dot hybrid system coupled to two electronic reservoirs and a phonon bath is proposed and analyzed in detail. While investigating the non-trivial role of electron-phonon interactions, we show that, although they are well known to be detrimental from a general refrigeration perspective, can be engineered to favorably improve the trade-off between the cooling power (CP) and the coefficient-of-performance (COP). Furthermore, an additional improvement in the trade-off can be facilitated by applying a high electronic thermal bias. However, the allowed maximum of the thermal bias being strongly limited by the electron-phonon coupling, in turn, determines the lowest achievable temperature of the cooled body. It is further demonstrated that such interactions drive a phonon flow between the dot and bath whose direction and magnitude depend on the temperature difference between the dot and bath. To justify its impact in optimizing the peak CP and COP, we show that a weak coupling with the bath is preferable when the phonons relax through it and a strong coupling is suitable in the opposite case when the phonons are extracted from the bath. Finally, in studying the effect of asymmetry in electronic couplings, we show that a stronger coupling is favorable with the contact whose temperature is closer to that of the bath. Combining these aspects, we believe that this study could offer important guidelines for a possible realization of molecular and quantum dot thermoelectric refrigerator.


title: "Call me sexist, but...": Revisiting Sexism Detection Using Psychological Scales and Adversarial Samples

abstract: Research has focused on automated methods to effectively detect sexism online. Although overt sexism seems easy to spot, its subtle forms and manifold expressions are not. In this paper, we outline the different dimensions of sexism by grounding them in their implementation in psychological scales. From the scales, we derive a codebook for sexism in social media, which we use to annotate existing and novel datasets, surfacing their limitations in breadth and validity with respect to the construct of sexism. Next, we leverage the annotated datasets to generate adversarial examples, and test the reliability of sexism detection methods. Results indicate that current machine learning models pick up on a very narrow set of linguistic markers of sexism and do not generalize well to out-of-domain examples. Yet, including diverse data and adversarial examples at training time results in models that generalize better and that are more robust to artifacts of data collection. By providing a scale-based codebook and insights regarding the shortcomings of the state-of-the-art, we hope to contribute to the development of better and broader models for sexism detection, including reflections on theory-driven approaches to data collection.


title: ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational Humor

abstract: Automation of humor detection and rating has interesting use cases in modern technologies, such as humanoid robots, chatbots, and virtual assistants. In this paper, we propose a novel approach for detecting and rating humor in short texts based on a popular linguistic theory of humor. The proposed technical method initiates by separating sentences of the given text and utilizing the BERT model to generate embeddings for each one. The embeddings are fed to separate lines of hidden layers in a neural network (one line for each sentence) to extract latent features. At last, the parallel lines are concatenated to determine the congruity and other relationships between the sentences and predict the target value. We accompany the paper with a novel dataset for humor detection consisting of 200,000 formal short texts. In addition to evaluating our work on the novel dataset, we participated in a live machine learning competition focused on rating humor in Spanish tweets. The proposed model obtained F1 scores of 0.982 and 0.869 in the humor detection experiments which outperform general and state-of-the-art models. The evaluation performed on two contrasting settings confirm the strength and robustness of the model and suggests two important factors in achieving high accuracy in the current task: 1) usage of sentence embeddings and 2) utilizing the linguistic structure of humor in designing the proposed model.


title: Parametric unfolding. Method and restrictions

abstract: Parametric unfolding of a true distribution distorted due to finite resolution and limited efficiency for the registration of individual events is discussed. Details of the computational algorithm of the unfolding procedure are presented.

categories: physics.data-an astro-ph.IM hep-ex nucl-ex stat.AP


title: Evolutionary dynamics and eigenspectrum of confluent Heun equation

abstract: We consider a biological population evolving under the joint action of selection, mutation and random genetic drift. The evolutionary dynamics are described by a one-dimensional Fokker-Planck equation whose eigenfunctions obey a confluent Heun equation. These eigenfunctions are expanded in an infinite series of orthogonal Jacobi polynomials and the expansion coefficients are found to obey a three-term recursion equation. Using scaling ideas, we obtain an expression for the expansion coefficients and an analytical estimate of the number of terms required in the series for an accurate determination of the eigenfunction. The eigenvalue spectrum is studied using a perturbation theory for weak selection and numerically for strong selection. In the latter case, we find that the eigenvalue for the first excited state exhibits a sharp transition: for mutation rate below one, the eigenvalue increases linearly with increasing mutation rate and then remains a constant; higher eigenvalues are found to display a more complex behavior.


title: Data-Driven Model-Based Analysis of the Ethereum Verifier's Dilemma

abstract: In proof-of-work based blockchains such as Ethereum, verification of blocks is an integral part of establishing consensus across nodes. However, in Ethereum, miners do not receive a reward for verifying. This implies that miners face the Verifier's Dilemma: use resources for verification, or use them for the more lucrative mining of new blocks? We provide an extensive analysis of the Verifier's Dilemma, using a data-driven model-based approach that combines closed-form expressions, machine learning techniques and discrete-event simulation. We collect data from over 300,000 smart contracts and experimentally obtain their CPU execution times. Gaussian Mixture Models and Random Forest Regression transform the data into distributions and inputs suitable for the simulator. We show that, indeed, it is often economically rational not to verify. We consider two approaches to mitigate the implications of the Verifier's Dilemma, namely parallelization and active insertion of invalid blocks, both will be shown to be effective.


title: A Skip-connected Multi-column Network for Isolated Handwritten Bangla Character and Digit recognition

abstract: Finding local invariant patterns in handwrit-ten characters and/or digits for optical character recognition is a difficult task. Variations in writing styles from one person to another make this task challenging. We have proposed a non-explicit feature extraction method using a multi-scale multi-column skip convolutional neural network in this work. Local and global features extracted from different layers of the proposed architecture are combined to derive the final feature descriptor encoding a character or digit image. Our method is evaluated on four publicly available datasets of isolated handwritten Bangla characters and digits. Exhaustive comparative analysis against contemporary methods establishes the efficacy of our proposed approach.


title: Differentiable Adaptive Computation Time for Visual Reasoning

abstract: This paper presents a novel attention-based algorithm for achieving adaptive computation called DACT, which, unlike existing ones, is end-to-end differentiable. Our method can be used in conjunction with many networks; in particular, we study its application to the widely known MAC architecture, obtaining a significant reduction in the number of recurrent steps needed to achieve similar accuracies, therefore improving its performance to computation ratio. Furthermore, we show that by increasing the maximum number of steps used, we surpass the accuracy of even our best non-adaptive MAC in the CLEVR dataset, demonstrating that our approach is able to control the number of steps without significant loss of performance. Additional advantages provided by our approach include considerably improving interpretability by discarding useless steps and providing more insights into the underlying reasoning process. Finally, we present adaptive computation as an equivalent to an ensemble of models, similar to a mixture of expert formulation. Both the code and the configuration files for our experiments are made available to support further research in this area.


title: Adversarial Fooling Beyond "Flipping the Label"

abstract: Recent advancements in CNNs have shown remarkable achievements in various CV/AI applications. Though CNNs show near human or better than human performance in many critical tasks, they are quite vulnerable to adversarial attacks. These attacks are potentially dangerous in real-life deployments. Though there have been many adversarial attacks proposed in recent years, there is no proper way of quantifying the effectiveness of these attacks. As of today, mere fooling rate is used for measuring the susceptibility of the models, or the effectiveness of adversarial attacks. Fooling rate just considers label flipping and does not consider the cost of such flipping, for instance, in some deployments, flipping between two species of dogs may not be as severe as confusing a dog category with that of a vehicle. Therefore, the metric to quantify the vulnerability of the models should capture the severity of the flipping as well. In this work we first bring out the drawbacks of the existing evaluation and propose novel metrics to capture various aspects of the fooling. Further, for the first time, we present a comprehensive analysis of several important adversarial attacks over a set of distinct CNN architectures. We believe that the presented analysis brings valuable insights about the current adversarial attacks and the CNN models.


title: On the Emergence of a Power Law in the Distribution of COVID-19 Cases

abstract: The first confirmed case of Coronavirus Disease 2019 (COVID-19) in the US was reported on January 21, 2020. By the end of March, 2020, there were more than 180000 confirmed cases in the US, distributed across more than 2000 counties. We find that the right tail of this distribution exhibits a power law, with Pareto exponent close to one. We investigate whether a simple model of the growth of COVID-19 cases involving Gibrat's law can explain the emergence of this power law. The model is calibrated to match (i) the growth rates of confirmed cases, and (ii) the varying lengths of time during which COVID-19 had been present within each county. Thus calibrated, the model generates a power law with Pareto exponent nearly exactly equal to the exponent estimated directly from the distribution of confirmed cases across counties at the end of March.