title: Haptic Rendering of Cultural Heritage Objects at Different Scales

abstract: In this work, we address the issue of a virtual representation of objects of cultural heritage for haptic interaction. Our main focus is to provide haptic access to artistic objects of any physical scale to the differently-abled people. This is a low-cost system and, in conjunction with a stereoscopic visual display, gives a better immersive experience even to the sighted persons. To achieve this, we propose a simple multilevel, proxy-based hapto-visual rendering technique for point cloud data, which includes the much-desired scalability feature which enables the users to change the scale of the objects adaptively during the haptic interaction. For the proposed haptic rendering technique, the proxy updation loop runs at a rate 100 times faster than the required haptic updation frequency of 1KHz. We observe that this functionality augments very well with the realism of the experience.


title: Modeling and Prediction of Rigid Body Motion with Planar Non-Convex Contact

abstract: We present a principled method for motion prediction via dynamic simulation for rigid bodies in intermittent contact with each other where the contact region is a planar non-convex contact patch. Such methods are useful in planning and control for robotic manipulation. The planar non-convex contact patch can either be a topologically connected set or disconnected set. Most work in rigid body dynamic simulation assume that the contact between objects is a point contact, which may not be valid in many applications. In this paper, by using the convex hull of the contact patch, we build on our recent work on simulating rigid bodies with convex contact patches for simulating motion of objects with planar non-convex contact patches. We formulate a discrete-time mixed complementarity problem where we solve the contact detection and integration of the equations of motion simultaneously. We solve for the equivalent contact point (ECP) and contact impulse of each contact patch simultaneously along with the state, i.e., configuration and velocity of the objects. We prove that although we are representing a patch contact by an equivalent point, our model for enforcing non-penetration constraints ensure that there is no artificial penetration between the contacting rigid bodies. We provide empirical evidence to show that our method can seamlessly capture transition among different contact modes like patch contact, multiple or single point contact.


title: Additive Tree-Structured Conditional Parameter Spaces in Bayesian Optimization: A Novel Covariance Function and a Fast Implementation

abstract: Bayesian optimization (BO) is a sample-efficient global optimization algorithm for black-box functions which are expensive to evaluate. Existing literature on model based optimization in conditional parameter spaces are usually built on trees. In this work, we generalize the additive assumption to tree-structured functions and propose an additive tree-structured covariance function, showing improved sample-efficiency, wider applicability and greater flexibility. Furthermore, by incorporating the structure information of parameter spaces and the additive assumption in the BO loop, we develop a parallel algorithm to optimize the acquisition function and this optimization can be performed in a low dimensional space. We demonstrate our method on an optimization benchmark function, on a neural network compression problem, on pruning pre-trained VGG16 and ResNet50 models as well as on searching activation functions of ResNet20. Experimental results show our approach significantly outperforms the current state of the art for conditional parameter optimization including SMAC, TPE and Jenatton et al. (2017).


title: Improving Sequential Latent Variable Models with Autoregressive Flows

abstract: We propose an approach for improving sequence modeling based on autoregressive normalizing flows. Each autoregressive transform, acting across time, serves as a moving frame of reference, removing temporal correlations, and simplifying the modeling of higher-level dynamics. This technique provides a simple, general-purpose method for improving sequence modeling, with connections to existing and classical techniques. We demonstrate the proposed approach both with standalone flow-based models and as a component within sequential latent variable models. Results are presented on three benchmark video datasets, where autoregressive flow-based dynamics improve log-likelihood performance over baseline models. Finally, we illustrate the decorrelation and improved generalization properties of using flow-based dynamics.


title: A Study on Trees's Knots Prediction from their Bark Outer-Shape

abstract: In the industry, the value of wood-logs strongly depends on their internal structure and more specifically on the knots' distribution inside the trees. As of today, CT-scanners are the prevalent tool to acquire accurate images of the trees internal structure. However, CT-scanners are expensive, and slow, making their use impractical for most industrial applications. Knowing where the knots are within a tree could improve the efficiency of the overall tree industry by reducing waste and improving the quality of wood-logs by-products. In this paper we evaluate different deep-learning based architectures to predict the internal knots distribution of a tree from its outer-shape, something that has never been done before. Three types of techniques based on Convolutional Neural Networks (CNN) will be studied. The architectures are tested on both real and synthetic CT-scanned trees. With these experiments, we demonstrate that CNNs can be used to predict internal knots distribution based on the external surface of the trees. The goal being to show that these inexpensive and fast methods could be used to replace the CT-scanners. Additionally, we look into the performance of several off-the-shelf object-detectors to detect knots inside CT-scanned images. This method is used to autonomously label part of our real CT-scanned trees alleviating the need to manually segment the whole of the images.


title: Dynamic Simulation-Guided Design of Tumbling Magnetic Microrobots

abstract: Design of robots at the small scale is a trial-and-error based process, which is costly and time-consuming. There are few dynamic simulation tools available to accurately predict the motion or performance of untethered microrobots as they move over a substrate. At smaller length scales, the influence of adhesion and friction, which scales with surface area, becomes more pronounced. Thus, rigid body dynamic simulators, which implicitly assume that contact between two bodies can be modeled as point contact are not suitable. In this paper, we present techniques for simulating the motion of microrobots where there can be intermittent and non-point contact between the robot and the substrate. We use these techniques to study the motion of tumbling microrobots of different shapes and select shapes that are optimal for improving locomotion performance. Simulation results are verified using experimental data on linear velocity, maximum climbable incline angle, and microrobot trajectory. Microrobots with improved geometry were fabricated, but limitations in the fabrication process resulted in unexpected manufacturing errors and material/size scale adjustments. The developed simulation model is able to incorporate these limitations and emulate their effect on the microrobot's motion, reproducing the experimental behavior of the tumbling microrobots, further showcasing the effectiveness of having such a dynamic model.


title: Laboratory application of sampling approaches to inverse scattering

abstract: This study presents an experimental investigation of the recently established generalized linear sampling method (GLSM) for non-destructive evaluation of damage in elastic materials. To this end, ultrasonic shear waves are generated in a prismatic slab of charcoal granite featuring a discontinuity interface induced by the three-point bending (3PB). The interaction of probing waves with the 3PB-induced damage gives rise to transient velocity responses measured on the sample's boundary by a 3D scanning laser Doppler vibrometer. Thus obtained waveform data are then carefully processed to retrieve the associated spectra of scattered displacement fields. On deploying multifrequency sensory data, the GLSM indicators are computed and their counterparts associated with the classical linear sampling method (LSM) for comparative analysis. Verified with in-situ observations, the GLSM map successfully exposes the support of hidden scatterers in the specimen with a remarkable clarity and resolution compared to its predecessor LSM. It is further shown that the GLSM remains robust for sparse and partial-aperture data inversion, thanks to its rigorous formulation. For completeness, the one-sided reconstruction by both indicators is investigated.


title: Ring isomorphisms of $\ast$-subalgebras of Murray-von Neumann factors

abstract: The present paper is devoted to study of ring isomorphisms of $\ast$-subalgebras of Murray--von Neumann factors. Let $\cM,$ $\cN$ be von Neumann factors of type II$_1,$ and let $S(\cM),$ $S(\cN)$ be the $\ast$-algebras of all measurable operators affiliated with $\cM$ and $ \cN,$ respectively. Suppose that $\cA\subset S(\cM),$ $\cB\subset S(\cN)$ are their $\ast$-subalgebras such that $\cM\subset \cA,$ $\cN\subset \cB.$ We prove that for every ring isomorphism $\Phi: \cA \to \cB$ there exist a positive invertible element $a \in \cB$ with $a^{-1}\in \cB$ and a real $\ast$-isomorphism $\Psi: \cM \to \cN$ (which extends to a real $\ast$-isomorphism from $\cA$ onto $\cB$) such that $\Phi(x) = a\Psi(x)a^{-1}$ for all $x \in \cA.$ In particular, $\Phi$ is real-linear and continuous in the measure topology. In particular, noncommutative Arens algebras and noncommutative $\cL_{log}$-algebras associated with von Neumann factors of type II$_1$ satisfy the above conditions and the main Theorem implies the automatic continuity of their ring isomorphisms in the corresponding metrics. We also present an example of a $\ast$-subalgebra in $S(\cM),$ which shows that the condition $\cM\subset \cA$ is essential in the above mentioned result.


title: Long-range order in discrete spin systems

abstract: We establish long-range order for discrete nearest-neighbor spin systems on $\mathbb{Z}^d$ satisfying a certain symmetry assumption, when the dimension $d$ is higher than an explicitly described threshold. The results characterize all periodic, maximal-pressure Gibbs states of the system. The results further apply in low dimensions provided that the lattice $\mathbb{Z}^d$ is replaced by $\mathbb{Z}^{d_1}\times\mathbb{T}^{d_2}$ with $d_1\ge 2$ and $d=d_1+d_2$ sufficiently high, where $\mathbb{T}$ is a cycle of even length. Applications to specific systems are discussed in detail and models for which new results are provided include the antiferromagnetic Potts model, Lipschitz height functions, and the hard-core, Widom--Rowlinson and beach models and their multi-type extensions. We also establish a formula conjectured by Jenssen and Keevash for the topological pressure in the high-dimensional limit.


title: Basic properties of an alternative flow equation in gravity theories

abstract: Basic properties of alternative flow equation in Quantum Gravity are studied. It is shown that the alternative flow equation for effective two-particle irreducible effective action is gauge independent and does not depend on IR parameter $k$ on shell.


title: Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages

abstract: Multilingual transformer models like mBERT and XLM-RoBERTa have obtained great improvements for many NLP tasks on a variety of languages. However, recent works also showed that results from high-resource languages could not be easily transferred to realistic, low-resource scenarios. In this work, we study trends in performance for different amounts of available resources for the three African languages Hausa, isiXhosa and Yor\`ub\'a on both NER and topic classification. We show that in combination with transfer learning or distant supervision, these models can achieve with as little as 10 or 100 labeled sentences the same performance as baselines with much more supervised training data. However, we also find settings where this does not hold. Our discussions and additional experiments on assumptions such as time and hardware restrictions highlight challenges and opportunities in low-resource learning.


title: Not All Datasets Are Born Equal: On Heterogeneous Data and Adversarial Examples

abstract: Recent work on adversarial learning has focused mainly on neural networks and domains where those networks excel, such as computer vision, or audio processing. The data in these domains is typically homogeneous, whereas heterogeneous tabular datasets domains remain underexplored despite their prevalence. When searching for adversarial patterns within heterogeneous input spaces, an attacker must simultaneously preserve the complex domain-specific validity rules of the data, as well as the adversarial nature of the identified samples. As such, applying adversarial manipulations to heterogeneous datasets has proved to be a challenging task, and no generic attack method was suggested thus far. We, however, argue that machine learning models trained on heterogeneous tabular data are as susceptible to adversarial manipulations as those trained on continuous or homogeneous data such as images. To support our claim, we introduce a generic optimization framework for identifying adversarial perturbations in heterogeneous input spaces. We define distribution-aware constraints for preserving the consistency of the adversarial examples and incorporate them by embedding the heterogeneous input into a continuous latent space. Due to the nature of the underlying datasets We focus on $\ell_0$ perturbations, and demonstrate their applicability in real life. We demonstrate the effectiveness of our approach using three datasets from different content domains. Our results demonstrate that despite the constraints imposed on input validity in heterogeneous datasets, machine learning models trained using such data are still equally susceptible to adversarial examples.


title: Isomorphic inverse problems

abstract: Consider two inverse problems for Sturm-Liouville problems on the unit interval. It means that there are two corresponding mappings $F, f$ from a Hilbert space of potentials $H$ into their spectral data. They are called isomorphic if $F$ is a composition of $f$ and some isomorphism $U$ of $H$ onto itself. A isomorphic class is a collection of inverse problems isomorphic to each other. We consider basic Sturm-Liouville problems on the unit interval and on the circle and describe their isomorphic classes of inverse problems. For example, we prove that the inverse problems for the case of Dirichlet and Neumann boundary conditions are isomorphic. The proof is based on the non-linear analysis.


title: VICTR: Visual Information Captured Text Representation for Text-to-Image Multimodal Tasks

abstract: Text-to-image multimodal tasks, generating/retrieving an image from a given text description, are extremely challenging tasks since raw text descriptions cover quite limited information in order to fully describe visually realistic images. We propose a new visual contextual text representation for text-to-image multimodal tasks, VICTR, which captures rich visual semantic information of objects from the text input. First, we use the text description as initial input and conduct dependency parsing to extract the syntactic structure and analyse the semantic aspect, including object quantities, to extract the scene graph. Then, we train the extracted objects, attributes, and relations in the scene graph and the corresponding geometric relation information using Graph Convolutional Networks, and it generates text representation which integrates textual and visual semantic information. The text representation is aggregated with word-level and sentence-level embedding to generate both visual contextual word and sentence representation. For the evaluation, we attached VICTR to the state-of-the-art models in text-to-image generation.VICTR is easily added to existing models and improves across both quantitative and qualitative aspects.


title: Network-aware Recommendations in the Wild: Methodology, Realistic Evaluations, Experiments

abstract: Joint caching and recommendation has been recently proposed as a new paradigm for increasing the efficiency of mobile edge caching. Early findings demonstrate significant gains for the network performance. However, previous works evaluated the proposed schemes exclusively on simulation environments. Hence, it still remains uncertain whether the claimed benefits would change in real settings. In this paper, we propose a methodology that enables to evaluate joint network and recommendation schemes in real content services by only using publicly available information. We apply our methodology to the YouTube service, and conduct extensive measurements to investigate the potential performance gains. Our results show that significant gains can be achieved in practice; e.g., 8 to 10 times increase in the cache hit ratio from cache-aware recommendations. Finally, we build an experimental testbed and conduct experiments with real users; we make available our code and datasets to facilitate further research. To our best knowledge, this is the first realistic evaluation (over a real service, with real measurements and user experiments) of the joint caching and recommendations paradigm. Our findings provide experimental evidence for the feasibility and benefits of this paradigm, validate assumptions of previous works, and provide insights that can drive future research.


title: The construction and weight distributions of all projective binary linear codes

abstract: Boolean functions can be used to construct binary linear codes in many ways, and vice versa. The objective of this short article is to point out a connection between the weight distributions of all projective binary linear codes and the Walsh spectra of all Boolean functions. New research problems are also proposed.


title: QCTL model-checking with QBF solvers

abstract: Quantified CTL (QCTL) extends the temporal logic CTL with quantifications over atomic propositions. This extension is known to be very expressive: QCTL allows us to express complex properties over Kripke structures (it is as expressive as MSO). Several semantics exist for the quantifications: here, we work with the structure semantics, where the extra propositions label the Kripke structure (and not its execution tree), and the model-checking problem is known to be PSPACE-complete in this framework. We propose a new model-checking algorithm for QCTL based on a reduction to QBF. We consider several reduction strategies and we compare them with a prototype (based on several QBF solvers) on different examples.


title: An unconditional proof of the abelian equivariant Iwasawa main conjecture and applications

abstract: Let $p$ be an odd prime. We give an unconditional proof of the equivariant Iwasawa main conjecture for totally real fields for every admissible one-dimensional $p$-adic Lie extension whose Galois group has an abelian Sylow $p$-subgroup. Crucially, this result does not depend on the vanishing of any $\mu$-invariant. As applications, we deduce the Coates-Sinnott conjecture away from its $2$-primary part and new cases of the equivariant Tamagawa number conjecture for Tate motives.


title: Absence of percolation in graphs based on stationary point processes with degrees bounded by two

abstract: We consider undirected graphs that arise as deterministic functions of stationary point processes such that each point has degree bounded by two. For a large class of point processes and edge-drawing rules, we show that the arising graph has no infinite connected component, almost surely. In particular, this extends our previous result for SINR graphs based on stabilizing Cox point processes and verifies the conjecture of Balister and Bollob\'as that the bidirectional $k$-nearest neighbor graph of a two-dimensional homogeneous Poisson point process does not percolate for $k=2$.


title: Thermal effects on helium scattering from LiF(001) at grazing incidence

abstract: Grazing-incidence fast atom diffraction (GIFAD) is an exceptionally sensitive method for surface analysis, which can be applied not only at room temperature but also at higher temperatures. In this work we use the He-LiF(001) system as benchmark to study the influence of temperature on GIFAD patterns from insulator surfaces. Our theoretical description is based on the Phonon-Surface Initial Value Representation (P0-SIVR) approximation, which is a semiquantum approach that includes the phonon contribution to the elastic scattering. Within the P0-SIVR approach the main features introduced by thermal lattice vibrations on the angular distributions of scattered projectiles are investigated as a function of the crystal temperature. We found that azimuthal and polar spectra are strongly affected by thermal fluctuations, which modify the relative intensities and the polar spread of the interference structures. These findings are relevant for the use of GIFAD in surface research. Moreover, the present results are contrasted with available experimental data at room temperature.


title: Theedhum Nandrum@Dravidian-CodeMix-FIRE2020: A Sentiment Polarity Classifier for YouTube Comments with Code-switching between Tamil, Malayalam and English

abstract: Theedhum Nandrum is a sentiment polarity detection system using two approaches--a Stochastic Gradient Descent (SGD) based classifier and a Long Short-term Memory (LSTM) based Classifier. Our approach utilises language features like use of emoji, choice of scripts and code mixing which appeared quite marked in the datasets specified for the Dravidian Codemix - FIRE 2020 task. The hyperparameters for the SGD were tuned using GridSearchCV. Our system was ranked 4th in Tamil-English with a weighted average F1 score of 0.62 and 9th in Malayalam-English with a score of 0.65. We achieved a weighted average F1 score of 0.77 for Tamil-English using a Logistic Regression based model after the task deadline. This performance betters the top ranked classifier on this dataset by a wide margin. Our use of language-specific Soundex to harmonise the spelling variants in code-mixed data appears to be a novel application of Soundex. Our complete code is published in github at https://github.com/oligoglot/theedhum-nandrum.


title: Generative Melody Composition with Human-in-the-Loop Bayesian Optimization

abstract: Deep generative models allow even novice composers to generate various melodies by sampling latent vectors. However, finding the desired melody is challenging since the latent space is unintuitive and high-dimensional. In this work, we present an interactive system that supports generative melody composition with human-in-the-loop Bayesian optimization (BO). This system takes a mixed-initiative approach; the system generates candidate melodies to evaluate, and the user evaluates them and provides preferential feedback (i.e., picking the best melody among the candidates) to the system. This process is iteratively performed based on BO techniques until the user finds the desired melody. We conducted a pilot study using our prototype system, suggesting the potential of this approach.


title: Stochastic stem cell models with mutation: A comparison of asymmetric and symmetric divisions

abstract: In order to fulfill cell proliferation and differentiation through cellular hierarchy, stem cells can undergo either asymmetric or symmetric divisions. Recent studies pay special attention to the effect of different modes of stem cell division on the lifetime risk of cancer, and report that symmetric division is more beneficial to delay the onset of cancer. The fate uncertainty of symmetric division is considered to be the reason for the cancer-delaying effect. In this paper we compare asymmetric and symmetric divisions of stem cells via studying stochastic stem cell models with mutations. Specially, by using rigorous mathematical analysis we find that both asymmetric and symmetric models show the same statistical average, but symmetric model shows higher fluctuation than asymmetric model. We further show that the difference between the two models would be more remarkable for lower mutation rates. Our work quantifies the uncertainty of cell division and highlights the significance of stochasticity for distinguishing between different modes of stem cell division.


title: Transformer Transducer: One Model Unifying Streaming and Non-streaming Speech Recognition

abstract: In this paper we present a Transformer-Transducer model architecture and a training technique to unify streaming and non-streaming speech recognition models into one model. The model is composed of a stack of transformer layers for audio encoding with no lookahead or right context and an additional stack of transformer layers on top trained with variable right context. In inference time, the context length for the variable context layers can be changed to trade off the latency and the accuracy of the model. We also show that we can run this model in a Y-model architecture with the top layers running in parallel in low latency and high latency modes. This allows us to have streaming speech recognition results with limited latency and delayed speech recognition results with large improvements in accuracy (20% relative improvement for voice-search task). We show that with limited right context (1-2 seconds of audio) and small additional latency (50-100 milliseconds) at the end of decoding, we can achieve similar accuracy with models using unlimited audio right context. We also present optimizations for audio and label encoders to speed up the inference in streaming and non-streaming speech decoding.


title: Rank and run-time aware compression of NLP Applications

abstract: Sequence model based NLP applications can be large. Yet, many applications that benefit from them run on small devices with very limited compute and storage capabilities, while still having run-time constraints. As a result, there is a need for a compression technique that can achieve significant compression without negatively impacting inference run-time and task accuracy. This paper proposes a new compression technique called Hybrid Matrix Factorization that achieves this dual objective. HMF improves low-rank matrix factorization (LMF) techniques by doubling the rank of the matrix using an intelligent hybrid-structure leading to better accuracy than LMF. Further, by preserving dense matrices, it leads to faster inference run-time than pruning or structure matrix based compression technique. We evaluate the impact of this technique on 5 NLP benchmarks across multiple tasks (Translation, Intent Detection, Language Modeling) and show that for similar accuracy values and compression factors, HMF can achieve more than 2.32x faster inference run-time than pruning and 16.77% better accuracy than LMF.


title: First-Order Algorithms Without Lipschitz Gradient: A Sequential Local Optimization Approach

abstract: First-order algorithms have been popular for solving convex and non-convex optimization problems. A key assumption for the majority of these algorithms is that the gradient of the objective function is globally Lipschitz continuous, but many contemporary problems such as tensor decomposition fail to satisfy such an assumption. This paper develops a sequential local optimization (SLO) framework of first-order algorithms that can effectively optimize problems without Lipschitz gradient. Operating on the assumption that the gradients are {\it locally} Lipschitz continuous over any compact set, the proposed framework carefully restricts the distance between two successive iterates. We show that the proposed framework can easily adapt to existing first-order methods such as gradient descent (GD), normalized gradient descent (NGD), accelerated gradient descent (AGD), as well as GD with Armijo line search. Remarkably, the latter algorithm is totally parameter-free and do not even require the knowledge of local Lipschitz constants. We show that for the proposed algorithms to achieve gradient error bound of $\|\nabla f(x)\|^2\le \epsilon$, it requires at most $\mathcal{O}(\frac{1}{\epsilon}\times \mathcal{L}(Y))$ total access to the gradient oracle, where $\mathcal{L}(Y)$ characterizes how the local Lipschitz constants grow with the size of a given set $Y$. Moreover, we show that the variant of AGD improves the dependency on both $\epsilon$ and the growth function $\mathcal{L}(Y)$. The proposed algorithms complement the existing Bregman Proximal Gradient (BPG) algorithm, because they do not require the global information about problem structure to construct and solve Bregman proximal mappings.


title: Optical quantum communication complexity in the simultaneous message passing model

abstract: The communication cost of a classical protocol is typically measured in terms of the number of bits communicated for this determines the time required for communication during the protocol. Similarly, for quantum communication protocols, which use finite-dimensional quantum states, the communication cost is measured in terms of the number of qubits communicated. However, in quantum physics, one can also use infinite-dimensional states, like optical quantum states, for communication protocols. Communication cost measures based on counting the (equivalent) number of qubits transmitted during communication cannot be directly used to measure the cost of such protocols, which use infinite-dimensional states. Moreover, one cannot infer any physical property of infinite-dimensional protocols using such qubit based communication costs. In this paper, we provide a framework to understand the growth of physical resources in infinite-dimensional protocols. We focus on optical protocols for the sake of concreteness. The time required for communication and the energy expended during communication are identified as the important physical resources of such protocols. In an optical protocol, the time required for communication is determined by the number of time-bin modes that are transmitted from one party to another. The mean photon number of the messages sent determines the energy required during communication in the protocol. We prove a lower bound on the tradeoff between the growth of these two quantities with the growth of the problem size. We call such tradeoff relations optical quantum communication complexity relations.


title: Visual Object Recognition in Indoor Environments Using Topologically Persistent Features

abstract: Object recognition in unseen indoor environments remains a challenging problem for visual perception of mobile robots. In this letter, we propose the use of topologically persistent features, which rely on the objects' shape information, to address this challenge. In particular, we extract two kinds of features, namely, sparse persistence image (PI) and amplitude, by applying persistent homology to multi-directional height function-based filtrations of the cubical complexes representing the object segmentation maps. The features are then used to train a fully connected network for recognition. For performance evaluation, in addition to a widely used shape dataset and a benchmark indoor scenes dataset, we collect a new dataset, comprising scene images from two different environments, namely, a living room and a mock warehouse. The scenes are captured using varying camera poses under different illumination conditions and include up to five different objects from a given set of fourteen objects. On the benchmark indoor scenes dataset, sparse PI features show better recognition performance in unseen environments than the features learned using the widely used ResNetV2-56 and EfficientNet-B4 models. Further, they provide slightly higher recall and accuracy values than Faster R-CNN, an end-to-end object detection method, and its state-of-the-art variant, Domain Adaptive Faster R-CNN. The performance of our methods also remains relatively unchanged from the training environment (living room) to the unseen environment (mock warehouse) in the new dataset. In contrast, the performance of the object detection methods drops substantially. We also implement the proposed method on a real-world robot to demonstrate its usefulness.


title: Invariance property in inhomogeneous scattering media with refractive-index mismatch

abstract: The mean path length invariance property is a very important property of scattering media illuminated by an isotropic and homogeneous radiation. Here we investigate the case of inhomogeneous media with refractive index mismatch between the external environment and also among their subdomains. The invariance property remains valid by the introduction of a correction, dependent on the refractive index, of the mean path length value. It is a consequence of the stationary solution of the radiative transfer equation in a medium subjected to an isotropic and homogeneous radiance. The theoretical results are in agreement with the reported results for numerical simulations for both the three-dimensional and the two-dimensional media.


title: Perfect state transfer in NEPS of complete graphs

abstract: Perfect state transfer in graphs is a concept arising from quantum physics and quantum computing. Given a graph $G$ with adjacency matrix $A_G$, the transition matrix of $G$ with respect to $A_G$ is defined as $H_{A_{G}}(t) = \exp(-\mathrm{i}tA_{G})$, $t \in \mathbb{R},\ \mathrm{i}=\sqrt{-1}$. We say that perfect state transfer from vertex $u$ to vertex $v$ occurs in $G$ at time $\tau$ if $u \ne v$ and the modulus of the $(u,v)$-entry of $H_{A_G}(\tau)$ is equal to $1$. If the moduli of all diagonal entries of $H_{A_G}(\tau)$ are equal to $1$ for some $\tau$, then $G$ is called periodic with period $\tau$. In this paper we give a few sufficient conditions for NEPS of complete graphs to be periodic or exhibit perfect state transfer.


title: WDN: A Wide and Deep Network to Divide-and-Conquer Image Super-resolution

abstract: Divide and conquer is an established algorithm design paradigm that has proven itself to solve a variety of problems efficiently. However, it is yet to be fully explored in solving problems with a neural network, particularly the problem of image super-resolution. In this work, we propose an approach to divide the problem of image super-resolution into multiple sub-problems and then solve/conquer them with the help of a neural network. Unlike a typical deep neural network, we design an alternate network architecture that is much wider (along with being deeper) than existing networks and is specially designed to implement the divide-and-conquer design paradigm with a neural network. Additionally, a technique to calibrate the intensities of feature map pixels is being introduced. Extensive experimentation on five datasets reveals that our approach towards the problem and the proposed architecture generate better and sharper results than current state-of-the-art methods.


title: Catastrophic phase inversion in high-Reynolds number turbulent Taylor--Couette flow

abstract: Emulsions are omnipresent in the food industry, health care, and chemical synthesis. In this Letter the dynamics of meta-stable oil-water emulsions in highly turbulent ($10^{11}\leq\text{Ta}\leq 3\times 10^{13}$) Taylor--Couette flow, far from equilibrium, is investigated. By varying the oil-in-water void fraction, catastrophic phase inversion between oil-in-water and water-in-oil emulsions can be triggered, changing the morphology, including droplet sizes, and rheological properties of the mixture, dramatically. The manifestation of these different states is exemplified by combining global torque measurements and local in-situ laser induced fluorescence (LIF) microscopy imaging. Despite the turbulent state of the flow and the dynamic equilibrium of the oil-water mixture, the global torque response of the system is found to be as if the fluid were Newtonian, and the effective viscosity of the mixture was found to be several times bigger or smaller than either of its constituents.


title: M3Lung-Sys: A Deep Learning System for Multi-Class Lung Pneumonia Screening from CT Imaging

abstract: To counter the outbreak of COVID-19, the accurate diagnosis of suspected cases plays a crucial role in timely quarantine, medical treatment, and preventing the spread of the pandemic. Considering the limited training cases and resources (e.g, time and budget), we propose a Multi-task Multi-slice Deep Learning System (M3Lung-Sys) for multi-class lung pneumonia screening from CT imaging, which only consists of two 2D CNN networks, i.e., slice- and patient-level classification networks. The former aims to seek the feature representations from abundant CT slices instead of limited CT volumes, and for the overall pneumonia screening, the latter one could recover the temporal information by feature refinement and aggregation between different slices. In addition to distinguish COVID-19 from Healthy, H1N1, and CAP cases, our M 3 Lung-Sys also be able to locate the areas of relevant lesions, without any pixel-level annotation. To further demonstrate the effectiveness of our model, we conduct extensive experiments on a chest CT imaging dataset with a total of 734 patients (251 healthy people, 245 COVID-19 patients, 105 H1N1 patients, and 133 CAP patients). The quantitative results with plenty of metrics indicate the superiority of our proposed model on both slice- and patient-level classification tasks. More importantly, the generated lesion location maps make our system interpretable and more valuable to clinicians.


title: Amount algebras

abstract: In this paper, as a generalization to content algebras, we introduce amount algebras. Similar to the Anderson-Badawi $\omega_{R[X]}(I[X])=\omega_R(I)$ conjecture, we prove that under some conditions, the formula $\omega_B(I^{\epsilon})=\omega_R(I)$ holds for some amount $R$-algebras $B$ and some ideals $I$ of $R$, where $\omega_R(I)$ is the smallest positive integer $n$ that the ideal $I$ of $R$ is $n$-absorbing. A corollary to the mentioned formula is that if, for example, $R$ is a Pr\"{u}fer domain or a torsion-free valuation ring and $I$ is a radical ideal of $R$, then $\omega_{R[][X]]}(I[[X]])=\omega_R(I)$.


title: RealSmileNet: A Deep End-To-End Network for Spontaneous and Posed Smile Recognition

abstract: Smiles play a vital role in the understanding of social interactions within different communities, and reveal the physical state of mind of people in both real and deceptive ways. Several methods have been proposed to recognize spontaneous and posed smiles. All follow a feature-engineering based pipeline requiring costly pre-processing steps such as manual annotation of face landmarks, tracking, segmentation of smile phases, and hand-crafted features. The resulting computation is expensive, and strongly dependent on pre-processing steps. We investigate an end-to-end deep learning model to address these problems, the first end-to-end model for spontaneous and posed smile recognition. Our fully automated model is fast and learns the feature extraction processes by training a series of convolution and ConvLSTM layer from scratch. Our experiments on four datasets demonstrate the robustness and generalization of the proposed model by achieving state-of-the-art performances.


title: Cardiac Arrhythmia Detection from ECG with Convolutional Recurrent Neural Networks

abstract: Except for a few specific types, cardiac arrhythmias are not immediately life-threatening. However, if not treated appropriately, they can cause serious complications. In particular, atrial fibrillation, which is characterized by fast and irregular heart beats, increases the risk of stroke. We propose three neural network architectures to detect abnormal rhythms from single-lead ECG signals. These architectures combine convolutional layers to extract high-level features pertinent for arrhythmia detection from sliding windows and recurrent layers to aggregate these features over signals of varying durations. We applied the neural networks to the dataset used for the challenge of Computing in Cardiology 2017 and a dataset built by joining three databases available on PhysioNet. Our architectures achieved an accuracy of 86.23% on the first dataset, similar to the winning entries of the challenge, and an accuracy of 92.02% on the second dataset.


title: Like hiking? You probably enjoy nature: Persona-grounded Dialog with Commonsense Expansions

abstract: Existing persona-grounded dialog models often fail to capture simple implications of given persona descriptions, something which humans are able to do seamlessly. For example, state-of-the-art models cannot infer that interest in hiking might imply love for nature or longing for a break. In this paper, we propose to expand available persona sentences using existing commonsense knowledge bases and paraphrasing resources to imbue dialog models with access to an expanded and richer set of persona descriptions. Additionally, we introduce fine-grained grounding on personas by encouraging the model to make a discrete choice among persona sentences while synthesizing a dialog response. Since such a choice is not observed in the data, we model it using a discrete latent random variable and use variational learning to sample from hundreds of persona expansions. Our model outperforms competitive baselines on the PersonaChat dataset in terms of dialog quality and diversity while achieving persona-consistent and controllable dialog generation.


title: Physical System for Non Time Sequence Data

abstract: We propose a novelty approach to connect machine learning to causal structure learning by jacobian matrix of neural network w.r.t. input variables. In this paper, we extend the jacobian-based approach to physical system which is the method human explore and reason the world and it is the highest level of causality. By functions fitting with Neural ODE, we can read out causal structure from functions. This method also enforces a important acylicity constraint on continuous adjacency matrix of graph nodes and significantly reduce the computational complexity of search space of graph.


title: Deep learning models for predictive maintenance: a survey, comparison, challenges and prospect

abstract: Given the growing amount of industrial data spaces worldwide, deep learning solutions have become popular for predictive maintenance, which monitor assets to optimise maintenance tasks. Choosing the most suitable architecture for each use-case is complex given the number of examples found in literature. This work aims at facilitating this task by reviewing state-of-the-art deep learning architectures, and how they integrate with predictive maintenance stages to meet industrial companies' requirements (i.e. anomaly detection, root cause analysis, remaining useful life estimation). They are categorised and compared in industrial applications, explaining how to fill their gaps. Finally, open challenges and future research paths are presented.


title: C-Minimal topological groups

abstract: We study topological groups having all closed subgroups (totally) minimal and we call such groups c-(totally) minimal. We show that a locally compact c-minimal connected group is compact. Using a well-known theorem of Hall and Kulatilaka and a characterization of a certain class of Lie groups, due to Grosser and Herfort, we prove that a c-minimal locally solvable Lie group is compact. It is shown that if a topological group $G$ contains a compact open normal subgroup $N$, then $G$ is c-totally minimal if and only if $G/N$ is hereditarily non-topologizable. Moreover, a c-totally minimal group that is either complete solvable or strongly compactly covered must be compact. Negatively answering a question by Dikranjan and Megrelishvili we find, in contrast, a totally minimal solvable (even metabelian) Lie group that is not compact. We also prove that the group $A\times F$ is c-(totally) minimal for every (respectively, totally) minimal abelian group $A$ and every finite group $F.$


title: Learning Arbitrary-Goal Fabric Folding with One Hour of Real Robot Experience

abstract: Manipulating deformable objects, such as fabric, is a long standing problem in robotics, with state estimation and control posing a significant challenge for traditional methods. In this paper, we show that it is possible to learn fabric folding skills in only an hour of self-supervised real robot experience, without human supervision or simulation. Our approach relies on fully convolutional networks and the manipulation of visual inputs to exploit learned features, allowing us to create an expressive goal-conditioned pick and place policy that can be trained efficiently with real world robot data only. Folding skills are learned with only a sparse reward function and thus do not require reward function engineering, merely an image of the goal configuration. We demonstrate our method on a set of towel-folding tasks, and show that our approach is able to discover sequential folding strategies, purely from trial-and-error. We achieve state-of-the-art results without the need for demonstrations or simulation, used in prior approaches. Videos available at: https://sites.google.com/view/learningtofold


title: Autonomous elastic microswimmer

abstract: A model of an autonomous three-sphere microswimmer is proposed by implementing a coupling effect between the two natural lengths of an elastic microswimmer. Such a coupling mechanism is motivated by the previous models for synchronization phenomena in coupled oscillator systems. We numerically show that a microswimmer can acquire a nonzero steady state velocity and a finite phase difference between the oscillations in the natural lengths. These velocity and phase difference are almost independent of the initial phase difference. There is a finite range of the coupling parameter for which a microswimmer can have an autonomous directed motion. The stability of the phase difference is investigated both numerically and analytically in order to determine its bifurcation structure.


title: A Robust Framework for Analyzing Gradient-Based Dynamics in Bilinear Games

abstract: In this work, we establish a frequency-domain framework for analyzing gradient-based algorithms in linear minimax optimization problems; specifically, our approach is based on the Z-transform, a powerful tool applied in Control Theory and Signal Processing in order to characterize linear discrete-time systems. We employ our framework to obtain the first tight analysis of stability of Optimistic Gradient Descent/Ascent (OGDA), a natural variant of Gradient Descent/Ascent that was shown to exhibit last-iterate convergence in bilinear games by Daskalakis et al. \cite{DBLP:journals/corr/abs-1711-00141}. Importantly, our analysis is considerably simpler and more concise than the existing ones. Moreover, building on the intuition of OGDA, we consider a general family of gradient-based algorithms that augment the memory of the optimization through multiple historical steps. We reduce the convergence -- to a saddle-point -- of the dynamics in bilinear games to the stability of a polynomial, for which efficient algorithmic schemes are well-established. As an immediate corollary, we obtain a broad class of algorithms -- that contains OGDA as a special case -- with a last-iterate convergence guarantee to the space of Nash equilibria of the game.


title: On the relaxation of functionals with contact terms on non-smooth domains

abstract: We provide the integral representation formula for the relaxation in $BV(\Omega; \mathbb{R}^M)$ with respect to strong convergence in $L^1(\Omega; \mathbb{R}^M)$ of a functional with a boundary contact energy term. This characterization is valid for a large class of surface energy densities, and for domains satisfying mild regularity assumptions. Motivated by some classical examples where lower semicontinuity fails, we analyze the extent to which the geometry of the set enters the relaxation procedure.


title: Designing, Playing, and Performing with a Vision-based Mouth Interface

abstract: The role of the face and mouth in speech production as well asnon-verbal communication suggests the use of facial action tocontrol musical sound. Here we document work on theMouthesizer, a system which uses a headworn miniaturecamera and computer vision algorithm to extract shapeparameters from the mouth opening and output these as MIDIcontrol changes. We report our experience with variousgesture-to-sound mappings and musical applications, anddescribe a live performance which used the Mouthesizerinterface.


title: Self-organized criticality in cumulus clouds

abstract: The shape of clouds has proven to be essential for classifying them. Our analysis of images from fair weather cumulus clouds reveals that, besides by turbulence they are driven by self-organized criticality (SOC). Our observations yield exponents that support the fact the clouds, when projected to two dimensions (2D), exhibit conformal symmetry compatible with $c=-2$ conformal field theory (CFT), in contrast to 2D turbulence which has $c=0$ CFT. By using a combination of the Navier-Stokes equation, diffusion equations and a coupled map lattice (CML) we successfully simulated cloud formation, and obtained the same exponents.


title: Collective spontaneous emission of two entangled atoms near an oscillating mirror

abstract: We consider the cooperative spontaneous emission of a system of two identical atoms, interacting with the electromagnetic field in the vacuum state and in the presence of an oscillating mirror. We assume that the two atoms, one in the ground state and the other in the excited state, are prepared in a correlated (symmetric or antisymmetric) {\em Bell}-type state. We also suppose that the perfectly reflecting plate oscillates adiabatically, with the field modes satisfying the boundary conditions at the mirror surface at any given instant, so that the time-dependence of the interaction Hamiltonian is entirely enclosed in the instantaneous atoms-wall distance. Using time-dependent perturbation theory, we investigate the spectrum of the radiation emitted by the two-atom system, showing how the oscillation of the boundary modifies the features of the emitted spectrum, which exhibits two lateral peaks not present in the case of a static boundary. We also evaluate the transition rate to the collective ground state of the two-atom system in both cases of the superradiant (symmetric) and subradiant (antisymmetric) state. We show that it is modulated in time, and that the presence of the oscillating mirror can enhance or inhibit the decay rate compared to the case of atoms in vacuum space or near a static boundary. Our results thus suggest that a dynamical (i.e. time-modulated) environment can give new possibilities to control and manipulate radiative processes of atoms or molecules nearby, such as the cooperative decay, and strongly indicate a similar possibility for other radiative processes, for example the resonance interaction and the energy transfer between atoms or molecules.


title: Modeling and analysis of driver behavior under shared control through weighted visual and haptic guidance

abstract: For the optimum design of a driver-automation shared control system, an understanding of driver behavior based on measurements and modeling is crucial early in the development process. This paper presents a driver model through a weighting process of visual guidance from the road ahead and haptic guidance from a steering system for a lane-following task. The proposed weighting process describes the interaction of a driver with the haptic guidance steering and the driver reliance on it. A driving simulator experiment is conducted to identify the model parameters for driving manually and with haptic guidance. The proposed driver model matched the driver input torque with a satisfactory goodness of fit among fourteen participants after considering the individual differences. The validation results reveal that the simulated trajectory effectively followed the driving course by matching the measured trajectory, thereby indicating that the proposed driver model is capable of predicting driver behavior during haptic guidance. Furthermore, the effect of different degrees of driver reliance on driving performance is evaluated considering various driver states and with system failure via numerical analysis. The model evaluation results reveal the potential of the proposed driver model to be applied in the design and evaluation of a haptic guidance system.


title: Entanglement and non-locality of four-qubit connected hypergraph states

abstract: We study entanglement and non-locality of connected four-qubit hypergraph states. One obtains the SLOCC classification from the known LU-orbits. We then consider Mermin's polynomials and show that all four-qubit hypergraph states exhibit non-local behavior. Finally, we implement some of the corresponding inequalities on the IBM Quantum Experience.


title: Chaos on compact manifolds: Differentiable synchronizations beyond the Takens theorem

abstract: This paper shows that a large class of fading memory state-space systems driven by discrete-time observations of dynamical systems defined on compact manifolds always yields continuously differentiable synchronizations. This general result provides a powerful tool for the representation, reconstruction, and forecasting of chaotic attractors. It also improves previous statements in the literature for differentiable generalized synchronizations, whose existence was so far guaranteed for a restricted family of systems and was detected using H\"older exponent-based criteria.


title: Excellent graphs with respect to domination: subgraphs induced by minimum dominating sets

abstract: A graph $G=(V,E)$ is $\gamma$-excellent if $V$ is a union of all $\gamma$-sets of $G$, where $\gamma$ stands for the domination number. Let $\mathcal{I}$ be a set of all mutually nonisomorphic graphs and $\emptyset \not= \mathcal{H} \subsetneq \mathcal{I}$. In this paper we initiate the study of the $\mathcal{H}$-$\gamma$-excellent graphs, which we define as follows. A graph $G$ is $\mathcal{H}$-$\gamma$-excellent if the following hold: (i) for every $H \in \mathcal{H}$ and for each $x \in V(G)$ there exists an induced subgraph $H_x$ of $G$ such that $H$ and $H_x$ are isomorphic, $x \in V(H_x)$ and $V(H_x)$ is a subset of some $\gamma$-set of $G$, and (ii) the vertex set of every induced subgraph $H$ of $G$, which is isomorphic to some element of $\mathcal{H}$, is a subset of some $\gamma$-set of $G$. For each of some well known graphs, including cycles, trees and some cartesian products of two graphs, we describe its largest set $\mathcal{H} \subsetneq \mathcal{I}$ for which the graph is $\mathcal{H}$-$\gamma$-excellent. Results on $\gamma$-excellent regular graphs and a generalized lexicographic product of graphs are presented. Several open problems and questions are posed.


title: Temporal evolution of fluxes in driven quantum dots

abstract: Driven mesoscopic system is a topic of great recent interest. The temporal evolution of the fluxes(particle and energy) are studied in a system of a driven single level quantum dot. At a very low reservoir temperature $T\rightarrow 0$ and for common chemical potentials of the two reservoirs, we have presented analytical expressions for time dependent particle and energy fluxes in a very simple form. Apart from these fluxes, the behavior of the dot occupation and the power developed in the system due to the presence of the time dependent drive are also being studied. Importantly, for a very low frequency of the drive, one finds a directed energy flow towards the leads. Increasing the frequency from low to medium, one finds change in the direction of the energy flow depending on the time. These results can also be verified experimentally.


title: Extending Vector Bundles from Curves

abstract: Given a curve in a (smooth) projective variety $C \subset X$, we show that a vector bundle $V$ on C can be extended to a ($\mu$-stable) vector bundle on $X$ if $\text{rank}(V) \geq \text{dim}(X)$ and $\text{det}(V)$ extends to $X$.


title: Unsupervised Evaluation for Question Answering with Transformers

abstract: It is challenging to automatically evaluate the answer of a QA model at inference time. Although many models provide confidence scores, and simple heuristics can go a long way towards indicating answer correctness, such measures are heavily dataset-dependent and are unlikely to generalize. In this work, we begin by investigating the hidden representations of questions, answers, and contexts in transformer-based QA architectures. We observe a consistent pattern in the answer representations, which we show can be used to automatically evaluate whether or not a predicted answer span is correct. Our method does not require any labeled data and outperforms strong heuristic baselines, across 2 datasets and 7 domains. We are able to predict whether or not a model's answer is correct with 91.37% accuracy on SQuAD, and 80.7% accuracy on SubjQA. We expect that this method will have broad applications, e.g., in the semi-automatic development of QA datasets


title: Sonification of Facial Actions for Musical Expression

abstract: The central role of the face in social interaction and non-verbal communication suggests we explore facial action as a means of musical expression. This paper presents the design, implementation, and preliminary studies of a novel system utilizing face detection and optic flow algorithms to associate facial movements with sound synthesis in a topographically specific fashion. We report on our experience with various gesture-to-sound mappings and applications, and describe our preliminary experiments at musical performance using the system.


title: Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields

abstract: Pronouns are often dropped in Chinese conversations and recovering the dropped pronouns is important for NLP applications such as Machine Translation. Existing approaches usually formulate this as a sequence labeling task of predicting whether there is a dropped pronoun before each token and its type. Each utterance is considered to be a sequence and labeled independently. Although these approaches have shown promise, labeling each utterance independently ignores the dependencies between pronouns in neighboring utterances. Modeling these dependencies is critical to improving the performance of dropped pronoun recovery. In this paper, we present a novel framework that combines the strength of Transformer network with General Conditional Random Fields (GCRF) to model the dependencies between pronouns in neighboring utterances. Results on three Chinese conversation datasets show that the Transformer-GCRF model outperforms the state-of-the-art dropped pronoun recovery models. Exploratory analysis also demonstrates that the GCRF did help to capture the dependencies between pronouns in neighboring utterances, thus contributes to the performance improvements.


title: Large anisotropies of the stochastic gravitational wave background from cosmic domain walls

abstract: We investigate the stochastic gravitational wave background (SGWB) from cosmic domain walls (DWs) caused by quantum fluctuations of a light scalar field $\phi$ during inflation. Perturbations of $\phi$ remain almost constant after leaving the Hubble horizon. The probabilities of the two domains depend on the averaged value of $\phi$ at each large scale region, leading to large scale perturbations of DW energy density and large anisotropies in the SGWB. We find that the angular power spectrum is scale-invariant and at least of the order of $10^{-2}$, which is expected to be detected by future gravitational-wave (GW) detectors. Since we have not detected primordial GWs yet, anisotropies of the SGWB could help us to verify the rationality of inflation and determine the energy scale of inflation.


title: BPS Skyrme Submodels of The Five Dimensional Skyrme Model

abstract: In this paper, we search for the BPS skyrmions in some BPS submodels of the generalized Skyrme model in five-dimensional spacetime using the BPS Lagrangian method. We focus on the static solutions of the Bogomolny's equations and their corresponding energies with topological charge $B>0$ is an integer. We consider two main cases based on the symmetry of the effective Lagrangian of the BPS submodels, i.e. the spherically symmetric and non-spherically symmetric cases. For the spherically symmetric case, we find two BPS submodels. The first BPS submodels consist of a potential term and a term proportional to the square of the topological current. The second BPS submodels consist of only the Skyrme term. The second BPS submodel has BPS skyrmions with the same topological charge $B>1$, but with different energies, that we shall call "topological degenerate" BPS skyrmions. It also has the usual BPS skyrmions with equal energies, if the topological charge is a prime number. Another interesting feature of the BPS skyrmions, with $B>1$, in this BPS submodel, is that these BPS skyrmions have non-zero pressures in the angular direction. For the non-spherically symmetric case, there is only one BPS submodel, which is similar to the first BPS submodel in the spherically symmetric case. We find that the BPS skyrmions depend on a constant $k$ and for a particular value of $k$ we obtain the BPS skyrmions of the first BPS submodel in the spherically symmetric case. The total static energy and the topological charge of these BPS skyrmions also depend on this constant. We also show that all the results found in this paper satisfy the full field equations of motions of the corresponding BPS submodels.


title: Learning Half-Spaces and other Concept Classes in the Limit with Iterative Learners

abstract: In order to model an efficient learning paradigm, iterative learning algorithms access data one by one, updating the current hypothesis without regress to past data. Past research on iterative learning analyzed for example many important additional requirements and their impact on iterative learners. In this paper, our results are twofold. First, we analyze the relative learning power of various settings of iterative learning, including learning from text and from informant, as well as various further restrictions, for example we show that strongly non-U-shaped learning is restrictive for iterative learning from informant. Second, we investigate the learnability of the concept class of half-spaces and provide a constructive iterative algorithm to learn the set of half-spaces from informant.


title: FairMixRep : Self-supervised Robust Representation Learning for Heterogeneous Data with Fairness constraints

abstract: Representation Learning in a heterogeneous space with mixed variables of numerical and categorical types has interesting challenges due to its complex feature manifold. Moreover, feature learning in an unsupervised setup, without class labels and a suitable learning loss function, adds to the problem complexity. Further, the learned representation and subsequent predictions should not reflect discriminatory behavior towards certain sensitive groups or attributes. The proposed feature map should preserve maximum variations present in the data and needs to be fair with respect to the sensitive variables. We propose, in the first phase of our work, an efficient encoder-decoder framework to capture the mixed-domain information. The second phase of our work focuses on de-biasing the mixed space representations by adding relevant fairness constraints. This ensures minimal information loss between the representations before and after the fairness-preserving projections. Both the information content and the fairness aspect of the final representation learned has been validated through several metrics where it shows excellent performance. Our work (FairMixRep) addresses the problem of Mixed Space Fair Representation learning from an unsupervised perspective and learns a Universal representation that is timely, unique, and a novel research contribution.


title: Sturm-Liouville Theory and Decay Parameter for Quadratic Markov Branching Processes

abstract: For a quadratic Markov branching process (QMBP), we show that the decay parameter is equal to the first eigenvalue of a Sturm-Liouville operator associated with the PDE that the generating function of the transition probability satisfies. The proof is based on the spectral properties of the Sturm-Liouville operator. Both the upper and lower bounds of the decay parameter are given explicitly by means of a version of Hardy inequality. Two examples are provided to illustrate our results. The important quantity, the Hardy index, which is closely linked with the decay parameter of QMBP, is deeply investigated and estimated.


title: Dimensions of "self-affine sponges" invariant under the action of multiplicative integers

abstract: Let $m_1 \geq m_2 \geq 2$ be integers. We consider subsets of the product symbolic sequence space $(\{0,\cdots,m_1-1\} \times \{0,\cdots,m_2-1\})^{\mathbb{N}^*}$ that are invariant under the action of the semigroup of multiplicative integers. These sets are defined following Kenyon, Peres and Solomyak and using a fixed integer $q \geq 2$. We compute the Hausdorff and Minkowski dimensions of the projection of these sets onto an affine grid of the unit square. The proof of our Hausdorff dimension formula proceeds via a variational principle over some class of Borel probability measures on the studied sets. This extends well-known results on self-affine Sierpinski carpets. However, the combinatoric arguments we use in our proofs are more elaborate than in the self-similar case and involve a new parameter, namely $j = \left\lfloor \log_q \left( \frac{\log(m_1)}{\log(m_2)} \right) \right\rfloor$. We then generalize our results to the same subsets defined in dimension $d \geq 2$. There, the situation is even more delicate and our formulas involve a collection of $2d-3$ parameters.


title: Index-Modulated Circularly-Shifted Chirps for Dual-Function Radar & Communication Systems

abstract: In this study, we analyze index modulation (IM) based on circularly-shifted chirps (CSCs) for dual-function radar & communication (DFRC) systems. We develop a maximum likelihood (ML) range estimator that considers multiple scatters. To improve the correlation properties of the transmitted waveform and estimation accuracy, we propose index separation (IS) which separates the CSCs apart in time. We theoretically show that the separation can be large under certain conditions without losing the spectral efficiency (SE). Our numerical results show that the IS combined ML and linear minimum mean square error (LMMSE)-based estimators can provide approximately 3 dB signal-to-noise ratio (SNR) gain in some cases while improving estimation accuracy substantially without causing any bit-error ratio (BER) degradation at the communication receiver.


title: Short Paper: Privacy Comparison of Contact Tracing Mobile Applications for COVID-19

abstract: With the COVID-19 pandemic, quarantines took place across the globe. In the aim of stopping or slowing the progression of the COVID-19 contamination, many countries have deployed a contact tracing system to notify persons that be in contact with a COVID-positive person. The contact tracing system is implemented in a mobile application and leverages technologies such as Bluetooth to trace interactions between persons. This paper discusses different smart-phone applications based on contact tracing system from privacy point of view.


title: Synthesis and self-assembly of aminyl and alkynyl substituted sophorolipids

abstract: Sophorolipids are one of the most important microbial biosurfactants, because of their large-scale production and applications developed so far in the fields of detergency, microbiology, cosmetics or environmental science. However, the structural variety of native sophorolipids is limited/restricted, a limiting fact for the development of new properties and their potential applications. In their open acidic form, C18:1 sophorolipids (SL) are classically composed of a sophorose headgroup and a carboxylic acid (COOH) end-group. The carboxyl group gives them unique pH-responsive properties, but they are a poorly-reactive group and their charge can only be negative. To develop a new generation of pH-responsive, positively-charged, SL and to improve their reactivity for further functionalization, we develop here SLs with an amine (-NH2) or terminal alkyne (-C$\not\equiv$CH) end-group analogues. The amine group generates positively-charged SL and is more reactive than carboxylic acids, e.g. towards aldehydes; the alkyne group provides access to copper-based click chemistry. In this work, we synthesize (C18:1) and (C18:0) --NH2 and (C18:1) -C$\not\equiv$CH sophorolipid derivatives and we study their self-assembly properties in response to pH and/or temperature changes by means of static and dynamic light scattering, small angle (X-ray, neutron) scattering and cryogenic electron microscopy. Monounsaturated aminyl SL-C18:1-NH2 sophorolipids form a micellar phase in their neutral form at high pH and a mixed micellar-bilayer phase in their positively-charged form at low pH. Saturated aminyl SL-C18:0-NH2 sophorolipids form a micellar phase in their charged form at low pH and a twisted ribbon phase in their neutral form at high pH and monounsaturated alkynyl SL-C18:1-C$\not\equiv$CH sophorolipids form a main micellar phase at T> 51.8{\textdegree}C and a twisted ribbon phase at T< 51.8 {\textdegree}C.


title: Testing the Mutual Consistency of the Pantheon and SDSS/eBOSS BAO Data Sets with Gaussian Processes

abstract: We test the mutual consistency between the baryon acoustic oscillation measurements from the eBOSS SDSS final release, as well as the Pantheon supernova compilation in a model independent fashion using Gaussian process regression. We also test their joint consistency with the $\Lambda$CDM model, also in a model independent fashion. We also use Gaussian process regression to reconstruct the expansion history that is preferred by these two datasets. While this methodology finds no significant preference for model flexibility beyond $\Lambda$CDM, we are able to generate a number of reconstructed expansion histories that fit the data better than the best-fit $\Lambda$CDM model. These example expansion histories may point the way towards modifications to $\Lambda$CDM. We also constrain the parameters $\Omega_k$ and $H_0r_d$ both with $\Lambda$CDM and with Gaussian process regression. We find that $H_0r_d =10030 \pm 130$ km/s and $\Omega_k = 0.05 \pm 0.10$ for $\Lambda$CDM and that $H_0r_d = 10040 \pm 140$ km/s and $\Omega_k = 0.02 \pm 0.20$ for the Gaussian process case.


title: The resolvent of the Nelson Hamiltonian improves positivity

abstract: We prove that the resolvent of the renormalised Nelson Hamiltonian at fixed total momentum P improves positivity in the (momentum) Fock-representation, for every P. Our argument is based on an explcit representation of the renormalised operator and its domain using interior boundary conditions.


title: Inverse iteration quantum eigensolvers assisted with a continuous variable

abstract: The capacity for solving eigenstates with a quantum computer is key for ultimately simulating physical systems. Here we propose inverse iteration quantum eigensolvers, which exploit the power of quantum computing for the classical inverse power iteration method. A key ingredient is constructing an inverse Hamiltonian as a linear combination of coherent Hamiltonian evolution. We first consider a continuous-variable quantum mode (qumode) for realizing such a linear combination as an integral, with weights being encoded into a qumode resource state. We demonstrate the quantum algorithm with numerical simulations under finite squeezing for various physical systems, including molecules and quantum many-body models. We also discuss a hybrid quantum-classical algorithm that directly sums up Hamiltonian evolution with different durations for comparison. It is revealed that continuous-variable resources are valuable for reducing the coherent evolution time of Hamiltonians in quantum algorithms.


title: Occurrence rates of small planets from HARPS: Focus on the Galactic context

abstract: Context. The stars in the Milky Way thin and thick disks can be distinguished by several properties such as metallicity and kinematics. It is not clear whether the two populations also differ in the properties of planets orbiting the stars. In order to study this, a careful analysis of both the chemical composition and mass detection limits is required for a sufficiently large sample. Currently, this information is still limited only to large radial-velocity (RV) programs. Based on the recently published archival database of the High Accuracy Radial velocity Planet Searcher (HARPS) spectrograph, we present a first analysis of low-mass (small) planet occurrence rates in a sample of thin- and thick-disk stars. Aims. We aim to assess the effects of stellar properties on planet occurrence rates and to obtain first estimates of planet occurrence rates in the thin and thick disks of the Galaxy. As a baseline for comparison, we also aim to provide an updated value for the small close-in planet occurrence rate and compare it to results of previous RV and transit ($\textit{Kepler}$) works. Methods. We used archival HARPS RV datasets to calculate detection limits of a sample of stars that were previously analysed for their elemental abundances. For stars with known planets we first subtracted the Keplerian orbit. We then used this information to calculate planet occurrence rates according to a simplified Bayesian model in different regimes of stellar and planet properties. Results. Our results suggest that metal-poor stars and more massive stars host fewer low-mass close-in planets. We find the occurrence rates of these planets in the thin and thick disks to be comparable. In the iron-poor regimes, we find these occurrence rates to be significantly larger at the high-$\alpha$ region (thick-disk stars) as compared with the low-$\alpha$ region (thin-disk stars). In general, we find the...


title: Hydrodynamic theory of chiral angular momentum generation in metals

abstract: We present a hydrodynamic theory to describe a chiral electron system with a Weyl spin-orbit interaction on a field-theoretic basis. Evaluating the momentum flux density as a linear response to a driving electric field, we derive an equation of motion for the orbital angular momentum. It is shown that the chiral nature leads to a dynamic bulk angular momentum generation by inducing a global torque as a response to the applied field. The steady state angular momentum is calculated taking account of rotational viscosity.


title: Frictional Granular Matter: Protocol Dependence of Mechanical Properties

abstract: Theoretical treatments of frictional granular matter often assume that it is legitimate to invoke classical elastic theory to describe its coarse-grained mechanical properties. Here we show, based on experiments and numerical simulations, that this is generically not the case since stress auto-correlation functions decay more slowly than the elastic Green's function. It was shown theoretically that standard elastic decay demands pressure and torque density fluctuations to be normal, with possibly one of them being hyperuniform. Generic compressed frictional assemblies exhibit however abnormal pressure fluctuations, failing to conform with the central limit theorem. The physics of this failure is linked to correlations built in the material during compression from a dilute configuration prior to jamming. By changing the protocol of compression one can observe different pressure fluctuations and stress auto-correlations decay at large scales.


title: Bias and Debias in Recommender System: A Survey and Future Directions

abstract: While recent years have witnessed a rapid growth of research papers on recommender system (RS), most of the papers focus on inventing machine learning models to better fit user behavior data. However, user behavior data is observational rather than experimental. This makes various biases widely exist in the data, including but not limited to selection bias, position bias, exposure bias, and popularity bias. Blindly fitting the data without considering the inherent biases will result in many serious issues, e.g., the discrepancy between offline evaluation and online metrics, hurting user satisfaction and trust on the recommendation service, etc. To transform the large volume of research models into practical improvements, it is highly urgent to explore the impacts of the biases and perform debiasing when necessary. When reviewing the papers that consider biases in RS, we find that, to our surprise, the studies are rather fragmented and lack a systematic organization. The terminology ``bias'' is widely used in the literature, but its definition is usually vague and even inconsistent across papers. This motivates us to provide a systematic survey of existing work on RS biases. In this paper, we first summarize seven types of biases in recommendation, along with their definitions and characteristics. We then provide a taxonomy to position and organize the existing work on recommendation debiasing. Finally, we identify some open challenges and envision some future directions, with the hope of inspiring more research work on this important yet less investigated topic. The summary of debiasing methods reviewed in this survey can be found at \url{https://github.com/jiawei-chen/RecDebiasing}.


title: Two attacks and counterattacks on the mutual semi-quantum key agreement protocol using Bell states

abstract: Recently, a mutual semi-quantum key agreement protocol using Bell states is proposed by Yan et al. (Mod. Phys. Lett. A, 34, 1950294, 2019). The proposed protocol tries to help a quantum participant share a key with a classical participant who just has limited quantum capacities. Yan et al. claimed that both the participants have the same influence on the final shared key. However, this study points out that the classical participant can manipulate the final shared key by himself/herself without being detected. To solve this problem, an improved method is proposed here.


title: Scalable Normalizing Flows for Permutation Invariant Densities

abstract: Modeling sets is an important problem in machine learning since this type of data can be found in many domains. A promising approach defines a family of permutation invariant densities with continuous normalizing flows. This allows us to maximize the likelihood directly and sample new realizations with ease. In this work, we demonstrate how calculating the trace, a crucial step in this method, raises issues that occur both during training and inference, limiting its practicality. We propose an alternative way of defining permutation equivariant transformations that give closed form trace. This leads not only to improvements while training, but also to better final performance. We demonstrate the benefits of our approach on point processes and general set modeling.


title: A note on some extensions of the matrix angular central Gaussian distribution

abstract: This paper extends the notion of the matrix angular central distribution (MACG) to the complex case. We start by considering the normally distributed random complex matrix ($Z$) and show that is the orientation ($H_Z=Z(Z'Z)^{-1}$) has complex MACG (CMACG) distribution. Then we discuss the distribution of the orientation of the linear transformation of the random matrix which orientation part has CMACG distribution. Finally, we discuss the family of distributions which lead to the CMACG distribution.


title: Deep Learning-Based Grading of Ductal Carcinoma In Situ in Breast Histopathology Images

abstract: Ductal carcinoma in situ (DCIS) is a non-invasive breast cancer that can progress into invasive ductal carcinoma (IDC). Studies suggest DCIS is often overtreated since a considerable part of DCIS lesions may never progress into IDC. Lower grade lesions have a lower progression speed and risk, possibly allowing treatment de-escalation. However, studies show significant inter-observer variation in DCIS grading. Automated image analysis may provide an objective solution to address high subjectivity of DCIS grading by pathologists. In this study, we developed a deep learning-based DCIS grading system. It was developed using the consensus DCIS grade of three expert observers on a dataset of 1186 DCIS lesions from 59 patients. The inter-observer agreement, measured by quadratic weighted Cohen's kappa, was used to evaluate the system and compare its performance to that of expert observers. We present an analysis of the lesion-level and patient-level inter-observer agreement on an independent test set of 1001 lesions from 50 patients. The deep learning system (dl) achieved on average slightly higher inter-observer agreement to the observers (o1, o2 and o3) ($\kappa_{o1,dl}=0.81, \kappa_{o2,dl}=0.53, \kappa_{o3,dl}=0.40$) than the observers amongst each other ($\kappa_{o1,o2}=0.58, \kappa_{o1,o3}=0.50, \kappa_{o2,o3}=0.42$) at the lesion-level. At the patient-level, the deep learning system achieved similar agreement to the observers ($\kappa_{o1,dl}=0.77, \kappa_{o2,dl}=0.75, \kappa_{o3,dl}=0.70$) as the observers amongst each other ($\kappa_{o1,o2}=0.77, \kappa_{o1,o3}=0.75, \kappa_{o2,o3}=0.72$). In conclusion, we developed a deep learning-based DCIS grading system that achieved a performance similar to expert observers. We believe this is the first automated system that could assist pathologists by providing robust and reproducible second opinions on DCIS grade.


title: Learning Clusterable Visual Features for Zero-Shot Recognition

abstract: In zero-shot learning (ZSL), conditional generators have been widely used to generate additional training features. These features can then be used to train the classifiers for testing data. However, some testing data are considered "hard" as they lie close to the decision boundaries and are prone to misclassification, leading to performance degradation for ZSL. In this paper, we propose to learn clusterable features for ZSL problems. Using a Conditional Variational Autoencoder (CVAE) as the feature generator, we project the original features to a new feature space supervised by an auxiliary classification loss. To further increase clusterability, we fine-tune the features using Gaussian similarity loss. The clusterable visual features are not only more suitable for CVAE reconstruction but are also more separable which improves classification accuracy. Moreover, we introduce Gaussian noise to enlarge the intra-class variance of the generated features, which helps to improve the classifier's robustness. Our experiments on SUN,CUB, and AWA2 datasets show consistent improvement over previous state-of-the-art ZSL results by a large margin. In addition to its effectiveness on zero-shot classification, experiments show that our method to increase feature clusterability benefits few-shot learning algorithms as well.


title: Optimal Gradient Compression for Distributed and Federated Learning

abstract: Communicating information, like gradient vectors, between computing nodes in distributed and federated learning is typically an unavoidable burden, resulting in scalability issues. Indeed, communication might be slow and costly. Recent advances in communication-efficient training algorithms have reduced this bottleneck by using compression techniques, in the form of sparsification, quantization, or low-rank approximation. Since compression is a lossy, or inexact, process, the iteration complexity is typically worsened; but the total communication complexity can improve significantly, possibly leading to large computation time savings. In this paper, we investigate the fundamental trade-off between the number of bits needed to encode compressed vectors and the compression error. We perform both worst-case and average-case analysis, providing tight lower bounds. In the worst-case analysis, we introduce an efficient compression operator, Sparse Dithering, which is very close to the lower bound. In the average-case analysis, we design a simple compression operator, Spherical Compression, which naturally achieves the lower bound. Thus, our new compression schemes significantly outperform the state of the art. We conduct numerical experiments to illustrate this improvement.


title: Exploration of Hands-free Text Entry Techniques For Virtual Reality

abstract: Text entry is a common activity in virtual reality (VR) systems. There is a limited number of available hands-free techniques, which allow users to carry out text entry when users' hands are busy such as holding items or hand-based devices are not available. The most used hands-free text entry technique is DwellType, where a user selects a letter by dwelling over it for a specific period. However, its performance is limited due to the fixed dwell time for each character selection. In this paper, we explore two other hands-free text entry mechanisms in VR: BlinkType and NeckType, which leverage users' eye blinks and neck's forward and backward movements to select letters. With a user study, we compare the performance of the two techniques with DwellType. Results show that users can achieve an average text entry rate of 13.47, 11.18 and 11.65 words per minute with BlinkType, NeckType, and DwellType, respectively. Users' subjective feedback shows BlinkType as the preferred technique for text entry in VR.


title: Prime Avoidance Property

abstract: Let $R$ be a commutative ring, we say that $\mathcal{A}\subseteq Spec(R)$ has prime avoidance property, if $I\subseteq \bigcup_{P\in\mathcal{A}}P$ for an ideal $I$ of $R$, then there exists $P\in\mathcal{A}$ such that $I\subseteq P$. We exactly determine when $\mathcal{A}\subseteq Spec(R)$ has prime avoidance property. In particular, if $\mathcal{A}$ has prime avoidance property, then $\mathcal{A}$ is compact. For certain classical rings we show the converse holds (such as Bezout rings, $QR$-domains, zero-dimensional rings and $C(X)$). We give an example of a compact set $\mathcal{A}\subseteq Spec(R)$, where $R$ is a Prufer domain, which has not $P.A$-property. Finally, we show that if $V,V_1,\ldots, V_n$ are valuation domains for a field $K$ and $V[x]\nsubseteq \bigcup_{i=1}^n V_i$ for some $x\in K$, then there exists $v\in V$ such that $v+x\notin \bigcup_{i=1}^n V_i$.


title: Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment

abstract: Entity alignment (EA) aims at building a unified Knowledge Graph (KG) of rich content by linking the equivalent entities from various KGs. GNN-based EA methods present promising performances by modeling the KG structure defined by relation triples. However, attribute triples can also provide crucial alignment signal but have not been well explored yet. In this paper, we propose to utilize an attributed value encoder and partition the KG into subgraphs to model the various types of attribute triples efficiently. Besides, the performances of current EA methods are overestimated because of the name-bias of existing EA datasets. To make an objective evaluation, we propose a hard experimental setting where we select equivalent entity pairs with very different names as the test set. Under both the regular and hard settings, our method achieves significant improvements ($5.10\%$ on average Hits@$1$ in DBP$15$k) over $12$ baselines in cross-lingual and monolingual datasets. Ablation studies on different subgraphs and a case study about attribute types further demonstrate the effectiveness of our method. Source code and data can be found at https://github.com/thunlp/explore-and-evaluate.


title: DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks

abstract: In this paper, we propose a novel framework to automatically utilize task-dependent semantic information which is encoded in heterogeneous information networks (HINs). Specifically, we search for a meta graph, which can capture more complex semantic relations than a meta path, to determine how graph neural networks (GNNs) propagate messages along different types of edges. We formalize the problem within the framework of neural architecture search (NAS) and then perform the search in a differentiable manner. We design an expressive search space in the form of a directed acyclic graph (DAG) to represent candidate meta graphs for a HIN, and we propose task-dependent type constraint to filter out those edge types along which message passing has no effect on the representations of nodes that are related to the downstream task. The size of the search space we define is huge, so we further propose a novel and efficient search algorithm to make the total search cost on a par with training a single GNN once. Compared with existing popular NAS algorithms, our proposed search algorithm improves the search efficiency. We conduct extensive experiments on different HINs and downstream tasks to evaluate our method, and experimental results show that our method can outperform state-of-the-art heterogeneous GNNs and also improves efficiency compared with those methods which can implicitly learn meta paths.


title: Reconfigurable Intelligent Surfaces and Machine Learning for Wireless Fingerprinting Localization

abstract: Reconfigurable Intelligent Surfaces (RISs) promise improved, secure and more efficient wireless communications. We propose and demonstrate how to exploit the diversity offered by RISs to generate and select easily differentiable radio maps for use in wireless fingerprinting localization applications. Further, we apply machine learning feature selection methods to prune the large state space of the RIS, thus reducing complexity and enhancing localization accuracy and position acquisition time. We evaluate our proposed approach by generation of radio maps with a novel radio propagation modelling and simulations.


title: Blow-up dynamics for smooth finite energy radial data solutions to the self-dual Chern-Simons-Schr\"odinger equation

abstract: We consider the finite-time blow-up dynamics of solutions to the self-dual Chern-Simons-Schr\"odinger (CSS) equation (also referred to as the Jackiw-Pi model) near the radial soliton $Q$ with the least $L^{2}$-norm (ground state). While a formal application of pseudoconformal symmetry to $Q$ gives rise to an $L^{2}$-continuous curve of initial data sets whose solutions blow up in finite time, they all have infinite energy due to the slow spatial decay of $Q$. In this paper, we exhibit initial data sets that are smooth finite energy radial perturbations of $Q$, whose solutions blow up in finite time. Interestingly, their blow-up rate differs from the pseudoconformal rate by a power of logarithm. Applying pseudoconformal symmetry in reverse, this also yields a first example of an infinite-time blow-up solution, whose blow-up profile contracts at a logarithmic rate. Our analysis builds upon the ideas of previous works of the first two authors on (CSS) [21,22], as well as the celebrated works on energy-critical geometric equations by Merle, Rapha\"el, and Rodnianski [33,38]. A notable feature of this paper is a systematic use of nonlinear covariant conjugations by the covariant Cauchy-Riemann operators in all parts of the argument. This not only overcomes the nonlocality of the problem, which is the principal challenge for (CSS), but also simplifies the structure of nonlinearity arising in the proof.


title: Exact solution of the Kermack and McKendrick SIR differential equations

abstract: Several exact expansions as well as lower and upperbounds of the Kermack and McKendrick SIR equations are presented.


title: The structure of translational tilings in $\mathbb{Z}^d$

abstract: We obtain structural results on translational tilings of periodic functions in $\mathbb{Z}^d$ by finite tiles. In particular, we show that any level one tiling of a periodic set in $\mathbb{Z}^2$ must be weakly periodic (the disjoint union of sets that are individually periodic in one direction), but present a counterexample of a higher level tiling of $\mathbb{Z}^2$ that fails to be weakly periodic. We also establish a quantitative version of the two-dimensional periodic tiling conjecture which asserts that any finite tile in $\mathbb{Z}^2$ that admits a tiling, must admit a periodic tiling, by providing a polynomial bound on the period; this also gives an exponential-type bound on the computational complexity of the problem of deciding whether a given finite subset of $\mathbb{Z}^2$ tiles or not. As a byproduct of our structural theory, we also obtain an explicit formula for a universal period for all tilings of a one-dimensional tile.


title: Variational Feature Disentangling for Fine-Grained Few-Shot Classification

abstract: Fine-grained few-shot recognition often suffers from the problem of training data scarcity for novel categories.The network tends to overfit and does not generalize well to unseen classes due to insufficient training data. Many methods have been proposed to synthesize additional data to support the training. In this paper, we focus one enlarging the intra-class variance of the unseen class to improve few-shot classification performance. We assume that the distribution of intra-class variance generalizes across the base class and the novel class. Thus, the intra-class variance of the base set can be transferred to the novel set for feature augmentation. Specifically, we first model the distribution of intra-class variance on the base set via variational inference. Then the learned distribution is transferred to the novel set to generate additional features, which are used together with the original ones to train a classifier. Experimental results show a significant boost over the state-of-the-art methods on the challenging fine-grained few-shot image classification benchmarks.


title: An In-Depth Exploration of the Effect of 2D/3D Views and Controller Types on First Person Shooter Games in Virtual Reality

abstract: The amount of interest in Virtual Reality (VR) research has significantly increased over the past few years, both in academia and industry. The release of commercial VR Head-Mounted Displays (HMDs) has been a major contributing factor. However, there is still much to be learned, especially how views and input techniques, as well as their interaction, affect the VR experience. There is little work done on First-Person Shooter (FPS) games in VR, and those few studies have focused on a single aspect of VR FPS. They either focused on the view, e.g., comparing VR to a typical 2D display or on the controller types. To the best of our knowledge, there are no studies investigating variations of 2D/3D views in HMDs, controller types, and their interactions. As such, it is challenging to distinguish findings related to the controller type from those related to the view. If a study does not control for the input method and finds that 2D displays lead to higher performance than VR, we cannot generalize the results because of the confounding variables. To understand their interaction, we propose to analyze in more depth, whether it is the view (2D vs. 3D) or the way it is controlled that gives the platforms their respective advantages. To study the effects of the 2D/3D views, we created a 2D visual technique, PlaneFrame, that was applied inside the VR headset. Our results show that the controller type can have a significant positive impact on performance, immersion, and simulator sickness when associated with a 2D view. They further our understanding of the interactions that controllers and views have and demonstrate that comparisons are highly dependent on how both factors go together. Further, through a series of three experiments, we developed a technique that can lead to a substantial performance, a good level of immersion, and can minimize the level of simulator sickness.


title: Solution concepts, well-posedness, and wave breaking for the Fornberg-Whitham equation

abstract: We discuss concepts and review results about the Cauchy problem for the Fornberg-Whitham equation, which has also been called Burgers-Poisson equation in the literature. Our focus is on a comparison of various strong and weak solution concepts as well as on blow-up of strong solutions in the form of wave breaking. Along the way we add aspects regarding semiboundedness at blow-up, from semigroups of nonlinear operators to the Cauchy problem, and about continuous traveling waves as weak solutions.


title: Global Optimization of Objective Functions Represented by ReLU Networks

abstract: Neural networks can learn complex, non-convex functions, and it is challenging to guarantee their correct behavior in safety-critical contexts. Many approaches exist to find failures in networks (e.g., adversarial examples), but these cannot guarantee the absence of failures. Verification algorithms address this need and provide formal guarantees about a neural network by answering "yes or no" questions. For example, they can answer whether a violation exists within certain bounds. However, individual "yes or no" questions cannot answer qualitative questions such as "what is the largest error within these bounds"; the answers to these lie in the domain of optimization. Therefore, we propose strategies to extend existing verifiers to perform optimization and find: (i) the most extreme failure in a given input region and (ii) the minimum input perturbation required to cause a failure. A naive approach using a bisection search with an off-the-shelf verifier results in many expensive and overlapping calls to the verifier. Instead, we propose an approach that tightly integrates the optimization process into the verification procedure, achieving better runtime performance than the naive approach. We evaluate our approach implemented as an extension of Marabou, a state-of-the-art neural network verifier, and compare its performance with the bisection approach and MIPVerify, an optimization-based verifier. We observe complementary performance between our extension of Marabou and MIPVerify.