title: Gravitational waves and extra dimensions: a short review

abstract: We give a brief review on the recent development of gravitational waves in extra-dimensional theories of gravity. Studying extra-dimensional theories with gravitational waves provides a new way to constrain extra dimensions. After a flash look at the history of gravitational waves and a brief introduction to several major extra-dimensional theories, we focus on the sources and spectra of gravitational waves in extra-dimensional theories. It is shown that one can impose limits on the size of extra dimensions and the curvature of the universe by researching the propagations of gravitational waves and the corresponding electromagnetic waves. Since gravitational waves can propagate throughout the bulk, how the amplitude of gravitational waves decreases determines the number of extra dimensions for some models. In addition, we also briefly present some other characteristics of gravitational waves in extra-dimensional theories.


title: Adversarial Policies: Attacking Deep Reinforcement Learning

abstract: Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another agent's observations. This might lead one to wonder: is it possible to attack an RL agent simply by choosing an adversarial policy acting in a multi-agent environment so as to create natural observations that are adversarial? We demonstrate the existence of adversarial policies in zero-sum games between simulated humanoid robots with proprioceptive observations, against state-of-the-art victims trained via self-play to be robust to opponents. The adversarial policies reliably win against the victims but generate seemingly random and uncoordinated behavior. We find that these policies are more successful in high-dimensional environments, and induce substantially different activations in the victim policy network than when the victim plays against a normal opponent. Videos are available at https://adversarialpolicies.github.io/.


title: Time-reversal invariant scaling of light propagation in one-dimensional non-Hermitian systems

abstract: Light propagation through a normal medium is determined not only by the real part of the refractive index but also by its imaginary part, which represents optical gain and loss. Therefore, two media with different gain and loss landscapes can have very different transmission and reflection spectra, even when their real parts of the refractive index are identical. Here we show that while this observation is true for an arbitrary one-dimensional medium with refractive index $n(x)$ and its time-reversed partner with refractive index $n^*(x)$, there exists a universal scaling that gives identical transmittance and reflectance in these corresponding systems. Interestingly, these scaled transmittance and reflectance reduce to their standard, unscaled forms in a time-reversal invariant system, i.e., one without gain or loss.


title: Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?

abstract: Exposure bias has been regarded as a central problem for auto-regressive language models (LM). It claims that teacher forcing would cause the test-time generation to be incrementally distorted due to the training-generation discrepancy. Although a lot of algorithms have been proposed to avoid teacher forcing and therefore alleviate exposure bias, there is little work showing how serious the exposure bias problem actually is. In this work, we focus on the task of open-ended language generation, propose metrics to quantify the impact of exposure bias in the aspects of quality, diversity, and consistency. Our key intuition is that if we feed ground-truth data prefixes (instead of prefixes generated by the model itself) into the model and ask it to continue the generation, the performance should become much better because the training-generation discrepancy in the prefix is removed. Both automatic and human evaluations are conducted in our experiments. On the contrary to the popular belief in exposure bias, we find that the the distortion induced by the prefix discrepancy is limited, and does not seem to be incremental during the generation. Moreover, our analysis reveals an interesting self-recovery ability of the LM, which we hypothesize to be countering the harmful effects from exposure bias.


title: Friedmann equations for deformed entropic gravity

abstract: In this study, we investigate the effects of the one and two-parameters deformed systems on the Friedmann equations of the Friedmann-Robertson-Walker (FRW) universe in the context of the entropic gravity approach. We give simplified forms for the deformed Unruh temperature and Einstein field equations for three different deformed systems. Based on these compact equations, we derive the Friedmann equations with the effective gravitational and cosmological constant.


title: RF design of APEX2 two-cell continuous-wave normal conducting photoelectron gun cavity based on multi-objective genetic algorithm

abstract: High brightness, high repetition rate electron beams are key components for optimizing the performance of next generation scientific instruments, such as MHz-class X-ray Free Electron Laser (XFEL) and Ultra-fast Electron Diffraction/Microscopy (UED/UEM). In the Advanced Photo-injector EXperiment (APEX) at Berkeley Lab, a photoelectron gun based on a 185.7 MHz normal conducting re-entrant RF cavity, has been proven to be a feasible solution to provide high brightness, high repetition rate electron beam for both XFEL and UED/UEM. Based on the success of APEX, a new electron gun system, named APEX2, has been under development to further improve the electron beam brightness. For APEX2, we have designed a new 162.5 MHz two-cell photoelectron gun and achieved a significant increase on the cathode launching field and the beam exit energy. For a fixed charge per bunch, these improvements will allow for the emittance reduction and hence an increased beam brightness. The design of APEX2 gun cavity is a complex problem with multiple design goals and restrictions, some even competing each other. For a systematic and comprehensive search for the optimized cavity geometry, we have developed and implemented a novel optimization method based on the Multi-Objective Genetic Algorithm (MOGA).


title: ShrinkTeaNet: Million-scale Lightweight Face Recognition via Shrinking Teacher-Student Networks

abstract: Large-scale face recognition in-the-wild has been recently achieved matured performance in many real work applications. However, such systems are built on GPU platforms and mostly deploy heavy deep network architectures. Given a high-performance heavy network as a teacher, this work presents a simple and elegant teacher-student learning paradigm, namely ShrinkTeaNet, to train a portable student network that has significantly fewer parameters and competitive accuracy against the teacher network. Far apart from prior teacher-student frameworks mainly focusing on accuracy and compression ratios in closed-set problems, our proposed teacher-student network is proved to be more robust against open-set problem, i.e. large-scale face recognition. In addition, this work introduces a novel Angular Distillation Loss for distilling the feature direction and the sample distributions of the teacher's hypersphere to its student. Then ShrinkTeaNet framework can efficiently guide the student's learning process with the teacher's knowledge presented in both intermediate and last stages of the feature embedding. Evaluations on LFW, CFP-FP, AgeDB, IJB-B and IJB-C Janus, and MegaFace with one million distractors have demonstrated the efficiency of the proposed approach to learn robust student networks which have satisfying accuracy and compact sizes. Our ShrinkTeaNet is able to support the light-weight architecture achieving high performance with 99.77% on LFW and 95.64% on large-scale Megaface protocols.


title: Dynamic Epistemic Logic with ASP Updates: Application to Conditional Planning

abstract: Dynamic Epistemic Logic (DEL) is a family of multimodal logics that has proved to be very successful for epistemic reasoning in planning tasks. In this logic, the agent's knowledge is captured by modal epistemic operators whereas the system evolution is described in terms of (some subset of) dynamic logic modalities in which actions are usually represented as semantic objects called event models. In this paper, we study a variant of DEL, that wecall DEL[ASP], where actions are syntactically described by using an Answer Set Programming (ASP) representation instead of event models. This representation directly inherits high level expressive features like indirect effects, qualifications, state constraints, defaults, or recursive fluents that are common in ASP descriptions of action domains. Besides, we illustrate how this approach can be applied for obtaining conditional plans in single-agent, partially observable domains where knowledge acquisition may be represented as indirect effects of actions.


title: Beyond Visual Semantics: Exploring the Role of Scene Text in Image Understanding

abstract: Images with visual and scene text content are ubiquitous in everyday life. However, current image interpretation systems are mostly limited to using only the visual features, neglecting to leverage the scene text content. In this paper, we propose to jointly use scene text and visual channels for robust semantic interpretation of images. We do not only extract and encode visual and scene text cues, but also model their interplay to generate a contextual joint embedding with richer semantics. The contextual embedding thus generated is applied to retrieval and classification tasks on multimedia images, with scene text content, to demonstrate its effectiveness. In the retrieval framework, we augment our learned text-visual semantic representation with scene text cues, to mitigate vocabulary misses that may have occurred during the semantic embedding. To deal with irrelevant or erroneous recognition of scene text, we also apply query-based attention to our text channel. We show how the multi-channel approach, involving visual semantics and scene text, improves upon state of the art.


title: Actively tunable terahertz electromagnetically induced transparency analogue based on vanadium-oxide-assisted metamaterials

abstract: Recently, phase-change materials (PCMs) have drawn more attention due to the dynamically tunable optical properties. Here, we investigate the active control of electromagnetically induced transparency (EIT) analogue based on terahertz (THz) metamaterials integrated with vanadium oxide (VO2). Utilizing the insulator-to-metal transition of VO2, the amplitude of EIT peak can be actively modulated with a significant modulation depth. Meanwhile the group delay within the transparent window can also be dynamically tuned, achieving the active control of slow light effect. Furthermore, we also introduce independently tunable transparent peaks as well as group delay based on a double-peak EIT with good tuning performance. Finally, based on broadband EIT, the active tuning of quality factor of the EIT peak is also realized. This work introduces active EIT control with more degree of freedom by employing VO2, and can find potential applications in future wireless and ultrafast THz communication systems as multi-channel filters, switches, spacers, logic gates and modulators.


title: Doubling Phase Shifters for Efficient Hybrid Precoder Design in Millimeter-Wave Communication Systems

abstract: Hybrid precoding is a cost-effective approach to support directional transmissions for millimeter-wave (mm-wave) communications, but its precoder design is highly complicated. In this paper, we propose a new hybrid precoder implementation, namely the double phase shifter (DPS) implementation, which enables highly tractable hybrid precoder design. Efficient algorithms are then developed for two popular hybrid precoder structures, i.e., the fully- and partially-connected structures. For the fully-connected one, the RF-only precoding and hybrid precoding problems are formulated as a least absolute shrinkage and selection operator (LASSO) problem and a low-rank matrix approximation problem, respectively. In this way, computationally efficient algorithms are provided to approach the performance of the fully digital one with a small number of radio frequency (RF) chains. On the other hand, the hybrid precoder design in the partially-connected structure is identified as an eigenvalue problem. To enhance the performance of this cost-effective structure, dynamic mapping from RF chains to antennas is further proposed, for which a greedy algorithm and a modified K-means algorithm are developed. Simulation results demonstrate the performance gains of the proposed hybrid precoding algorithms over existing ones. It shows that, with the proposed DPS implementation, the fully-connected structure enjoys both satisfactory performance and low design complexity while the partially-connected one serves as an economic solution with low hardware complexity.


title: ESA: Entity Summarization with Attention

abstract: Entity summarization aims at creating brief but informative descriptions of entities from knowledge graphs. While previous work mostly focused on traditional techniques such as clustering algorithms and graph models, we ask how to apply deep learning methods into this task. In this paper we propose ESA, a neural network with supervised attention mechanisms for entity summarization. Specifically, we calculate attention weights for facts in each entity, and rank facts to generate reliable summaries. We explore techniques to solve difficult learning problems presented by the ESA, and demonstrate the effectiveness of our model in comparison with the state-of-the-art methods. Experimental results show that our model improves the quality of the entity summaries in both F-measure and MAP.


title: Rethinking Softmax Cross-Entropy Loss for Adversarial Robustness

abstract: Previous work shows that adversarially robust generalization requires larger sample complexity, and the same dataset, e.g., CIFAR-10, which enables good standard accuracy may not suffice to train robust models. Since collecting new training data could be costly, we focus on better utilizing the given data by inducing the regions with high sample density in the feature space, which could lead to locally sufficient samples for robust learning. We first formally show that the softmax cross-entropy (SCE) loss and its variants convey inappropriate supervisory signals, which encourage the learned feature points to spread over the space sparsely in training. This inspires us to propose the Max-Mahalanobis center (MMC) loss to explicitly induce dense feature regions in order to benefit robustness. Namely, the MMC loss encourages the model to concentrate on learning ordered and compact representations, which gather around the preset optimal centers for different classes. We empirically demonstrate that applying the MMC loss can significantly improve robustness even under strong adaptive attacks, while keeping state-of-the-art accuracy on clean inputs with little extra computation compared to the SCE loss.


title: Heavy flavor dissociation in the framework of multi-body Dirac equations

abstract: We study heavy flavor properties at finite temperature in the framework of a relativistic potential model. With an improved method to solve the three-body Dirac equation, we determine a universal set of model parameters for both mesons and baryons by fitting heavy flavor masses in vacuum. Taking heavy quark potential from lattice QCD simulations in hot medium, we systematically calculate heavy flavor binding energies and averaged sizes as functions of temperature. The meson and baryons are separately sequentially dissociated in the quark-gluon plasma, and the mesons can survive at higher temperature due to the stronger potential between quark-antiquark pairs than that between quark-quark pairs.


title: Hyperparameter-Free Out-of-Distribution Detection Using Softmax of Scaled Cosine Similarity

abstract: The ability to detect out-of-distribution (OOD) samples is vital to secure the reliability of deep neural networks in real-world applications. Considering the nature of OOD samples, detection methods should not have hyperparameters that need to be tuned depending on incoming OOD samples. However, most of the recently proposed methods do not meet this requirement, leading to compromised performance in real-world applications. In this paper, we propose a simple, hyperparameter-free method based on softmax of scaled cosine similarity. It resembles the approach employed by modern metric learning methods, but it differs in details; the differences are essential to achieve high detection performance. We show through experiments that our method outperforms the existing methods on the evaluation test recently proposed by Shafaei et al., which takes the above issue of hyperparameter dependency into account. We also show that it achieves at least comparable performance to other methods on the conventional test, where their hyperparameters are chosen using explicit OOD samples. Furthermore, it is computationally more efficient than most of the previous methods, since it needs only a single forward pass.


title: Flexibly Regularized Mixture Models and Application to Image Segmentation

abstract: Probabilistic finite mixture models are widely used for unsupervised clustering. These models can often be improved by adapting them to the topology of the data. For instance, in order to classify spatially adjacent data points similarly, it is common to introduce a Laplacian constraint on the posterior probability that each data point belongs to a class. Alternatively, the mixing probabilities can be treated as free parameters, while assuming Gauss-Markov or more complex priors to regularize those mixing probabilities. However, these approaches are constrained by the shape of the prior and often lead to complicated or intractable inference. Here, we propose a new parametrization of the Dirichlet distribution to flexibly regularize the mixing probabilities of over-parametrized mixture distributions. Using the Expectation-Maximization algorithm, we show that our approach allows us to define any linear update rule for the mixing probabilities, including spatial smoothing regularization as a special case. We then show that this flexible design can be extended to share class information between multiple mixture models. We apply our algorithm to artificial and natural image segmentation tasks, and we provide quantitative and qualitative comparison of the performance of Gaussian and Student-t mixtures on the Berkeley Segmentation Dataset. We also demonstrate how to propagate class information across the layers of deep convolutional neural networks in a probabilistically optimal way, suggesting a new interpretation for feedback signals in biological visual systems. Our flexible approach can be easily generalized to adapt probabilistic mixture models to arbitrary data topologies.


title: Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers

abstract: In deep neural nets, lower level embedding layers account for a large portion of the total number of parameters. Tikhonov regularization, graph-based regularization, and hard parameter sharing are approaches that introduce explicit biases into training in a hope to reduce statistical complexity. Alternatively, we propose stochastically shared embeddings (SSE), a data-driven approach to regularizing embedding layers, which stochastically transitions between embeddings during stochastic gradient descent (SGD). Because SSE integrates seamlessly with existing SGD algorithms, it can be used with only minor modifications when training large scale neural networks. We develop two versions of SSE: SSE-Graph using knowledge graphs of embeddings; SSE-SE using no prior information. We provide theoretical guarantees for our method and show its empirical effectiveness on 6 distinct tasks, from simple neural networks with one hidden layer in recommender systems, to the transformer and BERT in natural languages. We find that when used along with widely-used regularization methods such as weight decay and dropout, our proposed SSE can further reduce overfitting, which often leads to more favorable generalization results.


title: Non-equilibrium thermodynamics and Newtonian gravitation

abstract: Classical gravitation is treated from the point of view of non-equilibrium thermodynamics. Gravitational potential is a thermodynamic state variable in a weakly nonlocal treatment. Entropy production is calculated and the simplest solution of the inequality with corresponding fluxes and forces is given. In case of ideal gravitation without dissipation one obtains the Poisson equation.


title: Solution of Linear Fractional Systems with Variable Coefficients

abstract: The paper deals with the initial value problem for linear systems of FDEs with variable coefficients involving Riemann--Liouville and Caputo derivatives. The technique of the generalized Peano--Baker series is used to obtain the state-transition matrix. Explicit solutions are derived both in the homogeneous and inhomogeneous case. The theoretical results are supported by examples.


title: Non-existence of Global Transverse Poincar\'{e} Sections

abstract: We study global transverse Poincar\'{e} sections and give topological conditions for their existence, showing they never exist in many important cases. We prove that an energy hypersurface possessing global transverse Poincar\'{e} section is equivalent to the hypersuface having a cosymplectic structure. We give a family of Hamiltonian systems with global Poincar\'{e} sections of all possible topologies. Finally, we address the question of when a compact hypersurface of a symplectic manifold possesses an induced cosymplectic structure.


title: Adaptive, Distribution-Free Prediction Intervals for Deep Networks

abstract: The machine learning literature contains several constructions for prediction intervals that are intuitively reasonable but ultimately ad-hoc in that they do not come with provable performance guarantees. We present methods from the statistics literature that can be used efficiently with neural networks under minimal assumptions with guaranteed performance. We propose a neural network that outputs three values instead of a single point estimate and optimizes a loss function motivated by the standard quantile regression loss. We provide two prediction interval methods with finite sample coverage guarantees solely under the assumption that the observations are independent and identically distributed. The first method leverages the conformal inference framework and provides average coverage. The second method provides a new, stronger guarantee by conditioning on the observed data. Lastly, our loss function does not compromise the predictive accuracy of the network like other prediction interval methods. We demonstrate the ease of use of our procedures as well as its improvements over other methods on both simulated and real data. As most deep networks can easily be modified by our method to output predictions with valid prediction intervals, its use should become standard practice, much like reporting standard errors along with mean estimates.


title: Multireference Ab Initio Studies of Magnetic Properties of Terbium-Based Single-Molecule Magnets

abstract: We investigate how different chemical environment influences magnetic properties of terbium(III) (Tb)-based single-molecule magnets (SMMs), using first-principles relativistic multireference methods. Recent experiments showed that Tb-based SMMs can have exceptionally large magnetic anisotropy and that they can be used for experimental realization of quantum information applications, with a judicious choice of chemical environment. Here, we perform complete active space self-consistent field (CASSCF) calculations including relativistic spin-orbit interaction (SOI) for representative Tb-based SMMs such as TbPc$_2$ and TbPcNc in three charge states. We calculate low-energy electronic structure from which we compute the Tb crystal-field parameters and construct an effective pseudospin Hamiltonian. Our calculations show that ligand type and fine points of molecular geometry do not affect the zero-field splitting, while the latter varies weakly with oxidation number. On the other hand, higher-energy levels have a strong dependence on all these characteristics. For neutral TbPc$_2$ and TbPcNc molecules, the Tb magnetic moment and the ligand spin are parallel to each other and the coupling strength between them does not depend much on ligand type and details of atomic structure. However, ligand distortion and molecular symmetry play a crucial role in transverse crystal-field parameters which lead to tunnel splitting. The tunnel splitting induces quantum tunneling of magnetization by itself or by combining with other processes. Our results provide insight into mechanisms of magnetization relaxation in the representative Tb-based SMMs.


title: Bridgeland wall-crossing for some Simpson moduli spaces on $\mathbb{P}^1 \times \mathbb{P}^1$

abstract: We investigate the wall-crossing behavior as Bridgeland moduli spaces for some Simpson moduli spaces of Gieseker-semistable torsion sheaves on $\mathbb{P}^1\times \mathbb{P}^1$ with linear Hilbert polynomial. In particular, we recover some of the birational transformations of these spaces described by Maican and Chung-Moon as wall-crossing maps in certain slices of $Stab(\mathbb{P}^1\times \mathbb{P}^1)$.


title: Note on linear relations in Galois cohomology and {\'e}tale $K$-theory of curves

abstract: In this paper we investigate a local to global principle for Galois cohomology of number fields with coefficients in the Tate module of an abelian variety. In \cite{bk13} G. Banaszak and the author obtained the sufficient condition for the validity of the local to global principle for {\'e}tale $K$-theory of a curve . This condition in fact has been established by means of an analysis of the corresponding problem in the Galois cohomology. We show that in some cases this result is the best possible i.e if this condition does not hold we obtain counterexamples. We also give some examples of curves and their Jacobians. Finally, we prove the dynamical version of the local to global principle for {\'e}tale $K$-theory of a curve. The dynamical local to global principle for the groups of Mordell-Weil type has recently been considered by S. Bara{\'n}czuk in \cite{b17}. We show that all our results remain valid for Quillen $K$-theory of ${\cal X}$ if the Bass and Quillen-Lichtenbaum conjectures hold true for ${\cal X}.$


title: Spectral projections correlation structure for short-to-long range dependent processes

abstract: Let $\mathbf{X}=(\mathbf{X}_t)_{t \geq 0}$ be a stochastic process issued from $x \in \mathbb R$ that admits a marginal stationary measure $\nu$, i.e. $\nu \mathbf{P}_t f = \nu f$ for all $t \geq 0$, where $\mathbf{P}_t f(x)= \mathbb{E}_x[f(\mathbf{X}_t)]$. In this paper, we introduce the (resp. biorthogonal) spectral projections correlation functions which are expressed in terms of projections into the eigenspaces of $\mathbf{P}_t$ (resp. and of its adjoint in the weighted Hilbert space $L^2(\nu)$). We obtain closed-form expressions involving eigenvalues, the condition number and/or the angle between the projections in the following different situations: when $\mathbf{X}=X$ with $X=(X_t)_{t \geq 0}$ is a Markov process, $\mathbf{X}$ is the subordination of $X$ in the sense of Bochner, and $\mathbf X$ is a non-Markovian process which is obtained by time-changing $X$ with an inverse of a subordinator. It turns out that these spectral projections correlation functions have different expressions with respect to these classes of processes which enables to identify substantial and deep properties about their dynamics. This interesting fact can be used to design original statistical tests to make inferences, for example, about the path properties of the process (presence of jumps), distance from symmetry (self-adjoint or non-self-adjoint) and short-to-long-range dependence. To reveal the usefulness of our results, we apply them to a class of non-self-adjoint Markov semigroups studied in Patie and Savov [28], and then time-change by subordinators and their inverses.


title: Covariant Differential Calculus Over Monoidal Hom-Hopf Algebras

abstract: Concepts of first order differential calculus (FODC) on a monoidal Hom-algebra and left-covariant FODC over a left Hom-quantum space with respect to a monoidal Hom-Hopf algebra are presented. Then, extension of the universal FODC over a monoidal Hom-algebra to a universal Hom-differential calculus is described. Next, concepts of left(right)-covariant and bicovariant FODC over a monoidal Hom-Hopf algebra are studied in detail. Subsequently, notion of quantum Hom-tangent space associated to a bicovariant Hom-FODC is introduced and equipped with an analogue of Lie bracket (commutator) through Woronowicz' braiding. Finally, it is proven that this commutator satisfies quantum versions of the antisymmetry relation and Hom-Jacobi identity.


title: Modeling work-speed-accuracy trade-offs in a stochastic rotary machine

abstract: Molecular machines are stochastic systems that catalyze the energetic processes keeping living cells alive and structured. Inspired by the examples of F1-ATP synthase and the bacterial flagellum, we present a minimal model of an externally driven stochastic rotary machine. We explore the trade-offs of work, driving speed, and driving accuracy when changing driving strength, speed, and the underlying system dynamics. We find an upper bound on accuracy and work for a particular speed. Our results favor slow driving when tasked with minimizing the work-accuracy ratio and maximizing the rate of successful cycles. Finally, in the parameter regime mapping to the dynamics of F1-ATP synthase, we find a significant decay of driving accuracy at physiological rotation rates, raising questions about how ATP synthase achieves reasonable or even remarkable efficiency in vivo.


title: On eigenproblem for inverted harmonic oscillators

abstract: We consider an eigenvalue problem for an inverted one dimensional harmonic oscillator. We find a complete description for the eigenproblem in $C^{\infty}(\mathbb R)$. The eigenfunctions are described in terms of the confluent hypergeometric functions, the spectrum is ${\mathbb C}$. The spectrum of the differential operator $-{\frac{d}{dx^2}}-{\omega}^{2}{x^2}$ is continuous and has physical significance only for the states which are in $L^{2}(\mathbb R)$ and correspond to real eigenvalues. To identify them we use two approaches. First we define a unitary operator between $L^{2}(\mathbb R)$ and $L^{2}$ for two copies of $\mathbb R$. This operator has the property that the spectrum of the image of the inverted harmonic oscillator corresponds to the spectrum of the operator $-i{\frac{d}{dx}}$. This shows that the (generalized) spectrum of the inverted harmonic operator is real. The second approach uses rigged Hilbert spaces.


title: Hydrodynamic acoustic plasmon resonances in semiconductor nanowires and their dimers

abstract: The hydrodynamic Drude model known from metal plasmonics also applies to semiconductor structures of sizes in between single-particle quantum confinement and bulk. But contrary to metals, for semiconductors two or more types of plasma may have to be taken into account in order to properly describe their plasmonic properties. In this combined analytical and computational study, we explore predictions of the recently proposed two-fluid hydrodynamic Drude model for the optical properties of plasmonic semiconductor nanowires, in particular for thermally excited InSb nanowires. We focus on the low-frequency acoustic surface and bulk plasmon resonances that are unique fingerprints for this model and are yet to be observed. We identify these resonances in spectra for single nanowires based on analytical calculations, and they are in complete agreement with our numerical implementation of the model. For dimers of nanowires we predict substantial increase of the extinction cross section and field enhancement of the acoustic localized surface plasmon resonance, which makes its observation in dimers more likely.


title: A Reference Architecture for Blockchain-based Peer-to-Peer IoT Applications

abstract: The advent of Blockchain and Distributed Ledger Technologies enable IoT and smart city application developers to conceive new types of applications and solutions for identity management, trust, and data monetization. However, architecting blockchain-based IoT applications remain challenging due to the heterogeneous nature of blockchain platforms and lack of guidelines on how to interface existing components in the IoT ecosystem with the emerging Blockchain technology. This article explains the characteristics of blockchain and IoT technologies and presents a general reference architecture that can be used to develop many blockchain-based peer-to-peer IoT applications.


title: Round-the-world echo of earthquake and solar flare

abstract: We drew attention to the analogy between the round-the-world seismic echo on the Earth and on the Sun. The phenomenon of echo on the Earth is observed during earthquakes. It was found that the main shock of earthquake excites a circular surface wave, which having rounded the Earth returns to the epicenter and stimulates a repeated earthquake (aftershock) 3 hours after the main shock. Apparently, something similar happens on the Sun during a chromospheric flare. We found signs of a small increase in flare brightness approximately one hour after reaching maximum brightness. The phenomenon is explained by the fact that the converging surface wave, which has returned to the epicenter after the round-the-world trip, has a definite impact on the flare area. Keywords: earthquake source, main shock, aftershock, chromospheric flare, circular surface wave


title: Multiple Killing Horizons: the initial value formulation for $\Lambda$-vacuum

abstract: In Class. Quantum Grav. 35 (2018) 155015 we have introduced the notion of "Multiple Killing Horizon" and analyzed some of its general properties. Multiple Killing Horizons are Killing horizons for two or more linearly independent Killing vectors simultaneously. In this paper we focus on the vacuum case, possibly with cosmological constant, and study the emergence of Multiple Killing Horizons in terms of characteristic initial value problems for two transversally intersecting null hypersurfaces. As a relevant outcome, a more general definition of Near Horizon Geometry is put forward. This new definition avoids the use of Gaussian null coordinates associated to the corresponding degenerate Killing vector and thereby allows for inclusion of its fixed points.


title: Structure of $^{38}$Cl and the quest for a comprehensive shell model interaction

abstract: The higher-spin structure of $^{38}$Cl ($N = 21$) was investigated following the $^{26}$Mg($^{14}$C, $pn$) reaction at 30 and 37 MeV beam energies. The outgoing protons were detected in an $E- \Delta E$ Si telescope placed at 0$^\circ$ close to the target with a Ta beam stopper between the target and telescope. Multiple $\gamma$ rays were detected in time coincidence with the protons using an enhanced version of the FSU $\gamma$ detection array. The level scheme was extended up to 8420 keV with a likely spin of 10 $\hbar$. A new multishell interaction was developed guided by the experimental information. This FSU interaction was built by fitting to the energies of 270 experimental states from $^{13}$C to $^{51}$Ti. Calculations using the FSU interaction reproduce observed properties of $^{38}$Cl rather well, including the spectroscopic factors. The interaction has been successfully used to interpret the $1p1h$ and $2p2h$ configurations in some nearby nuclei as well.


title: Higher Order Topology and Nodal Topological Superconductivity in Fe(Se,Te) Heterostructures

abstract: We show theoretically that a heterostructure of monolayer FeTe$_{1-x}$Se$_x$ - a superconducting quantum spin Hall material - with a monolayer of FeTe - a bicollinear antiferromagnet - realizes a higher order topological superconductor phase characterized by emergent Majorana zero modes pinned to the sample corners. We provide a minimal effective model for this system, analyze the origin of higher order topology, and fully characterize the topological phase diagram. Despite the conventional s-wave pairing, we find rather surprising emergence of a novel topological nodal superconductor in the phase diagram. Featured by edge-dependent Majorana flat bands, the topological nodal phase is protected by an antiferromagnetic chiral symmetry. We also discuss the experimental feasibility, the estimation of realistic model parameters, and the robustness of the Majorana corner modes against magnetic disorder. Our work provides a new experimentally feasible high-temperature platform for both higher order topology and non-Abelian Majorana physics.


title: High-$T_c$ Superconductor Fe(Se,Te) Monolayer: an Intrinsic, Scalable and Electrically-tunable Majorana Platform

abstract: A monolayer of the high-$T_c$ superconductor FeTe$_{1-x}$Se$_x$ has been predicted to realize a topologically non-trivial state with helical edge modes at its boundary, providing a novel intrinsic system to search for topological superconductivity and Majorana zero modes. Evidence in favor of a topological phase transition and helical edge modes has been identified in recent experiments \cite{Peng2019}. We propose to create Majorana zero modes by applying an in-plane magnetic field to the FeTe$_{1-x}$Se$_x$ monolayer and by tuning the local chemical potential via electric gating. Owing to the anisotropic magnetic couplings on edges from a topological band inversion, an in-plane magnetic field drives the system into an intrinsic high-order topological superconductor phase with Majorana corner modes, without fabricating heterostructures. Furthermore, we demonstrate that Majorana zero modes can occur at other different locations, including the domain wall of chemical potentials at one edge and certain type of tri-junction in the 2D bulk. Our study not only demonstrates FeTe$_{1-x}$Se$_x$ monolayer as a promising Majorana platform with scalability and electrical tunability and within reach of contemporary experimental capability, but also provides a general principle to search for realistic realization of high-order topological superconductivity.


title: Large Scale Markov Decision Processes with Changing Rewards

abstract: We consider Markov Decision Processes (MDPs) where the rewards are unknown and may change in an adversarial manner. We provide an algorithm that achieves state-of-the-art regret bound of $O( \sqrt{\tau (\ln|S|+\ln|A|)T}\ln(T))$, where $S$ is the state space, $A$ is the action space, $\tau$ is the mixing time of the MDP, and $T$ is the number of periods. The algorithm's computational complexity is polynomial in $|S|$ and $|A|$ per period. We then consider a setting often encountered in practice, where the state space of the MDP is too large to allow for exact solutions. By approximating the state-action occupancy measures with a linear architecture of dimension $d\ll|S|$, we propose a modified algorithm with computational complexity polynomial in $d$. We also prove a regret bound for this modified algorithm, which to the best of our knowledge this is the first $\tilde{O}(\sqrt{T})$ regret bound for large scale MDPs with changing rewards.


title: Are Sixteen Heads Really Better than One?

abstract: Attention is a powerful and ubiquitous mechanism for allowing neural models to focus on particular salient pieces of information by taking their weighted average when making predictions. In particular, multi-headed attention is a driving force behind many recent state-of-the-art NLP models such as Transformer-based MT models and BERT. These models apply multiple attention mechanisms in parallel, with each attention "head" potentially focusing on different parts of the input, which makes it possible to express sophisticated functions beyond the simple weighted average. In this paper we make the surprising observation that even if models have been trained using multiple heads, in practice, a large percentage of attention heads can be removed at test time without significantly impacting performance. In fact, some layers can even be reduced to a single head. We further examine greedy algorithms for pruning down models, and the potential speed, memory efficiency, and accuracy improvements obtainable therefrom. Finally, we analyze the results with respect to which parts of the model are more reliant on having multiple heads, and provide precursory evidence that training dynamics play a role in the gains provided by multi-head attention.


title: Asymptotic Distributions and Rates of Convergence for Random Forests via Generalized U-statistics

abstract: Random forests remain among the most popular off-the-shelf supervised learning algorithms. Despite their well-documented empirical success, however, until recently, few theoretical results were available to describe their performance and behavior. In this work we push beyond recent work on consistency and asymptotic normality by establishing rates of convergence for random forests and other supervised learning ensembles. We develop the notion of generalized U-statistics and show that within this framework, random forest predictions can potentially remain asymptotically normal for larger subsample sizes than previously established. We also provide Berry-Esseen bounds in order to quantify the rate at which this convergence occurs, making explicit the roles of the subsample size and the number of trees in determining the distribution of random forest predictions.


title: The Lelong number, the Monge-Amp\`ere mass and the Schwarz symmetrization of plurisubharmonic functions

abstract: The aim of this paper is to study the Lelong number, the integrability index and the Monge-Amp\`ere mass at the origin of an $S^1$-invariant plurisubharmonic function on a balanced domain in $\mathbb{C}^n$ under the Schwarz symmetrization. We prove that $n$ times the integrability index is exactly the Lelong number of the symmetrization, and if the function is further toric with a single pole at the origin, then the Monge-Amp\`ere mass is always decreasing under the symmetrization


title: Gaussian Process Regression for Estimating EM Ducting Within the Marine Atmospheric Boundary Layer

abstract: We show that Gaussian process regression (GPR) can be used to infer the electromagnetic (EM) duct height within the marine atmospheric boundary layer (MABL) from sparsely sampled propagation factors within the context of bistatic radars. We use GPR to calculate the posterior predictive distribution on the labels (i.e. duct height) from both noise-free and noise-contaminated array of propagation factors. For duct height inference from noise-contaminated propagation factors, we compare a naive approach, utilizing one random sample from the input distribution (i.e. disregarding the input noise), with an inverse-variance weighted approach, utilizing a few random samples to estimate the true predictive distribution. The resulting posterior predictive distributions from these two approaches are compared to a "ground truth" distribution, which is approximated using a large number of Monte-Carlo samples. The ability of GPR to yield accurate and fast duct height predictions using a few training examples indicates the suitability of the proposed method for real-time applications.


title: Exploring Temporal Information for Improved Video Understanding

abstract: In this dissertation, I present my work towards exploring temporal information for better video understanding. Specifically, I have worked on two problems: action recognition and semantic segmentation. For action recognition, I have proposed a framework, termed hidden two-stream networks, to learn an optimal motion representation that does not require the computation of optical flow. My framework alleviates several challenges faced in video classification, such as learning motion representations, real-time inference, multi-framerate handling, generalizability to unseen actions, etc. For semantic segmentation, I have introduced a general framework that uses video prediction models to synthesize new training samples. By scaling up the training dataset, my trained models are more accurate and robust than previous models even without modifications to the network architectures or objective functions. I believe videos have much more potential to be mined, and temporal information is one of the most important cues for machines to perceive the visual world better.


title: A Light Curve Analysis of 32 Recent Galactic Novae --- Distances and White Dwarf Masses

abstract: We obtained the absolute magnitudes, distances, and white dwarf (WD) masses of 32 recent galactic novae based on the time-stretching method for nova light curves. A large part of the light/color curves of two classical novae often overlap each other if we properly squeeze/stretch their timescales. Then, a target nova brightness is related to the other template nova brightness by $(M_V[t])_{\rm template} = (M_V[t/f_{\rm s}] - 2.5 \log f_{\rm s})_{\rm target}$, where $t$ is the time, $M_V[t]$ is the absolute $V$ magnitude, and $f_{\rm s}$ is their timescaling ratio. Moreover, when these two time-stretched light curves, $(t/f_{\rm s})$-$(M_V-2.5 \log f_{\rm s})$, overlap each other, $(t/f_{\rm s})$-$(B-V)_0$ do too, where $(B-V)_0$ is the intrinsic $B-V$ color. Thus, the two nova tracks overlap each other in the $(B-V)_0$-$(M_V-2.5 \log f_{\rm s})$ diagram. Inversely using these properties, we obtain/confirm the distance and reddening by comparing each nova light/color curves with the well calibrated template novae. We classify the 32 novae into two types, LV Vul and V1500 Cyg types, in the time-stretched $(B-V)_0$-$(M_V-2.5 \log f_{\rm s})$ color-magnitude diagram. The WD mass is obtained by direct comparison of the model $V$ light curves with the observation. Thus, we obtain a uniform set of 32 galactic classical novae that provides the distances and WD masses from a single method. Many novae broadly follow the universal decline law and the present method can be applied to them, while some novae largely deviate from the universal decline law and so the method cannot be directly applied to them. We discuss such examples.


title: Equitable Allocations of Indivisible Goods

abstract: In fair division, equitability dictates that each participant receives the same level of utility. In this work, we study equitable allocations of indivisible goods among agents with additive valuations. While prior work has studied (approximate) equitability in isolation, we consider equitability in conjunction with other well-studied notions of fairness and economic efficiency. We show that the Leximin algorithm produces an allocation that satisfies equitability up to any good and Pareto optimality. We also give a novel algorithm that guarantees Pareto optimality and equitability up to one good in pseudopolynomial time. Our experiments on real-world preference data reveal that approximate envy-freeness, approximate equitability, and Pareto optimality can often be achieved simultaneously.


title: A Finite Element Approximation for a Class of Caputo Time-Fractional Diffusion Equations

abstract: We develop a fully discrete scheme for time-fractional diffusion equations by using a finite difference method in time and a finite element method in space. The fractional derivatives are used in Caputo sense. Stability and error estimates are derived. The accuracy and efficiency of the presented method is shown by conducting two numerical examples.


title: Transfer matrix method for the analysis of space-time modulated media and systems

abstract: Space-time modulation adds another powerful degree of freedom to the manipulation of classical wave systems. It opens the door for complex control of wave behavior beyond the reach of stationary systems, such as nonreciprocal wave transport and realization of gain media. Here we generalize the transfer matrix method and use it to create a general framework to solve wave propagation problems in time-varying acoustic, electromagnetic, and electric circuit systems. The proposed method provides a versatile approach for the study of general space-time varying systems, which allows any number of time-modulated elements with arbitrary modulation profile, facilities the investigation of high order modes, and provides an interface between space-time modulated systems and other systems.


title: An Ensemble of Bayesian Neural Networks for Exoplanetary Atmospheric Retrieval

abstract: Machine learning is now used in many areas of astrophysics, from detecting exoplanets in Kepler transit signals to removing telescope systematics. Recent work demonstrated the potential of using machine learning algorithms for atmospheric retrieval by implementing a random forest to perform retrievals in seconds that are consistent with the traditional, computationally-expensive nested-sampling retrieval method. We expand upon their approach by presenting a new machine learning model, \texttt{plan-net}, based on an ensemble of Bayesian neural networks that yields more accurate inferences than the random forest for the same data set of synthetic transmission spectra. We demonstrate that an ensemble provides greater accuracy and more robust uncertainties than a single model. In addition to being the first to use Bayesian neural networks for atmospheric retrieval, we also introduce a new loss function for Bayesian neural networks that learns correlations between the model outputs. Importantly, we show that designing machine learning models to explicitly incorporate domain-specific knowledge both improves performance and provides additional insight by inferring the covariance of the retrieved atmospheric parameters. We apply \texttt{plan-net} to the Hubble Space Telescope Wide Field Camera 3 transmission spectrum for WASP-12b and retrieve an isothermal temperature and water abundance consistent with the literature. We highlight that our method is flexible and can be expanded to higher-resolution spectra and a larger number of atmospheric parameters.


title: An Algorithmic Framework for Fairness Elicitation

abstract: We consider settings in which the right notion of fairness is not captured by simple mathematical definitions (such as equality of error rates across groups), but might be more complex and nuanced and thus require elicitation from individual or collective stakeholders. We introduce a framework in which pairs of individuals can be identified as requiring (approximately) equal treatment under a learned model, or requiring ordered treatment such as "applicant Alice should be at least as likely to receive a loan as applicant Bob". We provide a provably convergent and oracle efficient algorithm for learning the most accurate model subject to the elicited fairness constraints, and prove generalization bounds for both accuracy and fairness. This algorithm can also combine the elicited constraints with traditional statistical fairness notions, thus "correcting" or modifying the latter by the former. We report preliminary findings of a behavioral study of our framework using human-subject fairness constraints elicited on the COMPAS criminal recidivism dataset.


title: Locality-Promoting Representation Learning

abstract: This work investigates fundamental questions related to learning features in convolutional neural networks (CNN). Empirical findings across multiple architectures such as VGG, ResNet, Inception, DenseNet and MobileNet indicate that weights near the center of a filter are larger than weights on the outside. Current regularization schemes violate this principle. Thus, we introduce Locality-promoting Regularization (LOCO-Reg), which yields accuracy gains across multiple architectures and datasets. We also show theoretically that the empirical finding is a consequence of maximizing feature cohesion under the assumption of spatial locality.


title: Optimal localization patterns in bacterial protein synthesis

abstract: In $\textit{Escherichia coli}$ bacterium, the molecular compounds involved in protein synthesis, messenger RNAs (mRNAs) and ribosomes, show marked intracellular localization patterns. Yet a quantitative understanding of the physical principles which would allow one to control protein synthesis by designing, bioengineering, and optimizing these localization patterns is still lacking. In this study, we consider a scenario where a synthetic modification of mRNA reaction-diffusion properties allows for controlling the localization and stoichiometry of mRNAs and polysomes$\mathrm{-}$complexes of multiple ribosomes bound to mRNAs. Our analysis demonstrates that protein synthesis can be controlled, e.g., optimally enhanced or inhibited, by leveraging mRNA spatial localization and stoichiometry only, without resorting to alterations of mRNA expression levels. We identify the physical mechanisms that control the protein-synthesis rate, highlighting the importance of colocalization between mRNAs and freely diffusing ribosomes, and the interplay between polysome stoichiometry and excluded-volume effects due to the DNA nucleoid. The genome-wide, quantitative predictions of our work may allow for a direct verification and implementation in cell-biology experiments, where localization patterns and protein-synthesis rates may be monitored by fluorescence microscopy in single cells and populations.


title: The complexity of some ordinal determined classes of operators

abstract: We compute the complexity of the classes of operators $\mathfrak{G}_{\xi, \zeta}\cap \mathcal{L}$ and $\mathfrak{M}_{\xi, \zeta}\cap \mathcal{L}$ in the coding of operators between separable Banach spaces. We also prove the non-existence of universal factoring operators for both $\complement \mathfrak{G}_{\xi, \zeta}$ and $\complement \mathfrak{M}_{\xi, \zeta}$. The latter result is an ordinal extension of a result of Johnson and Girardi.


title: A systematic procedure to build the beyond generalized Proca field theory

abstract: To date, different alternative theories of gravity, although related, involving Proca fields have been proposed. Unfortunately, the procedure to obtain the relevant terms in some formulations has not been systematic enough or exhaustive, thus resulting in some missing terms or ambiguity in the process carried out. In this paper, we propose a systematic procedure to build the beyond generalized theory for a Proca field in four dimensions containing only the field itself and its first-order derivatives. We examine the validity of our procedure at the fourth level of the generalized Proca theory. In our approach, we employ all the possible Lorentz-invariant Lagrangian pieces made of the Proca field and its first-order derivatives, including those that violate parity, and find the relevant combination that propagates only three degrees of freedom and has healthy dynamics for the longitudinal mode. The key step in our procedure is to retain the flat space-time divergences of the currents in the theory during the covariantization process. In the curved space-time theory, some of the retained terms are no longer current divergences so that they induce the new terms that identify the beyond generalized Proca field theory. The procedure constitutes a systematic method to build general theories for multiple vector fields with or without internal symmetries.


title: Derivation of Hamilton-like equations on a non-Cauchy hypersurface and their expected connection to quantum gravity theories

abstract: Recently it was found that quantum gravity theories may involve constructing a quantum theory on non-Cauchy hypersurfaces. However this is problematic since the ordinary Poisson brackets are not causal in this case. We suggest a method to identify classical brackets that are causal on 2+1 non-Cauchy hypersurfaces and use it in order to show that the evolution of scalars and vectors fields in the 3rd spatial direction can be constructed by using a Hamilton-like procedure. Finally, we discuss the relevance of this result to quantum gravity.


title: Hermite-Hadamard's Type Inequalities on a Ball

abstract: Some trapezoid and mid-point type inequalities related to the Hermite-Hadamard inequality for the mappings defined on a ball in the space are obtained.


title: A comprehensive model of high-concentration phosphorus diffusion in silicon

abstract: A comprehensive model of high-concentration phosphorus diffusion has been developed and simulation of phosphorus diffusion from a constant source (phosphosilicate glass) at a temperature of 890 Celsius degrees for 14.25 min. has been carried out. Such doping processes are widely used in manufacturing modern solar cells. The proposed model combines the ideas of the drift of silicon self-interstitials in the field of elastic stresses with the concept of the formation of negatively charge clusters of impurity atoms. The calculated phosphorus concentration profile is in good agreement with the experimental one.


title: Is a Single Vector Enough? Exploring Node Polysemy for Network Embedding

abstract: Networks have been widely used as the data structure for abstracting real-world systems as well as organizing the relations among entities. Network embedding models are powerful tools in mapping nodes in a network into continuous vector-space representations in order to facilitate subsequent tasks such as classification and link prediction. Existing network embedding models comprehensively integrate all information of each node, such as links and attributes, towards a single embedding vector to represent the node's general role in the network. However, a real-world entity could be multifaceted, where it connects to different neighborhoods due to different motives or self-characteristics that are not necessarily correlated. For example, in a movie recommender system, a user may love comedies or horror movies simultaneously, but it is not likely that these two types of movies are mutually close in the embedding space, nor the user embedding vector could be sufficiently close to them at the same time. In this paper, we propose a polysemous embedding approach for modeling multiple facets of nodes, as motivated by the phenomenon of word polysemy in language modeling. Each facet of a node is mapped as an embedding vector, while we also maintain association degree between each pair of node and facet. The proposed method is adaptive to various existing embedding models, without significantly complicating the optimization process. We also discuss how to engage embedding vectors of different facets for inference tasks including classification and link prediction. Experiments on real-world datasets help comprehensively evaluate the performance of the proposed method.


title: Characterization of the L 98-59 multi-planetary system with HARPS: two confirmed terrestrial planets and a mass upper limit on the third

abstract: L 98-59 (TIC 307210830, TOI-175) is a nearby M3 dwarf around which TESS revealed three terrestrial-sized transiting planets (0.80, 1.35, 1.57 Earth radii) in a compact configuration with orbital periods shorter than 7.5 days. Here we aim to measure the masses of the known transiting planets in this system using precise radial velocity (RV) measurements taken with the HARPS spectrograph. We consider both trained and untrained Gaussian process regression models of stellar activity to simultaneously model the RV data with the planetary signals. Our RV analysis is then supplemented with dynamical simulations to provide strong constraints on the planets' orbital eccentricities by requiring long-term stability. We measure the planet masses of the two outermost planets to be $2.46\pm 0.31$ and $2.26\pm 0.50$ Earth masses which confirms their bulk terrestrial compositions. We are able to place an upper limit on the mass of the smallest, innermost planet of $<0.98$ Earth masses with 95% confidence. Our RV plus dynamical stability analysis places strong constraints on the orbital eccentricities and reveals that each planet's orbit likely has $e<0.1$ to ensure a dynamically stable system. The L 98-59 compact system of three likely rocky planets offers a unique laboratory for studies of planet formation, dynamical stability, and comparative atmospheric planetology. Continued RV monitoring will help refine the characterization of the innermost planet and potentially reveal additional planets in the system at wider separations.


title: Subgraph Isomorphism on Graph Classes that Exclude a Substructure

abstract: We study Subgraph Isomorphism on graph classes defined by a fixed forbidden graph. Although there are several ways for forbidding a graph, we observe that it is reasonable to focus on the minor relation since other well-known relations lead to either trivial or equivalent problems. When the forbidden minor is connected, we present a near dichotomy of the complexity of Subgraph Isomorphism with respect to the forbidden minor, where the only unsettled case is $P_{5}$, the path of five vertices. We then also consider the general case of possibly disconnected forbidden minors. We show fixed-parameter tractable cases and randomized XP-time solvable cases parameterized by the size of the forbidden minor $H$. We also show that by slightly generalizing the tractable cases, the problem becomes NP-complete. All unsettle cases are equivalent to $P_{5}$ or the disjoint union of two $P_{5}$'s. As a byproduct, we show that Subgraph Isomorphism is fixed-parameter tractable parameterized by vertex integrity. Using similar techniques, we also observe that Subgraph Isomorphism is fixed-parameter tractable parameterized by neighborhood diversity.


title: DIANet: Dense-and-Implicit Attention Network

abstract: Attention networks have successfully boosted the performance in various vision problems. Previous works lay emphasis on designing a new attention module and individually plug them into the networks. Our paper proposes a novel-and-simple framework that shares an attention module throughout different network layers to encourage the integration of layer-wise information and this parameter-sharing module is referred as Dense-and-Implicit-Attention (DIA) unit. Many choices of modules can be used in the DIA unit. Since Long Short Term Memory (LSTM) has a capacity of capturing long-distance dependency, we focus on the case when the DIA unit is the modified LSTM (refer as DIA-LSTM). Experiments on benchmark datasets show that the DIA-LSTM unit is capable of emphasizing layer-wise feature interrelation and leads to significant improvement of image classification accuracy. We further empirically show that the DIA-LSTM has a strong regularization ability on stabilizing the training of deep networks by the experiments with the removal of skip connections or Batch Normalization in the whole residual network. The code is released at https://github.com/gbup-group/DIANet.


title: Signaling Friends and Head-Faking Enemies Simultaneously: Balancing Goal Obfuscation and Goal Legibility

abstract: In order to be useful in the real world, AI agents need to plan and act in the presence of others, who may include adversarial and cooperative entities. In this paper, we consider the problem where an autonomous agent needs to act in a manner that clarifies its objectives to cooperative entities while preventing adversarial entities from inferring those objectives. We show that this problem is solvable when cooperative entities and adversarial entities use different types of sensors and/or prior knowledge. We develop two new solution approaches for computing such plans. One approach provides an optimal solution to the problem by using an IP solver to provide maximum obfuscation for adversarial entities while providing maximum legibility for cooperative entities in the environment, whereas the other approach provides a satisficing solution using heuristic-guided forward search to achieve preset levels of obfuscation and legibility for adversarial and cooperative entities respectively. We show the feasibility and utility of our algorithms through extensive empirical evaluation on problems derived from planning benchmarks.


title: Continuous Sentences Preserved Under Reduced Products

abstract: Answering a question of Cif\'u Lopes, we give a syntactic characterization of those continuous sentences that are preserved under reduced products of metric structures. In fact, we settle this question in the wider context of general structures as introduced by the second author.


title: Compositional Fairness Constraints for Graph Embeddings

abstract: Learning high-quality node embeddings is a key building block for machine learning models that operate on graph data, such as social networks and recommender systems. However, existing graph embedding techniques are unable to cope with fairness constraints, e.g., ensuring that the learned representations do not correlate with certain attributes, such as age or gender. Here, we introduce an adversarial framework to enforce fairness constraints on graph embeddings. Our approach is compositional---meaning that it can flexibly accommodate different combinations of fairness constraints during inference. For instance, in the context of social recommendations, our framework would allow one user to request that their recommendations are invariant to both their age and gender, while also allowing another user to request invariance to just their age. Experiments on standard knowledge graph and recommender system benchmarks highlight the utility of our proposed framework.


title: Constellation Loss: Improving the efficiency of deep metric learning loss functions for optimal embedding

abstract: Metric learning has become an attractive field for research on the latest years. Loss functions like contrastive loss, triplet loss or multi-class N-pair loss have made possible generating models capable of tackling complex scenarios with the presence of many classes and scarcity on the number of images per class not only work to build classifiers, but to many other applications where measuring similarity is the key. Deep Neural Networks trained via metric learning also offer the possibility to solve few-shot learning problems. Currently used state of the art loss functions such as triplet and contrastive loss functions, still suffer from slow convergence due to the selection of effective training samples that has been partially solved by the multi-class N-pair loss by simultaneously adding additional samples from the different classes. In this work, we extend triplet and multiclass-N-pair loss function by proposing the constellation loss metric where the distances among all class combinations are simultaneously learned. We have compared our constellation loss for visual class embedding showing that our loss function over-performs the other methods by obtaining more compact clusters while achieving better classification results.


title: A Taxonomy to Assess and Tailor Risk-based Testing in Recent Testing Standards

abstract: This article provides a taxonomy for risk-based testing that serves as a tool to define, tailor, or assess risk-based testing approaches in general and to instantiate risk-based testing approaches for the current testing standards ISO/IEC/IEEE 29119, ETSI EG and OWASP Security Testing Guide in particular. We demonstrate the usefulness of the taxonomy by applying it to the aforementioned standards as well as to the risk-based testing approaches SmartTesting, RACOMAT, PRISMA and risk-based test case prioritization using fuzzy expert systems. In this setting, the taxonomy is used to systematically identify deviations between the standards' requirements and the individual testing approaches so that we are able to position and compare the testing approaches and discuss their potential for practical application.


title: An Exploratory Study on Machine Learning Model Stores

abstract: Recent advances in Artificial Intelligence, especially in Machine Learning (ML), have brought applications previously considered as science fiction (e.g., virtual personal assistants and autonomous cars) into the reach of millions of everyday users. Since modern ML technologies like deep learning require considerable technical expertise and resource to build custom models, reusing existing models trained by experts has become essential. This is why in the past year model stores have been introduced, which, similar to mobile app stores, offer organizations and developers access to pre-trained models and/or their code to train, evaluate, and predict samples. This paper conducts an exploratory study on three popular model stores (AWS marketplace, Wolfram neural net repository, and ModelDepot) that compares the information elements (features and policies) provided by model stores to those used by the two popular mobile app stores (Google Play and Apple's App Store). We have found that the model information elements vary among the different model stores, with 65% elements shared by all three studied stores. Model stores share five information elements with mobile app stores, while eight elements are unique to model stores and four elements unique to app stores. Only few models were available on multiple model stores. Our findings allow to better understand the differences between ML models and "regular" source code components or applications, and provide inspiration to identify software engineering practices (e.g., in requirements and delivery) specific to ML applications.


title: Logarithmic structures of Fontaine-Illusie. II

abstract: We discuss log flat topology and log flat descents of log schemes


title: Improved object recognition using neural networks trained to mimic the brain's statistical properties

abstract: The current state-of-the-art object recognition algorithms, deep convolutional neural networks (DCNNs), are inspired by the architecture of the mammalian visual system, and are capable of human-level performance on many tasks. However, even these algorithms make errors. As they are trained for object recognition tasks, it has been shown that DCNNs develop hidden representations that resemble those observed in the mammalian visual system. Moreover, DCNNs trained on object recognition tasks are currently among the best models we have of the mammalian visual system. This led us to hypothesize that teaching DCNNs to achieve even more brain-like representations could improve their performance. To test this, we trained DCNNs on a composite task, wherein networks were trained to: a) classify images of objects; while b) having intermediate representations that resemble those observed in neural recordings from monkey visual cortex. Compared with DCNNs trained purely for object categorization, DCNNs trained on the composite task had better object recognition performance and are more robust to label corruption. Interestingly, we also found that neural data was not required, but randomized data with the same statistics as neural data also boosted performance. Our results outline a new way to train object recognition networks, using strategies in which the brain - or at least the statistical properties of its activation patterns - serves as a teacher signal for training DCNNs.


title: Kernel Truncated Randomized Ridge Regression: Optimal Rates and Low Noise Acceleration

abstract: In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the square loss, closing a long-standing gap between upper and lower bounds. Moreover, we show that our algorithm has faster finite-time and asymptotic rates on problems where the Bayes risk with respect to the square loss is small. We state our results using standard tools from the theory of least square regression in RKHSs, namely, the decay of the eigenvalues of the associated integral operator and the complexity of the optimal predictor measured through the integral operator.


title: Composing Task-Agnostic Policies with Deep Reinforcement Learning

abstract: The composition of elementary behaviors to solve challenging transfer learning problems is one of the key elements in building intelligent machines. To date, there has been plenty of work on learning task-specific policies or skills but almost no focus on composing necessary, task-agnostic skills to find a solution to new problems. In this paper, we propose a novel deep reinforcement learning-based skill transfer and composition method that takes the agent's primitive policies to solve unseen tasks. We evaluate our method in difficult cases where training policy through standard reinforcement learning (RL) or even hierarchical RL is either not feasible or exhibits high sample complexity. We show that our method not only transfers skills to new problem settings but also solves the challenging environments requiring both task planning and motion control with high data efficiency.


title: Counting Homomorphisms Modulo a Prime Number

abstract: Counting problems in general and counting graph homomorphisms in particular have numerous applications in combinatorics, computer science, statistical physics, and elsewhere. One of the most well studied problems in this area is #GraphHom(H) --- the problem of finding the number of homomorphisms from a given graph G to the graph H. Not only the complexity of this basic problem is known, but also of its many variants for digraphs, more general relational structures, graphs with weights, and others. In this paper we consider a modification of #GraphHom(H), the #_p GraphHom(H) problem, p a prime number: Given a graph G, find the number of homomorphisms from G to H modulo p. In a series of papers Faben and Jerrum, and Goebel et al. determined the complexity of #_2 GraphHom(H) in the case H (or, in fact, a certain graph derived from H) is square-free, that is, does not contain a 4-cycle. Also, Goebel et al. found the complexity of #_p GraphHom(H) for an arbitrary prime p when H is a tree. Here we extend the above result to show that the #_p GraphHom(H) problem is #_p P-hard whenever the derived graph associated with H is square-free and is not a star, which completely classifies the complexity of #_p GraphHom(H) for square-free graphs H.


title: Measuring Directed Triadic Closure with Closure Coefficients

abstract: Recent work studying triadic closure in undirected graphs has drawn attention to the distinction between measures that focus on the "center" node of a wedge (i.e., length-2 path) vs. measures that focus on the "initiator," a distinction with considerable consequences. Existing measures in directed graphs, meanwhile, have all been center-focused. In this work, we propose a family of eight directed closure coefficients that measure the frequency of triadic closure in directed graphs from the perspective of the node initiating closure. The eight coefficients correspond to different labelled wedges, where the initiator and center nodes are labelled, and we observe dramatic empirical variation in these coefficients on real-world networks, even in cases when the induced directed triangles are isomorphic. To understand this phenomenon, we examine the theoretical behavior of our closure coefficients under a directed configuration model. Our analysis illustrates an underlying connection between the closure coefficients and moments of the joint in- and out-degree distributions of the network, offering an explanation of the observed asymmetries. We also use our directed closure coefficients as predictors in two machine learning tasks. We find interpretable models with AUC scores above 0.92 in class-balanced binary prediction, substantially outperforming models that use traditional center-focused measures.


title: Sensitivity analysis using bias functions for studies extending inferences from a randomized trial to a target population

abstract: Extending (generalizing or transporting) causal inferences from a randomized trial to a target population requires ``generalizability'' or ``transportability'' assumptions, which state that randomized and non-randomized individuals are exchangeable conditional on baseline covariates. These assumptions are made on the basis of background knowledge, which is often uncertain or controversial, and need to be subjected to sensitivity analysis. We present simple methods for sensitivity analyses that do not require detailed background knowledge about specific unknown or unmeasured determinants of the outcome or modifiers of the treatment effect. Instead, our methods directly parameterize violations of the assumptions using bias functions. We show how the methods can be applied to non-nested trial designs, where the trial data are combined with a separately obtained sample of non-randomized individuals, as well as to nested trial designs, where a clinical trial is embedded within a cohort sampled from the target population. We illustrate the methods using data from a clinical trial comparing treatments for chronic hepatitis C infection.


title: Cell decompositions of character varieties

abstract: We establish curious Lefschetz property for generic character varieties of Riemann surfaces conjectured by Hausel, Letellier and Rodriguez-Villegas. Our main tool applies directly in the case when there is at least one puncture where the local monodromy has distinct eigenvalues. We pass to a vector bundle over the character variety, which is then decomposed into cells, which look like vector bundles over varieties associated to braids by Shende-Treumann-Zaslow. These varieties are in turn decomposed into cells that look like $(\mathbb{C}^*)^{d-2k}\times \mathbb{C}^k$. The curious Lefschetz property is shown to hold on each cell, and therefore holds for the character variety. To deduce the general case, we introduce a fictitious puncture with trivial monodromy, and show that the cohomology of the character variety where one puncture has trivial monodromy is isomorphic to the sign component of the $S_n$ action on the cohomology for the character variety where trivial monodromy is replaced by regular semisimple monodromy. This involves an argument with the Grothendieck-Springer sheaf, and analysis of how the cohomology of the character variety varies when the eigenvalues are moved around.


title: Empirical Risk Minimization in the Interpolating Regime with Application to Neural Network Learning

abstract: A common strategy to train deep neural networks (DNNs) is to use very large architectures and to train them until they (almost) achieve zero training error. Empirically observed good generalization performance on test data, even in the presence of lots of label noise, corroborate such a procedure. On the other hand, in statistical learning theory it is known that over-fitting models may lead to poor generalization properties, occurring in e.g. empirical risk minimization (ERM) over too large hypotheses classes. Inspired by this contradictory behavior, so-called interpolation methods have recently received much attention, leading to consistent and optimally learning methods for some local averaging schemes with zero training error. However, there is no theoretical analysis of interpolating ERM-like methods so far. We take a step in this direction by showing that for certain, large hypotheses classes, some interpolating ERMs enjoy very good statistical guarantees while others fail in the worst sense. Moreover, we show that the same phenomenon occurs for DNNs with zero training error and sufficiently large architectures.


title: HINT: Hierarchical Invertible Neural Transport for Density Estimation and Bayesian Inference

abstract: Many recent invertible neural architectures are based on coupling block designs where variables are divided in two subsets which serve as inputs of an easily invertible (usually affine) triangular transformation. While such a transformation is invertible, its Jacobian is very sparse and thus may lack expressiveness. This work presents a simple remedy by noting that subdivision and (affine) coupling can be repeated recursively within the resulting subsets, leading to an efficiently invertible block with dense, triangular Jacobian. By formulating our recursive coupling scheme via a hierarchical architecture, HINT allows sampling from a joint distribution p(y,x) and the corresponding posterior p(x|y) using a single invertible network. We evaluate our method on some standard data sets and benchmark its full power for density estimation and Bayesian inference on a novel data set of 2D shapes in Fourier parameterization, which enables consistent visualization of samples for different dimensionalities.


title: Sherlock: A Deep Learning Approach to Semantic Data Type Detection

abstract: Correctly detecting the semantic type of data columns is crucial for data science tasks such as automated data cleaning, schema matching, and data discovery. Existing data preparation and analysis systems rely on dictionary lookups and regular expression matching to detect semantic types. However, these matching-based approaches often are not robust to dirty data and only detect a limited number of types. We introduce Sherlock, a multi-input deep neural network for detecting semantic types. We train Sherlock on $686,765$ data columns retrieved from the VizNet corpus by matching $78$ semantic types from DBpedia to column headers. We characterize each matched column with $1,588$ features describing the statistical properties, character distributions, word embeddings, and paragraph vectors of column values. Sherlock achieves a support-weighted F$_1$ score of $0.89$, exceeding that of machine learning baselines, dictionary and regular expression benchmarks, and the consensus of crowdsourced annotations.


title: Large-$S$ limit of the large-$N$ theory for the triangular antiferromagnet

abstract: Large-$S$ and large-$N$ theories (spin value $S$ and spinor component number $N$) are complementary, and sometimes conflicting, approaches to quantum magnetism. While large-$S$ spin-wave theory captures the correct semiclassical behavior, large-$N$ theories, on the other hand, emphasize the quantumness of spin fluctuations. In order to evaluate the possibility of the non-trivial recovery of the semiclassical magnetic excitations within a large-$N$ approach, we compute the large-$S$ limit of the dynamic spin structure of the triangular lattice Heisenberg antiferromagnet within a Schwinger boson spin representation. We demonstrate that, only after the incorporation of Gaussian ($1/N$) corrections to the saddle-point ($N=\infty$) approximation, we are able to exactly reproduce the linear spin wave theory results in the large-$S$ limit. The key observation is that the effect of $1/N$ corrections is to cancel out exactly the main contribution of the saddle-point solution; while the collective modes (magnons) consist of two spinon bound states arising from the poles of the RPA propagator. This result implies that it is essential to consider the interaction of the spinons with the emergent gauge fields and that the magnon dispersion relation should not be identified with that of the saddle-point spinons.


title: Homotopies in Grothendieck fibrations

abstract: We define a natural 2-categorical structure on the base category of a large class of Grothendieck fibrations. Given any model category $\mathbf{C}$, we apply this construction to a fibration whose fibers are the homotopy categories of the slice categories $\mathbf{C}/A$, and we show that in the case $\mathbf{C}=\mathbf{Top}$, our construction applied to this fibration recovers the usual 2-category of spaces.


title: Safe Reinforcement Learning with Nonlinear Dynamics via Model Predictive Shielding

abstract: Reinforcement learning is a promising approach to synthesizing policies for challenging robotics tasks. A key problem is how to ensure safety of the learned policy---e.g., that a walking robot does not fall over or that an autonomous car does not run into an obstacle. We focus on the setting where the dynamics are known, and the goal is to ensure that a policy trained in simulation satisfies a given safety constraint. We propose an approach, called model predictive shielding (MPS), that switches on-the-fly between a learned policy and a backup policy to ensure safety. We prove that our approach guarantees safety, and empirically evaluate it on the cart-pole.


title: Mapping high-performance RNNs to in-memory neuromorphic chips

abstract: The increasing need for compact and low-power computing solutions for machine learning applications has triggered significant interest in energy-efficient neuromorphic systems. However, most of these architectures rely on spiking neural networks, which typically perform poorly compared to their non-spiking counterparts in terms of accuracy. In this paper, we propose a new adaptive spiking neuron model that can be abstracted as a low-pass filter. This abstraction enables faster and better training of spiking networks using back-propagation, without simulating spikes. We show that this model dramatically improves the inference performance of a recurrent neural network and validate it with three complex spatio-temporal learning tasks: the temporal addition task, the temporal copying task, and a spoken-phrase recognition task. We estimate at least 500x higher energy-efficiency using our models on compatible neuromorphic chips in comparison to Cortex-M4, a popular embedded microprocessor.


title: DAVE: A Deep Audio-Visual Embedding for Dynamic Saliency Prediction

abstract: This paper studies audio-visual deep saliency prediction. It introduces a conceptually simple and effective Deep Audio-Visual Embedding for dynamic saliency prediction dubbed ``DAVE" in conjunction with our efforts towards building an Audio-Visual Eye-tracking corpus named ``AVE". Despite existing a strong relation between auditory and visual cues for guiding gaze during perception, video saliency models only consider visual cues and neglect the auditory information that is ubiquitous in dynamic scenes. Here, we investigate the applicability of audio cues in conjunction with visual ones in predicting saliency maps using deep neural networks. To this end, the proposed model is intentionally designed to be simple. Two baseline models are developed on the same architecture which consists of an encoder-decoder. The encoder projects the input into a feature space followed by a decoder that infers saliency. We conduct an extensive analysis on different modalities and various aspects of multi-model dynamic saliency prediction. Our results suggest that (1) audio is a strong contributing cue for saliency prediction, (2) salient visible sound-source is the natural cause of the superiority of our Audio-Visual model, (3) richer feature representations for the input space leads to more powerful predictions even in absence of more sophisticated saliency decoders, and (4) Audio-Visual model improves over 53.54\% of the frames predicted by the best Visual model (our baseline). Our endeavour demonstrates that audio is an important cue that boosts dynamic video saliency prediction and helps models to approach human performance. The code is available at https://github.com/hrtavakoli/DAVE


title: The Revised TESS Input Catalog and Candidate Target List

abstract: We describe the catalogs assembled and the algorithms used to populate the revised TESS Input Catalog (TIC), based on the incorporation of the Gaia second data release. We also describe a revised ranking system for prioritizing stars for 2-minute cadence observations, and assemble a revised Candidate Target List (CTL) using that ranking. The TIC is available on the Mikulski Archive for Space Telescopes (MAST) server, and an enhanced CTL is available through the Filtergraph data visualization portal system at the URL http://filtergraph.vanderbilt.edu/tess_ctl.


title: Adversarial Distillation for Ordered Top-k Attacks

abstract: Deep Neural Networks (DNNs) are vulnerable to adversarial attacks, especially white-box targeted attacks. One scheme of learning attacks is to design a proper adversarial objective function that leads to the imperceptible perturbation for any test image (e.g., the Carlini-Wagner (C&W) method). Most methods address targeted attacks in the Top-1 manner. In this paper, we propose to learn ordered Top-k attacks (k>= 1) for image classification tasks, that is to enforce the Top-k predicted labels of an adversarial example to be the k (randomly) selected and ordered labels (the ground-truth label is exclusive). To this end, we present an adversarial distillation framework: First, we compute an adversarial probability distribution for any given ordered Top-k targeted labels with respect to the ground-truth of a test image. Then, we learn adversarial examples by minimizing the Kullback-Leibler (KL) divergence together with the perturbation energy penalty, similar in spirit to the network distillation method. We explore how to leverage label semantic similarities in computing the targeted distributions, leading to knowledge-oriented attacks. In experiments, we thoroughly test Top-1 and Top-5 attacks in the ImageNet-1000 validation dataset using two popular DNNs trained with clean ImageNet-1000 train dataset, ResNet-50 and DenseNet-121. For both models, our proposed adversarial distillation approach outperforms the C&W method in the Top-1 setting, as well as other baseline methods. Our approach shows significant improvement in the Top-5 setting against a strong modified C&W method.


title: Lifelong Neural Predictive Coding: Learning Cumulatively Online without Forgetting

abstract: In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper, we propose a new kind of connectionist architecture, the Sequential Neural Coding Network, that is robust to forgetting when learning from streams of data points and, unlike networks of today, does not learn via the popular back-propagation of errors. Grounded in the neurocognitive theory of predictive processing, our model adapts synapses in a biologically-plausible fashion while another neural system learns to direct and control this cortex-like structure, mimicking some of the task-executive control functionality of the basal ganglia. In our experiments, we demonstrate that our self-organizing system experiences significantly less forgetting compared to standard neural models, outperforming a swath of previously proposed methods, including rehearsal/data buffer-based methods, on both standard (SplitMNIST, Split Fashion MNIST, etc.) and custom benchmarks even though it is trained in a stream-like fashion. Our work offers evidence that emulating mechanisms in real neuronal systems, e.g., local learning, lateral competition, can yield new directions and possibilities for tackling the grand challenge of lifelong machine learning.


title: Uniqueness of the Phase Transition in Many-Dipole Cavity Quantum Electrodynamical Systems

abstract: The possibility of a superradiant phase transition in light-matter systems is the subject of much debate, due to numerous apparently conflicting no-go and counter no-go theorems. Using an arbitrary gauge approach we show that a unique phase transition does occur in archetypal many-dipole cavity QED systems, and that it manifests unambiguously via a macroscopic gauge-invariant polarisation. We find that the gauge choice controls the extent to which this polarisation is included as part of the radiative quantum subsystem and thereby determines the degree to which the abnormal phase is classed as superradiant. This resolves the long-standing paradox of no-go and counter no-go theorems for superradiance, which are shown to refer to different definitions of radiation.


title: Efficient Neural Task Adaptation by Maximum Entropy Initialization

abstract: Transferring knowledge from one neural network to another has been shown to be helpful for learning tasks with few training examples. Prevailing fine-tuning methods could potentially contaminate pre-trained features by comparably high energy random noise. This noise is mainly delivered from a careless replacement of task-specific parameters. We analyze theoretically such knowledge contamination for classification tasks and propose a practical and easy to apply method to trap and minimize the contaminant. In our approach, the entropy of the output estimates gets maximized initially and the first back-propagated error is stalled at the output of the last layer. Our proposed method not only outperforms the traditional fine-tuning, but also significantly speeds up the convergence of the learner. It is robust to randomness and independent of the choice of architecture. Overall, our experiments show that the power of transfer learning has been substantially underestimated so far.


title: Non-Reciprocal and Collimated Surface Plasmons in Drift-biased Graphene Metasurfaces

abstract: We explore the unusual non-reciprocal and diffraction-less properties of surface plasmon polaritons propagating in drift-biased graphene-based metasurfaces. We show that applying a drift-current on a graphene sheet leads to extremely asymmetric in-plane modal dispersions from terahertz to infrared frequencies, associated with plasmons with low-loss (high-loss and ultra-high confinement) traveling along (against) the bias. Strikingly, truly unidirectional wave propagation is prevented by the intrinsic nonlocal response of a graphene, a mechanism that shapes the energy flow over the surface. We also show that highly-directive hyperbolic plasmons completely immune to backscattering propagate obliquely along the drift in nanostructured graphene. Finally, we discuss how spin-orbit interactions can be exploited in this platform to efficiently launch collimated plasmons along a single direction while maintaining giant non-reciprocal responses. Our findings open a new paradigm to excite, collimate, steer, and process surface plasmons over a broad frequency band.


title: Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions

abstract: The rise of increasingly more powerful chatbots offers a new way to collect information through conversational surveys, where a chatbot asks open-ended questions, interprets a user's free-text responses, and probes answers whenever needed. To investigate the effectiveness and limitations of such a chatbot in conducting surveys, we conducted a field study involving about 600 participants. In this study with mostly open-ended questions, half of the participants took a typical online survey on Qualtrics and the other half interacted with an AI-powered chatbot to complete a conversational survey. Our detailed analysis of over 5200 free-text responses revealed that the chatbot drove a significantly higher level of participant engagement and elicited significantly better quality responses measured by Gricean Maxims in terms of their informativeness, relevance, specificity, and clarity. Based on our results, we discuss design implications for creating AI-powered chatbots to conduct effective surveys and beyond.


title: Image Detection and Digit Recognition to solve Sudoku as a Constraint Satisfaction Problem

abstract: Sudoku is a puzzle well-known to the scientific community with simple rules of completion, which may require a com-plex line of reasoning. This paper addresses the problem of partitioning the Sudoku image into a 1-D array, recognizing digits from the array and representing it as a Constraint Sat-isfaction Problem (CSP). In this paper, we introduce new fea-ture extraction techniques for recognizing digits, which are used with our benchmark classifiers in conjunction with the CSP algorithms to provide performance assessment. Experi-mental results show that application of CSP techniques can decrease the solution's search time by eliminating incon-sistent values from the search space.


title: MDE: Multiple Distance Embeddings for Link Prediction in Knowledge Graphs

abstract: Over the past decade, knowledge graphs became popular for capturing structured domain knowledge. Relational learning models enable the prediction of missing links inside knowledge graphs. More specifically, latent distance approaches model the relationships among entities via a distance between latent representations. Translating embedding models (e.g., TransE) are among the most popular latent distance approaches which use one distance function to learn multiple relation patterns. However, they are mostly inefficient in capturing symmetric relations since the representation vector norm for all the symmetric relations becomes equal to zero. They also lose information when learning relations with reflexive patterns since they become symmetric and transitive. We propose the Multiple Distance Embedding model (MDE) that addresses these limitations and a framework to collaboratively combine variant latent distance-based terms. Our solution is based on two principles: 1) we use a limit-based loss instead of a margin ranking loss and, 2) by learning independent embedding vectors for each of the terms we can collectively train and predict using contradicting distance terms. We further demonstrate that MDE allows modeling relations with (anti)symmetry, inversion, and composition patterns. We propose MDE as a neural network model that allows us to map non-linear relations between the embedding vectors and the expected output of the score function. Our empirical results show that MDE performs competitively to state-of-the-art embedding models on several benchmark datasets.