title: Safe Autonomous Racing via Approximate Reachability on Ego-vision

abstract: Racing demands each vehicle to drive at its physical limits, when any safety infraction could lead to catastrophic failure. In this work, we study the problem of safe reinforcement learning (RL) for autonomous racing, using the vehicle's ego-camera view and speed as input. Given the nature of the task, autonomous agents need to be able to 1) identify and avoid unsafe scenarios under the complex vehicle dynamics, and 2) make sub-second decision in a fast-changing environment. To satisfy these criteria, we propose to incorporate Hamilton-Jacobi (HJ) reachability theory, a safety verification method for general non-linear systems, into the constrained Markov decision process (CMDP) framework. HJ reachability not only provides a control-theoretic approach to learn about safety, but also enables low-latency safety verification. Though HJ reachability is traditionally not scalable to high-dimensional systems, we demonstrate that with neural approximation, the HJ safety value can be learned directly on vision context -- the highest-dimensional problem studied via the method, to-date. We evaluate our method on several benchmark tasks, including Safety Gym and Learn-to-Race (L2R), a recently-released high-fidelity autonomous racing environment. Our approach has significantly fewer constraint violations in comparison to other constrained RL baselines in Safety Gym, and achieves the new state-of-the-art results on the L2R benchmark task. We provide additional visualization of agent behavior at the following anonymized paper website: https://sites.google.com/view/safeautonomousracing/home


title: Hindsight Network Credit Assignment: Efficient Credit Assignment in Networks of Discrete Stochastic Units

abstract: Training neural networks with discrete stochastic variables presents a unique challenge. Backpropagation is not directly applicable, nor are the reparameterization tricks used in networks with continuous stochastic variables. To address this challenge, we present Hindsight Network Credit Assignment (HNCA), a novel gradient estimation algorithm for networks of discrete stochastic units. HNCA works by assigning credit to each unit based on the degree to which its output influences its immediate children in the network. We prove that HNCA produces unbiased gradient estimates with reduced variance compared to the REINFORCE estimator, while the computational cost is similar to that of backpropagation. We first apply HNCA in a contextual bandit setting to optimize a reward function that is unknown to the agent. In this setting, we empirically demonstrate that HNCA significantly outperforms REINFORCE, indicating that the variance reduction implied by our theoretical analysis is significant and impactful. We then show how HNCA can be extended to optimize a more general function of the outputs of a network of stochastic units, where the function is known to the agent. We apply this extended version of HNCA to train a discrete variational auto-encoder and empirically show it compares favourably to other strong methods. We believe that the ideas underlying HNCA can help stimulate new ways of thinking about efficient credit assignment in stochastic compute graphs.


title: Exposing Query Identification for Search Transparency

abstract: Search systems control the exposure of ranked content to searchers. In many cases, creators value not only the exposure of their content but, moreover, an understanding of the specific searches where the content is surfaced. The problem of identifying which queries expose a given piece of content in the ranking results is an important and relatively under-explored search transparency challenge. Exposing queries are useful for quantifying various issues of search bias, privacy, data protection, security, and search engine optimization. Exact identification of exposing queries in a given system is computationally expensive, especially in dynamic contexts such as web search. We explore the feasibility of approximate exposing query identification (EQI) as a retrieval task by reversing the role of queries and documents in two classes of search systems: dense dual-encoder models and traditional BM25 models. We then propose how this approach can be improved through metric learning over the retrieval embedding space. We further derive an evaluation metric to measure the quality of a ranking of exposing queries, as well as conducting an empirical analysis focusing on various practical aspects of approximate EQI. Overall, our work contributes a novel conception of transparency in search systems and computational means of achieving it.


title: Relational evolution with oscillating clocks

abstract: A fundamental description of time can be consistent not only with the usual monotonic behavior but also with a periodic physical clock variable, coupled to the degrees of freedom of a system evolving in time. Generically, one would in fact expect some kind of oscillating motion of a system that is dynamical and interacts with its surroundings, as required for a fundamental clock that can be noticed by any other system. Unitary evolution does not require a monotonic clock variable and can be achieved more generally by formally unwinding the periodic clock movement, keeping track not only of the value of the clock variable but also of the number of cycles it has gone through at any moment. As a result, the clock is generically in a quantum state with a superposition of different clock cycles, a key feature that distinguishes oscillating clocks from monotonic time. Because the clock and an evolving system have a common conserved energy, the clock is in different cycles for different energy eigenstates of the system state. Coherence could therefore be lost faster than observed, for instance if a system that would be harmonic in isolation is made anharmonic by interactions with a fundamental clock, implying observational bounds on fundamental clocks. Numerical computations show that coherence is almost maintained over long time scales provided the clock period is much smaller than the system period. Since the precision of atomic clocks could not be achieved if atomic frequencies would be subject to additional variations from coupling to a fundamental clock, an upper bound on the clock period can be obtained that turns out to be much smaller than currently available direct or indirect measurements of time. (abbreviated)


title: ASK: Adaptively Selecting Key Local Features for RGB-D Scene Recognition

abstract: Indoor scene images usually contain scattered objects and various scene layouts, which make RGB-D scene classification a challenging task. Existing methods still have limitations for classifying scene images with great spatial variability. Thus, how to extract local patch-level features effectively using only image labels is still an open problem for RGB-D scene recognition. In this paper, we propose an efficient framework for RGB-D scene recognition, which adaptively selects important local features to capture the great spatial variability of scene images. Specifically, we design a differentiable local feature selection (DLFS) module, which can extract the appropriate number of key local scenerelated features. Discriminative local theme-level and object-level representations can be selected with the DLFS module from the spatially-correlated multi-modal RGB-D features. We take advantage of the correlation between RGB and depth modalities to provide more cues for selecting local features. To ensure that discriminative local features are selected, the variational mutual information maximization loss is proposed. Additionally, the DLFS module can be easily extended to select local features of different scales. By concatenating the local-orderless and global structured multi-modal features, the proposed framework can achieve state-of-the-art performance on public RGB-D scene recognition datasets.


title: Uplink Power Control in Integrated Access and Backhaul Networks

abstract: Integrated access and backhaul (IAB) network is a novel radio access network (RAN) solution, enabling network densification for 5G and beyond. In this paper, we use power control combined with resource allocation algorithms to develop efficient IAB networks with high service coverage. Particularly, we develop a genetic algorithm-based solution for the power control of both user equipments and IAB nodes such that the network uplink service coverage probability is maximized. Finally, considering millimeter wave channel models, we study the effect of different parameters including minimum data rate requirement, coverage distance and transmit power on the network performance. As we show, a power allocation schemes with well-tuned parameters can improve the uplink performance of IAB networks considerably. Moreover, with millimeter wave communications and a proper network deployment, the effect of interference on the service coverage probability is negligible.


title: Long-term meter wavelength variability study of Blazar J1415+1320 using the Ooty Radio Telescope

abstract: J1415+1320 is a well-studied blazar that exhibits strong flux density variability at a wide range of radio frequencies (2.4 $-$ 230~GHz). In this letter, we present a variability study of this source at 327~MHz using the data obtained with the Ooty Radio Telescope taken during the period 1989 to 2018. Two significant flares are detected at epochs 2007.6 and 2008.6. These flares are also seen in the publicly available 15 and 37~GHz light curves but with a lead time of a few months. The fractional changes in the flux densities are larger at frequencies $>$ 15~GHz compared to those at 327~MHz and the spectral indices of the increased flux densities are flatter compared to the quiescent spectrum during these flares. These observed features are consistent with a model of uniformly expanding cloud of relativistic electrons or shock-in-jet model. Our 327~MHz dataset also overlaps with a rare form of variability $-$ symmetric achromatic variability (SAV) $-$ seen at higher frequencies ($>$ 15~GHz) toward the source. SAV is possibly due to gravitational milli-lensing of the core emission by an intervening massive object and is expected to be detected at all frequencies \cite{Vedantham2017}. No variability in association with the SAV events is seen in the 327~MHz dataset; however, if SAV is due to the lensing of core emission alone then the expected variability is less than 3$\sigma$ uncertainty in our measurements.


title: On the proper interval completion problem within some chordal subclasses

abstract: Given a property (graph class) $\Pi$, a graph $G$, and an integer $k$, the \emph{$\Pi$-completion} problem consists in deciding whether we can turn $G$ into a graph with the property $\Pi$ by adding at most $k$ edges to $G$. The $\Pi$-completion problem is known to be NP-hard for general graphs when $\Pi$ is the property of being a proper interval graph (PIG). In this work, we study the PIG-completion problem %when $\Pi$ is the class of proper interval graphs (PIG) within different subclasses of chordal graphs. We show that the problem remains NP-complete even when restricted to split graphs. We then turn our attention to positive results and present polynomial time algorithms to solve the PIG-completion problem when the input is restricted to caterpillar and threshold graphs. We also present an efficient algorithm for the minimum co-bipartite-completion for quasi-threshold graphs, which provides a lower bound for the PIG-completion problem within this graph class.


title: On the parametrized Tate construction

abstract: We introduce and study a genuine equivariant refinement of the Tate construction associated to an extension $\widehat{G}$ of a finite group $G$ by a compact Lie group $K$, which we call the parametrized Tate construction $(-)^{t_G K}$. Our main theorem establishes the coincidence of three conceptually distinct approaches to its construction when $K$ is also finite: one via recollement theory for the $K$-free $\widehat{G}$-family, another via parametrized ambidexterity for $G$-local systems, and the last via parametrized assembly maps. We also show that $(-)^{t_G K}$ uniquely admits the structure of a lax $G$-symmetric monoidal functor, thereby refining a theorem of Nikolaus and Scholze. Along the way, we apply a theorem of the second author to reprove a result of Ayala--Mazel-Gee--Rozenblyum on reconstructing a genuine $G$-spectrum from its geometric fixed points; our method of proof further yields a formula for the geometric fixed points of an $\mathcal{F}$-complete $G$-spectrum for any $G$-family $\mathcal{F}$.


title: Noncommutative ergodic theory of higher rank lattices

abstract: We survey recent results regarding the study of dynamical properties of the space of positive definite functions and characters of higher rank lattices. These results have several applications to ergodic theory, topological dynamics, unitary representation theory and operator algebras. The key novelty in our work is a dynamical dichotomy theorem for equivariant faithful normal unital completely positive maps between noncommutative von Neumann algebras and the space of bounded measurable functions defined on the Poisson boundary of semisimple Lie groups.


title: Roman domination in graphs with minimum degree at least two and some forbidden cycles

abstract: Let $G=(V,E)$ be a graph of order $n$ and let $\gamma _{R}(G)$ and $\partial (G)$ denote the Roman domination number and the differential of $G,$ respectively. In this paper we prove that for any integer $k\geq 0$, if $G$ is a graph of order $n\geq 6k+9$, minimum degree $\delta \geq 2,$ which does not contain any induced $\{C_{5},C_{8},\ldots ,C_{3k+2}\}$% -cycles, then $\gamma _{R}(G)\leq \frac{(4k+8)n}{6k+11}$. This bound is an improvement of the bounds given in [E.W. Chambers, B. Kinnersley, N. Prince, and D.B. West, Extremal problems for Roman domination, SIAM J. Discrete Math. 23 (2009) 1575--1586] when $k=0,$ {and [S. Bermudo, On the differential and Roman domination number of a graph with minimum degree two, Discrete Appl. Math. 232 (2017), 64--72] when }$k=1.$ Moreover, using the Gallai-type result involving the Roman domination number and the differential of graphs established by Bermudo et al. stating that $\gamma _{R}(G)+\partial (G)=n$, we have $\partial (G)\geq \frac{(2k+3)n}{6k+11},$ thereby settling the conjecture of Bermudo posed in the second paper.


title: Semi-automated checking for regulatory compliance in e-Health

abstract: One of the main issues of every business process is to be compliant with legal rules. This work presents a methodology to check in a semi-automated way the regulatory compliance of a business process. We analyse an e-Health hospital service in particular: the Hospital at Home (HaH) service. The paper shows, at first, the analysis of the hospital business using the Business Process Management and Notation (BPMN) standard language, then, the formalization in Defeasible Deontic Logic (DDL) of some rules of the European General Data Protection Regulation (GDPR). The aim is to show how to combine a set of tasks of a business with a set of rules to be compliant with, using a tool.


title: Gray Matter Segmentation in Ultra High Resolution 7 Tesla ex vivo T2w MRI of Human Brain Hemispheres

abstract: Ex vivo MRI of the brain provides remarkable advantages over in vivo MRI for visualizing and characterizing detailed neuroanatomy. However, automated cortical segmentation methods in ex vivo MRI are not well developed, primarily due to limited availability of labeled datasets, and heterogeneity in scanner hardware and acquisition protocols. In this work, we present a high resolution 7 Tesla dataset of 32 ex vivo human brain specimens. We benchmark the cortical mantle segmentation performance of nine neural network architectures, trained and evaluated using manually-segmented 3D patches sampled from specific cortical regions, and show excellent generalizing capabilities across whole brain hemispheres in different specimens, and also on unseen images acquired at different magnetic field strength and imaging sequences. Finally, we provide cortical thickness measurements across key regions in 3D ex vivo human brain images. Our code and processed datasets are publicly available at https://github.com/Pulkit-Khandelwal/picsl-ex-vivo-segmentation.


title: The average size of $3$-torsion in class groups of $2$-extensions

abstract: We determine the average size of the 3-torsion in class groups of $G$-extensions of a number field when $G$ is any transitive $2$-group containing a transposition, for example $D_4$. It follows from the Cohen--Lenstra--Martinet heuristics that the average size of the $p$-torsion in class groups of $G$-extensions of a number field is conjecturally finite for any $G$ and most $p$ (including $p\nmid|G|$). Previously this conjecture had only been proven in the cases of $G=S_2$ with $p=3$ and $G=S_3$ with $p=2$. We also show that the average $3$-torsion in a certain relative class group for these $G$-extensions is as predicted by Cohen and Martinet, proving new cases of the Cohen--Lenstra--Martinet heuristics. Our new method also works for many other permutation groups $G$ that are not $2$-groups.


title: MOSS I: Double radio relics in the Saraswati supercluster

abstract: Superclusters are the largest objects in the Universe, and they provide a unique opportunity to study how galaxy clusters are born at the junction of the cosmic web as well as the distribution of magnetic fields and relativistic particles beyond cluster volume. The field of radio astronomy is going through an exciting and important era of the Square Kilometer Array (SKA). We now have the most sensitive functional radio telescopes, such as the MeerKAT, which offers high angular resolution and sensitivity towards diffuse and faint radio sources. To study the radio environments around supercluster, we observed the (core part of) {\it Saraswati} supercluster with the MeerKAT. From our MeerKAT Observation of the {\it Saraswati} Supercluster (MOSS) project, the initial results of the pilot observations of two massive galaxy clusters, A2631 and ZwCl2341.1+0000, which are located around the dense central part of the {\it Saraswati} supercluster, were discussed. In this paper, we describe the observations and data analysis details, including direction-dependent calibration. In particular, we focus on the ZwCl2341.1+0000 galaxy cluster, which hosts double radio relics and puzzling diffuse radio source in the filamentary network. We have imaged these double radio relics in our high resolution and sensitive L-band MeerKAT observation and a puzzling radio source, located between relics, in the low-resolution image. We also derived the spectra of double radio relics using MeerKAT and archival GMRT observations. A following papers will focus on the formation of radio relics and halo, as well as radio galaxy properties in a supercluster core environment.


title: Nonlinear Atomic Force Microscopy: Squeezing and Skewness of Micro-Mechanical Oscillators interacting with a Surface

abstract: We propose a two-frequency driving scheme in dynamic atomic force microscopy that maximizes the interaction time between tip and sample. Using a stochastic description of the cantilever dynamics, we predict large classical squeezing and a small amount of skewness of the tip's phase-space probability distribution. Strong position squeezing will require close contact between tip and surface, while momentum squeezing would also be possible in the van der Waals region of the tip-surface force. Employing a generalized Caldeira-Leggett model, we predict that surface-dependent dissipative forces may be the dominant source of quantum effects and propose a procedure to isolate quantum effects from thermal fluctuations.


title: L\'{e}vy walk dynamics in non-static media

abstract: Almost all the media the particles move in are non-static. Depending on the expected resolution of the studied dynamics and the amplitude of the displacement of the media, sometimes the non-static behaviours of the media can not be ignored. In this paper, we build the model describing L\'evy walks in non-static media, where the physical and comoving coordinates are connected by scale factor. We derive the equation governing the probability density function of the position of the particles in comoving coordinate. Using the Hermite orthogonal polynomial expansions, some statistical properties are obtained, such as mean squared displacements (MSDs) in both coordinates and kurtosis. For some representative non-static media and L\'{e}vy walks, the asymptotic behaviors of MSDs in both coordinates are analyzed in detail. The stationary distributions and mean first passage time for some cases are also discussed through numerical simulations.


title: Adversarial Scene Reconstruction and Object Detection System for Assisting Autonomous Vehicle

abstract: In the current computer vision era classifying scenes through video surveillance systems is a crucial task. Artificial Intelligence (AI) Video Surveillance technologies have been advanced remarkably while artificial intelligence and deep learning ascended into the system. Adopting the superior compounds of deep learning visual classification methods achieved enormous accuracy in classifying visual scenes. However, the visual classifiers face difficulties examining the scenes in dark visible areas, especially during the nighttime. Also, the classifiers face difficulties in identifying the contexts of the scenes. This paper proposed a deep learning model that reconstructs dark visual scenes to clear scenes like daylight, and the method recognizes visual actions for the autonomous vehicle. The proposed model achieved 87.3 percent accuracy for scene reconstruction and 89.2 percent in scene understanding and detection tasks.


title: Deep Human-guided Conditional Variational Generative Modeling for Automated Urban Planning

abstract: Urban planning designs land-use configurations and can benefit building livable, sustainable, safe communities. Inspired by image generation, deep urban planning aims to leverage deep learning to generate land-use configurations. However, urban planning is a complex process. Existing studies usually ignore the need of personalized human guidance in planning, and spatial hierarchical structure in planning generation. Moreover, the lack of large-scale land-use configuration samples poses a data sparsity challenge. This paper studies a novel deep human guided urban planning method to jointly solve the above challenges. Specifically, we formulate the problem into a deep conditional variational autoencoder based framework. In this framework, we exploit the deep encoder-decoder design to generate land-use configurations. To capture the spatial hierarchy structure of land uses, we enforce the decoder to generate both the coarse-grained layer of functional zones, and the fine-grained layer of POI distributions. To integrate human guidance, we allow humans to describe what they need as texts and use these texts as a model condition input. To mitigate training data sparsity and improve model robustness, we introduce a variational Gaussian embedding mechanism. It not just allows us to better approximate the embedding space distribution of training data and sample a larger population to overcome sparsity, but also adds more probabilistic randomness into the urban planning generation to improve embedding diversity so as to improve robustness. Finally, we present extensive experiments to validate the enhanced performances of our method.


title: Adversarial Attack across Datasets

abstract: Existing transfer attack methods commonly assume that the attacker knows the training set (e.g., the label set, the input size) of the black-box victim models, which is usually unrealistic because in some cases the attacker cannot know this information. In this paper, we define a Generalized Transferable Attack (GTA) problem where the attacker doesn't know this information and is acquired to attack any randomly encountered images that may come from unknown datasets. To solve the GTA problem, we propose a novel Image Classification Eraser (ICE) that trains a particular attacker to erase classification information of any images from arbitrary datasets. Experiments on several datasets demonstrate that ICE greatly outperforms existing transfer attacks on GTA, and show that ICE uses similar texture-like noises to perturb different images from different datasets. Moreover, fast fourier transformation analysis indicates that the main components in each ICE noise are three sine waves for the R, G, and B image channels. Inspired by this interesting finding, we then design a novel Sine Attack (SA) method to optimize the three sine waves. Experiments show that SA performs comparably to ICE, indicating that the three sine waves are effective and enough to break DNNs under the GTA setting.


title: Certified Patch Robustness via Smoothed Vision Transformers

abstract: Certified patch defenses can guarantee robustness of an image classifier to arbitrary changes within a bounded contiguous region. But, currently, this robustness comes at a cost of degraded standard accuracies and slower inference times. We demonstrate how using vision transformers enables significantly better certified patch robustness that is also more computationally efficient and does not incur a substantial drop in standard accuracy. These improvements stem from the inherent ability of the vision transformer to gracefully handle largely masked images. Our code is available at https://github.com/MadryLab/smoothed-vit.


title: Decomposing Convolutional Neural Networks into Reusable and Replaceable Modules

abstract: Training from scratch is the most common way to build a Convolutional Neural Network (CNN) based model. What if we can build new CNN models by reusing parts from previously build CNN models? What if we can improve a CNN model by replacing (possibly faulty) parts with other parts? In both cases, instead of training, can we identify the part responsible for each output class (module) in the model(s) and reuse or replace only the desired output classes to build a model? Prior work has proposed decomposing dense-based networks into modules (one for each output class) to enable reusability and replaceability in various scenarios. However, this work is limited to the dense layers and based on the one-to-one relationship between the nodes in consecutive layers. Due to the shared architecture in the CNN model, prior work cannot be adapted directly. In this paper, we propose to decompose a CNN model used for image classification problems into modules for each output class. These modules can further be reused or replaced to build a new model. We have evaluated our approach with CIFAR-10, CIFAR-100, and ImageNet tiny datasets with three variations of ResNet models and found that enabling decomposition comes with a small cost (1.77% and 0.85% for top-1 and top-5 accuracy, respectively). Also, building a model by reusing or replacing modules can be done with a 2.3% and 0.5% average loss of accuracy. Furthermore, reusing and replacing these modules reduces CO2e emission by ~37 times compared to training the model from scratch.


title: Is it time to swish? Comparing activation functions in solving the Helmholtz equation using physics-informed neural networks

abstract: Solving the wave equation numerically constitutes the majority of the computational cost for applications like seismic imaging and full waveform inversion. An alternative approach is to solve the frequency domain Helmholtz equation, since it offers a reduction in dimensionality as it can be solved per frequency. However, computational challenges with the classical Helmholtz solvers such as the need to invert a large stiffness matrix can make these approaches computationally infeasible for large 3D models or for modeling high frequencies. Moreover, these methods do not have a mechanism to transfer information gained from solving one problem to the next. This becomes a bottleneck for applications like full waveform inversion where repeated modeling is necessary. Therefore, recently a new approach based on the emerging paradigm of physics informed neural networks (PINNs) has been proposed to solve the Helmholtz equation. The method has shown promise in addressing several challenging associated with the conventional algorithms, including flexibility to model additional physics and the use of transfer learning to speed up computations. However, the approach still needs further developments to be fully practicable. Foremost amongst the challenges is the slow convergence speed and reduced accuracy, especially in presence of sharp heterogeneities in the velocity model. Therefore, with an eye on exploring how improved convergence can be obtained for the PINN Helmholtz solvers, we study different activation functions routinely used in the PINN literature, in addition to the swish activation function - a variant of ReLU that has shown improved performance on a number of data science problems. Through a comparative study, we find that swish yields superior performance compared to the other activation functions routinely used in the PINN literature.


title: The Sigma-Max System Induced from Randomness and Fuzziness

abstract: This paper managed to induce probability theory (sigma system) and possibility theory (max system) respectively from randomness and fuzziness, through which the premature theory of possibility is expected to be well founded. Such an objective is achieved by addressing three open key issues: a) the lack of clear mathematical definitions of randomness and fuzziness; b) the lack of intuitive mathematical definition of possibility; c) the lack of abstraction procedure of the axiomatic definitions of probability/possibility from their intuitive definitions. Especially, the last issue involves the question why the key axiom of "maxitivity" is adopted for possibility measure. By taking advantage of properties of the well-defined randomness and fuzziness, we derived the important conclusion that "max" is the only but un-strict disjunctive operator that is applicable across the fuzzy event space, and is an exact operator for fuzzy feature extraction that assures the max inference is an exact mechanism. It is fair to claim that the long-standing problem of lack of consensus to the foundation of possibility theory is well resolved, which would facilitate wider adoption of possibility theory in practice and promote cross prosperity of the two uncertainty theories of probability and possibility.


title: EMDS-7: Environmental Microorganism Image Dataset Seventh Version for Multiple Object Detection Evaluation

abstract: The Environmental Microorganism Image Dataset Seventh Version (EMDS-7) is a microscopic image data set, including the original Environmental Microorganism images (EMs) and the corresponding object labeling files in ".XML" format file. The EMDS-7 data set consists of 41 types of EMs, which has a total of 2365 images and 13216 labeled objects. The EMDS-7 database mainly focuses on the object detection. In order to prove the effectiveness of EMDS-7, we select the most commonly used deep learning methods (Faster-RCNN, YOLOv3, YOLOv4, SSD and RetinaNet) and evaluation indices for testing and evaluation. EMDS-7 is freely published for non-commercial purpose at: https://figshare.com/articles/dataset/EMDS-7_DataSet/16869571


title: Validity of solid-state Li$^+$ diffusion coefficient estimation by electrochemical approaches for lithium-ion batteries

abstract: The solid-state diffusion coefficient of the electrode active material is one of the key parameters in lithium-ion battery modelling. Conventionally, this diffusion coefficient is estimated through the galvanostatic intermittent titration technique (GITT). In this work, the validity of GITT and a faster alternative technique, intermittent current interruption (ICI), are investigated regarding their effectiveness through a black-box testing approach. A Doyle-Fuller-Newman model with parameters for a LiNi$_{0.8}$Mn$_{0.1}$Co$_{0.1}$O$_2$ electrode is used as a fairly faithful representation as a real battery system, and the GITT and ICI experiments are simulated to extract the diffusion coefficient. With the parameters used in this work, the results show that both the GITT and ICI methods can identify the solid-state diffusion coefficient very well compared to the value used as input into the simulation model. The ICI method allows more frequent measurement but the experiment time is 85% less than what takes to perform a GITT test. Different fitting approaches and fitting length affected the estimation accuracy, however not significantly. Moreover, a thinner electrode, a higher C-rate and a greater electrolyte diffusion coefficient will lead to an estimation of a higher solid-state diffusion coefficient, generally closer to the target value.


title: Nonstandard Null Lagrangians and gauge Functions for Newtonian Law of Inertia

abstract: New null Lagrangians and gauge functions are derived and they are called nonstandard because their forms are different than those previously found. The invariance of the action is used to make the Lagrangians and gauge functions exact. The first exact nonstandard null Lagrangian and its gauge function for the law of inertia are obtained, and their physical implications are discussed.


title: Multifocal Stereoscopic Projection Mapping

abstract: Stereoscopic projection mapping (PM) allows a user to see a three-dimensional (3D) computer-generated (CG) object floating over physical surfaces of arbitrary shapes around us using projected imagery. However, the current stereoscopic PM technology only satisfies binocular cues and is not capable of providing correct focus cues, which causes a vergence--accommodation conflict (VAC). Therefore, we propose a multifocal approach to mitigate VAC in stereoscopic PM. Our primary technical contribution is to attach electrically focus-tunable lenses (ETLs) to active shutter glasses to control both vergence and accommodation. Specifically, we apply fast and periodical focal sweeps to the ETLs, which causes the "virtual image'" (as an optical term) of a scene observed through the ETLs to move back and forth during each sweep period. A 3D CG object is projected from a synchronized high-speed projector only when the virtual image of the projected imagery is located at a desired distance. This provides an observer with the correct focus cues required. In this study, we solve three technical issues that are unique to stereoscopic PM: (1) The 3D CG object is displayed on non-planar and even moving surfaces; (2) the physical surfaces need to be shown without the focus modulation; (3) the shutter glasses additionally need to be synchronized with the ETLs and the projector. We also develop a novel compensation technique to deal with the "lens breathing" artifact that varies the retinal size of the virtual image through focal length modulation. Further, using a proof-of-concept prototype, we demonstrate that our technique can present the virtual image of a target 3D CG object at the correct depth. Finally, we validate the advantage provided by our technique by comparing it with conventional stereoscopic PM using a user study on a depth-matching task.


title: Active Learning of Neural Collision Handler for Complex 3D Mesh Deformations

abstract: We present a robust learning algorithm to detect and handle collisions in 3D deforming meshes. Our collision detector is represented as a bilevel deep autoencoder with an attention mechanism that identifies colliding mesh sub-parts. We use a numerical optimization algorithm to resolve penetrations guided by the network. Our learned collision handler can resolve collisions for unseen, high-dimensional meshes with thousands of vertices. To obtain stable network performance in such large and unseen spaces, we progressively insert new collision data based on the errors in network inferences. We automatically label these data using an analytical collision detector and progressively fine-tune our detection networks. We evaluate our method for collision handling of complex, 3D meshes coming from several datasets with different shapes and topologies, including datasets corresponding to dressed and undressed human poses, cloth simulations, and human hand poses acquired using multiview capture systems. Our approach outperforms supervised learning methods and achieves $93.8-98.1\%$ accuracy compared to the groundtruth by analytic methods. Compared to prior learning methods, our approach results in a $5.16\%-25.50\%$ lower false negative rate in terms of collision checking and a $9.65\%-58.91\%$ higher success rate in collision handling.


title: Pre-training Molecular Graph Representation with 3D Geometry

abstract: Molecular graph representation learning is a fundamental problem in modern drug and material discovery. Molecular graphs are typically modeled by their 2D topological structures, but it has been recently discovered that 3D geometric information plays a more vital role in predicting molecular functionalities. However, the lack of 3D information in real-world scenarios has significantly impeded the learning of geometric graph representation. To cope with this challenge, we propose the Graph Multi-View Pre-training (GraphMVP) framework where self-supervised learning (SSL) is performed by leveraging the correspondence and consistency between 2D topological structures and 3D geometric views. GraphMVP effectively learns a 2D molecular graph encoder that is enhanced by richer and more discriminative 3D geometry. We further provide theoretical insights to justify the effectiveness of GraphMVP. Finally, comprehensive experiments show that GraphMVP can consistently outperform existing graph SSL methods.


title: An Independent Study of Reinforcement Learning and Autonomous Driving

abstract: Reinforcement learning has become one of the most trending subjects in the recent decade. It has seen applications in various fields such as robot manipulations, autonomous driving, path planning, computer gaming, etc. We accomplished three tasks during the course of this project. Firstly, we studied the Q-learning algorithm for tabular environments and applied it successfully to an OpenAi Gym environment, Taxi. Secondly, we gained an understanding of and implemented the deep Q-network algorithm for Cart-Pole environment. Thirdly, we also studied the application of reinforcement learning in autonomous driving and its combination with safety check constraints (safety controllers). We trained a rough autonomous driving agent using highway-gym environment and explored the effects of various environment configurations like reward functions on the agent training performance.


title: Measurement of the Coherent Elastic Neutrino-Nucleus Scattering Cross Section on CsI by COHERENT

abstract: We measured the cross section of coherent elastic neutrino-nucleus scattering (\cevns{}) using a CsI[Na] scintillating crystal in a high flux of neutrinos produced at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory. New data collected before detector decommissioning has more than doubled the dataset since the first observation of \cevns{}, achieved with this detector. Systematic uncertainties have also been reduced with an updated quenching model, allowing for improved precision. With these analysis improvements, the COHERENT collaboration determined the cross section to be $(165^{+30}_{-25})\times10^{-40}$~cm$^2$, consistent with the standard model, giving the most precise measurement of \cevns{} yet. The timing structure of the neutrino beam has been exploited to compare the \cevns{} cross section from scattering of different neutrino flavors. This result places leading constraints on neutrino non-standard interactions while testing lepton flavor universality and measures the weak mixing angle as $\sin^2\theta_{W}=0.220^{+0.028}_{-0.026}$ at $Q^2\approx(50\text{ MeV})^2$


title: CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Training

abstract: With the rise of large-scale pre-trained language models, open-domain question-answering (ODQA) has become an important research topic in NLP. Based on the popular pre-training fine-tuning approach, we posit that an additional in-domain pre-training stage using a large-scale, natural, and diverse question-answering (QA) dataset can be beneficial for ODQA. Consequently, we propose a novel QA dataset based on the Common Crawl project in this paper. Using the readily available schema.org annotation, we extract around 130 million multilingual question-answer pairs, including about 60 million English data-points. With this previously unseen number of natural QA pairs, we pre-train popular language models to show the potential of large-scale in-domain pre-training for the task of question-answering. In our experiments, we find that pre-training question-answering models on our Common Crawl Question Answering dataset (CCQA) achieves promising results in zero-shot, low resource and fine-tuned settings across multiple tasks, models and benchmarks.


title: The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization

abstract: Despite progress across a broad range of applications, Transformers have limited success in systematic generalization. The situation is especially frustrating in the case of algorithmic tasks, where they often fail to find intuitive solutions that route relevant information to the right node/operation at the right time in the grid represented by Transformer columns. To facilitate the learning of useful control flow, we propose two modifications to the Transformer architecture, copy gate and geometric attention. Our novel Neural Data Router (NDR) achieves 100% length generalization accuracy on the classic compositional table lookup task, as well as near-perfect accuracy on the simple arithmetic task and a new variant of ListOps testing for generalization across computational depths. NDR's attention and gating patterns tend to be interpretable as an intuitive form of neural routing. Our code is public.


title: Identifying Similar Test Cases That Are Specified in Natural Language

abstract: Software testing is still a manual process in many industries, despite the recent improvements in automated testing techniques. As a result, test cases are often specified in natural language by different employees and many redundant test cases might exist in the test suite. This increases the (already high) cost of test execution. Manually identifying similar test cases is a time-consuming and error-prone task. Therefore, in this paper, we propose an unsupervised approach to identify similar test cases. Our approach uses a combination of text embedding, text similarity and clustering techniques to identify similar test cases. We evaluate five different text embedding techniques, two text similarity metrics, and two clustering techniques to cluster similar test steps and four techniques to identify similar test cases from the test step clusters. Through an evaluation in an industrial setting, we showed that our approach achieves a high performance to cluster test steps (an F-score of 87.39%) and identify similar test cases (an F-score of 83.47%). Furthermore, a validation with developers indicates several different practical usages of our approach (such as identifying redundant and legacy test cases), which help to reduce the testing manual effort and time.


title: Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

abstract: This paper studies the allocation of shared resources between vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) links in vehicle-to-everything (V2X) communications. In existing algorithms, dynamic vehicular environments and quantization of continuous power become the bottlenecks for providing an effective and timely resource allocation policy. In this paper, we develop two algorithms to deal with these difficulties. First, we propose a deep reinforcement learning (DRL)-based resource allocation algorithm to improve the performance of both V2I and V2V links. Specifically, the algorithm uses deep Q-network (DQN) to solve the sub-band assignment and deep deterministic policy-gradient (DDPG) to solve the continuous power allocation problem. Second, we propose a meta-based DRL algorithm to enhance the fast adaptability of the resource allocation policy in the dynamic environment. Numerical results demonstrate that the proposed DRL-based algorithm can significantly improve the performance compared to the DQN-based algorithm that quantizes continuous power. In addition, the proposed meta-based DRL algorithm can achieve the required fast adaptation in the new environment with limited experiences.


title: Continual Learning on Noisy Data Streams via Self-Purified Replay

abstract: Continually learning in the real world must overcome many challenges, among which noisy labels are a common and inevitable issue. In this work, we present a repla-ybased continual learning framework that simultaneously addresses both catastrophic forgetting and noisy labels for the first time. Our solution is based on two observations; (i) forgetting can be mitigated even with noisy labels via self-supervised learning, and (ii) the purity of the replay buffer is crucial. Building on this regard, we propose two key components of our method: (i) a self-supervised replay technique named Self-Replay which can circumvent erroneous training signals arising from noisy labeled data, and (ii) the Self-Centered filter that maintains a purified replay buffer via centrality-based stochastic graph ensembles. The empirical results on MNIST, CIFAR-10, CIFAR-100, and WebVision with real-world noise demonstrate that our framework can maintain a highly pure replay buffer amidst noisy streamed data while greatly outperforming the combinations of the state-of-the-art continual learning and noisy label learning methods. The source code is available at http://vision.snu.ac.kr/projects/SPR


title: Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Models

abstract: Recently, NLP models have achieved remarkable progress across a variety of tasks; however, they have also been criticized for being not robust. Many robustness problems can be attributed to models exploiting spurious correlations, or shortcuts between the training data and the task labels. Most existing work identifies a limited set of task-specific shortcuts via human priors or error analyses, which requires extensive expertise and efforts. In this paper, we aim to automatically identify such spurious correlations in NLP models at scale. We first leverage existing interpretability methods to extract tokens that significantly affect model's decision process from the input text. We then distinguish "genuine" tokens and "spurious" tokens by analyzing model predictions across multiple corpora and further verify them through knowledge-aware perturbations. We show that our proposed method can effectively and efficiently identify a scalable set of "shortcuts", and mitigating these leads to more robust models in multiple applications.


title: Scalable and robust quantum computing on qubit arrays with fixed coupling

abstract: We propose a scheme for scalable and robust quantum computing on two-dimensional arrays of qubits with fixed longitudinal coupling. This opens the possibility for bypassing the device complexity associated with tunable couplers required in conventional quantum computing hardware. Our approach is based on driving a subarray of qubits such that the total multi-qubit Hamiltonian can be decomposed into a sum of commuting few-qubit blocks, and then efficient optimization of the unitary evolution within each block. Each driving pulse can implement a target gate on the driven qubits, and at the same time implement identity gates on the neighbouring undriven qubits, cancelling any unwanted evolution due to the constant qubit-qubit interaction. We show that it is possible to realise a universal set of quantum gates with high fidelity on the basis blocks, and by shifting the driving pattern one can realise an arbitrary quantum circuit on the array. Allowing for imperfect Hamiltonian characterisation, we use robust optimal control to obtain fidelities around 99.99% despite 1% uncertainty in the qubit-qubit and drive-qubit couplings, and a detuning uncertainty at 0.1% of the qubit-qubit coupling strength. This robust feature is crucial for scaling up as parameter uncertainty is significant in large devices.


title: Detectability and global observer design for 2D Navier-Stokes equations with uncertain inputs

abstract: We present simulation friendly detectability conditions for 2D Navier-Stokes Equation (NSE) with periodic boundary conditions, and describe a generic class of ``detectable'' observation operators: it includes pointwise evaluation of NSE's solution at interpolation nodes, and spatial average measurements. For ``detectable'' observation operators we design a global infinite-dimensional observer for NSE with uncertain possibly destabilizing inputs: in our numerical experiments we illustrate $H^1$-sensitivity of NSE to small perturbations of initial conditions, yet the observer converges for known and uncertain inputs.


title: Model-Change Active Learning in Graph-Based Semi-Supervised Learning

abstract: Active learning in semi-supervised classification involves introducing additional labels for unlabelled data to improve the accuracy of the underlying classifier. A challenge is to identify which points to label to best improve performance while limiting the number of new labels. "Model-change" active learning quantifies the resulting change incurred in the classifier by introducing the additional label(s). We pair this idea with graph-based semi-supervised learning methods, that use the spectrum of the graph Laplacian matrix, which can be truncated to avoid prohibitively large computational and storage costs. We consider a family of convex loss functions for which the acquisition function can be efficiently approximated using the Laplace approximation of the posterior distribution. We show a variety of multiclass examples that illustrate improved performance over prior state-of-art.


title: A More Efficient, Doubly Robust, Nonparametric Estimator of Treatment Effects in Multilevel Studies

abstract: When studying treatment effects in multilevel studies, investigators commonly use (semi-)parametric estimators, which make strong parametric assumptions about the outcome, the treatment, and/or the correlation structure between study units in a cluster. We propose a novel estimator of treatment effects that does not make such assumptions. Specifically, the new estimator is shown to be doubly robust, asymptotically Normal, and often more efficient than existing estimators, all without having to make any parametric modeling assumptions about the outcome, the treatment, and the correlation structure. We achieve this by estimating two non-standard nuisance functions in causal inference, the conditional propensity score and the outcome covariance model, using existing existing machine learning methods designed for independent and identically distributed (i.i.d) data. The new estimator is also demonstrated in simulated and real data where the new estimator is drastically more efficient than existing estimators, especially when studying cluster-specific treatment effects.


title: New insights on the nebular emission, ionizing radiation and low metallicity of Green Peas from advanced modelling

abstract: Low-metallicity, compact starburst galaxies referred to as Green Peas (GPs) provide a unique window to study galactic evolution across cosmic epochs. In this work, we present new deep optical spectra for three GPs from OSIRIS at the 10m Gran Telescopio Canarias (GTC), which are studied using a state-of-the-art methodology. A stellar population synthesis is conducted with 1098 spectral templates. The methodology succeeds at characterising stellar populations from 0.5 Myrs to 10 Gyrs. The light distribution shows a large red excess from a single population with $log\left(age\right) > 8.5yr$ in the GP sample analysed. This points towards an incomplete characterisation of the gas luminosity, whose continuum already accounts between $7.4\%$ and $27.6\%$ in the galaxy sample. The emission spectra are fitted with the largest Bayesian chemical model consisting of a electron temperature, a electron density, the logarithmic extinction coefficient and eleven ionic species under the direct method paradigm. Additionally, building on previous work, we propose a neural networks sampler to constrain the effective temperature and ionization parameter of each source from photoionization model grids. Finally, we combine both methodologies into a 16-dimensional model, which for the first time, simultaneously explores the direct method and photoionization parameter spaces. Both techniques consistently indicate a low metallicity gas, $7.76<12+log\left(\frac{O}{H}\right)<8.04$, ionized by strong radiation fields, in agreement with previous works.


title: Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentation

abstract: Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a high possibility of being deployed for real-world, resource-constrained systems such as autonomous vehicles and drones. However, owing to their non-differentiable and complex neuronal dynamics, most previous SNN optimization methods have been limited to image recognition. In this paper, we explore the SNN applications beyond classification and present semantic segmentation networks configured with spiking neurons. Specifically, we first investigate two representative SNN optimization techniques for recognition tasks (i.e., ANN-SNN conversion and surrogate gradient learning) on semantic segmentation datasets. We observe that, when converted from ANNs, SNNs suffer from high latency and low performance due to the spatial variance of features. Therefore, we directly train networks with surrogate gradient learning, resulting in lower latency and higher performance than ANN-SNN conversion. Moreover, we redesign two fundamental ANN segmentation architectures (i.e., Fully Convolutional Networks and DeepLab) for the SNN domain. We conduct experiments on two public semantic segmentation benchmarks including the PASCAL VOC2012 dataset and the DDD17 event-based dataset. In addition to showing the feasibility of SNNs for semantic segmentation, we show that SNNs can be more robust and energy-efficient compared to their ANN counterparts in this domain.


title: On the objectivity of measurement outcomes

abstract: Recent arguments, involving entangled systems shared by sets of Wigner's friend arrangements, allegedly show that the assumption that the experiments performed by the friends yield definite outcomes, is incompatible with quantum predictions. From this, it is concluded that the results of measurements cannot be thought of as being actual or objective. Here, I show that these arguments depend upon a mistaken assumption, regarding the ("mixed") correlations between the results of the friends and those of "the Wigners", which leads to invalid predictions. It is not, then, that the assumption of definite outcomes leads to trouble, but that the results derived with such an assumption are contrasted with faulty predictions. Next, I explore the more famous no-go theorems by Frauchiger and Renner and by Brukner, on which these recent arguments are motivated. Regarding the first, I show that, although it is cast in a different form, it also rests on the mistaken assumption regarding "mixed" correlations--rendering it invalid. Regarding Brukner's theorem, I point out that it depends on the quite unattractive assumption of locality, a fact that fully diminishes its force. Throughout, I illustrate my claims with explicit calculations within pilot-wave theory.


title: Constrained Covariance Steering Based Tube-MPPI

abstract: In this paper, we present a new trajectory optimization algorithm for stochastic linear systems which combines Model Predictive Path Integral (MPPI) control with Constrained Covariance Steering (CSS) to achieve high performance with safety guarantees (robustness). Although MPPI can be used to solve complex nonlinear trajectory optimization problems, it may not always handle constraints effectively and its performance may degrade in the presence of unmodeled disturbances. By contrast, CCS can handle probabilistic state and / or input constraints (e.g., chance constraints) and also steer the state covariance of the system to a desired positive definite matrix (control of uncertainty) which both imply that CCS can provide robustness against stochastic disturbances. CCS, however, suffers from scalability issues and cannot handle complex cost functions in general. We argue that the combination of the two methods yields a class of trajectory optimization algorithms that can achieve high performance (a feature of MPPI) while ensuring safety with high probability (a feature of CCS). The efficacy of our algorithm is demonstrated in an obstacle avoidance problem and a circular track path generation problem.


title: A deep learning model for classification of diabetic retinopathy in eye fundus images based on retinal lesion detection

abstract: Diabetic retinopathy (DR) is the result of a complication of diabetes affecting the retina. It can cause blindness, if left undiagnosed and untreated. An ophthalmologist performs the diagnosis by screening each patient and analyzing the retinal lesions via ocular imaging. In practice, such analysis is time-consuming and cumbersome to perform. This paper presents a model for automatic DR classification on eye fundus images. The approach identifies the main ocular lesions related to DR and subsequently diagnoses the illness. The proposed method follows the same workflow as the clinicians, providing information that can be interpreted clinically to support the prediction. A subset of the kaggle EyePACS and the Messidor-2 datasets, labeled with ocular lesions, is made publicly available. The kaggle EyePACS subset is used as a training set and the Messidor-2 as a test set for lesions and DR classification models. For DR diagnosis, our model has an area-under-the-curve, sensitivity, and specificity of 0.948, 0.886, and 0.875, respectively, which competes with state-of-the-art approaches.


title: Convergence of regularized particle filters for stochastic reaction networks

abstract: Filtering for stochastic reaction networks (SRNs) is an important problem in systems/synthetic biology aiming to estimate the state of unobserved chemical species. A good solution to it can provide scientists valuable information about the hidden dynamic state and enable optimal feedback control. Usually, the model parameters need to be inferred simultaneously with state variables, and a conventional particle filter can fail to solve this problem accurately due to sample degeneracy. In this case, the regularized particle filter (RPF) is preferred to the conventional ones, as the RPF can mitigate sample degeneracy by perturbing particles with artificial noise. However, the artificial noise introduces an additional bias to the estimate, and, thus, it is questionable whether the RPF can provide reliable results for SRNs. In this paper, we aim to identify conditions under which the RPF converges to the exact filter in the filtering problem determined by a bimolecular network. First, we establish computationally efficient RPFs for SRNs on different scales using different dynamical models, including the continuous-time Markov process, tau-leaping model, and piecewise deterministic process. Then, by parameter sensitivity analyses, we show that the established RPFs converge to the exact filters if all reactions leading to an increase of the molecular population have linearly growing propensities and some other mild conditions are satisfied simultaneously. This ensures the performance of the RPF for a large class of SRNs, and several numerical examples are presented to illustrate our results.


title: Demonstration of the Rodeo Algorithm on a Quantum Computer

abstract: The rodeo algorithm is an efficient algorithm for eigenstate preparation and eigenvalue estimation for any observable on a quantum computer. The only requirement is that the initial state has sufficient overlap probability with the desired eigenstate. While it is exponentially faster than well-known algorithms such as phase estimation and adiabatic evolution for eigenstate preparation, it has yet to be implemented on an actual quantum device. In this work, we apply the rodeo algorithm to determine the energy levels of a random one-qubit Hamiltonian, resulting in a relative error of $0.08\%$ using mid-circuit measurements on the IBM Q device Casablanca. This surpasses the accuracy of directly-prepared eigenvector expectation values using the same quantum device. We take advantage of the high-accuracy energy determination and use the Hellmann-Feynman theorem to compute eigenvector expectation values for different random one-qubit observable. For the Hellmann-Feynman calculations, we find a relative error of $0.7\%$. We conclude by discussing possible future applications of the rodeo algorithm for multi-qubit Hamiltonians.


title: Modeling the Spectral Diversity of Quasars in the Sixteenth Data Release from the Sloan Digital Sky Survey

abstract: We present a new approach to capturing the broad diversity of emission line and continuum properties in quasar spectra. We identify populations of spectrally similar quasars through pixel-level clustering on 12,968 high signal-to-noise spectra from the Sloan Digital Sky Survey (SDSS) in the redshift range of $1.57<z<2.4$. Our clustering analysis finds 396 quasar spectra that are not assigned to any population, 15 misclassified spectra, and six quasars with incorrect redshifts. We compress the quasar populations into a library of 684 high signal-to-noise composite spectra, anchored in redshift space by the Mg II emission line. Principal component analysis on the library results in an eigenspectrum basis spanning 1067 to 4007 $\r{A}$. We model independent samples of SDSS quasar spectra with the eigenbasis, allowing for a free redshift parameter. Our models achieve a median reduced chi-squared on non-BAL quasar spectra that is reduced by 8.5% relative to models using the eigenspectra from the SDSS spectroscopic pipeline. A significant contribution to the relative improvement is from the ability to reconstruct the range of emission line variation. The redshift estimates from our model are consistent with the Mg II emission line redshift with an average offset that displays 51.4% less redshift-dependent variation relative to the SDSS eigenspectra. Our method for developing quasar spectra models can improve automated classification and predict the intrinsic spectrum in regions affected by intervening absorbers such as Ly$\alpha$, C IV, and Mg II, thus benefiting studies of large-scale structure.


title: Attention-Free Keyword Spotting

abstract: Till now, attention-based models have been used with great success in the keyword spotting problem domain. However, in light of recent advances in deep learning, the question arises whether self-attention is truly irreplaceable for recognizing speech keywords. We thus explore the usage of gated MLPs --previously shown to be alternatives to transformers in vision tasks-- for the keyword spotting task. We provide a family of highly efficient MLP-based models for keyword spotting, with less than 0.5 million parameters. We show that our approach achieves competitive performance on Google Speech Commands V2-12 and V2-35 benchmarks with much fewer parameters than self-attention-based methods.


title: Is that a Duiker or Dik Dik Next to the Giraffe? Impacts of Uncertainty on Classification Efficiency in Citizen Science

abstract: Quality control is an ongoing concern in citizen science that is often managed by replication to consensus in online tasks such as image classification. Numerous factors can lead to disagreement, including image quality problems, interface specifics, and the complexity of the content itself. We conducted trace ethnography with statistical and qualitative analyses of six Snapshot Safari projects to understand the content characteristics that can lead to uncertainty and low consensus. This study contributes content categorization based on aggregate classifications to characterize image complexity, with analysis that confirms that the categories impact classification efficiency, and an inductively generated set of additional image quality issues that also impact volunteers' ability to confidently classify content. The results suggest that different conceptualizations and measures of consensus may be needed for different types of content, and aggregate responses offer a way to identify content that needs different handling when complexity cannot be determined $a$ $priori$.


title: Leveraging Spatial and Temporal Correlations in Sparsified Mean Estimation

abstract: We study the problem of estimating at a central server the mean of a set of vectors distributed across several nodes (one vector per node). When the vectors are high-dimensional, the communication cost of sending entire vectors may be prohibitive, and it may be imperative for them to use sparsification techniques. While most existing work on sparsified mean estimation is agnostic to the characteristics of the data vectors, in many practical applications such as federated learning, there may be spatial correlations (similarities in the vectors sent by different nodes) or temporal correlations (similarities in the data sent by a single node over different iterations of the algorithm) in the data vectors. We leverage these correlations by simply modifying the decoding method used by the server to estimate the mean. We provide an analysis of the resulting estimation error as well as experiments for PCA, K-Means and Logistic Regression, which show that our estimators consistently outperform more sophisticated and expensive sparsification methods.


title: Hindsight: Posterior-guided training of retrievers for improved open-ended generation

abstract: Many text generation systems benefit from using a retriever to retrieve passages from a textual knowledge corpus (e.g., Wikipedia) which are then provided as additional context to the generator. For open-ended generation tasks (like generating informative utterances in conversations) many varied passages may be equally relevant and we find that existing methods that jointly train the retriever and generator underperform: the retriever may not find relevant passages even amongst the top-10 and hence the generator may not learn a preference to ground its generated output in them. We propose using an additional guide retriever that is allowed to use the target output and "in hindsight" retrieve relevant passages during training. We model the guide retriever after the posterior distribution Q of passages given the input and the target output and train it jointly with the standard retriever and the generator by maximizing the evidence lower bound (ELBo) in expectation over Q. For informative conversations from the Wizard of Wikipedia dataset, with posterior-guided training, the retriever finds passages with higher relevance in the top-10 (23% relative improvement), the generator's responses are more grounded in the retrieved passage (19% relative improvement) and the end-to-end system produces better overall output (6.4% relative improvement).


title: On Efficient Range-Summability of Ideally IID Random Variables in Two or Higher Dimensions

abstract: $d$-dimensional (for $d>1$) efficient range-summability ($d$D-ERS) of random variables (RVs) is a fundamental algorithmic problem that has applications to two important families of database problems, namely, fast approximate wavelet tracking (FAWT) on data streams and approximately answering range-sum queries over a data cube. Whether there are efficient solutions to the $d$D-ERS problem, or to the latter database problem, have been two long-standing open problems. Both are solved in this work. Specifically, we propose a novel solution framework to $d$D-ERS on RVs that have Gaussian or Poisson distribution. Our $d$D-ERS solutions are the first ones that have polylogarithmic time complexities. Furthermore, we develop a novel $k$-wise independence theory that allows our $d$D-ERS solutions to have both high computational efficiencies and strong provable independence guarantees. Finally, we show that under a sufficient and likely necessary condition, certain existing solutions for 1D-ERS can be generalized to higher dimensions.


title: Detection of the Permanent Strain Offset Component of Gravitational-Wave Memory in Black Hole Mergers

abstract: We propose a novel approach to detecting the elusive gravitational-wave memory predicted by general relativity to accompany black hole mergers: direct measurement of the permanent space-time strain offset. Compared to previous techniques modeling and disentangling both the "chirp" and memory signals, this approach has several advantages: it targets the feature of the signal carrying nearly all its Shannon information, has great simplicity, circumvents the need for precise modeling of the time evolution of all components of the gravitational wave signal, and uses only data largely free of the more complicated chirp signal. The frequency spectrum of the predicted memory signal is roughly similar to that of the chirp signal. However its inclusion of lower frequencies, where noise and data calibration are problematic, makes detection difficult but not impossible. We applied this novel analysis, implemented with a template-like algorithm, to a selection of 67 observations of 41 black hole mergers in the LIGO/Virgo Gravitational Wave Transient Catalog. Statistical significance was assessed by analyzing many time-shifted intervals. The result: a few possible detections ($2\sigma-4\sigma$) and many upper limits. The probability that a random ensemble of 67 strain time series, with the same noise but no memory signals, will yield a particular figure-of-merit computed for the actual data is approximately 0.1. Several validation checks proved useless, partly due to large measurement and theoretical uncertainties, so these results should be viewed with reservation. Appendices contain MatLab code for various operations, including an algorithm for the complex Fourier transform of arbitrarily spaced data.


title: Multi-Stage Sparse Resource Allocation for Control of Spreading Processes over Networks

abstract: In this paper we propose a method for sparse dynamic allocation of resources to bound the risk of spreading processes, such as epidemics and wildfires, using convex optimization and dynamic programming techniques. Here, risk is defined as the risk of an outbreak, i.e. the product of the probability of an outbreak occurring over a time interval and the future impact of that outbreak, and we can allocate budgeted resources each time step to bound or minimize the risk. Our method in particular provides sparsity of resources, which is important due to the large network structures involved with spreading processes and has advantages when resources can not be distributed widely.


title: Learning Mean-Field Equations from Particle Data Using WSINDy

abstract: We develop a weak-form sparse identification method for interacting particle systems (IPS) with the primary goals of reducing computational complexity for large particle number $N$ and offering robustness to either intrinsic or extrinsic noise. In particular, we use concepts from mean-field theory of IPS in combination with the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) to provide a fast and reliable system identification scheme for recovering the governing stochastic differential equations for an IPS when the number of particles per experiment $N$ is on the order of several thousand and the number of experiments $M$ is less than 100. This is in contrast to existing work showing that system identification for $N$ less than 100 and $M$ on the order of several thousand is feasible using strong-form methods. We prove that under some standard regularity assumptions the scheme converges with rate $\mathcal{O}(N^{-1/2})$ in the ordinary least squares setting and we demonstrate the convergence rate numerically on several systems in one and two spatial dimensions. Our examples include a canonical problem from homogenization theory (as a first step towards learning coarse-grained models), the dynamics of an attractive-repulsive swarm, and the IPS description of the parabolic-elliptic Keller-Segel model for chemotaxis.

categories: stat.ML cs.LG cs.NA math.DS math.NA math.OC math.PR


title: Universal nonadiabatic energy pumping in a quasiperiodically driven extended system

abstract: The paradigm of Floquet engineering of topological states of matter can be generalized into the time-quasiperiodic scenario, where a lower dimensional time-dependent system maps into a higher dimensional one by combining the physical dimensions with additional synthetic dimensions generated by multiple incommensurate driving frequencies. Different than most previous works in which gapped topological phases were considered, we propose an experimentally realizable, one dimensional chain driven by two frequencies, which maps into a gapless Weyl semimetal in synthetic dimension. Based on analytical reasoning and numerical simulations, we found the nonadiabatic quantum dynamics of this system exhibit energy pumping behaviors characterized by universal functions. We also numerically found such behaviors are robust against a considerable amount of spatial disorder.


title: "Knights": First Place Submission for VIPriors21 Action Recognition Challenge at ICCV 2021

abstract: This technical report presents our approach "Knights" to solve the action recognition task on a small subset of Kinetics-400 i.e. Kinetics400ViPriors without using any extra-data. Our approach has 3 main components: state-of-the-art Temporal Contrastive self-supervised pretraining, video transformer models, and optical flow modality. Along with the use of standard test-time augmentation, our proposed solution achieves 73% on Kinetics400ViPriors test set, which is the best among all of the other entries Visual Inductive Priors for Data-Efficient Computer Vision's Action Recognition Challenge, ICCV 2021.


title: Vector fields with big and small volume on the 2-sphere

abstract: We consider the problem of minimal volume vector fields on a given Riemann surface, specialising on the case of $M^\star$, that is, the arbitrary radius 2-sphere with two antipodal points removed. We discuss the homology theory of the unit tangent bundle $(T^1M^\star,\partial T^1M^\star)$ in relation with calibrations and a certain minimal volume equation. A particular family $X_{\mathrm{m},k},\:k\in\mathbb{N}$, of minimal vector fields on $M^\star$ is found in an original fashion. The family has unbounded volume, $\lim_k\mathrm{vol}({X_{\mathrm{m},k}}_{|\Omega})=+\infty$, on any given open subset $\Omega$ of $M^\star$ and indeed satisfies the necessary differential equation for minimality. Another vector field $X_\ell$ is discovered on a region $\Omega_1\subset\mathbb{S}^2$, with volume smaller than any other known \textit{optimal} vector field restricted to $\Omega_1$.


title: Hybrid-mode-family Kerr optical parametric oscillation for robust coherent light generation on chip

abstract: Optical parametric oscillation (OPO) using the third-order nonlinearity ($\chi^{(3)}$) in integrated photonics platforms is an emerging approach for coherent light generation, and has shown great promise in achieving broad spectral coverage with small device footprints and at low pump powers. However, current $\chi^{(3)}$ nanophotonic OPO devices use pump, signal, and idler modes of the same transverse spatial mode family. As a result, such single-mode-family OPO (sOPO) is inherently sensitive in dispersion and can be challenging to scalably fabricate and implement. In this work, we propose to use different families of transverse spatial modes for pump, signal, and idler, which we term as hybrid-mode-family OPO (hOPO). We demonstrate its unprecedented robustness in dispersion versus device geometry, pump frequency, and temperature. Moreover, we show the capability of the hOPO scheme to generate a few milliwatts of output signal power with a power conversion efficiency of approximately 8 $\%$ and without competitive processes. The hOPO scheme is an important counterpoint to existing sOPO approaches, and is particularly promising as a robust method to generate coherent on-chip visible and infrared light sources.


title: Finite-density QCD, $\mathcal{PT}$ symmetry, and exotic phases

abstract: We study the phase structure of effective models of finite-density QCD using analytic and lattice simulation techniques developed for the study of non-Hermitian and $\mathcal{PT}$-symmetric QFTs. Finite-density QCD is symmetric under the combined operation of the charge and complex conjugation operators $\mathcal{CK}$, which falls into the class of so-called generalized $\mathcal{PT}$ symmetries. We show that $\mathcal{PT}$-symmetric quantum field theories can support patterned ground-state field configurations in the vicinity of a critical endpoint. We apply our methods to a lattice heavy quark model at nonzero chemical potential that displays patterning behavior for a range of parameters. We derive a simple approximate criterion for the formation of these patterns, which can be used with lattice results.


title: Fractional revival on non-cospectral vertices

abstract: Perfect state transfer and fractional revival can be used to move information between pairs of vertices in a quantum network. While perfect state transfer has received a lot of attention, fractional revival is newer and less studied. One problem is to determine the differences between perfect state transfer and fractional revival. If perfect state transfer occurs between two vertices in a graph, the vertices must be cospectral. Further if there is perfect state transfer between vertices $a$ and $b$ in a graph, there cannot be perfect state transfer from $a$ to any other vertex. No examples of unweighted graphs with fractional revival between non-cospectral vertices were known; here we give an infinite family of such graphs. No examples of unweighted graphs where the pairs involved in fractional revival overlapped were known; we give examples of such graphs as well.


title: Separation for isometric group actions and hyperimaginary independence

abstract: We generalize P. M. Neumann's Lemma to the setting of isometric actions on metric spaces and use it to prove several results in continuous logic related to algebraic independence. In particular, we show that algebraic independence satisfies the full existence axiom (which answers a question of Goldbring) and is implied by dividing independence. We also use the relationship between hyperimaginaries and continuous imaginaries to derive further results that are new even for discrete theories. Specifically, we show that if $\mathbb{M}$ is a monster model of a discrete or continuous theory, then bounded-closure independence in $\mathbb{M}^{\text{heq}}$ satisfies full existence (which answers a question of Adler) and is implied by dividing independence.


title: A degree preserving delta wye transformation with applications to 6-regular graphs and Feynman periods

abstract: We investigate a degree preserving variant of the $\Delta$-Y transformation which replaces a triangle with a new 6-valent vertex which has double edges to the vertices that had been in the triangle. This operation is relevant for understanding scalar Feynman integrals in 6 dimensions. We study the structure of equivalence classes under this operation and its inverse, with particular attention to when the equivalence classes are finite, when they contain simple 6-regular graphs, and when they contain doubled 3-regular graphs. The last of these, in particular, is relevant for the Feynman integral calculations and we make some observations linking the structure of these classes to the Feynman periods. Furthermore, we investigate properties of minimal graphs in these equivalence classes.


title: Efficient formation pathway of methyl formate: the role of OH radicals on ice dust

abstract: Three structural isomers of the C2H4O2 molecule, namely, methyl formate (MF; HCOOCH3), acetic acid (AA; CH3COOH), and glycol aldehyde (GA; HOCH2CHO), have attracted considerable attention as targets for understanding pathways towards molecular complexity in the interstellar medium (ISM). Among these isomers, MF is decisively abundant in various astronomical objects. For various formation pathways of MF, surface reactions on cosmic dust would play an important role. However, when compared to observations, the formation of MF has been found to be relatively inefficient in laboratory experiments in which methanol (CH3OH)-dominant ices were processed by ultraviolet (UV) photons and cosmic-ray analogues. Here, we show experimental results on the effective formation of MF by the photolysis of CH3OH on water ice at 10 K. We found that the key parameter leading to the efficient formation of MF is the supply of OH radicals by the photolysis of H2O, which significantly differs from CH3OH-rich experimental conditions. Moreover, using an ultra-high-sensitivity surface analysis method, we succeeded in constraining the decisive formation pathway of MF via the photolysis of methoxymethanol (MM; CH3OCH2OH), which would improve our current understanding of chemical evolution in the ISM.


title: 3D Reconstruction of Curvilinear Structures with Stereo Matching DeepConvolutional Neural Networks

abstract: Curvilinear structures frequently appear in microscopy imaging as the object of interest. Crystallographic defects, i.e., dislocations, are one of the curvilinear structures that have been repeatedly investigated under transmission electron microscopy (TEM) and their 3D structural information is of great importance for understanding the properties of materials. 3D information of dislocations is often obtained by tomography which is a cumbersome process since it is required to acquire many images with different tilt angles and similar imaging conditions. Although, alternative stereoscopy methods lower the number of required images to two, they still require human intervention and shape priors for accurate 3D estimation. We propose a fully automated pipeline for both detection and matching of curvilinear structures in stereo pairs by utilizing deep convolutional neural networks (CNNs) without making any prior assumption on 3D shapes. In this work, we mainly focus on 3D reconstruction of dislocations from stereo pairs of TEM images.


title: Observability of fidelity decay at the Lyapunov rate in few-qubit quantum simulations

abstract: In certain regimes, the fidelity of quantum states will decay at a rate set by the classical Lyapunov exponent. This serves both as one of the most important examples of the quantum-classical correspondence principle and as an accurate test for the presence of chaos. While detecting this phenomenon is one of the first useful calculations that noisy quantum computers without error correction can perform [G. Benenti et al., Phys. Rev. E 65, 066205 (2001)], a thorough study of the quantum sawtooth map reveals that observing the Lyapunov regime is just beyond the reach of present-day devices. We prove that there are three bounds on the ability of any device to observe the Lyapunov regime and give the first quantitatively accurate description of these bounds: (1) the Fermi golden rule decay rate must be larger than the Lyapunov rate, (2) the quantum dynamics must be diffusive rather than localized, and (3) the initial decay rate must be slow enough for Lyapunov decay to be observable. This last bound, which has not been recognized previously, places a limit on the maximum amount of noise that can be tolerated. The theory implies that an absolute minimum of 6 qubits is required. Recent experiments on IBM-Q and IonQ imply that some combination of a noise reduction by up to 100$\times$ per gate and large increases in connectivity and gate parallelization are also necessary. Finally, scaling arguments are given that quantify the ability of future devices to observe the Lyapunov regime based on trade-offs between hardware architecture and performance.


title: Application of Homomorphic Encryption in Medical Imaging

abstract: In this technical report, we explore the use of homomorphic encryption (HE) in the context of training and predicting with deep learning (DL) models to deliver strict \textit{Privacy by Design} services, and to enforce a zero-trust model of data governance. First, we show how HE can be used to make predictions over medical images while preventing unauthorized secondary use of data, and detail our results on a disease classification task with OCT images. Then, we demonstrate that HE can be used to secure the training of DL models through federated learning, and report some experiments using 3D chest CT-Scans for a nodule detection task.


title: Using the Semantic Information G Measure to Explain and Extend Rate-Distortion Functions and Maximum Entropy Distributions

abstract: In the rate-distortion function and the Maximum Entropy (ME) method, Minimum Mutual In-formation (MMI) distributions and ME distributions are expressed by Bayes-like formulas, in-cluding Negative Exponential Functions (NEFs) and partition functions. Why do these non-probability functions exist in Bayes-like formulas? On the other hand, the rate-distortion function has three disadvantages: (1) the distortion function is subjectively defined; (2) the defi-nition of the distortion function between instances and labels is often difficult; (3) it cannot be used for data compression according to the labels' semantic meanings. The author has proposed using the semantic information G measure with both statistical probability and logical probability before. We can now explain NEFs as truth functions, partition functions as logical probabilities, Bayes-like formulas as semantic Bayes' formulas, MMI as Semantic Mutual Information (SMI), and ME as extreme ME minus SMI. In overcoming the above disadvantages, this paper sets up the relationship between truth functions and distortion functions, obtains truth functions from samples by machine learning, and constructs constraint conditions with truth functions to extend rate-distortion functions. Two examples are used to help readers understand the MMI iteration and to support the theoretical results. Using truth functions and the semantic information G measure, we can combine machine learning and data compression, including semantic com-pression. We need further studies to explore general data compression and recovery, according to the semantic meaning.


title: Human factors engineering research on single pilot operations for large commercial aircraft: Status and prospect

abstract: The civil aviation community is actively exploring and developing the solutions of single pilot operations SPO for large commercial aircraft. Human factors engineering research for SPO has been launched, and the research mainly focuses on three research solutions: flight deck airborne equipment upgrade, flight support from ground stations, and the combined SPO solution of "flight deck airborne equipment upgrade, flight support from ground stations". This paper reviews and analyzez the progress of human factors engineering research on SPO. The preliminary research outcome tends to support the combined SPO solution. However, the current human factors engineering research is not comprehensive and cannot provide a complete human factors engineering solution for SPO. For future human factors engineering research, this paper analyzes the key human factors issues on SPO and points out the gaps in the current research and the areas for future work. Finally, this paper puts forward an overall strategy and recommendations for future human factors engineering research on SPO.


title: Assessing Risks and Modeling Threats in the Internet of Things

abstract: Threat modeling and risk assessments are common ways to identify, estimate, and prioritize risk to national, organizational, and individual operations and assets. Several threat modeling and risk assessment approaches have been proposed prior to the advent of the Internet of Things (IoT) that focus on threats and risks in information technology (IT). Due to shortcomings in these approaches and the fact that there are significant differences between the IoT and IT, we synthesize and adapt these approaches to provide a threat modeling framework that focuses on threats and risks in the IoT. In doing so, we develop an IoT attack taxonomy that describes the adversarial assets, adversarial actions, exploitable vulnerabilities, and compromised properties that are components of any IoT attack. We use this IoT attack taxonomy as the foundation for designing a joint risk assessment and maturity assessment framework that is implemented as an interactive online tool. The assessment framework this tool encodes provides organizations with specific recommendations about where resources should be devoted to mitigate risk. The usefulness of this IoT framework is highlighted by case study implementations in the context of multiple industrial manufacturing companies, and the interactive implementation of this framework is available at http://iotrisk.andrew.cmu.edu.


title: Ion-Driven Instabilities in the Inner Heliosphere I: Statistical Trends

abstract: Instabilities described by linear theory characterize an important form of wave-particle interaction in the solar wind. We diagnose unstable behavior of solar wind plasma between 0.3 and 1 au via the Nyquist criterion, applying it to fits of $\sim1.5$M proton and $\alpha$ particle Velocity Distribution Functions (VDFs) observed by \emph{Helios I} and \emph{II}. The variation of the fraction of unstable intervals with radial distance from the Sun is linear, signaling a gradual decline in the activity of unstable modes. When calculated as functions of the solar wind velocity and Coulomb number, we obtain more extreme, exponential trends in the regions where collisions appear to have a notable influence on the VDF. Instability growth rates demonstrate similar behavior, and significantly decrease with Coulomb number. We find that, for a non-negligible fraction of observations, the proton beam or secondary component might not be detected due to instrument resolution limitations, and demonstrate that the impact of this issue does not affect the main conclusions of this work.


title: Areas on the space of smooth probability density functions on $S^2$

abstract: We present symbolic and numerical methods for computing Poisson brackets on the spaces of measures with positive densities of the plane, the 2-torus, and the 2-sphere. We apply our methods to compute symplectic areas of finite regions for the case of the 2-sphere, including an explicit example for Gaussian measures with positive densities.

categories: math.SG cs.LG math-ph math.MP math.PR math.ST stat.TH


title: 4D flight trajectory prediction using a hybrid Deep Learning prediction method based on ADS-B technology: a case study of Hartsfield-Jackson Atlanta International Airport(ATL)

abstract: The core of any flight schedule is the trajectories. In particular, 4D trajectories are the most crucial component for flight attribute prediction. In particular, 4D trajectories are the most crucial component for flight attribute prediction. Each trajectory contains spatial and temporal features that are associated with uncertainties that make the prediction process complex. Today because of the increasing demand for air transportation, it is compulsory for airports and airlines to have an optimized schedule to use all of the airport's infrastructure potential. This is possible using advanced trajectory prediction methods. This paper proposes a novel hybrid deep learning model to extract the spatial and temporal features considering the uncertainty of the prediction model for Hartsfield-Jackson Atlanta International Airport(ATL). Automatic Dependent Surveillance-Broadcast (ADS-B) data are used as input to the models. This research is conducted in three steps: (a) data preprocessing; (b) prediction by a hybrid Convolutional Neural Network and Gated Recurrent Unit (CNN-GRU) along with a 3D-CNN model; (c) The third and last step is the comparison of the model's performance with the proposed model by comparing the experimental results. The deep model uncertainty is considered using the Mont-Carlo dropout (MC-Dropout). Mont-Carlo dropouts are added to the network layers to enhance the model's prediction performance by a robust approach of switching off between different neurons. The results show that the proposed model has low error measurements compared to the other models (i.e., 3D CNN, CNN-GRU). The model with MC-dropout reduces the error further by an average of 21 %.


title: Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models

abstract: The design process of user interfaces (UIs) often begins with articulating high-level design goals. Translating these high-level design goals into concrete design mock-ups, however, requires extensive effort and UI design expertise. To facilitate this process for app designers and developers, we introduce three deep-learning techniques to create low-fidelity UI mock-ups from a natural language phrase that describes the high-level design goal (e.g. "pop up displaying an image and other options"). In particular, we contribute two retrieval-based methods and one generative method, as well as pre-processing and post-processing techniques to ensure the quality of the created UI mock-ups. We quantitatively and qualitatively compare and contrast each method's ability in suggesting coherent, diverse and relevant UI design mock-ups. We further evaluate these methods with 15 professional UI designers and practitioners to understand each method's advantages and disadvantages. The designers responded positively to the potential of these methods for assisting the design process.


title: Linear Channel Estimation Based on a Low-Bandwidth Observation Channel with Unknown Response

abstract: We propose a novel system identification technique, based on a least-mean square algorithm, allowing for the estimation of a linear channel by using an unknown-response measurement channel. The key of the technique is a memoryless nonlinear function working as uncoupling block between the estimated and observation channels, conforming a Wiener-Hammerstein scheme. We prove that this estimation, only differing from the actual channel response by a scaling factor and a temporal shift, does not depend on the observation channel bandwidth. As a consequence, this technique enables the usage of low-cost measurement devices as feedback channel. We present numerical examples of the method, supporting the proposal and displaying excellent results.


title: A Physics-Based Safety Recovery Approach for Fault-Resilient Multi-Quadcopter Coordination

abstract: This paper develops a novel physics-based approach for fault-resilient multi-quadcopter coordination in the presence of abrupt quadcopter failure. Our approach consists of two main layers: (i) high-level physics-based guidance to safely plan the desired recovery trajectory for every healthy quadcopter and (ii) low-level trajectory control design by choosing an admissible control for every healthy quadcopter to safely recover from the anomalous situation, arisen from quadcopter failure, as quickly as possible. For the high-level trajectory planning, first, we consider healthy quadcopters as particles of an irrotational fluid flow sliding along streamline paths wrapping failed quadcopters in the shared motion space. We then obtain the desired recovery trajectories by maximizing the sliding speeds along the streamline paths such that the rotor angular speeds of healthy quadcopters do not exceed certain upper bounds at all times during the safety recovery. In the low level, a feedback linearization control is designed for every healthy quadcopter such that quadcopter rotor angular speeds remain bounded and satisfy the corresponding safety constraints. Simulation results are given to illustrate the efficacy of the proposed method.


title: NeuroView: Explainable Deep Network Decision Making

abstract: Deep neural networks (DNs) provide superhuman performance in numerous computer vision tasks, yet it remains unclear exactly which of a DN's units contribute to a particular decision. NeuroView is a new family of DN architectures that are interpretable/explainable by design. Each member of the family is derived from a standard DN architecture by vector quantizing the unit output values and feeding them into a global linear classifier. The resulting architecture establishes a direct, causal link between the state of each unit and the classification decision. We validate NeuroView on standard datasets and classification tasks to show that how its unit/class mapping aids in understanding the decision-making process.


title: On the Ramsey Numbers of Odd-Linked Double Stars

abstract: The linked double star $S_c(n,m)$, where $n \geq m \geq 0$, is the graph consisting of the union of two stars $K_{1,n}$ and $K_{1,m}$ with a path on $c$ vertices joining the centers. Its ramsey number $r(S_c(n,m))$ is the smallest integer $r$ such that every $2$-coloring of the edges of a $K_r$ admits a monochromatic $S_c(n,m)$. In this paper, we study the ramsey numbers of linked double stars when $c$ is odd. In particular, we establish bounds on the value of $r(S_c(n,m))$ and determine the exact value of $r(S_c(n,m))$ if $n \geq c$, or if $n \leq \lfloor \frac{c}{2} \rfloor - 2$ and $m = 2$.