title: Good Classifiers are Abundant in the Interpolating Regime

abstract: Within the machine learning community, the widely-used uniform convergence framework has been used to answer the question of how complex, over-parameterized models can generalize well to new data. This approach bounds the test error of the worst-case model one could have fit to the data, but it has fundamental limitations. Inspired by the statistical mechanics approach to learning, we formally define and develop a methodology to compute precisely the full distribution of test errors among interpolating classifiers from several model classes. We apply our method to compute this distribution for several real and synthetic datasets, with both linear and random feature classification models. We find that test errors tend to concentrate around a small typical value $\varepsilon^*$, which deviates substantially from the test error of the worst-case interpolating model on the same datasets, indicating that "bad" classifiers are extremely rare. We provide theoretical results in a simple setting in which we characterize the full asymptotic distribution of test errors, and we show that these indeed concentrate around a value $\varepsilon^*$, which we also identify exactly. We then formalize a more general conjecture supported by our empirical findings. Our results show that the usual style of analysis in statistical learning theory may not be fine-grained enough to capture the good generalization performance observed in practice, and that approaches based on the statistical mechanics of learning may offer a promising alternative.


title: Extensions of homomorphisms between localities

abstract: We show that the automorphism group of a linking system associated to a saturated fusion system $\mathcal{F}$ depends only on $\mathcal{F}$ as long as the object set of the linking system is $\mathrm{Aut}(\mathcal{F})$-invariant. This was known to be true for linking systems in Oliver's definition, but we demonstrate that the result holds also for linking systems in the considerably more general definition introduced previously by the author of this paper. A similar result is proved for linking localities, which are group-like structures corresponding to linking systems. Our argument builds on a general lemma about the existence of an extension of a homomorphism between localities. This lemma is also used to reprove a theorem of Chermak showing that there is a natural bijection between the sets of partial normal subgroups of two possibly different linking localities over the same fusion system.


title: Metastability of Waves and Patterns Subject to Spatially-Extended Noise

abstract: In this paper we present a general framework in which one can rigorously study the effect of spatio-temporal noise on traveling waves, stationary patterns and oscillations that are invariant under the action of a finite-dimensional set of continuous isometries (such as translation or rotation). This formalism can accommodate patterns, waves and oscillations in reaction-diffusion systems and neural field equations. To do this, we define the phase by precisely projecting the infinite-dimensional system onto the manifold of isometries. Two differing types of stochastic phase dynamics are defined: (i) a variational phase, obtained by insisting that the difference between the projection and the original solution is orthogonal to the non-decaying eigenmodes, and (ii) an isochronal phase, defined as the limiting point on manifold obtained by taking $t\to\infty$ in the absence of noise. We outline precise stochastic differential equations for both types of phase. The variational phase SDE is then used to show that the probability of the system leaving the attracting basin of the manifold after an exponentially long period of time (in $\epsilon^{-2}$, the magnitude of the noise) is exponentially unlikely. In the case that the manifold is periodic (such as for spiral waves, spatially-distributed oscillations, or neural-field phenomena on a compact domain), the isochronal phase SDE is used to determine asymptotic limits for the average occupation times of the phase as it wanders in the basin of attraction of the manifold over very long times. In particular, we find that frequently the correlation structure of the noise biases the wandering in a particular direction, such that the noise induces a slow oscillation that would not be present in the absence of noise.


title: Paratransit Agency Responses to the Adoption of Sub-contracted Services Using Secure Technologies

abstract: Transportation agencies across the United States have the responsibility of providing transportation services for all travelers. Paratransit services which are designed to meet the needs of disabled travelers have been available to a certain extent for decades, but under the Americans with Disabilities Act mandate of 1990, uniform requirements were adopted across U.S. agencies. Most of these paratransit operators offer services which must be scheduled at least a day in advance. And, provision of these services by accessible busses is generally very expensive. Therefore, many agencies are considering sub-contracting some services to approved ride-hailing or taxi services. The purpose of this work is to examine the opinions of various public agencies with respect to the adoption of sub-contracted services through the use of secure technologies. Our research provides insight into the future of these partnerships. Agencies expressed interest in the use of privacy preserving secure technologies as well as a strong desire for better software solutions for paratransit passengers and operators. The on-line survey received thirty responses for a completion rate of 19.1%. Our primary findings are that a major concern of agencies for this sort of arrangement is the lack of Wheelchair Accessible Vehicles offered by taxis and TNCs and about 36% of the surveyed agencies have not considered such partnerships.


title: Is single-mode lasing possible in an infinite periodic system?

abstract: In this Letter, we present a rigorous method to study the stability of periodic lasing systems. In a linear model, the presence of a continuum of modes (with arbitrarily close lasing thresholds) gives the impression that stable single-mode lasing cannot be maintained in the limit of an infinite system. However, we show that nonlinear effects of the Maxwell-Bloch equations can lead to stable systems near threshold given a simple stability condition on the sign of the laser detuning compared to the band curvature. We examine band-edge (1d) and bound-in-continuum (2d) lasing modes and validate our stability results against time-domain simulations.


title: An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics

abstract: Sufficient data presence is one of the key preconditions for applying metrics in practice. Based on both Altmetric.com data and Mendeley data collected up to 2019, this paper presents a state-of-the-art analysis of the presence of 12 kinds of altmetric events for nearly 12.3 million Web of Science publications published between 2012 and 2018. Results show that even though an upward trend of data presence can be observed over time, except for Mendeley readers and Twitter mentions, the overall presence of most altmetric data is still low. The majority of altmetric events go to publications in the fields of Biomedical and Health Sciences, Social Sciences and Humanities, and Life and Earth Sciences. As to research topics, the level of attention received by research topics varies across altmetric data, and specific altmetric data show different preferences for research topics, on the basis of which a framework for identifying hot research topics is proposed and applied to detect research topics with higher levels of attention garnered on certain altmetric data source. Twitter mentions and policy document citations were selected as two examples to identify hot research topics of interest of Twitter users and policy-makers, respectively, shedding light on the potential of altmetric data in monitoring research trends of specific social attention.


title: Fast and Flexible Temporal Point Processes with Triangular Maps

abstract: Temporal point process (TPP) models combined with recurrent neural networks provide a powerful framework for modeling continuous-time event data. While such models are flexible, they are inherently sequential and therefore cannot benefit from the parallelism of modern hardware. By exploiting the recent developments in the field of normalizing flows, we design TriTPP -- a new class of non-recurrent TPP models, where both sampling and likelihood computation can be done in parallel. TriTPP matches the flexibility of RNN-based methods but permits orders of magnitude faster sampling. This enables us to use the new model for variational inference in continuous-time discrete-state systems. We demonstrate the advantages of the proposed framework on synthetic and real-world datasets.


title: Towards Contrastive Explanations for Comparing the Ethics of Plans

abstract: The development of robotics and AI agents has enabled their wider usage in human surroundings. AI agents are more trusted to make increasingly important decisions with potentially critical outcomes. It is essential to consider the ethical consequences of the decisions made by these systems. In this paper, we present how contrastive explanations can be used for comparing the ethics of plans. We build upon an existing ethical framework to allow users to make suggestions to plans and receive contrastive explanations.


title: Improved autonomous error correction using variable dissipation in small logical qubit architectures

abstract: Coherence times for superconducting qubits have greatly improved over time. Moreover, small logical qubit architectures using engineered dissipation have shown great promise for further improvements in the coherence of a logical qubit manifold comprised of few physical qubits. Nevertheless, optimal working parameters for small logical qubits are generally not well understood. This work presents several approaches to finding preferential parameter configurations by looking at three different cases of increasing complexity. We begin by looking at state stabilization of a single qubit using dissipation via coupling to a lossy object. We look at the limiting factors in this approach to error correction, and how we address those by numerically optimizing the parametric coupling strength with the lossy object having an effective time-varying dissipation rate---we call this a pulse-reset cycle. We then translate this approach to more efficient state stabilization to an abstracted three-qubit flip code, and end by looking at the Very Small Logical Qubit (VSLQ). By using these techniques, we can further increase logical state lifetimes for different architectures. We show significant advantages in using a pulse-reset cycle over numerically optimized, fixed parameter spaces.


title: RP2K: A Large-Scale Retail Product Dataset for Fine-Grained Image Classification

abstract: We introduce RP2K, a new large-scale retail product dataset for fine-grained image classification. Unlike previous datasets focusing on relatively few products, we collect more than 500,000 images of retail products on shelves belonging to 2000 different products. Our dataset aims to advance the research in retail object recognition, which has massive applications such as automatic shelf auditing and image-based product information retrieval. Our dataset enjoys following properties: (1) It is by far the largest scale dataset in terms of product categories. (2) All images are captured manually in physical retail stores with natural lightings, matching the scenario of real applications. (3) We provide rich annotations to each object, including the sizes, shapes and flavors/scents. We believe our dataset could benefit both computer vision research and retail industry. Our dataset is publicly available at https://www.pinlandata.com/rp2k_dataset.


title: Unified controller for take-off and landing for a fixed-wing aircraft

abstract: Take-off and landing are the most important maneuvers for an aircraft's flight. Deployment for small fixed-wing aircraft is usually made by hand but when payload increases, take-off, and landing maneuvers are then performed on a runway making the procedures more complex. For that reason, we address the performance of the two maneuvers in order to develop a unique controller using the feedback control technique. We present the longitudinal aircraft dynamics to model the take-off and landing considering the rolling resistance forces during ground roll through a friction model. We also present the controller design for such a model. A stability proof is conducted to validate the stability of the system with the developed control law. Additionally, simulations are carried out to corroborate that the control law is effective applied to the dynamic model presented.


title: Multitasking Across Industry Projects: A Replication Study

abstract: Background: Multitasking is usual in software development. It is the ability to stop working on a task, switch to another, and return eventually to the first one, as needed or as scheduled. Multitasking, however, comes at a cognitive cost: frequent context-switches can lead to distraction, sub-standard work, and even greater stress. Aims: This paper reports a replication experiment where we gathered data on a group of developers from a software development company from industry on a large collection of projects stored in GitLab repositories. Method: We reused the developed models and methods from the original study for measuring the rate and breadth of a developers' context-switching behavior, and we study how context-switching affects their productivity. We applied semi-structured interviews, replacing the original survey, to some of the developers to understand the reasons for and perceptions of multitasking. Results: We found out that industry developers multitask as much as OSS developers focusing more (on fewer projects), and working more repetitively from one day to the next is associated with higher productivity, but there is no effect for higher multitasking. Some commons reasons make them multitask: dependencies, personal interests, and social relationships. Conclusions: Short context change, less than three minutes, did not impact results from industry developers; however, more than that, it brings a feeling of left the previous tasks behind. So, it is proportional to how much context is switched: as bigger the context and bigger the interruption, it is worst to come back.


title: Multiple solutions for a Schr\"odinger-Bopp-Podolsky system with positive potentials

abstract: In the paper we prove existence of solutions for a Schr\"odinger-Bopp-Podolsky system under positive potentials. We use the Ljusternick-Schnirelmann and Morse Theories to get multiple solutions with a priori given ``interaction energy''.


title: Information-theoretic User Interaction: Significant Inputs for Program Synthesis

abstract: Programming-by-example technologies are being deployed in industrial products for real-time synthesis of various kinds of data transformations. These technologies rely on the user to provide few representative examples of the transformation task. Motivated by the need to find the most pertinent question to ask the user, in this paper, we introduce the {\em significant questions problem}, and show that it is hard in general. We then develop an information-theoretic greedy approach for solving the problem. We justify the greedy algorithm using the conditional entropy result, which informally says that the question that achieves the maximum information gain is the one that we know least about. In the context of interactive program synthesis, we use the above result to develop an {\em{active program learner}} that generates the significant inputs to pose as queries to the user in each iteration. The procedure requires extending a {\em{passive program learner}} to a {\em{sampling program learner}} that is able to sample candidate programs from the set of all consistent programs to enable estimation of information gain. It also uses clustering of inputs based on features in the inputs and the corresponding outputs to sample a small set of candidate significant inputs. Our active learner is able to tradeoff false negatives for false positives and converge in a small number of iterations on a real-world dataset of %around 800 string transformation tasks.


title: A fourth-order superintegrable system with a rational potential related to Painleve VI

abstract: In this paper, we investigate in detail a superintegrable extension of the singular harmonic oscillator whose wave functions can be expressed in terms of exceptional Jacobi polynomials. We show that this Hamiltonian admits a fourth-order integral of motion and use the classification of such systems to show that the potential gives a rational solution associated with the sixth Painlev\'e equation. Additionally, we show that the integrals of the motion close to form a cubic algebra and describe briefly deformed oscillator representations of this algebra.


title: Wasserstein Autoregressive Models for Density Time Series

abstract: Data consisting of time-indexed distributions of cross-sectional or intraday returns have been extensively studied in finance, and provide one example in which the data atoms consist of serially dependent probability distributions. Motivated by such data, we propose an autoregressive model for density time series by exploiting the tangent space structure on the space of distributions that is induced by the Wasserstein metric. The densities themselves are not assumed to have any specific parametric form, leading to flexible forecasting of future unobserved densities. The main estimation targets in the order-$p$ Wasserstein autoregressive model are Wasserstein autocorrelations and the vector-valued autoregressive parameter. We propose suitable estimators and establish their asymptotic normality, which is verified in a simulation study. The new order-$p$ Wasserstein autoregressive model leads to a prediction algorithm, which includes a data driven order selection procedure. Its performance is compared to existing prediction procedures via application to four financial return data sets, where a variety of metrics are used to quantify forecasting accuracy. For most metrics, the proposed model outperforms existing methods in two of the data sets, while the best empirical performance in the other two data sets is attained by existing methods based on functional transformations of the densities.


title: Exploring Software Naturalness through Neural Language Models

abstract: The Software Naturalness hypothesis argues that programming languages can be understood through the same techniques used in natural language processing. We explore this hypothesis through the use of a pre-trained transformer-based language model to perform code analysis tasks. Present approaches to code analysis depend heavily on features derived from the Abstract Syntax Tree (AST) while our transformer-based language models work on raw source code. This work is the first to investigate whether such language models can discover AST features automatically. To achieve this, we introduce a sequence labeling task that directly probes the language models understanding of AST. Our results show that transformer based language models achieve high accuracy in the AST tagging task. Furthermore, we evaluate our model on a software vulnerability identification task. Importantly, we show that our approach obtains vulnerability identification results comparable to graph based approaches that rely heavily on compilers for feature extraction.


title: Unimodality of the Expectation of Betti Numbers for Bernoulli Random Quota Complexes

abstract: We study certain random simplicial complexes, called random quota complexes. A quota complex on $N+1$ weighted vertices is constructed by adding an $n$-simplex if the sum of the weights of the vertices is below a given quota, $q$. In this paper, the weights of the vertices are chosen i.i.d. with a Bernoulli distribution. The main result of this paper is that the expectation of the $m^{\textrm{th}}$ Betti number, i.e., the dimension of the $m^{\textrm{th}}$ homology group, is unimodal in $m$.


title: Intelligent Reflecting Surfaces with Spatial Modulation: An Electromagnetic Perspective

abstract: Electromagnetic wave control using the concept of a reflecting surface is first studied as a near-field and a far-field problem. Using a secondary source present in a wireless communication environment, such as a backscatter tag, it is possible to leverage the incoming radiation from the source as a reference-wave to synthesize the desired wavefront across the reflecting surface, radiating a field of interest. In this geometry, the phase grating, which is synthesized using an array of sub-wavelength unit cells, is calculated by interacting the incident reference-wave and the desired wavefront, similar to a hologram. When illuminated by the reference-wave, the reflected wavefront from the calculated phase grating is guaranteed to constructively add in the direction of the desired radiation (beam-steering in the far-field) and also focus at the intended depth (beam-focusing in the radiative near-field). Leveraging a dynamic modulation mechanism in the context of an intelligent reflective surface (IRS) illuminated by a backscatter tag, later, we present that one can selectively focus and defocus at an arbitrarily positioned receiver within the 3D field of view of the reflecting surface. This enables the control of the amplitude of the radiated electric field at the receiver location, paving the way for a spatial modulation mechanism by means of reconfiguring the reflecting surface in a backscattered wireless communication environment. In addition to the phase modification approach on a unit cell level to reconfigure the aperture radiated wavefronts, we finally present a time varying IRS concept making use of a time-delay based approach relying on a delay adjustment between the reflection coefficients of the IRS' unit cell lattices.


title: Interaction Between Coordinated and Droop Control PV Inverters

abstract: Autonomous droop control PV inverters have improved voltage regulation compared to the inverters without grid support functions, but more flexible control techniques will be required as the number of solar photovoltaic (PV) installations increases. This paper studies three inverter future deployment scenarios with droop control inverters, non-exporting inverters, and coordinated inverter control (CIC). The network operation and the interaction between various inverter control methods are studied by simulating inverter operation on two low-voltage networks. Considering 30% PV penetration as the base case, we demonstrate that coordinated inverters can mitigate overvoltages and voltage fluctuations caused by the tripping of passive inverters in 85% of PV location cases when at least as many coordinated as passive inverters are deployed on the 114-node test feeder. However, this rate reduced to 37% with the IEEE 906-node network demonstrating that the deployment of coordinated inverter control may not be able to reverse passive inverter-related voltage disturbances when the build-up of passive inverters has reached a certain threshold. The aggregated PV output from coordinated inverters can be also used to provide grid support services. When the low-voltage networks operate close to the upper voltage limits, the change in the power output from coordinated inverters following a regulation request may be partially offset by passive inverters. Considering an equal number of passive and coordinated inverters, this paper shows that for each unit of the down-regulation request delivered by coordinated inverters, passive inverter output may increase by up to 0.2 units and decrease by up to 0.45 units during coordinated inverter up-regulation.


title: Automatic Kernel Generation for Volta Tensor Cores

abstract: A commonly occurring computation idiom in neural networks is to perform some pointwise operations on the result of a matrix multiplication. Such a sequence of operations is typically represented as a computation graph in deep learning compilers. When compiling to a GPU target, these computations can be individually mapped to manually tuned implementations provided by libraries such as cuBLAS and cuDNN. These libraries also provide off-the-shelf support for targeting tensor cores in NVIDIA GPUs, which can lead to huge performance boosts through their specialized support for mixed-precision matrix math. Alternatively, tensor cores can be programmed directly using CUDA APIs or inline assembly instructions, which opens up the possibility of generating efficient CUDA kernels automatically for such computations. Automatic kernel generation is particularly crucial when it is beneficial to generate efficient code for an entire computation graph by fusing several operations into a single device function instead of invoking a separate kernel for each of them. Polyhedral compilation techniques provide a systematic approach for the analysis and transformation of a sequence of affine loop-nests. In this paper, we describe a polyhedral approach to generate efficient CUDA kernels for matrix multiplication using inline assembly instructions for programming tensor cores on NVIDIA Volta GPUs. Furthermore, we build on this approach to generate fused kernels for computation sequences involving matrix multiplication and pointwise operations such as bias addition, ReLU activation etc. Experimental evaluation of these techniques show that automatically generated kernels can provide significantly better performance than manually tuned library implementations, with speedups ranging up to 2.55X.


title: Characterizations of symmetric convex sets

abstract: In this work we prove that either a sequence of axis of symmetry or a sequence of hyperplanes of symmetry of a convex body $K$ in the Euclidian space $\mathbb{E}^d, n\geq 3$, are enough to guarantee that $K$ is either a generalized body of revolution or a sphere.


title: CIF2WAN: A Tool to Generate Input Files for Electronic Structure Calculations with Wannier90

abstract: The generation of input files for density functional theory (DFT) programs must often be manually done by researchers. If one wishes to produce a maximally localized wannier functions (MLWFs) the calculation consists of several separate files that must be formatted correctly in order for the program to work properly. Many of the inputs are repeated throughout the files and can be easily automated. In this work, a program is presented to generate all of the input files needed to produce wannier functions with Wannier90 starting from open source DFT programs such as Quantum Espresso, Abinit, and Siesta. In addition, the input files for WannierTools are also included for those that wish to produce surface green's functions for the generation of surface state bands. The program presented allows for users new to DFT to use the programs with minimal understanding of parameters needed to produce good results, in addition, this program allows for researchers who are advanced DFT users to utilize this program for high throughput wannier calculations.


title: Aligning Time Series on Incomparable Spaces

abstract: Dynamic time warping (DTW) is a useful method for aligning, comparing and combining time series, but it requires them to live in comparable spaces. In this work, we consider a setting in which time series live on different spaces without a sensible ground metric, causing DTW to become ill-defined. To alleviate this, we propose Gromov dynamic time warping (GDTW), a distance between time series on potentially incomparable spaces that avoids the comparability requirement by instead considering intra-relational geometry. We demonstrate its effectiveness at aligning, combining and comparing time series living on incomparable spaces. We further propose a smoothed version of GDTW as a differentiable loss and assess its properties in a variety of settings, including barycentric averaging, generative modeling and imitation learning.


title: A geometrical demonstration for continuation of solutions of the generalised BBM equation

abstract: A simple proof that if the generalised BBM equation has a solution vanishing on an open sent of its domain then the solution is necessarily zero is given. In particular, the only compactly supported solution of the equation under consideration is the identically vanishing one.


title: Joint Poisson distribution of prime factors in sets

abstract: Given disjoint subsets $T_1,\ldots,T_m$ of "not too large" primes up to $x$, we establish that for a random integer $n$ drawn from $[1,x]$, the $m$-dimensional vector enumerating the number of prime factors of $n$ from $T_1,\ldots,T_m$ converges to a vector of $m$ independent Poisson random variables. We give a specific rate of convergence using the Kubilius model of prime factors. We also show a universal upper bound of Poisson type when $T_1,\ldots,T_m$ are unrestricted, and apply this to the distribution of the number of prime factors from a set $T$ given that $n$ has $k$ total prime factors.


title: $\mathbf{q}=\mathbf{0}$ long-range magnetic order in centennialite CaCu$_3$(OD)$_6$Cl$_2$$\cdot$0.6D$_2$O: A spin-1/2 perfect kagome antiferromagnet with $J_1$-$J_2$-$J_d$

abstract: Crystal and magnetic structures of the mineral centennialite CaCu$_3$(OH)$_6$Cl$_2\cdot0.6$H$_2$O are investigated by means of synchrotron x-ray diffraction and neutron diffraction measurements complemented by density functional theory (DFT) and pseudofermion functional renormalization group (PFFRG) calculations. CaCu$_3$(OH)$_6$Cl$_2\cdot0.6$H$_2$O crystallizes in the $P\bar{3}m1$ space group and Cu$^{2+}$ ions form a geometrically perfect kagome network with antiferromagnetic $J_1$. No intersite disorder between Cu$^{2+}$ and Ca$^{2+}$ ions is detected. CaCu$_3$(OH)$_6$Cl$_2\cdot0.6$H$_2$O enters a magnetic long-range ordered state below $T_\text{N}=7.2$~K, and the $\mathbf{q}=\mathbf{0}$ magnetic structure with negative vector spin chirality is obtained. The ordered moment at 0.3~K is suppressed to $0.58(2)\mu_\text{B}$. Our DFT calculations indicate the presence of antiferromagnetic $J_2$ and ferromagnetic $J_d$ superexchange couplings of a strength which places the system at the crossroads of three magnetic orders (at the classical level) and a spin-$\frac{1}{2}$ PFFRG analysis shows a dominance of $\mathbf{q}=\mathbf{0}$ type magnetic correlations, consistent with and indicating proximity to the observed $\mathbf{q}=\mathbf{0}$ spin structure. The results suggest that this material is located close to a quantum critical point and is a good realization of a $J_1$-$J_2$-$J_d$ kagome antiferromagnet.


title: Multilevel Polarization for Quantum Channels

abstract: Recently, a purely quantum version of polar codes has been proposed in [1] based on a quantum channel combining and splitting procedure, where a randomly chosen two-qubit Clifford unitary acts as channel combining operation. Here, we consider the quantum polar code construction using the same channel combining and splitting procedure as in [1], but with a fixed two-qubit Clifford unitary. For the family of Pauli channels, we show that polarization happens in multi-levels, where synthesized quantum virtual channels tend to become completely noisy, half-noisy, or noiseless. Further, we present a quantum polar code exploiting the multilevel nature of polarization, and provide an efficient decoding for this code. We show that half-noisy channels can be frozen by fixing their inputs in either the amplitude or the phase basis, which allows reducing the number of preshared EPR pairs compared to the construction in [1]. We provide an upper bound on the number of preshared EPR pairs, which is an equality in the case of the quantum erasure channel. To improve the speed of polarization, we propose an alternative construction, which again polarizes in multi-levels, and the previous upper bound on the number of preshared EPR pairs also holds. For a quantum erasure channel, we confirm by numerical analysis that the multilevel polarization happens relatively faster for the alternative construction.


title: Fast Initial Access with Deep Learning for Beam Prediction in 5G mmWave Networks

abstract: This paper presents DeepIA, a deep learning solution for faster and more accurate initial access (IA) in 5G millimeter wave (mmWave) networks when compared to conventional IA. By utilizing a subset of beams in the IA process, DeepIA removes the need for an exhaustive beam search thereby reducing the beam sweep time in IA. A deep neural network (DNN) is trained to learn the complex mapping from the received signal strengths (RSSs) collected with a reduced number of beams to the optimal spatial beam of the receiver (among a larger set of beams). In test time, DeepIA measures RSSs only from a small number of beams and runs the DNN to predict the best beam for IA. We show that DeepIA reduces the IA time by sweeping fewer beams and significantly outperforms the conventional IA's beam prediction accuracy in both line of sight (LoS) and non-line of sight (NLoS) mmWave channel conditions.


title: Larger $\lambda_R$ in the disc of isolated active spiral galaxies than in their non-active twins

abstract: We present a comparison of the spin parameter $\lambda_R$, measured in a region dominated by the galaxy disc, between 20 pairs of nearby (0.005$<$z$<$0.03) seemingly isolated twin galaxies differing in nuclear activity. We find that 80--82% of the active galaxies show higher values of $\lambda_R$ than their corresponding non-active twin(s), indicating larger rotational support in the AGN discs. This result is driven by the 11 pairs of unbarred galaxies, for which 100% of the AGN show larger $\lambda_R$ than their twins. These results can be explained by a more efficient angular momentum transfer from the inflowing gas to the disc baryonic matter in the case of the active galaxies. This gas inflow could have been induced by disc or bar instabilities, although we cannot rule out minor mergers if these are prevalent in our active galaxies. This result represents the first evidence of galaxy-scale differences between the dynamics of active and non-active isolated spiral galaxies of intermediate stellar masses (10$^{10}<M_*<10^{11}$ M$_{\odot}$) in the Local Universe.


title: Perceptual Adversarial Robustness: Defense Against Unseen Threat Models

abstract: A key challenge in adversarial robustness is the lack of a precise mathematical characterization of human perception, used in the very definition of adversarial attacks that are imperceptible to human eyes. Most current attacks and defenses try to avoid this issue by considering restrictive adversarial threat models such as those bounded by $L_2$ or $L_\infty$ distance, spatial perturbations, etc. However, models that are robust against any of these restrictive threat models are still fragile against other threat models. To resolve this issue, we propose adversarial training against the set of all imperceptible adversarial examples, approximated using deep neural networks. We call this threat model the neural perceptual threat model (NPTM); it includes adversarial examples with a bounded neural perceptual distance (a neural network-based approximation of the true perceptual distance) to natural images. Through an extensive perceptual study, we show that the neural perceptual distance correlates well with human judgements of perceptibility of adversarial examples, validating our threat model. Under the NPTM, we develop novel perceptual adversarial attacks and defenses. Because the NPTM is very broad, we find that Perceptual Adversarial Training (PAT) against a perceptual attack gives robustness against many other types of adversarial attacks. We test PAT on CIFAR-10 and ImageNet-100 against five diverse adversarial attacks. We find that PAT achieves state-of-the-art robustness against the union of these five attacks, more than doubling the accuracy over the next best model, without training against any of them. That is, PAT generalizes well to unforeseen perturbation types. This is vital in sensitive applications where a particular threat model cannot be assumed, and to the best of our knowledge, PAT is the first adversarial training defense with this property.


title: Origin of the orbital polarization of Co$^{2+}$ in La$_2$CoTiO$_6$ and (LaCoO$_3$)$_1$+(LaTiO$_3$)$_1$ : a DFT+$U$ and DMFT study

abstract: The unequal electronic occupation of localized orbitals (orbital polarization), and associated lowering of symmetry and degeneracy, play an important role in the properties of transition metal oxides. Here, we examine systematically the underlying origin of orbital polarization, taking as exemplar the 3$d$ manifold of Co$^{2+}$ in a variety of spin, orbital and structural phases in the double perovskite La$_2$CoTiO$_6$ and the (001) superlattice (LaCoO$_3$)$_1$+(LaTiO$_3$)$_1$ systems. Superlattices are of specific interest due to the large experimentally observed orbital polarization of their Co cations. Based on first principles calculations, we find that robust and observable orbital polarization requires symmetry reduction through the lattice structure; the role of local electronic interactions is to greatly enhance the orbital polarization.


title: Spectral Evolution with Approximated Eigenvalue Trajectories for Link Prediction

abstract: The spectral evolution model aims to characterize the growth of large networks (i.e., how they evolve as new edges are established) in terms of the eigenvalue decomposition of the adjacency matrices. It assumes that, while eigenvectors remain constant, eigenvalues evolve in a predictable manner over time. This paper extends the original formulation of the model twofold. First, it presents a method to compute an approximation of the spectral evolution of eigenvalues based on the Rayleigh quotient. Second, it proposes an algorithm to estimate the evolution of eigenvalues by extrapolating only a fraction of their approximated values. The proposed model is used to characterize mention networks of users who posted tweets that include the most popular political hashtags in Colombia from August 2017 to August 2018 (the period which concludes the disarmament of the Revolutionary Armed Forces of Colombia). To evaluate the extent to which the spectral evolution model resembles these networks, link prediction methods based on learning algorithms (i.e., extrapolation and regression) and graph kernels are implemented. Experimental results show that the learning algorithms deployed on the approximated trajectories outperform the usual kernel and extrapolation methods at predicting the formation of new edges.


title: Studies of Exoplanets with Candidate TOI 717.01 and Confirmed HAT-P-3b

abstract: Images of the exoplanets TOI 717.01, Qatar-8 b, and HAT-P-3 b were requested in the w-filter from the Las Cumbres Observatory 0.4-meter telescopes. Of these requests, images were taken of TOI 717.01 and HAT-P-3b and were reduced using the EXOplanet Transit Interpretation Code (EXOTIC) software, as well as 6 photometric algorithms from the Our Solar Siblings pipeline. The transit midpoint for HAT-P-3 b was found to be 2458907.6205, which is 20.2 minutes different from its expected midpoint that night. For TOI 717.01, the transit was not discernible, likely due to its low transit depth of 0.1%. It is possible that one of the comparison stars in the TOI 717.01 field is variable.


title: COHERENT Collaboration data release from the first detection of coherent elastic neutrino-nucleus scattering on argon

abstract: Release of COHERENT collaboration data from the first detection of coherent elastic neutrino-nucleus scattering (CEvNS) on argon. This release corresponds with the results of "Analysis A" published in Akimov et al., arXiv:2003.10630 [nucl-ex]. Data is shared in a binned, text-based format representing both "signal" and "backgrounds" along with associated uncertainties such that the included data can be used to perform independent analyses. This document describes the contents of the data release as well as guidance on the use of the data. Included example code in C++ (ROOT) and Python show one possible use of the included data.


title: Vortices in Kekulene Molecules

abstract: Kekulene is an aromatic hydrocarbon with formula C48H24 arranged in the shape of a closed super-ring as shown in Fig. 2. It consists of a sublattice with 48 C atoms with spin 5/2 and a 24 hydrogen sublattice with spin 2. In this communication, we use Monte Carlo simulations to determine the magnetic structures present in Kekulene for several temperatures (T) and dipole anisotropies ({\delta} = D/J). Our results show that there are two regimes at low temperature separated by a crossover at 2.5 < {\delta}cross < 3.0. For {\delta} < {\delta}cross the ground state has a unique vortex configuration. In the region {\delta} > {\delta}cross arrangements of vortices-antivortices (V-AV) appears. As temperature raises the vortex structure disorders and small oscillations take over. The importance on synthesizing this molecule grounds in the possibility of building real planar structures of sizes at least 10 times smaller than the earlier proposed permalloy nanodots. It is worthy to mention that Kekulene is a planar structure with atomic thickness, which is a great advantage compared with other nanomagnetic structures.


title: SN-Engine, a Scale-free Geometric Modelling Environment

abstract: We present a new scale-free geometric modelling environment designed by the author of the paper. It allows one to consistently treat geometric objects of arbitrary size and offers extensive analytic and computational support for visualization of both real and artificial sceneries.


title: Non-stationary normal forms for contracting extensions

abstract: We present the theory of non-stationary normal forms for uniformly contracting smooth extensions with sufficiently narrow Mather spectrum. We give coherent proofs of existence, (non)uniqueness, and a description of the centralizer results. As a corollary, we obtain corresponding results for normal forms along an invariant contracting foliation. The main improvements over the previous results in the narrow spectrum setting include explicit description of non-uniqueness and obtaining results in any regularity above the precise critical level, which is especially useful for the centralizer. In addition to sub-resonance normal form, we also prove corresponding results for resonance normal form, which is new in the narrow spectrum setting.


title: Three Dimensional Black Hole in the Low Energy Heterotic String Theory

abstract: We study the BTZ black holes (2+1 dimensional space-time) in the low energy heterotic string theory (BTZ-Sen BH). This concept requires us to include a non-trivial dilaton $ \phi $ and a 3-form $ H_{\mu\nu\rho} $ field. By using the Hassan-Sen transformation and BTZ black hole as a seed solution, we obtain the solution in the string frame. Some properties of the black hole solutions are discussed.


title: A Liouville theorem for the fractional Ginzburg-Landau equation

abstract: In this paper, we are concerned with a Liouville-type result of the nonlinear integral equation \begin{equation*} u(x)=\int_{\mathbb{R}^{n}}\frac{u(1-|u|^{2})}{|x-y|^{n-\alpha}}dy, \end{equation*} where $u: \mathbb{R}^{n} \to \mathbb{R}^{k}$ with $k \geq 1$ and $1<\alpha<n/2$. We prove that $u \in L^2(\mathbb{R}^n) \Rightarrow u \equiv 0$ on $\mathbb{R}^n$, as long as $u$ is a bounded and differentiable solution.


title: Blockchain for Academic Credentials

abstract: Academic credentials are documents that attest to successful completion of any test, exam or act as a validation of an individual's skill. Currently, the domain of academic credential management suffers from large time consumption, high cost, dependence on third-party and a lack of transparency. A blockchain based solution tries to resolve these pain-points by allowing any recruiter or company to verify the user credentials without dependence on any centralized third party. Our decentralized application is based off of BlockCerts, an MIT project that acts as an open standard for blockchain credentials. The project talks about the implementation details of the decentralized application built for BlockCerts Wallet. It is an attempt to leverage the power of the blockchain technology as a global notary for the verification of digital records.


title: The muon $g$-2 and $\Delta \alpha$ connection

abstract: The discrepancy between the Standard Model theory and experimental measurement of the muon magnetic moment anomaly, $a_{\mu}=\left(g_{\mu}-2\right)/2$, is connected to precision electroweak (EW) predictions via their common dependence on hadronic vacuum polarization effects. The same data for the total $e^+e^- \rightarrow \text{hadrons}$ cross section, $\sigma_{\rm had}(s)$, are used as input into dispersion relations to estimate the hadronic vacuum polarization contributions, $a_{\mu}^{\rm had,\,VP}$, as well as the five-flavor hadronic contribution to the running QED coupling at the $Z$-pole, $\Delta\alpha_{\rm had}^{(5)}(M_{Z}^2)$, which enters natural relations and global EW fits. The EW fit prediction of $\Delta\alpha_{\rm had}^{(5)}(M_{Z}^2) = 0.02722(41)$ agrees well with $\Delta\alpha_{\rm had}^{(5)}(M_{Z}^2) = 0.02761(11)$ obtained from the dispersion relation approach, but exhibits a smaller central value suggestive of a larger discrepancy $\Delta a_{\mu}=a_{\mu}^{\rm exp} - a_{\mu}^{\rm SM}$ than currently expected. Postulating that the $\Delta a_{\mu}$ difference may be due to missing $\sigma_{\rm had}(s)$ contributions, implications for $M_W$, $\sin^2 \! \theta^{\rm lep}_{\rm eff}$ and $M_H$ obtained from global EW fits are investigated. Shifts in $\sigma_{\rm had}(s)$ needed to bridge $\Delta a_{\mu}$ are found to be excluded above $\sqrt{s} \gtrsim 0.7$ GeV at the 95\%CL. Moreover, prospects for $\Delta a_{\mu}$ originating below that energy are deemed improbable given the required increases in the cross section. Such hypothetical changes to the hadronic data are also found to affect other related observables, such as the electron anomaly, $a_e^{\rm SM}$, the ratio $R_{e/\mu} = (m_\mu/m_e)^2 (a_{e}^{\rm had,\,LO\,VP}/a_{\mu}^{\rm had,\,LO\,VP})$ and the running of the weak mixing angle at low energies, although the consequences of these are currently less constraining.


title: Accelerated Deep Reinforcement Learning Based Load Shedding for Emergency Voltage Control

abstract: Load shedding has been one of the most widely used and effective emergency control approaches against voltage instability. With increased uncertainties and rapidly changing operational conditions in power systems, existing methods have outstanding issues in terms of either speed, adaptiveness, or scalability. Deep reinforcement learning (DRL) was regarded and adopted as a promising approach for fast and adaptive grid stability control in recent years. However, existing DRL algorithms show two outstanding issues when being applied to power system control problems: 1) computational inefficiency that requires extensive training and tuning time; and 2) poor scalability making it difficult to scale to high dimensional control problems. To overcome these issues, an accelerated DRL algorithm named PARS was developed and tailored for power system voltage stability control via load shedding. PARS features high scalability and is easy to tune with only five main hyperparameters. The method was tested on both the IEEE 39-bus and IEEE 300-bus systems, and the latter is by far the largest scale for such a study. Test results show that, compared to other methods including model-predictive control (MPC) and proximal policy optimization(PPO) methods, PARS shows better computational efficiency (faster convergence), more robustness in learning, excellent scalability and generalization capability.


title: Liquid crystal director fields in three-dimensional non-Euclidean geometries

abstract: This paper investigates nematic liquid crystals in three-dimensional curved space, and determines which director deformation modes are compatible with each possible type of non-Euclidean geometry. Previous work by Sethna et al. showed that double twist is frustrated in flat space $R^3$, but can fit perfectly in the hypersphere $S^3$. Here, we extend that work to all four deformation modes (splay, twist, bend, and biaxial splay) and all eight Thurston geometries. Each pure mode of director deformation can fill space perfectly, for at least one type of geometry. This analysis shows the ideal structure of each deformation mode in curved space, which is frustrated by the requirements of flat space.


title: Approximate Cross-Validation for Structured Models

abstract: Many modern data analyses benefit from explicitly modeling dependence structure in data -- such as measurements across time or space, ordered words in a sentence, or genes in a genome. A gold standard evaluation technique is structured cross-validation (CV), which leaves out some data subset (such as data within a time interval or data in a geographic region) in each fold. But CV here can be prohibitively slow due to the need to re-run already-expensive learning algorithms many times. Previous work has shown approximate cross-validation (ACV) methods provide a fast and provably accurate alternative in the setting of empirical risk minimization. But this existing ACV work is restricted to simpler models by the assumptions that (i) data across CV folds are independent and (ii) an exact initial model fit is available. In structured data analyses, both these assumptions are often untrue. In the present work, we address (i) by extending ACV to CV schemes with dependence structure between the folds. To address (ii), we verify -- both theoretically and empirically -- that ACV quality deteriorates smoothly with noise in the initial fit. We demonstrate the accuracy and computational benefits of our proposed methods on a diverse set of real-world applications.


title: An Efficient PTAS for Stochastic Load Balancing with Poisson Jobs

abstract: We give the first polynomial-time approximation scheme (PTAS) for the stochastic load balancing problem when the job sizes follow Poisson distributions. This improves upon the 2-approximation algorithm due to Goel and Indyk (FOCS'99). Moreover, our approximation scheme is an efficient PTAS that has a running time double exponential in $1/\epsilon$ but nearly-linear in $n$, where $n$ is the number of jobs and $\epsilon$ is the target error. Previously, a PTAS (not efficient) was only known for jobs that obey exponential distributions (Goel and Indyk, FOCS'99). Our algorithm relies on several probabilistic ingredients including some (seemingly) new results on scaling and the so-called "focusing effect" of maximum of Poisson random variables which might be of independent interest.


title: AFDet: Anchor Free One Stage 3D Object Detection

abstract: High-efficiency point cloud 3D object detection operated on embedded systems is important for many robotics applications including autonomous driving. Most previous works try to solve it using anchor-based detection methods which come with two drawbacks: post-processing is relatively complex and computationally expensive; tuning anchor parameters is tricky. We are the first to address these drawbacks with an anchor free and Non-Maximum Suppression free one stage detector called AFDet. The entire AFDet can be processed efficiently on a CNN accelerator or a GPU with the simplified post-processing. Without bells and whistles, our proposed AFDet performs competitively with other one stage anchor-based methods on KITTI validation set and Waymo Open Dataset validation set.


title: Time Series Extrinsic Regression

abstract: This paper studies Time Series Extrinsic Regression (TSER): a regression task of which the aim is to learn the relationship between a time series and a continuous scalar variable; a task closely related to time series classification (TSC), which aims to learn the relationship between a time series and a categorical class label. This task generalizes time series forecasting (TSF), relaxing the requirement that the value predicted be a future value of the input series or primarily depend on more recent values. In this paper, we motivate and study this task, and benchmark existing solutions and adaptations of TSC algorithms on a novel archive of 19 TSER datasets which we have assembled. Our results show that the state-of-the-art TSC algorithm Rocket, when adapted for regression, achieves the highest overall accuracy compared to adaptations of other TSC algorithms and state-of-the-art machine learning (ML) algorithms such as XGBoost, Random Forest and Support Vector Regression. More importantly, we show that much research is needed in this field to improve the accuracy of ML models. We also find evidence that further research has excellent prospects of improving upon these straightforward baselines.


title: Zilber's Dichotomy for Differentially Closed Fields with an Automorphism

abstract: The theory of difference-differential fields of characteristic zero has a model-companion denoted by $\it DCFA$. Previously we proved a weak version of Zilber's dichotomy for $\it DCFA$. In this paper we use arc spaces techniques as developed by Moosa, Pillay and Scanlon to suppress the extra hypothesis needed before and prove the full Zilber's dichotomy for $\it DCFA$, we also state how these techniques generalise to partial differential fields with an automorphism.


title: Inexact Derivative-Free Optimization for Bilevel Learning

abstract: Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to resolve this issue is to learn these parameters from data. While mathematically appealing this strategy leads to a nested optimization problem (known as bilevel optimization) which is computationally very difficult to handle. It is common when solving the upper-level problem to assume access to exact solutions of the lower-level problem, which is practically infeasible. In this work we propose to solve these problems using inexact derivative-free optimization algorithms which never require exact lower-level problem solutions, but instead assume access to approximate solutions with controllable accuracy, which is achievable in practice. We prove global convergence and a worstcase complexity bound for our approach. We test our proposed framework on ROFdenoising and learning MRI sampling patterns. Dynamically adjusting the lower-level accuracy yields learned parameters with similar reconstruction quality as highaccuracy evaluations but with dramatic reductions in computational work (up to 100 times faster in some cases).

categories: math.OC cs.CV cs.LG cs.NA math.NA stat.ML


title: Countably compact groups without non-trivial convergent sequences

abstract: We construct, in $\mathsf{ZFC}$, a countably compact subgroup of $2^{\mathfrak{c}}$ without non-trivial convergent sequences, answering an old problem of van Douwen. As a consequence we also prove the existence of two countably compact groups $\mathbb{G}_{0}$ and $\mathbb{G}_{1}$ such that the product $\mathbb{G}_{0} \times \mathbb{G}_{1}$ is not countably compact, thus answering a classical problem of Comfort.


title: Generalized Grasping for Mechanical Grippers for Unknown Objects with Partial Point Cloud Representations

abstract: We present a generalized grasping algorithm that uses point clouds (i.e. a group of points and their respective surface normals) to discover grasp pose solutions for multiple grasp types, executed by a mechanical gripper, in near real-time. The algorithm introduces two ideas: 1) a histogram of finger contact normals is used to represent a grasp 'shape' to guide a gripper orientation search in a histogram of object(s) surface normals, and 2) voxel grid representations of gripper and object(s) are cross-correlated to match finger contact points, i.e. grasp 'size', to discover a grasp pose. Constraints, such as collisions with neighbouring objects, are optionally incorporated in the cross-correlation computation. We show via simulations and experiments that 1) grasp poses for three grasp types can be found in near real-time, 2) grasp pose solutions are consistent with respect to voxel resolution changes for both partial and complete point cloud scans, and 3) a planned grasp is executed with a mechanical gripper.


title: Extreme Lightwave Electron Field Emission from a Nanotip

abstract: We report on sub-cycle terahertz light-field emission of electrons from tungsten nanotips under extreme conditions corresponding to a Keldysh parameter $\gamma_K\approx10^{-4}$. Local peak THz fields up to 40~GV/m are achieved at the apex of an illuminated nanotip, causing sub-cycle cold-field electron emission and acceleration in the quasi-static field. By simultaneous measurement of the electron bunch charge and energy distribution, we perform a quantitative test of quasi-static Fowler-Nordheim tunnelling theory under field conditions that completely suppress the tunnel barrier. Very high bunch charges of $\sim10^6$ electrons/pulse are observed, reaching maximum energies of 3.5~keV after acceleration in the local field. The energy distribution and emission current show good agreement with Fowler-Nordheim theory even in this extreme field regime. Extending this model to the single-shot regime under these conditions predicts peak electron distributions with a spectral purity of $10^{-4}$. THz field-induced reshaping and sharpening of the nanotip is observed, reducing the tip radius from 120~nm to 35~nm over roughly $10^9$ THz shots. These results indicate THz-driven nanotips in the extreme field limit are promising electron sources for ultrafast electron diffraction and microscopy.


title: Parameterization of quantum walks on cycles

abstract: This study investigate the unitary equivalence classes of quantum walks on cycles. We show that unitary equivalence classes of quantum walks on a cycle with $N$ vertices are parameterized by $2N$ real parameters. Moreover, the ranges of two of the parameters are restricted, and the ranges depend on the parity of $N$.


title: Laser-Pulse and Electron-Bunch Plasma Wakefield Accelerator

abstract: Propagation distances of intense laser pulses and high-charge electron beams through the plasma are, respectively, limited by diffraction and self-deceleration. This imposes severe constraints on the performance of the two major advanced accelerator concepts: laser and plasma wakefield accelerators. Using numerical simulations, we demonstrate that when the two beams co-propagate in the plasma, they can interact synergistically and extend each other's travel distances. The key interactions responsible for the synergy are found to be laser channeling by the electron bunch, and direct laser acceleration of the bunch electrons by the laser pulse. Remarkably, the amount of energy transferred from the laser pulse to the plasma can be increased by several times by the guiding electron bunch despite its small energy content. Implications of such synergistic interactions for the high-gradient acceleration of externally injected witness charges are discussed, and a new concept of a Laser-pulse and Electron-bunch Plasma Accelerator (LEPA) is formulated.


title: Trapping in Self-Avoiding Walks with Nearest-Neighbor Attraction

abstract: The statistics of self-avoiding random walks have been used to model polymer physics for decades. A self-avoiding walk that grows one step at a time on a lattice will eventually trap itself, which occurs after an average of 71 steps on a square lattice. Here, we consider the effect of nearest-neighbor attractive interactions on the growing self-avoiding walk, and examine the effect that self-attraction has both on the statistics of trapping as well as on chain statistics through the transition between expanded and collapsed walks at the theta point. We find the trapping length increases exponentially with the nearest-neighbor contact energy, but that there is a local minimum in trapping length for weakly self-attractive walks. While it has been controversial whether growing self-avoiding walks have the same asymptotic behavior as traditional self-avoiding walks, we find that the theta point is not at the same location for growing self-avoiding walks, and that the persistence length converges much more rapidly to a smaller value.


title: ContraGAN: Contrastive Learning for Conditional Image Generation

abstract: Conditional image generation is the task of generating diverse images using class label information. Although many conditional Generative Adversarial Networks (GAN) have shown realistic results, such methods consider pairwise relations between the embedding of an image and the embedding of the corresponding label (data-to-class relations) as the conditioning losses. In this paper, we propose ContraGAN that considers relations between multiple image embeddings in the same batch (data-to-data relations) as well as the data-to-class relations by using a conditional contrastive loss. The discriminator of ContraGAN discriminates the authenticity of given samples and minimizes a contrastive objective to learn the relations between training images. Simultaneously, the generator tries to generate realistic images that deceive the authenticity and have a low contrastive loss. The experimental results show that ContraGAN outperforms state-of-the-art-models by 7.3% and 7.7% on Tiny ImageNet and ImageNet datasets, respectively. Besides, we experimentally demonstrate that contrastive learning helps to relieve the overfitting of the discriminator. For a fair comparison, we re-implement twelve state-of-the-art GANs using the PyTorch library. The software package is available at https://github.com/POSTECH-CVLab/PyTorch-StudioGAN.


title: Neural Dynamical Systems: Balancing Structure and Flexibility in Physical Prediction

abstract: We introduce Neural Dynamical Systems (NDS), a method of learning dynamical models in various gray-box settings which incorporates prior knowledge in the form of systems of ordinary differential equations. NDS uses neural networks to estimate free parameters of the system, predicts residual terms, and numerically integrates over time to predict future states. A key insight is that many real dynamical systems of interest are hard to model because the dynamics may vary across rollouts. We mitigate this problem by taking a trajectory of prior states as the input to NDS and train it to dynamically estimate system parameters using the preceding trajectory. We find that NDS learns dynamics with higher accuracy and fewer samples than a variety of deep learning methods that do not incorporate the prior knowledge and methods from the system identification literature which do. We demonstrate these advantages first on synthetic dynamical systems and then on real data captured from deuterium shots from a nuclear fusion reactor. Finally, we demonstrate that these benefits can be utilized for control in small-scale experiments.


title: Improving Workflow Integration with xPath: Design and Evaluation of a Human-AI Diagnosis System in Pathology

abstract: Recent developments in AI have provided assisting tools to support pathologists' diagnoses. However, it remains challenging to incorporate such tools into pathologists' practice; one main concern is AI's insufficient workflow integration with medical decisions. We observed pathologists' examination and discovered that the main hindering factor to integrate AI is its incompatibility with pathologists' workflow. To bridge the gap between pathologists and AI, we developed a human-AI collaborative diagnosis tool -- xPath -- that shares a similar examination process to that of pathologists, which can improve AI's integration into their routine examination. The viability of xPath is confirmed by a technical evaluation and work sessions with twelve medical professionals in pathology. This work identifies and addresses the challenge of incorporating AI models into pathology, which can offer first-hand knowledge about how HCI researchers can work with medical professionals side-by-side to bring technological advances to medical tasks towards practical applications.


title: On the radical of Cluster tilted algebras

abstract: We determine the minimal lower bound $n$, with $n \geq 1$, where the $n$-th power of the radical of the module category of a representation-finite cluster tilted algebra vanishes. We give such a bound in terms of the number of vertices of the underline quiver. Consequently, we get the nilpotency index of the radical of the module category for representation-finite self-injective cluster tilted algebras. We also study the non-zero composition of $m$, $m \ge 2$, irreducible morphisms between indecomposable modules in representation-finite cluster tilted algebras lying in the $(m+1)$-th power of the radical of their module category.


title: Superelliptic curves with many automorphisms and CM Jacobians

abstract: Let $\mathcal{C}$ be a smooth, projective, genus $g\geq 2$ curve, defined over $\mathbb{C}$. Then $\mathcal{C}$ has \emph{many automorphisms} if its corresponding moduli point $p \in \mathcal{M}_g$ has a neighborhood $U$ in the complex topology, such that all curves corresponding to points in $U \setminus \{p \}$ have strictly fewer automorphisms than $\mathcal{C}$. We compute completely the list of superelliptic curves having many automorphisms. For each of these curves, we determine whether its Jacobian has complex multiplication. As a consequence, we prove the converse of Streit's complex multiplication criterion for these curves.


title: Risk-Sensitive Reinforcement Learning: a Martingale Approach to Reward Uncertainty

abstract: We introduce a novel framework to account for sensitivity to rewards uncertainty in sequential decision-making problems. While risk-sensitive formulations for Markov decision processes studied so far focus on the distribution of the cumulative reward as a whole, we aim at learning policies sensitive to the uncertain/stochastic nature of the rewards, which has the advantage of being conceptually more meaningful in some cases. To this end, we present a new decomposition of the randomness contained in the cumulative reward based on the Doob decomposition of a stochastic process, and introduce a new conceptual tool - the \textit{chaotic variation} - which can rigorously be interpreted as the risk measure of the martingale component associated to the cumulative reward process. We innovate on the reinforcement learning side by incorporating this new risk-sensitive approach into model-free algorithms, both policy gradient and value function based, and illustrate its relevance on grid world and portfolio optimization problems.


title: Accurate Parameter Estimation for Risk-aware Autonomous Systems

abstract: Analysis and synthesis of safety-critical autonomous systems are carried out using models which are often dynamic. Two central features of these dynamic systems are parameters and unmodeled dynamics. This paper addresses the use of a spectral lines-based approach for estimating parameters of the dynamic model of an autonomous system. Existing literature has treated all unmodeled components of the dynamic system as sub-Gaussian noise and proposed parameter estimation using Gaussian noise-based exogenous signals. In contrast, we allow the unmodeled part to have deterministic unmodeled dynamics, which are almost always present in physical systems, in addition to sub-Gaussian noise. In addition, we propose a deterministic construction of the exogenous signal in order to carry out parameter estimation. We introduce a new tool kit which employs the theory of spectral lines, retains the stochastic setting, and leads to non-asymptotic bounds on the parameter estimation error. Unlike the existing stochastic approach, these bounds are tunable through an optimal choice of the spectrum of the exogenous signal leading to accurate parameter estimation. We also show that this estimation is robust to unmodeled dynamics, a property that is not assured by the existing approach. Finally, we show that under ideal conditions with no unmodeled dynamics, the proposed approach can ensure a $\tilde{O}(\sqrt{T})$ regret, matching existing literature. Experiments are provided to support all theoretical derivations, which show that the spectral lines-based approach outperforms the Gaussian noise-based method when unmodeled dynamics are present, in terms of both parameter estimation error and Regret obtained using the parameter estimates with a Linear Quadratic Regulator in feedback.


title: A Dedekind-style axiomatization and the corresponding universal property of an ordinal number system

abstract: In this paper, we give an axiomatization of the ordinal number system, in the style of Dedekind's axiomatization of the natural number system. The latter is based on a structure $(N,0,s)$ consisting of a set $N$, a distinguished element $0\in N$ and a function $s\colon N\to N$. The structure in our axiomatization is a triple $(O,L,s)$, where $O$ is a class, $L$ is a function defined on all $s$-closed `subsets' of $O$, and $s$ is a class function $s\colon O\to O$. In fact, we develop the theory relative to a Grothendieck-style universe (minus the power-set axiom), as a way of bringing the natural and the ordinal cases under one framework. We also establish a universal property for the ordinal number system, analogous to the well-known universal property for the natural number system.


title: Bounds for Combinatorial Types of Non-Attacking Riders

abstract: Given q non-attacking riders with r moves, the number of combinatorial types has not been found for r greater than 2 and q greater than 3. This paper aims to create upper and lower bound functions which can be applied to any q and r, regardless of size.


title: A Dynamical Systems Approach for Convergence of the Bayesian EM Algorithm

abstract: Out of the recent advances in systems and control (S\&C)-based analysis of optimization algorithms, not enough work has been specifically dedicated to machine learning (ML) algorithms and its applications. This paper addresses this gap by illustrating how (discrete-time) Lyapunov stability theory can serve as a powerful tool to aid, or even lead, in the analysis (and potential design) of optimization algorithms that are not necessarily gradient-based. The particular ML problem that this paper focuses on is that of parameter estimation in an incomplete-data Bayesian framework via the popular optimization algorithm known as maximum a posteriori expectation-maximization (MAP-EM). Following first principles from dynamical systems stability theory, conditions for convergence of MAP-EM are developed. Furthermore, if additional assumptions are met, we show that fast convergence (linear or quadratic) is achieved, which could have been difficult to unveil without our adopted S\&C approach. The convergence guarantees in this paper effectively expand the set of sufficient conditions for EM applications, thereby demonstrating the potential of similar S\&C-based convergence analysis of other ML algorithms.


title: Nonlinear effects in high-intensity focused ultrasound power transfer systems

abstract: In the context of wireless acoustic power transfer, high intensity focused ultrasound technology aims at the reduction of spreading losses by concentrating the acoustic energy at a specific location. Experiments are performed to determine the impact of nonlinear wave propagation on the spatially resonant conditions in a focused ultrasonic power transfer system. An in-depth analysis is performed to explain the experimental observations. The results show that the efficiency of the energy transfer is reduced as nonlinear effects become more prominent. Furthermore, the position of the maximum voltage output position shifts away from the focal point and closer to the transducer as the source strength is increased. The results and analysis are relevant to the development of novel efficient ultrasonic power transfer devices when using focused sources.


title: The Effect of Multi-step Methods on Overestimation in Deep Reinforcement Learning

abstract: Multi-step (also called n-step) methods in reinforcement learning (RL) have been shown to be more efficient than the 1-step method due to faster propagation of the reward signal, both theoretically and empirically, in tasks exploiting tabular representation of the value-function. Recently, research in Deep Reinforcement Learning (DRL) also shows that multi-step methods improve learning speed and final performance in applications where the value-function and policy are represented with deep neural networks. However, there is a lack of understanding about what is actually contributing to the boost of performance. In this work, we analyze the effect of multi-step methods on alleviating the overestimation problem in DRL, where multi-step experiences are sampled from a replay buffer. Specifically building on top of Deep Deterministic Policy Gradient (DDPG), we propose Multi-step DDPG (MDDPG), where different step sizes are manually set, and its variant called Mixed Multi-step DDPG (MMDDPG) where an average over different multi-step backups is used as update target of Q-value function. Empirically, we show that both MDDPG and MMDDPG are significantly less affected by the overestimation problem than DDPG with 1-step backup, which consequently results in better final performance and learning speed. We also discuss the advantages and disadvantages of different ways to do multi-step expansion in order to reduce approximation error, and expose the tradeoff between overestimation and underestimation that underlies offline multi-step methods. Finally, we compare the computational resource needs of Twin Delayed Deep Deterministic Policy Gradient (TD3), a state-of-art algorithm proposed to address overestimation in actor-critic methods, and our proposed methods, since they show comparable final performance and learning speed.


title: Cohomology of torsion and completion of N-complexes

abstract: We introduce the notions of Koszul $N$-complex, $\check{\mathrm{C}}$ech $N$-complex and telescope $N$-complex, explicit derived torsion and derived completion functors in the derived category $\mathbf{D}_N(R)$ of $N$-complexes using the $\check{\mathrm{C}}$ech $N$-complex and the telescope $N$-complex. Moreover, we give an equivalence between the category of cohomologically $\mathfrak{a}$-torsion $N$-complexes and the category of cohomologically $\mathfrak{a}$-adic complete $N$-complexes, and prove that over a commutative noetherian ring, via Koszul cohomology, via RHom cohomology (resp. $\otimes$ cohomology) and via local cohomology (resp. derived completion), all yield the same invariant.


title: Limits of Transfer Learning

abstract: Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove several novel results related to transfer learning, showing the need to carefully select which sets of information to transfer and the need for dependence between transferred information and target problems. Furthermore, we prove how the degree of probabilistic change in an algorithm using transfer learning places an upper bound on the amount of improvement possible. These results build on the algorithmic search framework for machine learning, allowing the results to apply to a wide range of learning problems using transfer.


title: Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists

abstract: Despite the promises of data-driven artificial intelligence (AI), little is known about how we can bridge the gulf between traditional physician-driven diagnosis and a plausible future of medicine automated by AI. Specifically, how can we involve AI usefully in physicians' diagnosis workflow given that most AI is still nascent and error-prone (e.g., in digital pathology)? To explore this question, we first propose a series of collaborative techniques to engage human pathologists with AI given AI's capabilities and limitations, based on which we prototype Impetus - a tool where an AI takes various degrees of initiatives to provide various forms of assistance to a pathologist in detecting tumors from histological slides. We summarize observations and lessons learned from a study with eight pathologists and discuss recommendations for future work on human-centered medical AI systems.


title: When Distributed Formation Control Is Feasible under Hard Constraints on Energy and Time?

abstract: This paper studies distributed optimal formation control with hard constraints on energy levels and termination time, in which the formation error is to be minimized jointly with the energy cost. The main contributions include a globally optimal distributed formation control law and a comprehensive analysis of the resulting closed-loop system under those hard constraints. It is revealed that the energy levels, the task termination time, the steady-state error tolerance, as well as the network topology impose inherent limitations in achieving the formation control mission. Most notably, the lower bounds on the achievable termination time and the required minimum energy levels are derived, which are given in terms of the initial formation error, the steady-state error tolerance, and the largest eigenvalue of the Laplacian matrix. These lower bounds can be employed to assert whether an energy and time constrained formation task is achievable and how to accomplish such a task. Furthermore, the monotonicity of those lower bounds in relation to the control parameters is revealed. A simulation example is finally given to illustrate the obtained results.


title: A Study on Impacts of Multiple Factors on Video Qualify of Experience

abstract: HTTP Adaptive Streaming (HAS) has become a cost-effective means for multimedia delivery nowadays. However, how the quality of experience (QoE) is jointly affected by 1) varying perceptual quality and 2) interruptions is not well-understood. In this paper, we present the first attempt to quantitatively quantify the relative impacts of these factors on the QoE of streaming sessions. To achieve this purpose, we first model the impacts of the factors using histograms, which represent the frequency distributions of the individual factors in a session. By using a large dataset, various insights into the relative impacts of these factors are then provided, serving as suggestions to improve the QoE of streaming sessions.


title: Security and Privacy Preserving Deep Learning

abstract: Commercial companies that collect user data on a large scale have been the main beneficiaries of this trend since the success of deep learning techniques is directly proportional to the amount of data available for training. Massive data collection required for deep learning presents obvious privacy issues. Users personal, highly sensitive data such as photos and voice recordings are kept indefinitely by the companies that collect it. Users can neither delete it nor restrict the purposes for which it is used. So, data privacy has been a very important concern for governments and companies these days. It gives rise to a very interesting challenge since on the one hand, we are pushing further and further for high-quality models and accessible data, but on the other hand, we need to keep data safe from both intentional and accidental leakage. The more personal the data is it is more restricted it means some of the most important social issues cannot be addressed using machine learning because researchers do not have access to proper training data. But by learning how to machine learning that protects privacy we can make a huge difference in solving many social issues like curing disease etc. Deep neural networks are susceptible to various inference attacks as they remember information about their training data. In this chapter, we introduce differential privacy, which ensures that different kinds of statistical analyses dont compromise privacy and federated learning, training a machine learning model on a data to which we do not have access to.


title: Antiferromagnetic Half-skyrmions and Bimerons at room temperature

abstract: In the quest for post-CMOS technologies, ferromagnetic skyrmions and their anti-particles have shown great promise as topologically protected solitonic information carriers in memory-in-logic or neuromorphic devices. However, the presence of dipolar fields in ferromagnets, restricting the formation of ultra-small topological textures, and the deleterious skyrmion Hall effect when driven by spin torques have thus far inhibited their practical implementations. Antiferromagnetic analogues, which are predicted to demonstrate relativistic dynamics, fast deflection-free motion and size scaling have recently come into intense focus, but their experimental realizations in natural antiferromagnetic systems are yet to emerge. Here, we demonstrate a family of topological antiferromagnetic spin-textures in $\alpha$-Fe$_2$O$_3$ - an earth-abundant oxide insulator - capped with a Pt over-layer. By exploiting a first-order analogue of the Kibble-Zurek mechanism, we stabilize exotic merons-antimerons (half-skyrmions), and bimerons, which can be erased by magnetic fields and re-generated by temperature cycling. These structures have characteristic sizes of the order ~100 nm that can be chemically controlled via precise tuning of the exchange and anisotropy, with pathways to further scaling. Driven by current-based spin torques from the heavy-metal over-layer, some of these AFM textures could emerge as prime candidates for low-energy antiferromagnetic spintronics at room temperature.


title: Cine Cardiac MRI Motion Artifact Reduction Using a Recurrent Neural Network

abstract: Cine cardiac magnetic resonance imaging (MRI) is widely used for diagnosis of cardiac diseases thanks to its ability to present cardiovascular features in excellent contrast. As compared to computed tomography (CT), MRI, however, requires a long scan time, which inevitably induces motion artifacts and causes patients' discomfort. Thus, there has been a strong clinical motivation to develop techniques to reduce both the scan time and motion artifacts. Given its successful applications in other medical imaging tasks such as MRI super-resolution and CT metal artifact reduction, deep learning is a promising approach for cardiac MRI motion artifact reduction. In this paper, we propose a recurrent neural network to simultaneously extract both spatial and temporal features from under-sampled, motion-blurred cine cardiac images for improved image quality. The experimental results demonstrate substantially improved image quality on two clinical test datasets. Also, our method enables data-driven frame interpolation at an enhanced temporal resolution. Compared with existing methods, our deep learning approach gives a superior performance in terms of structural similarity (SSIM) and peak signal-to-noise ratio (PSNR).


title: Unsupervised Sound Separation Using Mixture Invariant Training

abstract: In recent years, rapid progress has been made on the problem of single-channel sound separation using supervised training of deep neural networks. In such supervised approaches, a model is trained to predict the component sources from synthetic mixtures created by adding up isolated ground-truth sources. Reliance on this synthetic training data is problematic because good performance depends upon the degree of match between the training data and real-world audio, especially in terms of the acoustic conditions and distribution of sources. The acoustic properties can be challenging to accurately simulate, and the distribution of sound types may be hard to replicate. In this paper, we propose a completely unsupervised method, mixture invariant training (MixIT), that requires only single-channel acoustic mixtures. In MixIT, training examples are constructed by mixing together existing mixtures, and the model separates them into a variable number of latent sources, such that the separated sources can be remixed to approximate the original mixtures. We show that MixIT can achieve competitive performance compared to supervised methods on speech separation. Using MixIT in a semi-supervised learning setting enables unsupervised domain adaptation and learning from large amounts of real world data without ground-truth source waveforms. In particular, we significantly improve reverberant speech separation performance by incorporating reverberant mixtures, train a speech enhancement system from noisy mixtures, and improve universal sound separation by incorporating a large amount of in-the-wild data.


title: Orbifold bordism and duality for finite orbispectra

abstract: We construct the stable (representable) homotopy category of finite orbispectra, whose objects are formal desuspensions of finite orbi-CW-pairs by vector bundles and whose morphisms are stable homotopy classes of (representable) relative maps. The stable representable homotopy category of finite orbispectra admits a contravariant involution extending Spanier--Whitehead duality. This duality relates homotopical cobordism theories (cohomology theories on finite orbispectra) represented by global Thom spectra to geometric (derived) orbifold bordism groups (homology theories on finite orbispectra). This isomorphism extends the classical Pontryagin--Thom isomorphism and its known equivariant generalizations.


title: Efficient Hyperparameter Optimization in Deep Learning Using a Variable Length Genetic Algorithm

abstract: Convolutional Neural Networks (CNN) have gained great success in many artificial intelligence tasks. However, finding a good set of hyperparameters for a CNN remains a challenging task. It usually takes an expert with deep knowledge, and trials and errors. Genetic algorithms have been used in hyperparameter optimizations. However, traditional genetic algorithms with fixed-length chromosomes may not be a good fit for optimizing deep learning hyperparameters, because deep learning models have variable number of hyperparameters depending on the model depth. As the depth increases, the number of hyperparameters grows exponentially, and searching becomes exponentially harder. It is important to have an efficient algorithm that can find a good model in reasonable time. In this article, we propose to use a variable length genetic algorithm (GA) to systematically and automatically tune the hyperparameters of a CNN to improve its performance. Experimental results show that our algorithm can find good CNN hyperparameters efficiently. It is clear from our experiments that if more time is spent on optimizing the hyperparameters, better results could be achieved. Theoretically, if we had unlimited time and CPU power, we could find the optimized hyperparameters and achieve the best results in the future.


title: Semi-Supervised Learning for Fetal Brain MRI Quality Assessment with ROI consistency

abstract: Fetal brain MRI is useful for diagnosing brain abnormalities but is challenged by fetal motion. The current protocol for T2-weighted fetal brain MRI is not robust to motion so image volumes are degraded by inter- and intra- slice motion artifacts. Besides, manual annotation for fetal MR image quality assessment are usually time-consuming. Therefore, in this work, a semi-supervised deep learning method that detects slices with artifacts during the brain volume scan is proposed. Our method is based on the mean teacher model, where we not only enforce consistency between student and teacher models on the whole image, but also adopt an ROI consistency loss to guide the network to focus on the brain region. The proposed method is evaluated on a fetal brain MR dataset with 11,223 labeled images and more than 200,000 unlabeled images. Results show that compared with supervised learning, the proposed method can improve model accuracy by about 6\% and outperform other state-of-the-art semi-supervised learning methods. The proposed method is also implemented and evaluated on an MR scanner, which demonstrates the feasibility of online image quality assessment and image reacquisition during fetal MR scans.


title: Signal Shaping for Non-Uniform Beamspace Modulated mmWave Hybrid MIMO Communications

abstract: This paper investigates adaptive signal shaping methods for millimeter wave (mmWave) multiple-input multiple-output (MIMO) communications based on the maximizing the minimum Euclidean distance (MMED) criterion. In this work, we utilize the indices of analog precoders to carry information and optimize the symbol vector sets used for each analog precoder activation state. Specifically, we firstly propose a joint optimization based signal shaping (JOSS) approach, in which the symbol vector sets used for all analog precoder activation states are jointly optimized by solving a series of quadratically constrained quadratic programming (QCQP) problems. JOSS exhibits good performance, however, with a high computational complexity. To reduce the computational complexity, we then propose a full precoding based signal shaping (FPSS) method and a diagonal precoding based signal shaping (DPSS) method, where the full or diagonal digital precoders for all analog precoder activation states are optimized by solving two small-scale QCQP problems. Simulation results show that the proposed signal shaping methods can provide considerable performance gain in reliability in comparison with existing mmWave transmission solutions.


title: Deep Learning of Unified Region, Edge, and Contour Models for Automated Image Segmentation

abstract: Image segmentation is a fundamental and challenging problem in computer vision with applications spanning multiple areas, such as medical imaging, remote sensing, and autonomous vehicles. Recently, convolutional neural networks (CNNs) have gained traction in the design of automated segmentation pipelines. Although CNN-based models are adept at learning abstract features from raw image data, their performance is dependent on the availability and size of suitable training datasets. Additionally, these models are often unable to capture the details of object boundaries and generalize poorly to unseen classes. In this thesis, we devise novel methodologies that address these issues and establish robust representation learning frameworks for fully-automatic semantic segmentation in medical imaging and mainstream computer vision. In particular, our contributions include (1) state-of-the-art 2D and 3D image segmentation networks for computer vision and medical image analysis, (2) an end-to-end trainable image segmentation framework that unifies CNNs and active contour models with learnable parameters for fast and robust object delineation, (3) a novel approach for disentangling edge and texture processing in segmentation networks, and (4) a novel few-shot learning model in both supervised settings and semi-supervised settings where synergies between latent and image spaces are leveraged to learn to segment images given limited training data.


title: Large-scale Simulations of Antihelium Production in Cosmic-ray Interactions

abstract: The possibility of antihelium production in interaction of cosmic rays with the interstellar gas is studied using large-scale Monte Carlo simulations. For this purpose, an energy-dependent coalescence mechanism developed previously is extended to estimate the production of light antinuclei (${}^3\overline{\text{He}}$ and ${}^4\overline{\text{He}}$). The uncertainty in the coalescence parameter and its effect on the expected antiparticle flux is also investigated. The simulated background antihelium fluxes are found to be lower than the fluxes predicted by simplified models using numerical scaling techniques.


title: iffDetector: Inference-aware Feature Filtering for Object Detection

abstract: Modern CNN-based object detectors focus on feature configuration during training but often ignore feature optimization during inference. In this paper, we propose a new feature optimization approach to enhance features and suppress background noise in both the training and inference stages. We introduce a generic Inference-aware Feature Filtering (IFF) module that can easily be combined with modern detectors, resulting in our iffDetector. Unlike conventional open-loop feature calculation approaches without feedback, the IFF module performs closed-loop optimization by leveraging high-level semantics to enhance the convolutional features. By applying Fourier transform analysis, we demonstrate that the IFF module acts as a negative feedback that theoretically guarantees the stability of feature learning. IFF can be fused with CNN-based object detectors in a plug-and-play manner with negligible computational cost overhead. Experiments on the PASCAL VOC and MS COCO datasets demonstrate that our iffDetector consistently outperforms state-of-the-art methods by significant margins\footnote{The test code and model are anonymously available in https://github.com/anonymous2020new/iffDetector }.


title: CIE XYZ Net: Unprocessing Images for Low-Level Computer Vision Tasks

abstract: Cameras currently allow access to two image states: (i) a minimally processed linear raw-RGB image state (i.e., raw sensor data) or (ii) a highly-processed nonlinear image state (e.g., sRGB). There are many computer vision tasks that work best with a linear image state, such as image deblurring and image dehazing. Unfortunately, the vast majority of images are saved in the nonlinear image state. Because of this, a number of methods have been proposed to "unprocess" nonlinear images back to a raw-RGB state. However, existing unprocessing methods have a drawback because raw-RGB images are sensor-specific. As a result, it is necessary to know which camera produced the sRGB output and use a method or network tailored for that sensor to properly unprocess it. This paper addresses this limitation by exploiting another camera image state that is not available as an output, but it is available inside the camera pipeline. In particular, cameras apply a colorimetric conversion step to convert the raw-RGB image to a device-independent space based on the CIE XYZ color space before they apply the nonlinear photo-finishing. Leveraging this canonical image state, we propose a deep learning framework, CIE XYZ Net, that can unprocess a nonlinear image back to the canonical CIE XYZ image. This image can then be processed by any low-level computer vision operator and re-rendered back to the nonlinear image. We demonstrate the usefulness of the CIE XYZ Net on several low-level vision tasks and show significant gains that can be obtained by this processing framework. Code and dataset are publicly available at https://github.com/mahmoudnafifi/CIE_XYZ_NET.


title: Inflation Wars: A New Hope

abstract: We explore a class of primordial power spectra that can fit the observed anisotropies in the cosmic microwave background well and that predicts a value for the Hubble parameter consistent with the local measurement of $H_0 = 74$ km/s/Mpc. This class of primordial power spectrum consists of a continuous deformation between the best-fit power law primordial power spectrum and the primordial power spectrum derived from the modified Richardson-Lucy deconvolution algorithm applied to the $C_\ell$s of best-fit power law primordial power spectrum. We find that linear interpolation half-way between the power law and modified Richardson-Lucy power spectra fits the Planck data better than the best-fit $\Lambda$CDM by $\Delta\log\mathcal{L} = 2.5$. In effect, this class of deformations of the primordial power spectra offer a new dimension which is correlated with the Hubble parameter. This correlation causes the best-fit value for $H_0$ to shift and the uncertainty to expand to $H_0 = 70.2 \pm 1.2$ km/s/Mpc. When considering the Planck dataset combined with the Cepheid $H_0$ measurement, the best-fit $H_0$ becomes $H_0 = 71.8 \pm 0.9$ km/s/Mpc. We also compute a Bayes factor of $\log K = 5.7$ in favor of the deformation model.


title: Comprehensive Photometric Investigation of an Active Early K-type Contact System -- IL Cnc

abstract: Comprehensive photometric investigation was carried out to the early K-type contact binary - IL Cnc. A few light curves from both ground-based telescopes and the Kepler space telescope were obtained (or downloaded) and then analyzed in detail. They are mostly found to be asymmetric and there are even continuously changing O'Connell effect in the light curves from Kepler K2 data, suggesting the system to be highly active. Using the Wilson-Devinney code (version 2013), photometric solutions were derived and then compared. It is found that the calculation of the mass ratio is easily affected by the spot settings. Combining the radial velocities determined from LAMOST median resolution spectral data, the mass ratio of the binary components is found to be $M_2/M_1 = 1.76\pm 0.05$. The components are in shallow contact ($f\sim 9\%$) and have a temperature difference about $T_2 - T_1 = -280\pm 20$ K. The system is demonstrated to be W-subtype, which may be a common feature of K-type contact binaries. The masses of the binary components were estimated to be $M_1\sim 0.51$ M$_{sun}$ and $M_2\sim 0.90$ M$_{sun}$. The values are in good agreement with that deduced from the parallax data of Gaia. The results suggest that the primary component lacks luminosity compared with the zero main sequence. The H$\alpha$ spectral line of the primary component is found to be peculiar. Combining newly determined minimum light times with those collected from literature, the orbital period of IL Cnc is studied. It is found that the (O$-$C)s of the primary minima show sinusoidal variation while the secondary do not. The oscillation is more likely to be caused by the starspot activities. Yet this assumption needs more data to support.