title: Energy-Efficient Distributed Learning Algorithms for Coarsely Quantized Signals

abstract: In this work, we present an energy-efficient distributed learning framework using low-resolution ADCs and coarsely quantized signals for Internet of Things (IoT) networks. In particular, we develop a distributed quantization-aware least-mean square (DQA-LMS) algorithm that can learn parameters in an energy-efficient fashion using signals quantized with few bits while requiring a low computational cost. We also carry out a statistical analysis of the proposed DQA-LMS algorithm that includes a stability condition. Simulations assess the DQA-LMS algorithm against existing techniques for a distributed parameter estimation task where IoT devices operate in a peer-to-peer mode and demonstrate the effectiveness of the DQA-LMS algorithm.


title: Towards Mobile Distributed Ledgers

abstract: Advances in mobile computing have paved the way for new types of distributed applications that can be executed solely by mobile devices on device-to-device (D2D) ecosystems (e.g., crowdsensing). Sophisticated applications, like cryptocurrencies, need distributed ledgers to function. Distributed ledgers, such as blockchains and directed acyclic graphs (DAGs), employ consensus protocols to add data in the form of blocks. However, such protocols are designed for resourceful devices that are interconnected via the Internet. Moreover, existing distributed ledgers are not deployable to D2D ecosystems since their storage needs are continuously increasing. In this work, we introduce and analyse Mneme, a DAG-based distributed ledger that can be maintained solely by mobile devices. Mneme utilizes two novel consensus protocols: Proof-of-Context (PoC) and Proof-of-Equivalence (PoE). PoC employs users' context to add data on Mneme. PoE is executed periodically to summarize data and produce equivalent blocks that require less storage. We analyze Mneme's security and justify the ability of PoC and PoE to guarantee the characteristics of distributed ledgers: persistence and liveness. Furthermore, we analyze potential attacks from malicious users and prove that the probability of a successful attack is inversely proportional to the square of the number of mobile users who maintain Mneme.


title: Intensity correlation OCT -- a true classical equivalent of quantum OCT able to achieve up to 2-fold resolution improvement in standard OCT images

abstract: Quantum Optical Coherence Tomography (Q-OCT) uses quantum properties of light to provide several advantages over its classical counterpart, OCT: it achieves a twice better axial resolution with the same spectral bandwidth and it is immune to even orders of dispersion. Since these features are very sought-after in OCT imaging, many hardware and software techniques have been created to mimic the quantum behaviour of light and achieve these features using traditional OCT systems. The most recent, purely algorithmic scheme - an improved version of Intensity Correlation Spectral Domain OCT named ICA-SD-OCT showed even-order dispersion cancellation and reduction of artefacts. The true capabilities of this method were unfortunately severely undermined, both in terms of its relation to Q-OCT and in terms of its main performance parameters. In this work, we provide experimental demonstrations as well as numerical and analytical arguments to show that ICA-SD-OCT is a true classical equivalent of Q-OCT, more specifically its Fourier domain version, and therefore it enables a true two-fold axial resolution improvement. We believe that clarification of all the misconceptions about this very promising algorithm will highlight the great value of this method for OCT and consequently lead to its practical applications for resolution- and quality-enhanced OCT imaging.


title: Urban land-use analysis using proximate sensing imagery: a survey

abstract: Urban regions are complicated functional systems that are closely associated with and reshaped by human activities. The propagation of online geographic information-sharing platforms and mobile devices equipped with Global Positioning System (GPS) greatly proliferates proximate sensing images taken near or on the ground at a close distance to urban targets. Studies leveraging proximate sensing imagery have demonstrated great potential to address the need for local data in urban land-use analysis. This paper reviews and summarizes the state-of-the-art methods and publicly available datasets from proximate sensing to support land-use analysis. We identify several research problems in the perspective of examples to support training of models and means of integrating diverse data sets. Our discussions highlight the challenges, strategies, and opportunities faced by the existing methods using proximate sensing imagery in urban land-use studies.


title: Injection Locking and Noise Reduction of Resonant Tunneling Diode Terahertz Oscillator

abstract: We studied the injection-locking properties of a resonant-tunneling-diode terahertz oscillator in the small-signal injection regime with a frequency-stabilized continuous THz wave. The linewidth of the emission spectrum dramatically decreased to less than 120 mHz (HWHM) from 4.4 MHz in the free running state as a result of the injection locking. We experimentally determined the amplitude of injection voltage at the antenna caused by the injected THz wave. The locking range was proportional to the injection amplitude and consistent with Adler's model. As increasing the injection amplitude, we observed decrease of the noise component in the power spectrum, which manifests the free-running state, and alternative increase of the injection-locked component. The noise component and the injection-locked component had the same power at the threshold injection amplitude as small as $5\times10^{-4}$ of the oscillation amplitude. This threshold behavior can be qualitatively explained by Maffezzoni's model of noise reduction in general limit-cycle oscillators.


title: On the Effectiveness of Small Input Noise for Defending Against Query-based Black-Box Attacks

abstract: While deep neural networks show unprecedented performance in various tasks, the vulnerability to adversarial examples hinders their deployment in safety-critical systems. Many studies have shown that attacks are also possible even in a black-box setting where an adversary cannot access the target model's internal information. Most black-box attacks are based on queries, each of which obtains the target model's output for an input, and many recent studies focus on reducing the number of required queries. In this paper, we pay attention to an implicit assumption of query-based black-box adversarial attacks that the target model's output exactly corresponds to the query input. If some randomness is introduced into the model, it can break the assumption, and thus, query-based attacks may have tremendous difficulty in both gradient estimation and local search, which are the core of their attack process. From this motivation, we observe even a small additive input noise can neutralize most query-based attacks and name this simple yet effective approach Small Noise Defense (SND). We analyze how SND can defend against query-based black-box attacks and demonstrate its effectiveness against eight state-of-the-art attacks with CIFAR-10 and ImageNet datasets. Even with strong defense ability, SND almost maintains the original classification accuracy and computational speed. SND is readily applicable to pre-trained models by adding only one line of code at the inference.


title: Characterizing the Manx Candidate A/2018 V3

abstract: Manx objects approach the inner solar system on long-period comet (LPC) orbits with the consequent high inbound velocities, but unlike comets, Manxes display very little to no activity even near perihelion. This suggests that they may have formed in circumstances different from typical LPCs; moreover, this lack of significant activity also renders them difficult to detect at large distances. Thus, analyzing their physical properties can help constrain models of solar system formation as well as sharpen detection methods for those classified as NEOs. Here, we focus on the Manx candidate A/2018 V3 as part of a larger effort to characterize Manxes as a whole. This particular object was observed to be inactive even at its perihelion at $q$ = 1.34 au in 2019 September. Its spectral reflectivity is consistent with typical organic-rich comet surfaces with colors of $g'-r'= 0.67\pm0.02$, $r'-i' = 0.26\pm0.02$, and $r'-z' = 0.45\pm0.02$, corresponding to a spectral reflectivity slope of $10.6\pm 0.9$ %/100nm. A least-squares fit of our constructed light curve to the observational data yields an average nucleus radius of $\approx$2 km assuming an albedo of 0.04. This is consistent with the value measured from NEOWISE. A surface brightness analysis for data taken 2020 July 13 indicated possible low activity ($\lesssim0.68$ g $\rm s^{-1}$), but not enough to lift optically significant amounts of dust. Finally, we discuss Manxes as a constraint on solar system dynamical models as well as their implications for planetary defense.


title: Relative Rota-Baxter systems on Leibniz algebras

abstract: In this paper, we introduce relative Rota-Baxter systems on Leibniz algebras and give some characterizations and new constructions. Then we construct a graded Lie algebra whose Maurer-Cartan elements are relative Rota-Baxter systems. This allows us to define a cohomology theory associated with a relative Rota-Baxter system. Finally, we study formal deformations and extendibility of finite order deformations of a relative Rota-Baxter system in terms of the cohomology theory.


title: Current-induced magnetization switching in a chemically disordered A1 CoPt single layer

abstract: We report the first demonstration of the current-induced magnetization switching in a perpendicularly magnetized A1 CoPt single layer. We show that good perpendicular magnetic anisotropy can be obtained in a wide composition range of the A1 Co1-xPtx single layers, which allows to fabricate perpendicularly magnetized CoPt single layer with composition gradient to break the inversion symmetry of the structure. By fabricating the gradient CoPt single layer, we have evaluated the SOT efficiency and successfully realized the SOT-induced magnetization switching. Our study provides an approach to realize the current-induced magnetization in the ferromagnetic single layers without attaching SOT source materials.


title: Laser Cooling of Germanium Semiconductor Nanocrystals

abstract: Laser cooling of matter through anti-Stokes photoluminescence, where the emitted frequency of light exceeds that of the impinging laser by virtue of absorption of thermal vibrational energy, has been successfully realized in condensed media, and in particular with rare earth doped systems achieving sub-100K solid state optical refrigeration. Studies suggest that laser cooling in semiconductors has the potential of achieving temperatures down to ~10K and that its direct integration can usher unique high-performance nanostructured semiconductor devices. While laser cooling of nanostructured II-VI semiconductors has been reported recently, laser cooling of indirect bandgap semiconductors such as group IV silicon and germanium remains a major challenge. Here we report on the anomalous observation of dominant anti-Stokes photoluminescence in germanium nanocrystals. We attribute this result to the confluence of ultra-high purity nanocrystal germanium, generation of high density of electron-hole plasma, the inherent degeneracy of longitudinal and transverse optical phonons in non-polar indirect bandgap semiconductors, and commensurate spatial confinement effects. At high laser intensities, laser cooling with lattice temperature as low as ~50K is inferred.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.optics quant-ph


title: Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows

abstract: Efforts to make machine learning more widely accessible have led to a rapid increase in Auto-ML tools that aim to automate the process of training and deploying machine learning. To understand how Auto-ML tools are used in practice today, we performed a qualitative study with participants ranging from novice hobbyists to industry researchers who use Auto-ML tools. We present insights into the benefits and deficiencies of existing tools, as well as the respective roles of the human and automation in ML workflows. Finally, we discuss design implications for the future of Auto-ML tool development. We argue that instead of full automation being the ultimate goal of Auto-ML, designers of these tools should focus on supporting a partnership between the user and the Auto-ML tool. This means that a range of Auto-ML tools will need to be developed to support varying user goals such as simplicity, reproducibility, and reliability.


title: GPS Spoofing Mitigation and Timing Risk Analysis in Networked PMUs via Stochastic Reachability

abstract: To address PMU vulnerability against spoofing, we propose a set-valued state estimation technique known as Stochastic Reachability-based Distributed Kalman Filter (SR-DKF) that computes secure GPS timing across a network of receivers. Utilizing stochastic reachability, we estimate not only GPS time but also its stochastic reachable set, which is parameterized via probabilistic zonotope (p-Zonotope). While requiring known measurement error bounds in only non-spoofed conditions, we design a two-tier approach: We first perform measurement-level spoofing mitigation via deviation of measurement innovation from its expected p-Zonotope and second perform state-level timing risk analysis via intersection probability of estimated pZonotope with an unsafe set that violates IEEE C37.118.1a-2014 standards. We validate the proposed SR-DKF by subjecting a simulated receiver network to coordinated signal-level spoofing. We demonstrate improved GPS timing accuracy and successful spoofing mitigation via our SR-DKF. We validate the robustness of the estimated timing risk as the number of receivers is varied.


title: Robust GPS-Vision Localization via Integrity-Driven Landmark Attention

abstract: For robust GPS-vision navigation in urban areas, we propose an Integrity-driven Landmark Attention (ILA) technique via stochastic reachability. Inspired by cognitive attention in humans, we perform convex optimization to select a subset of landmarks from GPS and vision measurements that maximizes integrity-driven performance. Given known measurement error bounds in non-faulty conditions, our ILA follows a unified approach to address both GPS and vision faults and is compatible with any off-the-shelf estimator. We analyze measurement deviation to estimate the stochastic reachable set of expected position for each landmark, which is parameterized via probabilistic zonotope (p-Zonotope). We apply set union to formulate a p-Zonotopic cost that represents the size of position bounds based on landmark inclusion/exclusion. We jointly minimize the p-Zonotopic cost and maximize the number of landmarks via convex relaxation. For an urban dataset, we demonstrate improved localization accuracy and robust predicted availability for a pre-defined alert limit.


title: Assessing the Students' Understanding and their Mistakes in Code Review Checklists -- An Experience Report of 1,791 Code Review Checklist Questions from 394 Students

abstract: Code review is a widely-used practice in software development companies to identify defects. Hence, code review has been included in many software engineering curricula at universities worldwide. However, teaching code review is still a challenging task because the code review effectiveness depends on the code reading and analytical skills of a reviewer. While several studies have investigated the code reading techniques that students should use to find defects during code review, little has focused on a learning activity that involves analytical skills. Indeed, developing a code review checklist should stimulate students to develop their analytical skills to anticipate potential issues (i.e., software defects). Yet, it is unclear whether students can anticipate potential issues given their limited experience in software development (programming, testing, etc.). We perform a qualitative analysis to investigate whether students are capable of creating code review checklists, and if the checklists can be used to guide reviewers to find defects. In addition, we identify common mistakes that students make when developing a code review checklist. Our results show that while there are some misconceptions among students about the purpose of code review, students are able to anticipate potential defects and create a relatively good code review checklist. Hence, our results lead us to conclude that developing a code review checklist can be a part of the learning activities for code review in order to scaffold students' skills.


title: Feature refinement: An expression-specific feature learning and fusion method for micro-expression recognition

abstract: Micro-Expression Recognition has become challenging, as it is extremely difficult to extract the subtle facial changes of micro-expressions. Recently, several approaches proposed several expression-shared features algorithms for micro-expression recognition. However, they do not reveal the specific discriminative characteristics, which lead to sub-optimal performance. This paper proposes a novel Feature Refinement ({FR}) with expression-specific feature learning and fusion for micro-expression recognition. It aims to obtain salient and discriminative features for specific expressions and also predict expression by fusing the expression-specific features. FR consists of an expression proposal module with attention mechanism and a classification branch. First, an inception module is designed based on optical flow to obtain expression-shared features. Second, in order to extract salient and discriminative features for specific expression, expression-shared features are fed into an expression proposal module with attention factors and proposal loss. Last, in the classification branch, labels of categories are predicted by a fusion of the expression-specific features. Experiments on three publicly available databases validate the effectiveness of FR under different protocol. Results on public benchmarks demonstrate that our FR provides salient and discriminative information for micro-expression recognition. The results also show our FR achieves better or competitive performance with the existing state-of-the-art methods on micro-expression recognition.


title: Vertex and Energy Reconstruction in JUNO with Machine Learning Methods

abstract: The Jiangmen Underground Neutrino Observatory (JUNO) is an experiment designed to study neutrino oscillations. Determination of neutrino mass ordering and precise measurement of neutrino oscillation parameters $\sin^2 2\theta_{12}$, $\Delta m^2_{21}$ and $\Delta m^2_{32}$ are the main goals of the experiment. A rich physical program beyond the oscillation analysis is also foreseen. The ability to accurately reconstruct particle interaction events in JUNO is of great importance for the success of the experiment. In this work we present a few machine learning approaches applied to the vertex and the energy reconstruction. Multiple models and architectures were compared and studied, including Boosted Decision Trees (BDT), Deep Neural Networks (DNN), a few kinds of Convolution Neural Networks (CNN), based on ResNet and VGG, and a Graph Neural Network based on DeepSphere. Based on a study, carried out using the dataset, generated by the official JUNO software, we demonstrate that machine learning approaches achieve the necessary level of accuracy for reaching the physical goals of JUNO: $\sigma_E=3\%$ at $E_\text{vis}=1~\text{MeV}$ for the energy and $\sigma_{x,y,z}=10~\text{cm}$ at $E_\text{vis}=1~\text{MeV}$ for the position.


title: Robustness Gym: Unifying the NLP Evaluation Landscape

abstract: Despite impressive performance on standard benchmarks, deep neural networks are often brittle when deployed in real-world systems. Consequently, recent research has focused on testing the robustness of such models, resulting in a diverse set of evaluation methodologies ranging from adversarial attacks to rule-based data transformations. In this work, we identify challenges with evaluating NLP systems and propose a solution in the form of Robustness Gym (RG), a simple and extensible evaluation toolkit that unifies 4 standard evaluation paradigms: subpopulations, transformations, evaluation sets, and adversarial attacks. By providing a common platform for evaluation, Robustness Gym enables practitioners to compare results from all 4 evaluation paradigms with just a few clicks, and to easily develop and share novel evaluation methods using a built-in set of abstractions. To validate Robustness Gym's utility to practitioners, we conducted a real-world case study with a sentiment-modeling team, revealing performance degradations of 18%+. To verify that Robustness Gym can aid novel research analyses, we perform the first study of state-of-the-art commercial and academic named entity linking (NEL) systems, as well as a fine-grained analysis of state-of-the-art summarization models. For NEL, commercial systems struggle to link rare entities and lag their academic counterparts by 10%+, while state-of-the-art summarization models struggle on examples that require abstraction and distillation, degrading by 9%+. Robustness Gym can be found at https://robustnessgym.com/


title: Doubling inequalities and nodal sets in periodic elliptic homogenization

abstract: We prove explicit doubling inequalities and obtain uniform upper bounds (under $(d-1)$-dimensional Hausdorff measure) of nodal sets of weak solutions for a family of linear elliptic equations with rapidly oscillating periodic coefficients. The doubling inequalities, explicitly depending on the doubling index, are proved at different scales by a combination of convergence rates, a three-ball inequality from certain "analyticity", and a monotonicity formula of a frequency function. The upper bounds of nodal sets are shown by using the doubling inequalities, approximations by harmonic functions and an iteration argument.


title: Observation of Beam Spin Asymmetries in the Process $e p \rightarrow e \pi^{+}\pi^{-}X$ with CLAS12

abstract: The observation of beam spin asymmetries in two-pion production in semi-inclusive deep inelastic scattering off an unpolarized proton target is reported. The data presented here were taken in the fall of 2018 with the CLAS12 spectrometer using a 10.6 GeV longitudinally spin-polarized electron beam delivered by CEBAF at JLab. The measured asymmetries provide the first opportunity to extract the parton distribution function $e(x)$, which provides information about the interaction between gluons and quarks, in a collinear framework that offers cleaner access than previous measurements. The asymmetries also constitute the first ever signal sensitive to the helicity-dependent two-pion fragmentation function $G_1^\perp$. A clear sign change is observed around the $\rho$ mass that appears in model calculations and is indicative of the dependence of the produced pions on the helicity of the fragmenting quark.


title: What Makes a Dark Pattern... Dark? Design Attributes, Normative Considerations, and Measurement Methods

abstract: There is a rapidly growing literature on dark patterns, user interface designs -- typically related to shopping or privacy -- that researchers deem problematic. Recent work has been predominantly descriptive, documenting and categorizing objectionable user interfaces. These contributions have been invaluable in highlighting specific designs for researchers and policymakers. But the current literature lacks a conceptual foundation: What makes a user interface a dark pattern? Why are certain designs problematic for users or society? We review recent work on dark patterns and demonstrate that the literature does not reflect a singular concern or consistent definition, but rather, a set of thematically related considerations. Drawing from scholarship in psychology, economics, ethics, philosophy, and law, we articulate a set of normative perspectives for analyzing dark patterns and their effects on individuals and society. We then show how future research on dark patterns can go beyond subjective criticism of user interface designs and apply empirical methods grounded in normative perspectives.


title: Reproducing Activation Function for Deep Learning

abstract: We propose reproducing activation functions (RAFs) to improve deep learning accuracy for various applications ranging from computer vision to scientific computing. The idea is to employ several basic functions and their learnable linear combination to construct neuron-wise data-driven activation functions for each neuron. Armed with RAFs, neural networks (NNs) can reproduce traditional approximation tools and, therefore, approximate target functions with a smaller number of parameters than traditional NNs. In NN training, RAFs can generate neural tangent kernels (NTKs) with a better condition number than traditional activation functions lessening the spectral bias of deep learning. As demonstrated by extensive numerical tests, the proposed RAFs can facilitate the convergence of deep learning optimization for a solution with higher accuracy than existing deep learning solvers for audio/image/video reconstruction, PDEs, and eigenvalue problems. With RAFs, the errors of audio/video reconstruction, PDEs, and eigenvalue problems are decreased by over 14%, 73%, 99%, respectively, compared with baseline, while the performance of image reconstruction increases by 58%.


title: An algebraic construction of sum-integral interpolators

abstract: This paper presents an algebraic construction of Euler-Maclaurin formulas for polytopes. The formulas obtained generalize and unite the previous lattice point formulas of Morelli and Pommersheim-Thomas, and the Euler-Maclaurin formulas of Berline-Vergne While the approach of this paper originates in the theory of toric varieties, and recovers previous results about characteristic classes of toric varieties, the present paper is self-contained and does not rely on results from toric geometry. We aim in particular to exhibit in a combinatorial way ingredients such as such Todd classes and cycle-level intersections in Chow rings, that first entered the theory of polytopes from algebraic geometry.


title: Observation and Modeling of Solar Jets

abstract: The solar atmosphere is full of complicated transients manifesting the reconfiguration of solar magnetic field and plasma. Solar jets represent collimated, beam-like plasma ejections; they are ubiquitous in the solar atmosphere and important for the understanding of solar activities at different scales, magnetic reconnection process, particle acceleration, coronal heating, solar wind acceleration, as well as other related phenomena. Recent high spatiotemporal resolution, wide-temperature coverage, spectroscopic, and stereoscopic observations taken by ground-based and space-borne solar telescopes have revealed many valuable new clues to restrict the development of theoretical models. This review aims at providing the reader with the main observational characteristics of solar jets, physical interpretations and models, as well as unsolved outstanding questions in future studies.


title: Validation and application of the lattice Boltzmann algorithm for a turbulent immiscible Rayleigh-Taylor system

abstract: We develop a multicomponent lattice Boltzmann (LB) model for the 2D Rayleigh--Taylor turbulence with a Shan-Chen pseudopotential implemented on GPUs. In the immiscible case this method is able to accurately overcome the inherent numerical complexity caused by the complicated structure of the interface that appears in the fully developed turbulent regime. Accuracy of the LB model is tested both for early and late stages of instability. For the developed turbulent motion we analyze the balance between different terms describing variations of the kinetic and potential energies. Then, we analyze the role of interface in the energy balance, and also the effects of the vorticity induced by the interface in the energy dissipation. Statistical properties are compared for miscible and immiscible flows. Our results can also be considered as a first validation step to extend the application of LB model to 3D immiscible Rayleigh-Taylor turbulence.


title: Photosystem II network benefits from mixed chlorophylls in the antennae

abstract: Photosynthesis is the primary energy production process of ecosystem. Throughout the green plants, two different types of chlorophylls, Chl-a and -b, are bound to the light-harvesting complex for photosystem II. While the structure and functional characteristics of the two types of chlorophylls have been well documented as individual, the features of the coexistence has yet to be understood clearly. Here, we present a principled framework for discerning and quantifying the chlorophylls' role during the excited energy transfer. Our approach combines network science and Monte Carlo Markov analysis based on the Foerster resonance energy transfer rates between all the chlorophyll pairs in the light-harvesting antennae for photosystem II. We find that the excitation energy can be rapidly confined to the specific chlorophyll clusters in the light-harvesting complex, where excess energy dissipation possibly takes place, only when both chlorophyll species are involved. Comparing to other models with hypothetical chlorophyll compositions, we show that the light harvesting system with natural chlorophyll a and b ratio is the most advantageous for the photosystem II supercomplex to balance the light-harvesting and photoprotection capabilities.


title: Probabilistic Metric Learning with Adaptive Margin for Top-K Recommendation

abstract: Personalized recommender systems are playing an increasingly important role as more content and services become available and users struggle to identify what might interest them. Although matrix factorization and deep learning based methods have proved effective in user preference modeling, they violate the triangle inequality and fail to capture fine-grained preference information. To tackle this, we develop a distance-based recommendation model with several novel aspects: (i) each user and item are parameterized by Gaussian distributions to capture the learning uncertainties; (ii) an adaptive margin generation scheme is proposed to generate the margins regarding different training triplets; (iii) explicit user-user/item-item similarity modeling is incorporated in the objective function. The Wasserstein distance is employed to determine preferences because it obeys the triangle inequality and can measure the distance between probabilistic distributions. Via a comparison using five real-world datasets with state-of-the-art methods, the proposed model outperforms the best existing models by 4-22% in terms of recall@K on Top-K recommendation.


title: Heterogeneous Network Embedding for Deep Semantic Relevance Match in E-commerce Search

abstract: Result relevance prediction is an essential task of e-commerce search engines to boost the utility of search engines and ensure smooth user experience. The last few years eyewitnessed a flurry of research on the use of Transformer-style models and deep text-match models to improve relevance. However, these two types of models ignored the inherent bipartite network structures that are ubiquitous in e-commerce search logs, making these models ineffective. We propose in this paper a novel Second-order Relevance, which is fundamentally different from the previous First-order Relevance, to improve result relevance prediction. We design, for the first time, an end-to-end First-and-Second-order Relevance prediction model for e-commerce item relevance. The model is augmented by the neighborhood structures of bipartite networks that are built using the information of user behavioral feedback, including clicks and purchases. To ensure that edges accurately encode relevance information, we introduce external knowledge generated from BERT to refine the network of user behaviors. This allows the new model to integrate information from neighboring items and queries, which are highly relevant to the focus query-item pair under consideration. Results of offline experiments showed that the new model significantly improved the prediction accuracy in terms of human relevance judgment. An ablation study showed that the First-and-Second-order model gained a 4.3% average gain over the First-order model. Results of an online A/B test revealed that the new model derived more commercial benefits compared to the base model.


title: HESS J1858+020: A GeV-TeV source possibly powered by CRs from SNR G35.6-0.4

abstract: Context: The supernova remnant (SNR) G35.6-0.4 shows a non-thermal radio shell, however, no {\gamma}-ray or X-ray counterparts have been found for it thus far. One TeV source, HESS J1858+020, was found near the SNR and this source is spatially associated with some clouds at 3.6 kpc. Aims: To attain a better understanding of the origin of HESS J1858+020, we further investigate the association between SNR cosmic rays (CRs) and the clouds through the Fermi-LAT analysis and hadronic modeling. Methods: We performed the Fermi-LAT analysis to explore the GeV emission in and around the SNR. We explored the SNR physics with previously observed multi-wavelength data. We built a hadronic model using runaway CRs of the SNR to explain the GeV-TeV observation. Results: We found a hard GeV source (SrcX2) that is spatially coincident with both HESS J1858+020 and a molecular cloud complex at 3.6 kpc. In addition, a soft GeV source (SrcX1) was found at the northern edge of the SNR. The GeV spectrum of SrcX2 connects well with the TeV spectrum of HESS J1858+020. The entire {\gamma}-ray spectrum ranges from several GeV up to tens of TeV and it follows a power-law with an index of ~2.15. We discuss several pieces of observational evidence to support the middle-aged SNR argument. Using runaway CRs from the SNR, our hadronic model explains the GeV-TeV emission at HESS J1858+020, with a diffusion coefficient that is much lower than the Galactic value.


title: Knowledge-Enhanced Top-K Recommendation in Poincar\'e Ball

abstract: Personalized recommender systems are increasingly important as more content and services become available and users struggle to identify what might interest them. Thanks to the ability for providing rich information, knowledge graphs (KGs) are being incorporated to enhance the recommendation performance and interpretability. To effectively make use of the knowledge graph, we propose a recommendation model in the hyperbolic space, which facilitates the learning of the hierarchical structure of knowledge graphs. Furthermore, a hyperbolic attention network is employed to determine the relative importances of neighboring entities of a certain item. In addition, we propose an adaptive and fine-grained regularization mechanism to adaptively regularize items and their neighboring representations. Via a comparison using three real-world datasets with state-of-the-art methods, we show that the proposed model outperforms the best existing models by 2-16% in terms of NDCG@K on Top-K recommendation.


title: Adversarial Sample Enhanced Domain Adaptation: A Case Study on Predictive Modeling with Electronic Health Records

abstract: With the successful adoption of machine learning on electronic health records (EHRs), numerous computational models have been deployed to address a variety of clinical problems. However, due to the heterogeneity of EHRs, models trained on different patient groups suffer from poor generalizability. How to mitigate domain shifts between the source patient group where the model is built upon and the target one where the model will be deployed becomes a critical issue. In this paper, we propose a data augmentation method to facilitate domain adaptation, which leverages knowledge from the source patient group when training model on the target one. Specifically, adversarially generated samples are used during domain adaptation to fill the generalization gap between the two patient groups. The proposed method is evaluated by a case study on different predictive modeling tasks on MIMIC-III EHR dataset. Results confirm the effectiveness of our method and the generality on different tasks.


title: A Feasibility Study on Deep Learning Based Individualized 3D Dose Distribution Prediction

abstract: Purpose: Radiation therapy treatment planning is a trial-and-error, often time-consuming process. An optimal dose distribution based on a specific anatomy can be predicted by pre-trained deep learning (DL) models. However, dose distributions are often optimized based on not only patient-specific anatomy but also physician preferred trade-offs between planning target volume (PTV) coverage and organ at risk (OAR) sparing. Therefore, it is desirable to allow physicians to fine-tune the dose distribution predicted based on patient anatomy. In this work, we developed a DL model to predict the individualized 3D dose distributions by using not only the anatomy but also the desired PTV/OAR trade-offs, as represented by a dose volume histogram (DVH), as inputs. Methods: The desired DVH, fine-tuned by physicians from the initially predicted DVH, is first projected onto the Pareto surface, then converted into a vector, and then concatenated with mask feature maps. The network output for training is the dose distribution corresponding to the Pareto optimal DVH. The training/validation datasets contain 77 prostate cancer patients, and the testing dataset has 20 patients. Results: The trained model can predict a 3D dose distribution that is approximately Pareto optimal. We calculated the difference between the predicted and the optimized dose distribution for the PTV and all OARs as a quantitative evaluation. The largest average error in mean dose was about 1.6% of the prescription dose, and the largest average error in the maximum dose was about 1.8%. Conclusions: In this feasibility study, we have developed a 3D U-Net model with the anatomy and desired DVH as inputs to predict an individualized 3D dose distribution. The predicted dose distributions can be used as references for dosimetrists and physicians to rapidly develop a clinically acceptable treatment plan.


title: DESC DC2 Data Release Note

abstract: In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created a 300 deg$^2$ simulated survey as part of an effort called Data Challenge 2 (DC2). The DC2 simulated sky survey, in six optical bands with observations following a reference LSST observing cadence, was processed with the LSST Science Pipelines (19.0.0). In this Note, we describe the public data release of the resulting object catalogs for the coadded images of five years of simulated observations along with associated truth catalogs. We include a brief description of the major features of the available data sets. To enable convenient access to the data products, we have developed a web portal connected to Globus data services. We describe how to access the data and provide example Jupyter Notebooks in Python to aid first interactions with the data. We welcome feedback and questions about the data release via a GitHub repository.


title: A Recurrent Neural Network Approach to Roll Estimation for Needle Steering

abstract: Steerable needles are a promising technology for delivering targeted therapies in the body in a minimally-invasive fashion, as they can curve around anatomical obstacles and hone in on anatomical targets. In order to accurately steer them, controllers must have full knowledge of the needle tip's orientation. However, current sensors either do not provide full orientation information or interfere with the needle's ability to deliver therapy. Further, torsional dynamics can vary and depend on many parameters making steerable needles difficult to accurately model, limiting the effectiveness of traditional observer methods. To overcome these limitations, we propose a model-free, learned-method that leverages LSTM neural networks to estimate the needle tip's orientation online. We validate our method by integrating it into a sliding-mode controller and steering the needle to targets in gelatin and ex vivo ovine brain tissue. We compare our method's performance against an Extended Kalman Filter, a model-based observer, achieving significantly lower targeting errors.


title: Extinction time of stochastic SIRS models with small initial size of the infected population

abstract: The stochastic SIRS model is a continuous-time Markov chain modelling the spread of infectious diseases with temporary immunity, in a homogeneously-mixing population of fixed size $N$. We study the scaling behaviour of the extinction time of stochastic SIRS models as $N$ tends to infinity. When the initial size of infected population is small, we obtain the closed-form expression of the asymptotic distribution of this extinction time, and compare it with the data from Monte Carlo simulation.


title: A Data-driven Nonlinear Recharge Controller for Energy Storage in Frequency Regulation

abstract: Battery energy storage boosts up the response speed of power system frequency regulation, but must be recharged carefully to minimize the distortion to the frequency regulation response. This paper proposes a nonlinear feedback controller to optimize the recharge for storage resources in frequency regulation. This controller is designed using a data-driven best-hindsight optimization framework, the resulting nonlinear recharge controller's gain depends on the storage state of charge as well as its power and energy rating. The developed controller is compared with two benchmark automatic generation control designs, one is a proportional-integral-based control from PJM Interconnection, the other one is based on linear-quadratic regulator. Simulation results using real area control error data from PJM Interconnection show the proposed controller achieves smaller deviations in both the area control error and the storage state of charge compared to the two benchmark controllers under various storage configurations.


title: A*HAR: A New Benchmark towards Semi-supervised learning for Class-imbalanced Human Activity Recognition

abstract: Despite the vast literature on Human Activity Recognition (HAR) with wearable inertial sensor data, it is perhaps surprising that there are few studies investigating semisupervised learning for HAR, particularly in a challenging scenario with class imbalance problem. In this work, we present a new benchmark, called A*HAR, towards semisupervised learning for class-imbalanced HAR. We evaluate state-of-the-art semi-supervised learning method on A*HAR, by combining Mean Teacher and Convolutional Neural Network. Interestingly, we find that Mean Teacher boosts the overall performance when training the classifier with fewer labelled samples and a large amount of unlabeled samples, but the classifier falls short in handling unbalanced activities. These findings lead to an interesting open problem, i.e., development of semi-supervised HAR algorithms that are class-imbalance aware without any prior knowledge on the class distribution for unlabeled samples. The dataset and benchmark evaluation are released at https://github.com/I2RDL2/ASTAR-HAR for future research.


title: Exploring effects of tensor force and its strength via neutron drops

abstract: The tensor-force effects on the evolution of the spin-orbit splittings in the neutron drops are investigated within the framework of the relativistic Hartree-Fock theory. For fair comparisons on the pure mean-field level, the results of the relativistic Brueckner-Hartree-Fock calculation with the Bonn A interaction are adopted as meta-data. Through a quantitative analysis, we certify that the $\pi$-pseudovector ($\pi$-PV) coupling affects the evolutionary trend through the tensor force embedded. The strength of the tensor force is explored by enlarging the strength $f_{\pi}$ of the $\pi$-PV coupling. It is found that weakening the density dependence of $f_{\pi}$ is slightly better than enlarging it with a factor. We thus provide a semiquantitative support for the \textit{renormalization persistency} of the tensor force within the framework of density functional theory. This will serve as an important guidance for the further development of the relativistic effective interactions with particular focus on the tensor force.


title: Thermoelectric refrigerator based on asymmetric surfaces of a magnetic topological insulator

abstract: Thermoelectric (TE) refrigeration such as Peltier cooler enables a unique opportunity in electric energy to directly convert thermal energy. Here, we propose a TE module with both refrigeration and power generation modes by utilizing asymmetric surfaces of a magnetic topological insulator (quantum anomalous Hall insulator) with a periodic array of hollows filled with two different dielectrics. Based on the Boltzmann transport theory, we show that its efficiency, i.e., the dimensionless figure of merit ZT exceeds 1 in the low-temperature regime below 300 K. The proposed device could be utilized as a heat management device that requires precise temperature control in small-scale cooling.


title: Shadow cast by a rotating black hole with anisotropic matter

abstract: We obtain the shadow cast induced by the rotating black hole with an anisotropic matter. A Killing tensor representing the hidden symmetry is derived explicitly. The existence of separability structure implies a complete integrability of the geodesic motion. We analyze an effective potential around the unstable circular photon orbits to show that one side of the black hole is brighter than the other side. Further, it is shown that the inclusion of the anisotropic matter ($Kr^{2(1-w)}$) has an effect on the observables of the shadow cast. The shadow observables include approximate shadow radius $R_s$, distortion parameter $\delta_s$, area of the shadow $A_s$, and oblateness $D_{os}$.


title: Contrast-independent partially explicit time discretizations for multiscale flow problems

abstract: Many multiscale problems have a high contrast, which is expressed as a very large ratio between the media properties. The contrast is known to introduce many challenges in the design of multiscale methods and domain decomposition approaches. These issues to some extend are analyzed in the design of spatial multiscale and domain decomposition approaches. However, some of these issues remain open for time dependent problems as the contrast affects the time scales, particularly, for explicit methods. For example, in parabolic equations, the time step is $dt=H^2/\kappa_{max}$, where $\kappa_{max}$ is the largest diffusivity. In this paper, we address this issue in the context of parabolic equation by designing a splitting algorithm. The proposed splitting algorithm treats dominant multiscale modes in the implicit fashion, while the rest in the explicit fashion. The unconditional stability of these algorithms require a special multiscale space design, which is the main purpose of the paper. We show that with an appropriate choice of multiscale spaces we can achieve an unconditional stability with respect to the contrast. This could provide computational savings as the time step in explicit methods is adversely affected by the contrast. We discuss some theoretical aspects of the proposed algorithms. Numerical results are presented.


title: Theory of competing Chern-Simons orders and emergent phase transitions

abstract: Based on the Chern-Simons fermionization of spin-1/2 operators, we propose a systematic framework to investigate the competition between emergent phases in frustrated two-dimensional XY quantum magnets. Application of the method to the antiferromagnetic honeycomb spin-1/2 $J_1$-$J_2$ XY model reveals an unconventional phase transition between two Chern-Simons orders: the Chern-Simons superconductor and the exciton insulator of Chern-Simons fermions. We show that in the spin language, this transition translates to the transition from the planar N\'{e}el state to the non-uniform chiral spin-liquid that was proposed earlier in the literature. Namely, the Chern-Simons superconductor describes the planar N\'{e}el state, while the Chern-Simons exciton insulator corresponds to the non-uniform chiral spin-liquid. These results are further confirmed by our high-precision tensor network calculation, which provides the first numerical evidence for the transition from N\'{e}el order to a non-uniform chiral spin-liquid. We argue that the developed method can be applied to other frustrated quantum magnets of XXZ type and can detect unconventional phase transitions.


title: A three-dimensional Laguerre one-way wave equation solver

abstract: A finite difference algorithm based on the integral Laguerre transform in time for solving a three-dimensional one-way wave equation is proposed. This allows achieving high accuracy of calculation results. In contrast to the Fourier method, the approach does not need to solve systems of linear algebraic equations with indefinite matrices. To filter the unstable components of a wave field, Richardson extrapolation or spline approximation can be used. However, these methods impose additional limitations on the integration step in depth. This problem can be solved if the filtering is performed not in the direction of extrapolation of the wave field, but in a horizontal plane. This approach called for fast methods of converting the Laguerre series coefficients into the Fourier series coefficients and vice versa. The high stability of the new algorithm allows calculations with a large depth step without loss of accuracy and, in combination with Marchuk-Strang splitting, this can significantly reduce the calculation time. Computational experiments are performed. The results have shown that this algorithm is highly accurate and efficient in solving the problems of seismic migration.


title: Towards Energy Efficient Federated Learning over 5G+ Mobile Devices

abstract: The continuous convergence of machine learning algorithms, 5G and beyond (5G+) wireless communications, and artificial intelligence (AI) hardware implementation hastens the birth of federated learning (FL) over 5G+ mobile devices, which pushes AI functions to mobile devices and initiates a new era of on-device AI applications. Despite the remarkable progress made in FL, huge energy consumption is one of the most significant obstacles restricting the development of FL over battery-constrained 5G+ mobile devices. To address this issue, in this paper, we investigate how to develop energy efficient FL over 5G+ mobile devices by making a trade-off between energy consumption for "working" (i.e., local computing) and that for "talking" (i.e., wireless communications) in order to boost the overall energy efficiency. Specifically, we first examine energy consumption models for graphics processing unit (GPU) computation and wireless transmissions. Then, we overview the state of the art of integrating FL procedure with energy-efficient learning techniques (e.g., gradient sparsification, weight quantization, pruning, etc.). Finally, we present several potential future research directions for FL over 5G+ mobile devices from the perspective of energy efficiency.


title: Geometric origins of topological insulation in twisted layered semiconductors

abstract: Twisted bilayers of two-dimensional (2D) materials are proving a fertile ground for investigating strongly correlated electron phases. This is because the moir\'e pattern introduced by the relative twist between layers introduces long-wavelength effective potentials which lead to electron localization. Here, we develop a generalized continuum model for the electronic structure of moir\'e patterns, based on first-principles calculations and tailored to capture the physics of twisted bilayer 2D semiconductors. We apply this model to a database of eighteen 2D crystals covering a range of atomic relaxation and electronic structure features. Many of these materials host topologically insulating (TI) moir\'e bands in a certain range of twist angles, which originate from the competition between triangular and hexagonal moir\'e patterns, tuned by the twist angle. The topological phases occur in the same range as the maximally flat moir\'e bands.


title: Impact of strong magnetic fields on the inner crust of neutron stars

abstract: We study the impact of strong magnetic fields on the pasta phases that are expected to exist in the inner crust of neutron stars. We employ the relativistic mean field model to describe the nucleon interaction and use the self-consistent Thomas-Fermi approximation to calculate the nonuniform matter in neutron star crust. The properties of pasta phases and crust-core transition are examined. It is found that as the magnetic field strength $B$ is less than $10^{17}$ G, the effects of magnetic field are not evident comparing with the results without magnetic field. As $B$ is stronger than $10^{18}$ G, the onset densities of pasta phases and crust-core transition density decrease significantly, and the density distributions of nucleons and electrons are also changed obviously.


title: Convolutional Neural Nets in Chemical Engineering: Foundations, Computations, and Applications

abstract: In this paper we review the mathematical foundations of convolutional neural nets (CNNs) with the goals of: i) highlighting connections with techniques from statistics, signal processing, linear algebra, differential equations, and optimization, ii) demystifying underlying computations, and iii) identifying new types of applications. CNNs are powerful machine learning models that highlight features from grid data to make predictions (regression and classification). The grid data object can be represented as vectors (in 1D), matrices (in 2D), or tensors (in 3D or higher dimensions) and can incorporate multiple channels (thus providing high flexibility in the input data representation). CNNs highlight features from the grid data by performing convolution operations with different types of operators. The operators highlight different types of features (e.g., patterns, gradients, geometrical features) and are learned by using optimization techniques. In other words, CNNs seek to identify optimal operators that best map the input data to the output data. A common misconception is that CNNs are only capable of processing image or video data but their application scope is much wider; specifically, datasets encountered in diverse applications can be expressed as grid data. Here, we show how to apply CNNs to new types of applications such as optimal control, flow cytometry, multivariate process monitoring, and molecular simulations.


title: Angular spectrum influence and entanglement characterization of Gaussian-path encoded photonic qudits

abstract: Entangled quantum states play an important role in quantum information science and also in quantum mechanics fundamental investigations. Implementation and characterization of techniques allowing for easy preparation of entangled states are important steps in such fields. Here we generated entangled quantum states encoded in photons transversal paths, obtained by pumping a non-linear crystal with multiple transversal Gaussian beams. Such approach allows us to generate entangled states of two qubits and two qutrits encoded in Gaussian transversal path of twin photons. We make a theoretical analyses of this source, considering the influence of the pump angular spectrum on the generated states, further characterizing those by their purity and entanglement degree. Our experimental results reveals that the generated states presents both high purity and entanglement, and the theoretical analysis elucidates how the pump beams profile can be used to manipulate such photonic states.


title: Fixed points of nilpotent actions on surfaces of negative Euler characteristic

abstract: We prove that a locally nilpotent group $G$ of $C^{1}$ diffeomorphisms of a compact surface $S$ of non-vanishing Euler characteristic has a finite orbit ${\mathcal O}$ whose cardinal is bounded by above by a function of the characteristic of Euler of $S$. We focus on the case of negative Euler characteristic $\chi (S)$. Then we can choose ${\mathcal O}$ so that it consists of global contractible fixed points of thesubgroup $G_0$ of $G$ consisting of isotopic to the identity elements. In particular $G$ has a global contractible fixed point if it consists of isotopic to the identity elements.


title: Analyticity, renormalization, and evolution of the soft-quark function

abstract: We compute the renormalization and evolution of the soft-quark function that appears in the factorization theorem for Higgs-boson decays to two photons through a $b$-quark loop. Our computation confirms a conjecture by Liu, Mecaj, Neubert, Wang, and Fleming for the form of the renormalization and evolution of the soft-quark function in order $\alpha_s$. We also work out the analyticity structure of the soft-quark function by making use of light-cone perturbation theory.


title: Global smooth solutions to the 3D non-resistive MHD equations with low regularity axisymmetric data

abstract: The purpose of this paper is to study the incompressible non-resistive MHD equations in $\mathbb{R}^3$. We establish the global well-posedness of classical solutions if the initial data is axially symmetric and the swirl components of the velocity and magnetic vorticity vanish. In particular, the special axially symmetric initial data can be arbitrarily large and satisfy low regularity assumptions.


title: Amicus Plato, sed magis amica veritas: There is a reproducibility crisis in COVID-19 Computational Fluid Dynamics studies

abstract: There is overwhelming evidence on SARS-CoV-2 Airborne Transmission (AT) in the ongoing COVID-19 outbreak. It is extraordinarily difficult, however, to deduce a generalized framework to assess the relative airborne transmission risk with respect to other modes. This is due to the complex biophysics entailed in such phenomena. Since the SARS outbreak in 2002, Computational Fluid Dynamics (CFD) has been one of the main tools scientists used to investigate AT of respiratory viruses. Now, CFD simulations produce intuitive and physically plausible colour-coded results that help scientists understand SARS-CoV-2 airborne transmission patterns. In addition to validation requirements, for any CFD model to be of epistemic value to the scientific community; it must be reproducible. In 2020, more than 45 published studies investigated SARS-CoV-2 airborne transmission in different scenarios using CFD. Here, I systematically review the published CFD studies of COVID-19 and discuss their reproducibility criteria with respect to the CFD modeling process. Using a Weighted Scoring Model (WSM), I propose a novel reproducibility index for CFD simulations of SARS-CoV-2 AT. The proposed index $(0 \leq R^{CFD}_j \leq 1)$ relies on three reproducibility criteria comprising 10 elements that represent the possibility of a CFD study (j) to be reproduced. Frustratingly, only 3 of 23 studies (13%) achieved full reproducibility index $(R^{CFD}_j\geq 0.9)$ while the remaining 87% were found generally irreproducible $(R^{CFD}_j<0.9)$. Without reproducible models, the scientific benefit of CFD simulations will remain hindered, fragmented and limited. In conclusion, I call the scientific community to apply more rigorous measures on reporting and publishing CFD simulations in COVID-19 research.


title: Analytic quasi-steady evolution of a marginally unstable wave in the presence of drag and scattering

abstract: The 1D bump-on-tail problem is studied in order to determine the influence of drag on quasi-steady solutions near marginal stability ($1-\gamma_d/\gamma_L\ll 1$) when effective collisions are much larger than the instability growth rate ($\nu \gg \gamma$). In this common tokamak regime, it is rigorously shown that the paradigmatic Berk-Breizman cubic equation for the nonlinear mode evolution reduces to a much simpler differential equation, dubbed the time-local cubic equation, which can be solved directly. It is found that in addition to increasing the saturation amplitude, drag introduces a shift in the apparent oscillation frequency by modulating the saturated wave envelope. Excellent agreement is found between the analytic solution for the mode evolution and both the numerically integrated Berk-Breizman cubic equation and fully nonlinear 1D Vlasov simulations. Experimentally isolating the contribution of drag to the saturated mode amplitude for verification purposes is explored but complicated by the reality that the amount of drag can not be varied independently of other key parameters in realistic scenarios. While the effect of drag is modest when the ratio of drag to scattering $\alpha/\nu$ is very small, it can become substantial when $\alpha/\nu \gtrsim 0.5$, suggesting that drag should be accounted for in quantitative models of fast-ion-driven instabilities in fusion plasmas.


title: Empirical Evaluation of User Experience Using Lean Product and Process Development: A Public Institution Case Study in Indonesia

abstract: The easiness, speed, accuracy, security are the four main indicators of information quality that may be of concern to people for accessing information in a public institution dashboard system. To find out whether the data displayed on the system is easily understood by the users, an empirical evaluation study may indispensable to be performed. Evaluating user experience is one way to know whether a system is in accordance with user needs or not, whether related to data, interfaces or system performance. This study assessed user experiences based on the product pyramid and its development process in the case of a public dashboard system in a public institution in Indonesia. The empirical experiment was conducted with about 15 participants using a scenario that were deliberately designed and then gave answers to the single ease question (SEQ) and the system usability scale (SUS). The results show that SEQ measurement results obtained value of almost 5.7 which indicates that the application measurement results have an easy level. The SUS results demonstrate that the system was in the acceptable category with the value of around 81.3. Although findings of the study might not contribute theoretically, the findings may demonstrate a practical consideration for the stakeholders, in terms of the next system development stage.


title: Ultra-broadband Entangled Photons on a Nanophotonic Chip

abstract: Nanophotonic entangled-photon sources are a critical building block of chip-scale quantum photonic architecture and have seen significant development over the past two decades. These sources generate photon pairs that typically span over a narrow frequency bandwidth. Generating entanglement over a wide spectral region has proven to be useful in a wide variety of applications including quantum metrology, spectroscopy and sensing, and optical communication. However, generation of broadband photon pairs with temporal coherence approaching an optical cycle on a chip is yet to be seen. Here we demonstrate generation of ultra-broadband entangled photons using spontaneous parametric down-conversion in a periodically-poled lithium niobate nanophotonic waveguide. We employ dispersion engineering to achieve a bandwidth of 100 THz (1.2 - 2 $\mu$m), at a high efficiency of 13 GHz/mW. The photons show strong temporal correlations and purity with the coincidence-to-accidental ratio exceeding $10^5$ and $>$ 98\% two-photon interference visibility. These properties together with the piezo-electric and electro-optic control and reconfigurability, make thin-film lithium niobate an excellent platform for a controllable entanglement source for quantum communication and computing, and open a path towards femtosecond metrology and spectroscopy with non-classical light on a nanophotonic chip.


title: Random invariant densities for Markov operator cocycles and random mean ergodic theorem

abstract: In the present paper, we consider random invariant densities and the mean ergodic theorem for Markov operator cocycles which are applicable to quenched type random dynamical systems. We give necessary and sufficient conditions for the existence of random invariant densities for Markov operator cocycles and establish the mean ergodic theorem for generalized linear operator cocycles over a weakly sequentially complete Banach space. The advantage of the result is that we show the implication of weak precompactness for almost every environment to strong convergence in the global sense.


title: Bayesian neural networks for weak solution of PDEs with uncertainty quantification

abstract: Solving partial differential equations (PDEs) is the canonical approach for understanding the behavior of physical systems. However, large scale solutions of PDEs using state of the art discretization techniques remains an expensive proposition. In this work, a new physics-constrained neural network (NN) approach is proposed to solve PDEs without labels, with a view to enabling high-throughput solutions in support of design and decision-making. Distinct from existing physics-informed NN approaches, where the strong form or weak form of PDEs are used to construct the loss function, we write the loss function of NNs based on the discretized residual of PDEs through an efficient, convolutional operator-based, and vectorized implementation. We explore an encoder-decoder NN structure for both deterministic and probabilistic models, with Bayesian NNs (BNNs) for the latter, which allow us to quantify both epistemic uncertainty from model parameters and aleatoric uncertainty from noise in the data. For BNNs, the discretized residual is used to construct the likelihood function. In our approach, both deterministic and probabilistic convolutional layers are used to learn the applied boundary conditions (BCs) and to detect the problem domain. As both Dirichlet and Neumann BCs are specified as inputs to NNs, a single NN can solve for similar physics, but with different BCs and on a number of problem domains. The trained surrogate PDE solvers can also make interpolating and extrapolating (to a certain extent) predictions for BCs that they were not exposed to during training. Such surrogate models are of particular importance for problems, where similar types of PDEs need to be repeatedly solved for many times with slight variations. We demonstrate the capability and performance of the proposed framework by applying it to steady-state diffusion, linear elasticity, and nonlinear elasticity.


title: Investigating Quality of Institutional Repository Website Design Using Usability Testing Framework

abstract: Quality of website design is one of the influential factors of website success. How the design helps the users using effectively and efficiently website and satisfied at the end of the use. However, it is a common tendency that websites are designed based on the developer's perspectives and lack considering user importance. Thus, the degree of website usability tends to be low according to user perceptions. This study purposed to understand the user experiences using an institutional repository (IR) website in a public university in Indonesia. The research was performed based on usability testing framework as the usability testing method. About 12 participants were purposely involved concerning their key informant characteristics. Following three empirical data collection techniques (i.e., query technique, formal experiment, and thinking aloud), both descriptive analysis using usability scale matric and content analysis using qualitative data analysis (QDA) Miner Lite software were used in the data analysis stage. Lastly, several visual design recommendations were then proposed at the end of the study. In terms of a case study, besides the practical recommendations which may contextually useful for the next website development; the clarity of the research design may also help scholars how to combine more than one usability testing technique within a multi-technique study design.


title: An analytical theory of CEP-dependent coherence driven by few-cycle pulses

abstract: The interaction between an atomic system and a few-cycle ultrafast pulse carries rich physics and a considerable application prospect in quantum-coherence control. However, theoretical understanding of its general behaviors has been hindered by the lack of an analytical description in this regime, especially with regard to the impact of the carrier-envelope phase (CEP). Here, we present an analytical theory that describes a two-level atom driven by a far-off-resonance, few-cycle square pulse. A simple, closed-form solution of the Schrodinger equation is obtained under the first-order perturbation without invoking the rotating-wave approximation or the slowly varying envelope approximation. Further investigation reveals an arithmetic relation between the final inversion of the atom and the CEP of the pulse. Despite its mathematical simplicity, the relation is able to capture some of the key features of the interaction, which prove to be robust against generalization of pulse shapes and show good agreements with numerical solutions. The theory can potentially offer a general guidance in future studies of CEP-sensitive quantum coherence.


title: Asymmetric self-play for automatic goal discovery in robotic manipulation

abstract: We train a single, goal-conditioned policy that can solve many robotic manipulation tasks, including tasks with previously unseen goals and objects. We rely on asymmetric self-play for goal discovery, where two agents, Alice and Bob, play a game. Alice is asked to propose challenging goals and Bob aims to solve them. We show that this method can discover highly diverse and complex goals without any human priors. Bob can be trained with only sparse rewards, because the interaction between Alice and Bob results in a natural curriculum and Bob can learn from Alice's trajectory when relabeled as a goal-conditioned demonstration. Finally, our method scales, resulting in a single policy that can generalize to many unseen tasks such as setting a table, stacking blocks, and solving simple puzzles. Videos of a learned policy is available at https://robotics-self-play.github.io.


title: An empirical approach to measuring interface energies in mixed-phase bismuth ferrite

abstract: In complex oxide heteroepitaxy, strain engineering is a powerful tool to obtain phases in thin films that may be otherwise unstable in bulk. A successful example of this approach is mixed phase bismuth ferrite (BiFeO3) epitaxial thin films. The coexistence of a tetragonal-like (T-like) matrix and rhombohedral-like (R-like) striations provides an enhanced electromechanical response, along with other attractive functional behaviors. In this paper, we compare the energetics associated with two thickness dependent strain relaxation mechanisms in this system: domain walls arising from monoclinic distortion in the T-like phase, and the interphase boundary between the host T-like matrix and tilted R-like phases. Combining x-ray diffraction measurements with scanning probe microscopy, we extract quantitative values using an empirical energy balance approach. The domain wall and phase boundary energies are found to be 113 $\pm$ 21 and 426 $\pm$ 23 mJ.m$^{-2}$, respectively. These numerical estimates will help us realize designer phase boundaries in multiferroics, which possess colossal responses to external stimuli, attractive for a diverse range of functional applications.


title: Piano Skills Assessment

abstract: Can a computer determine a piano player's skill level? Is it preferable to base this assessment on visual analysis of the player's performance or should we trust our ears over our eyes? Since current CNNs have difficulty processing long video videos, how can shorter clips be sampled to best reflect the players skill level? In this work, we collect and release a first-of-its-kind dataset for multimodal skill assessment focusing on assessing piano player's skill level, answer the asked questions, initiate work in automated evaluation of piano playing skills and provide baselines for future work. Dataset is available from: https://github.com/ParitoshParmar/Piano-Skills-Assessment.


title: Fermi Level Engineering and Mechanical Properties of High Entropy Carbides

abstract: Fermi level engineering and mechanical properties evolution in high entropy carbides are investigated by theoretical and experimental means. Massive elemental diversity in high entropy ceramics broadens the compositional space but imposes great challenges in composition selection and property investigation. We have utilized the valence electron concentration (VEC) descriptor to design and predict properties of high entropy carbides. The VEC regulates the Fermi energy and systematically alters the bonding characteristics of materials. As a result, mechanical properties evolve as function of the VEC. At VEC 8.4, the strong {\sigma} bonding states stem from filled overlapping metal d and carbon p orbitals, which results in maximum resistance to shear deformation and highest hardness. Beyond or below the optimum VEC point of 8.4, mechanical response degrades due to filling or emptying of energy orbitals that facilitates shear deformation. Furthermore, the optimum VEC point can shift based on the constituent metals that formulate the high entropy carbide. Our analyses demonstrate strong correlation between calculated hardness and shear modulus. As an experimental complement, a set of high entropy carbides are synthesized, and mechanical properties investigated. The measured hardness follows theoretical predictions and the highest hardness of ~30 GPa is achieved at VEC 8.4. In contrast, hardness decreases by 50% when VEC is 9.4. Designing high entropy carbides based on VEC and understanding mechanical properties at an electronic level enables one to manipulate the composition spectrum to procure a desired mechanical response from a chemically disordered crystal.


title: Large remnant polarization in a wake-up free Hf0.5Zr0.5O2 ferroelectric film

abstract: A wake-up free Hf0.5Zr0.5O2 (HZO) ferroelectric film with the highest remnant polarization (Pr) value to-date was achieved through tuning of the ozone pulse duration, the annealing process, and the metal/insulator interface. The ozone dosage during the atomic layer deposition of HZO films appears to be a crucial parameter in suppressing the mechanisms driving the wake-up effect. A tungsten capping electrode with a relatively low thermal expansion coefficient enables the induction of an in-plane tensile strain, which increases the formation of the orthorhombic phase while decreasing the formation of the monoclinic phase during the cooling step of the annealing process. Therefore, increasing the annealing temperature TA followed by rapid cooling to room temperature resulted in a substantial increase in the 2Pr value (64 uC/cm2). However, the leakage current increased considerably, which can affect the performance of metal-insulator-metal (MIM) devices. To reduce the leakage current while maintaining the mechanical stress during thermal annealing, a 10 nm Pt layer was inserted between the W/HZO bottom interface. This resulted in a ~ 20-fold decrease in the leakage current while the 2Pr value remained almost constant (~ 60 uC/cm2). The increase in barrier height at the Pt/HZO interface compared to that of the W/HZO interface coupled with the suppression of the formation of interfacial oxides (WOx) by the introduction of a Pt/HZO interface serves to decrease the leakage current.


title: Probing a degenerate-scalar scenario in a pseudoscalar dark-matter model

abstract: We study a pseudoscalar dark-matter model arising from a complex singlet extension of the standard model (SM), and show that the dark-matter--nucleon scattering is suppressed when two CP-even scalars are degenerate. In such a degenerate-scalar scenario we explore the model parameter space which satisfies constraints from the direct detection experiments and the relic density of dark matter. In addition, we discuss a possibility to verify such a scenario by using the recoil mass technique at the International Linear Collider. We find that a pair of states separated by 0.2 GeV can be distinguished from the single SM-like Higgs state at 5$\sigma$ with integrated luminosity of 2 ab$^{-1}$.


title: Crooked Indifferentiability Revisited

abstract: In CRYPTO 2018, Russell et al introduced the notion of crooked indifferentiability to analyze the security of a hash function when the underlying primitive is subverted. They showed that the $n$-bit to $n$-bit function implemented using enveloped XOR construction (\textsf{EXor}) with $3n+1$ many $n$-bit functions and $3n^2$-bit random initial vectors (iv) can be proven secure asymptotically in the crooked indifferentiability setting. -We identify several major issues and gaps in the proof by Russel et al, We show that their proof can achieve security only when the adversary is restricted to make queries related to a single message. - We formalize new technique to prove crooked indifferentiability without such restrictions. Our technique can handle function dependent subversion. We apply our technique to provide a revised proof for the \textsf{EXor} construction. - We analyze crooked indifferentiability of the classical sponge construction. We show, using a simple proof idea, the sponge construction is a crooked-indifferentiable hash function using only $n$-bit random iv. This is a quadratic improvement over the {\sf EXor} construction and solves the main open problem of Russel et al.


title: Towards Interpretable Ensemble Learning for Image-based Malware Detection

abstract: Deep learning (DL) models for image-based malware detection have exhibited their capability in producing high prediction accuracy. But model interpretability is posing challenges to their widespread application in security and safety-critical application domains. This paper aims for designing an Interpretable Ensemble learning approach for image-based Malware Detection (IEMD). We first propose a Selective Deep Ensemble Learning-based (SDEL) detector and then design an Ensemble Deep Taylor Decomposition (EDTD) approach, which can give the pixel-level explanation to SDEL detector outputs. Furthermore, we develop formulas for calculating fidelity, robustness and expressiveness on pixel-level heatmaps in order to assess the quality of EDTD explanation. With EDTD explanation, we develop a novel Interpretable Dropout approach (IDrop), which establishes IEMD by training SDEL detector. Experiment results exhibit the better explanation of our EDTD than the previous explanation methods for image-based malware detection. Besides, experiment results indicate that IEMD achieves a higher detection accuracy up to 99.87% while exhibiting interpretability with high quality of prediction results. Moreover, experiment results indicate that IEMD interpretability increases with the increasing detection accuracy during the construction of IEMD. This consistency suggests that IDrop can mitigate the tradeoff between model interpretability and detection accuracy.


title: A general framework of rotational sparse approximation in uncertainty quantification

abstract: This paper proposes a general framework to estimate coefficients of generalized polynomial chaos (gPC) used in uncertainty quantification via rotational sparse approximation. In particular, we aim to identify a rotation matrix such that the gPC expansion of a set of random variables after the rotation has a sparser representation. However, this rotational approach alters the underlying linear system to be solved, which makes finding the sparse coefficients more difficult than the case without rotation. To solve this problem, we examine several popular nonconvex regularizations in compressive sensing (CS) that perform better than the classic l1 approach empirically. All these regularizations can be minimized by the alternating direction method of multipliers (ADMM). Numerical examples show superior performance of the proposed combination of rotation and nonconvex sparse promoting regularizations over the ones without rotation and with rotation but using the convex l1 approach.


title: Cofreeness in Real Bordism Theory and the Segal Conjecture

abstract: We prove that the genuine $C_{2^n}$-spectrum $N_{C_{2}}^{C_{2^n}}MU_{\mathbb{R}}$ is cofree, for all $n$. Our proof is a formal argument using chromatic hypercubes and the Slice Theorem of Hill, Hopkins, and Ravenel. We show that this gives a new proof of the Segal conjecture for $C_2$, independent of Lin's theorem.


title: Singularity-free Aerial Deformation by Two-dimensional Multilinked Aerial Robot with 1-DoF Vectorable Propeller

abstract: Two-dimensional multilinked structures can benefit aerial robots in both maneuvering and manipulation because of their deformation ability. However, certain types of singular forms must be avoided during deformation. Hence, an additional 1 Degrees-of-Freedom (DoF) vectorable propeller is employed in this work to overcome singular forms by properly changing the thrust direction. In this paper, we first extend modeling and control methods from our previous works for an under-actuated model whose thrust forces are not unidirectional. We then propose a planning method for the vectoring angles to solve the singularity by maximizing the controllability under arbitrary robot forms. Finally, we demonstrate the feasibility of the proposed methods by experiments where a quad-type model is used to perform trajectory tracking under challenging forms, such as a line-shape form, and the deformation passing these challenging forms.


title: Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels

abstract: Many accessibility features available on mobile platforms require applications (apps) to provide complete and accurate metadata describing user interface (UI) components. Unfortunately, many apps do not provide sufficient metadata for accessibility features to work as expected. In this paper, we explore inferring accessibility metadata for mobile apps from their pixels, as the visual interfaces often best reflect an app's full functionality. We trained a robust, fast, memory-efficient, on-device model to detect UI elements using a dataset of 77,637 screens (from 4,068 iPhone apps) that we collected and annotated. To further improve UI detections and add semantic information, we introduced heuristics (e.g., UI grouping and ordering) and additional models (e.g., recognize UI content, state, interactivity). We built Screen Recognition to generate accessibility metadata to augment iOS VoiceOver. In a study with 9 screen reader users, we validated that our approach improves the accessibility of existing mobile apps, enabling even previously inaccessible apps to be used.


title: D-completion, well-filterification and sobrification

abstract: In this paper, we obtain some sufficient conditions for the D-completion of a T0 space to be the well-filterification of this space, the well-filterification of a T0 space to be the sobrification of this space and the D-completion of a T0 space to be the sobrification, respectively. Moreover, we give an example to show that a tapered closed set may be neither the closure of a directed set nor the closed KF-set, respectively. Because the tapered closed set is a closed WD-set, the example also gives a negative answer to a problem proposed by Xu. Meantime, a new direct characterization of the D-completion of a T0 space is given by using the notion of pre-c-compact elements.


title: Defining the (Black Hole)-Spheroid Connection with the Discovery of Morphology-Dependent Substructure in the $M_{\rm BH}$--$\rm n_{sph}$ and $M_{\rm BH}$--$\rm R_{e, sph}$ Diagrams: New Tests for Advanced Theories and Realistic Simulations

abstract: For 123 local galaxies with directly-measured black hole masses ($M_{\rm BH}$), we provide the host spheroid's S\'ersic index ($\rm n_{sph}$), effective half-light radius ($\rm R_{e,sph}$), and effective surface brightness ($\mu_e$), obtained from careful multi-component decompositions, and we use these to derive the morphology-dependent $M_{\rm BH}$--$\rm n_{sph}$ and $M_{\rm BH}$--$\rm R_{e,sph}$ relations. We additionally present the morphology-dependent $M_{\rm *,sph}$--$\rm n_{sph}$ and $M_{\rm *,sph}$--$\rm R_{e,sph}$ relations. We explored differences due to: early-type galaxies (ETGs) versus late-type galaxies (LTGs); S\'ersic versus core-S\'ersic galaxies; barred versus non-barred galaxies; and galaxies with and without a stellar disk. We detect two different $M_{\rm BH}$--$\rm n_{sph}$ relations due to ETGs and LTGs with power-law slopes $3.95\pm0.34$ and $2.85\pm 0.31$. We additionally quantified the correlation between $M_{\rm BH}$ and the spheroid's central concentration index, which varies monotonically with the S\'ersic index. Furthermore, we observe a single, near-linear $M_{\rm *,sph}$--$\rm R_{e,sph}^{1.08\pm 0.04}$ relation for ETGs and LTGs, which encompasses both classical and alleged pseudobulges. In contrast, ETGs and LTGs define two distinct $M_{\rm BH}$--$\rm R_{e,sph}$ relations with $\Delta_{\rm rms|BH}\sim\rm 0.60~dex$ (cf.\ $\sim$0.51~dex for the $M_{\rm BH}$--$\sigma$ relation and $\sim$0.58~dex for the $M_{\rm BH}$--$M_{\rm *,sph}$ relation), and the ETGs alone define two steeper $M_{\rm BH}$--$\rm R_{e,sph}$ relations, offset by $\sim$1~dex in the $\log M_{\rm BH}$-direction, depending on whether they have a disk or not and explaining their similar offset in the $M_{\rm BH}$--$M_{\rm *,sph}$ diagram. This trend holds using $10 \%$, $50 \%$, or $90 \%$ radii.(Abridged)


title: Anisotropic Particles Focusing Effect in Complex Flows

abstract: Finite size effects can lead neutrally buoyant particles to exhibit different dynamics than tracer particles, and can alter their transport properties in fluid flows. Here we investigate the effect of the particle's shape on their dispersion in 2-dimensional complex flows. Combining numerical simulations with laboratory experiments, we show that particles with isotropic and anisotropic shapes exhibit different Lagrangian coherent structures, resulting in distinct dispersion phenomena within a given flow field. Experiments with rod shaped particles show a focusing effect in the vicinity of vortex cores. We present a simple model that describes the dynamics of neutrally buoyant ellipsoidal particles in two-dimensional flow and show that particle aspect ratio and orientation dependent forces can generate clustering phenomena in vortices.


title: A quasi-conservative DG-ALE method for multi-component flows using the non-oscillatory kinetic flux

abstract: A high-order quasi-conservative discontinuous Galerkin (DG) method is proposed for the numerical simulation of compressible multi-component flows. A distinct feature of the method is a predictor-corrector strategy to define the grid velocity. A Lagrangian mesh is first computed based on the flow velocity and then used as an initial mesh in a moving mesh method (the moving mesh partial differential equation or MMPDE method ) to improve its quality. The fluid dynamic equations are discretized in the direct arbitrary Lagrangian-Eulerian framework using DG elements and the non-oscillatory kinetic flux while the species equation is discretized using a quasi-conservative DG scheme to avoid numerical oscillations near material interfaces. A selection of one- and two-dimensional examples are presented to verify the convergence order and the constant-pressure-velocity preservation property of the method. They also demonstrate that the incorporation of the Lagrangian meshing with the MMPDE moving mesh method works well to concentrate mesh points in regions of shocks and material interfaces.


title: Unlearnable Examples: Making Personal Data Unexploitable

abstract: The volume of "free" data on the internet has been key to the current success of deep learning. However, it also raises privacy concerns about the unauthorized exploitation of personal data for training commercial models. It is thus crucial to develop methods to prevent unauthorized data exploitation. This paper raises the question: \emph{can data be made unlearnable for deep learning models?} We present a type of \emph{error-minimizing} noise that can indeed make training examples unlearnable. Error-minimizing noise is intentionally generated to reduce the error of one or more of the training example(s) close to zero, which can trick the model into believing there is "nothing" to learn from these example(s). The noise is restricted to be imperceptible to human eyes, and thus does not affect normal data utility. We empirically verify the effectiveness of error-minimizing noise in both sample-wise and class-wise forms. We also demonstrate its flexibility under extensive experimental settings and practicability in a case study of face recognition. Our work establishes an important first step towards making personal data unexploitable to deep learning models.


title: Experimental Evaluation of Deep Learning models for Marathi Text Classification

abstract: The Marathi language is one of the prominent languages used in India. It is predominantly spoken by the people of Maharashtra. Over the past decade, the usage of language on online platforms has tremendously increased. However, research on Natural Language Processing (NLP) approaches for Marathi text has not received much attention. Marathi is a morphologically rich language and uses a variant of the Devanagari script in the written form. This works aims to provide a comprehensive overview of available resources and models for Marathi text classification. We evaluate CNN, LSTM, ULMFiT, and BERT based models on two publicly available Marathi text classification datasets and present a comparative analysis. The pre-trained Marathi fast text word embeddings by Facebook and IndicNLP are used in conjunction with word-based models. We show that basic single layer models based on CNN and LSTM coupled with FastText embeddings perform on par with the BERT based models on the available datasets. We hope our paper aids focused research and experiments in the area of Marathi NLP.


title: Typical representations, parabolic induction and the inertial local Langlands correspondence

abstract: We prove a result which provides a link between the decomposition of parabolically induced representations and the Bushnell--Kutzko theory of typical representations. As an application, we show that there exists a well-defined inertial Langlands correspondence which respects the monodromy action of L-parameters, under some standard conjectures regarding the local Langlands correspondence. To allow for potential applications of this inertial Langlands correspondence, we also provide a complete construction of the set of typical representations, giving a parametrization of these in terms of the structure of the Bruhat--Tits building of $G$.


title: Lucas non-Wieferich primes in arithmetic progressions and the $abc$ conjecture

abstract: We prove the lower bound for the number of Lucas non-Wieferich primes in arithmetic progressions. More precisely, for any given integer $k\geq 2$ there are $\gg \log x$ Lucas non-Wieferich primes $p\leq x$ such that $p\equiv\pm1\pmod{k}$, assuming the $abc$ conjecture for number fields. Further, we discuss some applications of Lucas sequences in Cryptography.


title: Linear-quadratic control of Volterra integral systems and extensions

abstract: We study linear-quadratic optimal control problems for Voterra systems, and problems that are linear-quadratic in the control but generally nonlinear in the state. In the case of linear-quadratic Volterra control, we obtain sharp necessary and sufficient conditions for optimality. For problems that are linear-quadratic in the control only, we obtain a novel form of necessary conditions in the form of double Volterra equation; we prove the solvability of such equations.


title: Model-based multi-sensor fusion for reconstructing wall-bounded turbulence

abstract: Wall-bounded turbulent flows can be challenging to measure within experiments due to the breadth of spatial and temporal scales inherent in such flows. Instrumentation capable of obtaining time-resolved data (e.g., Hot-Wire Anemometers) tends to be restricted to spatially-localized point measurements; likewise, instrumentation capable of achieving spatially-resolved field measurements (e.g., Particle Image Velocimetry) tends to lack the sampling rates needed to attain time-resolution in many such flows. In this study, we propose to fuse measurements from multi-rate and multi-fidelity sensors with predictions from a physics-based model to reconstruct the spatiotemporal evolution of a wall-bounded turbulent flow. A "fast" filter is formulated to assimilate high-rate point measurements with estimates from a linear model derived from the Navier-Stokes equations. Additionally, a "slow" filter is used to update the reconstruction every time a new field measurement becomes available. By marching through the data both forward and backward in time, we are able to reconstruct the turbulent flow with greater spatiotemporal resolution than either sensing modality alone. We demonstrate the approach using direct numerical simulations of a turbulent channel flow from the Johns Hopkins Turbulence Database. A statistical analysis of the model-based multi-sensor fusion approach is also conducted.


title: EEC: Learning to Encode and Regenerate Images for Continual Learning

abstract: The two main impediments to continual learning are catastrophic forgetting and memory limitations on the storage of data. To cope with these challenges, we propose a novel, cognitively-inspired approach which trains autoencoders with Neural Style Transfer to encode and store images. During training on a new task, reconstructed images from encoded episodes are replayed in order to avoid catastrophic forgetting. The loss function for the reconstructed images is weighted to reduce its effect during classifier training to cope with image degradation. When the system runs out of memory the encoded episodes are converted into centroids and covariance matrices, which are used to generate pseudo-images during classifier training, keeping classifier performance stable while using less memory. Our approach increases classification accuracy by 13-17% over state-of-the-art methods on benchmark datasets, while requiring 78% less storage space.


title: A Review of results on axially symmetric Navier-Stokes equations, with addendum by X. Pan and Q. S. Zhang

abstract: In this paper, we give a brief survey of recent results on axially symmetric Navier-Stokes equations (ASNS) in the following categories: regularity criterion, Liouville property for ancient solutions, decay and vanishing of stationary solutions. Some discussions also touch on the full 3 dimensional equations. Two results, closing of the scaling gap for ASNS and vanishing of homogeneous D solutions in 3 dimensional slabs will be described in more detail. In the addendum, two new results in the 3rd category will also be presented, which are generalizations of recently published results by the author and coauthors.


title: Some new results on negative polynomial Pell's equation

abstract: We consider the negative polynomial Pell's equation $P^2(X)-D(X)Q^2(X)=-1$, where $D(X)\in \mathbb{Z}[X]$ be some fixed, monic, square-free, even degree polynomials. In this paper, we investigate the existence of polynomial solutions $P(X), \, Q(X)$ with integer coefficients.


title: The Physics of Fast Radio Bursts

abstract: In 2007, a very bright radio pulse was identified in the archival data of the Parkes Telescope in Australia, marking the beginning of a new research branch in astrophysics. In 2013, this kind of millisecond bursts with extremely high brightness temperature takes a unified name, fast radio burst (FRB). Over the first few years, FRBs seemed very mysterious because the sample of known events was limited. With the improvement of instruments over the last five years, hundreds of new FRBs have been discovered. The field is now undergoing a revolution and understanding of FRB has rapidly increased as new observational data increasingly accumulates. In this review, we will summarize the basic physics of FRBs and discuss the current research progress in this area. We have tried to cover a wide range of FRB topics, including the observational property, propagation effect, population study, radiation mechanism, source model, and application in cosmology. A framework based on the latest observational facts is now under construction. In the near future, this exciting field is expected to make significant breakthroughs.