title: A comprehensive power spectral density analysis of astronomical time series I: the Fermi-LAT gamma-ray light curves of selected blazars

abstract: We present the results of the \textit{Fermi}-LAT 10-years-long light curves (LCs) modeling of selected blazars: six flat spectrum radio quasars (FSRQs) and five BL Lacertae (BL Lacs), examined in 7-, 10-, and 14-day binning. The LCs and power spectral densities (PSDs) were investigated with various methods: Fourier transform, Lomb-Scargle periodogram (LSP), wavelet scalogram, autoregressive moving average (ARMA) process, continuous-time ARMA (CARMA), Hurst exponent ($H$), and the $\mathcal{A}-\mathcal{T}$ plane. First, with extensive simulations we showed that parametric modeling returns unreliable parameters, with a high dispersion for different realizations of the same stochastic model. Hence any such analysis should be supported with Monte Carlo simulations. For our blazar sample, we find that the power law indices $\beta$ calculated from the Fourier and LSP modeling mostly fall in the range $1\lesssim\beta\lesssim 2$. Using the wavelet scalograms, we confirm a quasi-periodic oscillation (QPO) in PKS~2155$-$304 at a $3\sigma$ significance level, but do not detect any QPOs in other objects. The ARMA fits reached higher orders for 7-day binned LCs and lower orders for 10- and 14-days binned LCs for the majority of blazars, suggesting there might exist a characteristic timescale for the perturbations in the jet and/or accretion disk to die out. ARMA and CARMA modeling revealed breaks in their PSDs at timescales of few hundred days. The estimation of $H$ was performed with several methods. We find that most blazars exhibit $H > 0.5$, indicating long-term memory. Finally, the FSRQ and BL Lac subclasses are clearly separated in the $\mathcal{A}-\mathcal{T}$ plane.


title: Truthful Data Acquisition via Peer Prediction

abstract: We consider the problem of purchasing data for machine learning or statistical estimation. The data analyst has a budget to purchase datasets from multiple data providers. She does not have any test data that can be used to evaluate the collected data and can assign payments to data providers solely based on the collected datasets. We consider the problem in the standard Bayesian paradigm and in two settings: (1) data are only collected once; (2) data are collected repeatedly and each day's data are drawn independently from the same distribution. For both settings, our mechanisms guarantee that truthfully reporting one's dataset is always an equilibrium by adopting techniques from peer prediction: pay each provider the mutual information between his reported data and other providers' reported data. Depending on the data distribution, the mechanisms can also discourage misreports that would lead to inaccurate predictions. Our mechanisms also guarantee individual rationality and budget feasibility for certain underlying distributions in the first setting and for all distributions in the second setting.


title: Quasi-two dimensional perturbations in duct flows under transverse magnetic field

abstract: Inspired by the experiment from Moresco \& Alboussi\`ere (2004, J. Fluid Mech.), we study the stability of a liquid metal flow in a rectangular, electrically insulating duct with a steady homogeneous transverse magnetic field. The Lorentz force tends to eliminate velocity variations along the magnetic field, leading to a quasi-two dimensional base flow with Hartmann boundary layers near the walls perpendicular to the magnetic field, and Shercliff layers near the walls parallel to the field. Since the Lorentz force strongly opposes the growth of perturbations with a dependence along the magnetic field direction too, we represent the flow with Sommeria \& Moreau's (1982, J. Fluid Mech.) model, a two-dimensional shallow water model with linear friction accounting for the effect of the Hartmann layer. The simplicity of this model makes it possible to study the stability and transient growth of quasi-two dimensional perturbations over an extensive range of parameters up to the limit of high magnetic fields, where the Reynolds number based on the Shercliff layer thickness $Re/H^{1/2}$ becomes the only relevant parameter. Tollmien-Schlichting waves are the most linearly unstable mode, with a further unstable mode $H \gtrsim 42$. The flow is linearly unstable for $Re/H^{1/2}\gtrsim 48350$ and energetically stable for $Re/H^{1/2}\lesssim 65.32$. Between these two bounds, non-modal quasi-two dimensional perturbations undergo significant transient growth (between 2 and 7 times more than in the case of a purely 2D Poiseuille flow, and for much more subcritical values of $Re$). In the limit of a high magnetic field, the maximum gain $G_{max}$ associated to this transient growth varies as $G_{max} \sim (Re/Re_c)^{2/3}$ and occurs at time $t_{Gmax}\sim(Re/Re_c)^{1/3}$ for streamwise wavenumbers of the same order of magnitude as the critical wavenumber for the linear stability.


title: A Scalable Architecture for Monitoring IoT Devices Using Ethereum and Fog Computing

abstract: With the recent considerable developments in the Internet of Things (IoT), billions of resource-constrained devices are interconnected through the internet. Monitoring this huge number of IoT devices that are heterogeneous in terms of underlying communication protocols and data format is challenging. The majority of existing IoT device monitoring solutions heavily rely on centralized architectures. Since using centralized architectures comes at the expense of trusting an authority, it has several inherent drawbacks, including vulnerability to security attacks, lack of data privacy, and unauthorized data manipulation. Hence, a new decentralized approach is crucial to remedy these drawbacks. One of the most promising technologies which is widely used to provide decentralization is blockchain. Additionally, to ease the burden of communication overhead and computational power on resource-constrained IoT devices, fog computing can be exploited to decrease communication latency and provide better network scalability. In this paper, we propose a scalable blockchain-based architecture for monitoring IoT devices using fog computing. To demonstrate the feasibility and usability of the proposed solution, we have implemented a proof-of-concept prototype, leveraging Ethereum smart contracts. Finally, a comprehensive evaluation is conducted. The evaluation results indicate that the proposed solution is significantly scalable and compatible with resource-constrained IoT devices.


title: SCARL: Side-Channel Analysis with Reinforcement Learning on the Ascon Authenticated Cipher

abstract: Existing side-channel analysis techniques require a leakage model, in the form of a prior knowledge or a set of training data, to establish a relationship between the secret data and the measurements. We introduce side-channel analysis with reinforcement learning (SCARL) capable of extracting data-dependent features of the measurements in an unsupervised learning approach without requiring a prior knowledge on the leakage model. SCARL consists of an auto-encoder to encode the information of power measurements into an internal representation, and a reinforcement learning algorithm to extract information about the secret data. We employ a reinforcement learning algorithm with actor-critic networks, to identify the proper leakage model that results in maximum inter-cluster separation of the auto-encoder representation. SCARL assumes that the lower order components of a generic non-linear leakage model have larger contribution to the leakage of sensitive data. On a lightweight implementation of the Ascon authenticated cipher on the Artix-7 FPGA, SCARL is able to recover the secret key using 24K power traces during the key insertion, or Initialization Stage, of the cipher. We also demonstrate that classical techniques such as DPA and CPA fail to identify the correct key using traditional linear leakage models and more than 40K power traces.


title: Graph Neural Network Encoding for Community Detection in Attribute Networks

abstract: In this paper, we first propose a graph neural network encoding method for multiobjective evolutionary algorithm to handle the community detection problem in complex attribute networks. In the graph neural network encoding method, each edge in an attribute network is associated with a continuous variable. Through non-linear transformation, a continuous valued vector (i.e. a concatenation of the continuous variables associated with the edges) is transferred to a discrete valued community grouping solution. Further, two objective functions for single- and multi-attribute network are proposed to evaluate the attribute homogeneity of the nodes in communities, respectively. Based on the new encoding method and the two objectives, a multiobjective evolutionary algorithm (MOEA) based upon NSGA-II, termed as continuous encoding MOEA, is developed for the transformed community detection problem with continuous decision variables. Experimental results on single- and multi-attribute networks with different types show that the developed algorithm performs significantly better than some well-known evolutionary and non-evolutionary based algorithms. The fitness landscape analysis verifies that the transformed community detection problems have smoother landscapes than those of the original problems, which justifies the effectiveness of the proposed graph neural network encoding method.


title: MeshSDF: Differentiable Iso-Surface Extraction

abstract: Geometric Deep Learning has recently made striking progress with the advent of continuous Deep Implicit Fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid, resulting in a learnable parameterization that is not limited in resolution. Unfortunately, these methods are often not suitable for applications that require an explicit mesh-based surface representation because converting an implicit field to such a representation relies on the Marching Cubes algorithm, which cannot be differentiated with respect to the underlying implicit field. In this work, we remove this limitation and introduce a differentiable way to produce explicit surface mesh representations from Deep Signed Distance Functions. Our key insight is that by reasoning on how implicit field perturbations impact local surface geometry, one can ultimately differentiate the 3D location of surface samples with respect to the underlying deep implicit field. We exploit this to define MeshSDF, an end-to-end differentiable mesh representation which can vary its topology. We use two different applications to validate our theoretical insight: Single-View Reconstruction via Differentiable Rendering and Physically-Driven Shape Optimization. In both cases our differentiable parameterization gives us an edge over state-of-the-art algorithms.


title: Controlling Metal-Insulator Transitions in Vanadium Oxide Thin Films by Modifying Oxygen Stoichiometry

abstract: Vanadium oxides are strongly correlated materials which display metal-insulator transitions as well as various structural and magnetic properties that depend heavily on oxygen stoichiometry. Therefore, it is crucial to precisely control oxygen stoichiometry in these materials, especially in thin films. This work demonstrates a high-vacuum gas evolution technique which allows for the modification of oxygen concentration in VOX thin films by carefully tuning thermodynamic conditions. We were able to control the evolution between VO2, V3O5, and V2O3 phases on sapphire substrates, overcoming the narrow phase stability of adjacent Magn\'eli phases. A variety of annealing routes were found to achieve the desired phases and eventually to control the metal-insulator transition (MIT). The pronounced MIT of the transformed films along with the detailed structural investigations based on x-ray diffraction measurements and reciprocal space mapping show that optimal stoichiometry is obtained and stabilized. Using this technique, we find that the thin film V-O phase diagram differs from that of the bulk material due to strain and finite size effects. Our study demonstrates new pathways to strategically tune the oxygen stoichiometry in complex oxides and provides a roadmap for understanding the phase stability of VOX thin films.


title: Efficient Evaluation of Exact Exchange for Periodic Systems via Concentric Atomic Density Fitting

abstract: The evaluation of exact (Hartree--Fock, HF) exchange operator is a crucial ingredient for the accurate description of electronic structure in periodic systems through ab initio and hybrid density functional approaches. An efficient formulation of periodic HF exchange in LCAO representation presented here is based on the concentric atomic density fitting (CADF) approximation, a domain-free local density fitting approach in which the product of two atomic orbitals (AOs) is approximated using a linear combination of fitting basis functions centered at the same nuclei as the AOs in that product. Significant reduction in the computational cost of exact exchange is demonstrated relative to the conventional approach due to avoiding the need to evaluate four-center two-electron integrals, with sub-millihartree/atom errors in absolute Hartree-Fock energies and good cancellation of fitting errors in relative energies. Novel aspects of the evaluation of the Coulomb contribution to the Fock operator, such as the use of real two-center multipole expansions and spheropole-compensated unit cell densities are also described.


title: Ultra-high-resolution imaging of moir\'e lattices and superstructures using scanning microwave impedance microscopy under ambient conditions

abstract: Two-dimensional heterostructures with layers of slightly different lattice vectors exhibit a new periodic structure known as moire lattices. Moire lattice formation provides a powerful new way to engineer the electronic structure of two-dimensional materials for realizing novel correlated and topological phenomena. In addition, superstructures of moire lattices can emerge from multiple misaligned lattice vectors or inhomogeneous strain distribution, which offers an extra degree of freedom in the electronic band structure design. High-resolution imaging of the moire lattices and superstructures is critical for quantitative understanding of emerging moire physics. Here we report the nanoscale imaging of moire lattices and superstructures in various graphene-based samples under ambient conditions using an ultra-high-resolution implementation of scanning microwave impedance microscopy. We show that, quite remarkably, although the scanning probe tip has a gross radius of ~100 nm, an ultra-high spatial resolution in local conductivity profiles better than 5 nm can be achieved. This resolution enhancement not only enables to directly visualize the moire lattices in magic-angle twisted double bilayer graphene and composite super-moire lattices, but also allows design path toward artificial synthesis of novel moire superstructures such as the Kagome moire from the interplay and the supermodulation between twisted graphene and hexagonal boron nitride layers.


title: Real-Time Model Calibration with Deep Reinforcement Learning

abstract: The dynamic, real-time, and accurate inference of model parameters from empirical data is of great importance in many scientific and engineering disciplines that use computational models (such as a digital twin) for the analysis and prediction of complex physical processes. However, fast and accurate inference for processes with large and high dimensional datasets cannot easily be achieved with state-of-the-art methods under noisy real-world conditions. The primary reason is that the inference of model parameters with traditional techniques based on optimisation or sampling often suffers from computational and statistical challenges, resulting in a trade-off between accuracy and deployment time. In this paper, we propose a novel framework for inference of model parameters based on reinforcement learning. The contribution of the paper is twofold: 1) We reformulate the inference problem as a tracking problem with the objective of learning a policy that forces the response of the physics-based model to follow the observations; 2) We propose the constrained Lyapunov-based actor-critic (CLAC) algorithm to enable the robust and accurate inference of physics-based model parameters in real time under noisy real-world conditions. The proposed methodology is demonstrated and evaluated on two model-based diagnostics test cases utilizing two different physics-based models of turbofan engines. The performance of the methodology is compared to that of two alternative approaches: a state update method (unscented Kalman filter) and a supervised end-to-end mapping with deep neural networks. The experimental results demonstrate that the proposed methodology outperforms all other tested methods in terms of speed and robustness, with high inference accuracy.


title: Ghost Point Diffusion Maps for solving elliptic PDE's on Manifolds with Classical Boundary Conditions

abstract: In this paper, we extend the class of kernel methods, the so-called diffusion maps (DM), and its local kernel variants, to approximate second-order differential operators defined on smooth manifolds with boundaries that naturally arise in elliptic PDE models. To achieve this goal, we introduce the Ghost Point Diffusion Maps (GPDM) estimator on an extended manifold, identified by the set of point clouds on the unknown original manifold together with a set of ghost points, specified along the estimated tangential direction at the sampled points at the boundary. The resulting GPDM estimator restricts the standard DM matrix to a set of extrapolation equations that estimates the function values at the ghost points. This adjustment is analogous to the classical ghost point method in finite-difference scheme for solving PDEs on flat domain. As opposed to the classical DM which diverges near the boundary, the proposed GPDM estimator converges pointwise even near the boundary. Applying the consistent GPDM estimator to solve the well-posed elliptic PDEs with classical boundary conditions (Dirichlet, Neumann, and Robin), we establish the convergence of the approximate solution under appropriate smoothness assumptions. We numerically validate the proposed mesh-free PDE solver on various problems defined on simple sub-manifolds embedded in Euclidean spaces as well as on an unknown manifold. Numerically, we also found that the GPDM is more accurate compared to DM in solving elliptic eigenvalue problems on bounded smooth manifolds.


title: Every Action Based Sensor

abstract: In studying robots and planning problems, a basic question is what is the minimal information a robot must obtain to guarantee task completion. Erdmann's theory of action-based sensors is a classical approach to characterizing fundamental information requirements. That approach uses a plan to derive a type of virtual sensor which prescribes actions that make progress toward a goal. We show that the established theory is incomplete: the previous method for obtaining such sensors, using backchained plans, overlooks some sensors. Furthermore, there are plans, that are guaranteed to achieve goals, where the existing methods are unable to provide any action-based sensor. We identify the underlying feature common to all such plans. Then, we show how to produce action-based sensors even for plans where the existing treatment is inadequate, although for these cases they have no single canonical sensor. Consequently, the approach is generalized to produce sets of sensors. Finally, we show also that this is a complete characterization of action-based sensors for planning problems and discuss how an action-based sensor translates into the traditional conception of a sensor.


title: Distributionally Robust Weighted $k$-Nearest Neighbors

abstract: Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that captures similarities between samples. When the samples are limited, robustness is especially crucial to ensure the generalization capability of the classifier. In this paper, we study a minimax distributionally robust formulation of weighted $k$-nearest neighbors, which aims to find the optimal weighted $k$-NN classifiers that hedge against feature uncertainties. We develop an algorithm, \texttt{Dr.k-NN}, that efficiently solves this functional optimization problem and features in assigning minimax optimal weights to training samples when performing classification. These weights are class-dependent, and are determined by the similarities of sample features under the least favorable scenarios. When the size of the uncertainty set is properly tuned, the robust classifier has a smaller Lipschitz norm than the vanilla $k$-NN, and thus improves the generalization capability. We also couple our framework with neural-network-based feature embedding. We demonstrate the competitive performance of our algorithm compared to the state-of-the-art in the few-training-sample setting with various real-data experiments.


title: Entropic Out-of-Distribution Detection: Seamless Detection of Unknown Examples

abstract: In this paper, we argue that the unsatisfactory out-of-distribution (OOD) detection performance of neural networks is mainly due to the SoftMax loss anisotropy and propensity to produce low entropy probability distributions in disagreement with the principle of maximum entropy. Current out-of-distribution (OOD) detection approaches usually do not directly fix the SoftMax loss drawbacks, but rather build techniques to circumvent it. Unfortunately, those methods usually produce undesired side effects (e.g., classification accuracy drop, additional hyperparameters, slower inferences, and collecting extra data). In the opposite direction, we propose replacing SoftMax loss with a novel loss function that does not suffer from the mentioned weaknesses. The proposed IsoMax loss is isotropic (exclusively distance-based) and provides high entropy posterior probability distributions. Replacing the SoftMax loss by IsoMax loss requires no model or training changes. Additionally, the models trained with IsoMax loss produce as fast and energy-efficient inferences as those trained using SoftMax loss. Moreover, no classification accuracy drop is observed. The proposed method does not rely on outlier/background data, hyperparameter tuning, temperature calibration, feature extraction, metric learning, adversarial training, ensemble procedures, or generative models. Our experiments showed that IsoMax loss works as a seamless SoftMax loss drop-in replacement that significantly improves neural networks' OOD detection performance. Hence, it may be used as a baseline OOD detection approach to be combined with current or future OOD detection techniques to achieve even higher results.


title: Spectral Waldhausen categories, the $S_\bullet$-construction, and the Dennis trace

abstract: We give an explicit point-set construction of the Dennis trace map from the $K$-theory of endomorphisms $K\mathrm{End}(\mathcal{C})$ to topological Hochschild homology $\mathrm{THH}(\mathcal{C})$ for any spectral Waldhausen category $\mathcal{C}$. We describe the necessary technical foundations, most notably a well-behaved model for the spectral category of diagrams in $\mathcal{C}$ indexed by an ordinary category via the Moore end. This is applied to define a version of Waldhausen's $S_{\bullet}$-construction for spectral Waldhausen categories, which is central to this account of the Dennis trace map. Our goals are both convenience and transparency---we provide all details except for a proof of the additivity theorem for $\mathrm{THH}$, which is taken for granted---and the exposition is concerned not with originality of ideas, but rather aims to provide a useful resource for learning about the Dennis trace and its underlying machinery.


title: Controlled Propagation and Jamming of a Delamination Front

abstract: We study the birth and propagation of a delamination front in the peeling of a soft, weakly adhesive layer. In a controlled-displacement setting, the layer partially detaches via a subcritical instability and the motion continues until arrested, by jamming of the two lobes. Using numerical solutions and scaling analysis, we quantitatively describe the equilibrium shapes and obtain constitutive sensitivities of jamming process to material and interface properties. We conclude with a way to delay or avoid jamming altogether by tunable interface properties.


title: Steganography GAN: Cracking Steganography with Cycle Generative Adversarial Networks

abstract: For as long as humans have participated in the act of communication, concealing information in those communicative mediums has manifested into an art of its own. Crytographic messages, through written language or images, are a means of concealment, usually reserved for highly sensitive or compromising information. Specifically, the field of Cryptography is the construction and analysis of protocols that prevent third parties from understanding private messages. Steganography is related to Cryptography in that the goal is to obscure information using some method or algorithm, but the most important difference is that the information and the method of concealing information within Steganography both involve images--more precisely, the embedding of one image or piece of information into another image. Ever since the creation of covert communication methods, steps have been taken to crack cryptography and steganography algorithms. The desire for this rises from both human curiosity and the need to counteract adverse uses, such as encoding harmful media in inconspicuous media (phishing attack). In this paper, we succeed in cracking the Least Significant Bit (LSB) steganography algorithm using Cycle Generative Adversarial Networks (CycleGANs) and Bayesian Optimization and compare the use of CycleGANs against Convolutional Autoencoders. The results of our experiments highlight the promising nature of CycleGANs in cracking steganography and open several possible avenues of research.


title: Photohadronic model for the neutrino and $\gamma$-ray emission from TXS 0506+056

abstract: The detection of a high energy muon neutrino on 22 September 2017 by IceCube neutrino detector coincides with the multiwavelength flaring from the BL Lac object TXS 0506+056, most likely confirming AGN as a source of high energy cosmic rays and neutrinos. Using the photohadronic model, we have explained the very high energy $\gamma$-rays observed by MAGIC telescopes few days after the neutrino event and extend the model to calculate the neutrino flux at different windows consistent with the flaring period of TXS 0506+056 and compared with the IceCube and MAGIC estimates. We also use this model to estimate the neutrino flux from the flaring of FSRQ PKS B1424-418 which is believed to be associated with the 2 PeV neutrino event observed by IceCube.


title: Random circuit block-encoded matrix and a proposal of quantum LINPACK benchmark

abstract: The LINPACK benchmark reports the performance of a computer for solving a system of linear equations with dense random matrices. Although this task was not designed with a real application directly in mind, the LINPACK benchmark has been used to define the list of TOP500 supercomputers since the debut of the list in 1993. We propose that a similar benchmark, called the quantum LINPACK benchmark, could be used to measure the whole machine performance of quantum computers. The success of the quantum LINPACK benchmark should be viewed as the minimal requirement for a quantum computer to perform a useful task of solving linear algebra problems, such as linear systems of equations. We propose an input model called the RAndom Circuit Block-Encoded Matrix (RACBEM), which is a proper generalization of a dense random matrix in the quantum setting. The RACBEM model is efficient to be implemented on a quantum computer, and can be designed to optimally adapt to any given quantum architecture, with relying on a black-box quantum compiler. Besides solving linear systems, the RACBEM model can be used to perform a variety of linear algebra tasks relevant to many physical applications, such as computing spectral measures, time series generated by a Hamiltonian simulation, and thermal averages of the energy. We implement these linear algebra operations on IBM Q quantum devices as well as quantum virtual machines, and demonstrate their performance in solving scientific computing problems.


title: A new f(R) Gravity Model and properties of Gravitational Waves in it

abstract: In this paper, we have introduced a new $f(R)$ gravity model as an attempt to have a model with more parametric control, so that the model can be used to explain the existing problems as well as to explore new directions in physics of gravity, by properly constraining it with recent observational data. Here basic aim is to study the properties of Gravitational Waves (GWs) in this new model. In $f(R)$ gravity metric formalism, the model shows the existence of scalar degree of freedom as like other $f(R)$ gravity models. Due to this reason, there is a scalar mode of polarization of GWs present in the theory. This polarization mode exists in a mixed state, of which one is transverse massless breathing mode with non-vanishing trace and the other is massive longitudinal mode. The longitudinal mode being massive, travels at speed less than the usual tensor modes found in General Relativity (GR). Moreover, for a better understanding of the model, we have studied the potential and mass of scalar graviton in both Jordan frame and Einstein frame. This model can pass the solar system tests and can explain primordial and present dark energy. Also, we have put constraints on the model. It is found that the correlation function for the third mode of polarization under certain mass scale predicted by the model agrees well with the recent data of Pulsar Timing Arrays. It seems that this new model would be useful in dealing with different existing issues in the areas of astrophysics and cosmology.


title: An Efficient Algorithm For Generalized Linear Bandit: Online Stochastic Gradient Descent and Thompson Sampling

abstract: We consider the contextual bandit problem, where a player sequentially makes decisions based on past observations to maximize the cumulative reward. Although many algorithms have been proposed for contextual bandit, most of them rely on finding the maximum likelihood estimator at each iteration, which requires $O(t)$ time at the $t$-th iteration and are memory inefficient. A natural way to resolve this problem is to apply online stochastic gradient descent (SGD) so that the per-step time and memory complexity can be reduced to constant with respect to $t$, but a contextual bandit policy based on online SGD updates that balances exploration and exploitation has remained elusive. In this work, we show that online SGD can be applied to the generalized linear bandit problem. The proposed SGD-TS algorithm, which uses a single-step SGD update to exploit past information and uses Thompson Sampling for exploration, achieves $\tilde{O}(\sqrt{T})$ regret with the total time complexity that scales linearly in $T$ and $d$, where $T$ is the total number of rounds and $d$ is the number of features. Experimental results show that SGD-TS consistently outperforms existing algorithms on both synthetic and real datasets.


title: AI from concrete to abstract: demystifying artificial intelligence to the general public

abstract: Artificial Intelligence (AI) has been adopted in a wide range of domains. This shows the imperative need to develop means to endow common people with a minimum understanding of what AI means. Combining visual programming and WiSARD weightless artificial neural networks, this article presents a new methodology, AI from concrete to abstract (AIcon2abs), to enable general people (including children) to achieve this goal. The main strategy adopted by is to promote a demystification of artificial intelligence via practical activities related to the development of learning machines, as well as through the observation of their learning process. Thus, it is possible to provide subjects with skills that contributes to making them insightful actors in debates and decisions involving the adoption of artificial intelligence mechanisms. Currently, existing approaches to the teaching of basic AI concepts through programming treat machine intelligence as an external element/module. After being trained, that external module is coupled to the main application being developed by the learners. In the methodology herein presented, both training and classification tasks are blocks that compose the main program, just as the other programming constructs. As a beneficial side effect of AIcon2abs, the difference between a program capable of learning from data and a conventional computer program becomes more evident. In addition, the simplicity of the WiSARD weightless artificial neural network model enables easy visualization and understanding of training and classification tasks internal realization.


title: Medical Concept Normalization in User Generated Texts by Learning Target Concept Embeddings

abstract: Medical concept normalization helps in discovering standard concepts in free-form text i.e., maps health-related mentions to standard concepts in a vocabulary. It is much beyond simple string matching and requires a deep semantic understanding of concept mentions. Recent research approach concept normalization as either text classification or text matching. The main drawback in existing a) text classification approaches is ignoring valuable target concepts information in learning input concept mention representation b) text matching approach is the need to separately generate target concept embeddings which is time and resource consuming. Our proposed model overcomes these drawbacks by jointly learning the representations of input concept mention and target concepts. First, it learns the input concept mention representation using RoBERTa. Second, it finds cosine similarity between embeddings of input concept mention and all the target concepts. Here, embeddings of target concepts are randomly initialized and then updated during training. Finally, the target concept with maximum cosine similarity is assigned to the input concept mention. Our model surpasses all the existing methods across three standard datasets by improving accuracy up to 2.31%.


title: Light-Generating CdSe/CdS Colloidal Quantum Dot-Doped Plastic Optical Fibers

abstract: Colloidal quantum dots (cQDs) are now a mature nanomaterial with optical properties customizable through varying size and composition. However, their use in optical devices is limited as they are not widely available in convenient forms such as optical fibers. With advances in polymerization methods incorporating nanocrystals, nanocomposite materials suitable for processing into high quality hybrid active fibers can be achieved. We demonstrate a plastic optical fiber fabrication method which ensures homogeneous dispersion of cQDs within a polymer core matrix. Loading concentrations between 10$^{11}$-10$^{13}$ CdSe/CdS cQDs per cm$^{3}$ in polystyrene were electronically imaged, confirming only sporadic sub-wavelength aggregates. Rayleigh scattering losses are therefore dominant at energies below the semiconductors' band gap, but are overtaken by a sharp CdS-related absorption onset around 525 nm facilitating cQD excitation. The redshifted photoluminescence emission is then minimally reabsorbed along the fiber with a spectrum barely affected by the polymerization and a quantum yield staying at $\sim$65$\%$ of its initial value. The latter, along with the glass transition temperature and refractive index, is independent of the cQD concentration hence yielding a proportionally increasing light output. Our cQD-doped fibers are photostable to within 5$\%$ over days showing great promise for functional material applications.


title: A Multitask Learning Approach for Diacritic Restoration

abstract: In many languages like Arabic, diacritics are used to specify pronunciations as well as meanings. Such diacritics are often omitted in written text, increasing the number of possible pronunciations and meanings for a word. This results in a more ambiguous text making computational processing on such text more difficult. Diacritic restoration is the task of restoring missing diacritics in the written text. Most state-of-the-art diacritic restoration models are built on character level information which helps generalize the model to unseen data, but presumably lose useful information at the word level. Thus, to compensate for this loss, we investigate the use of multi-task learning to jointly optimize diacritic restoration with related NLP problems namely word segmentation, part-of-speech tagging, and syntactic diacritization. We use Arabic as a case study since it has sufficient data resources for tasks that we consider in our joint modeling. Our joint models significantly outperform the baselines and are comparable to the state-of-the-art models that are more complex relying on morphological analyzers and/or a lot more data (e.g. dialectal data).


title: Information Mandala: Statistical Distance Matrix with Clustering

abstract: In machine learning, observation features are measured in a metric space to obtain their distance function for optimization. Given similar features that are statistically sufficient as a population, a statistical distance between two probability distributions can be calculated for more precise learning. Provided the observed features are multi-valued, the statistical distance function is still efficient. However, due to its scalar output, it cannot be applied to represent detailed distances between feature elements. To resolve this problem, this paper extends the traditional statistical distance to a matrix form, called a statistical distance matrix. In experiments, the proposed approach performs well in object recognition tasks and clearly and intuitively represents the dissimilarities between cat and dog images in the CIFAR dataset, even when directly calculated using the image pixels. By using the hierarchical clustering of the statistical distance matrix, the image pixels can be separated into several clusters that are geometrically arranged around a center like a Mandala pattern. The statistical distance matrix with clustering, called the Information Mandala, is beyond ordinary saliency maps and can help to understand the basic principles of the convolution neural network.


title: Projecting and comparing non-pharmaceutical interventions to contain COVID-19 in major economies

abstract: Non-pharmaceutical interventions (NPIs) such as quarantine, self-isolation, social distancing, and virus-contact tracing can greatly reduce the spread of the virus during a pandemic. In the wave of the COVID-19 pandemic, many countries have implemented various NPIs for infection control and mitigation. However, the stringency of the NPIs and the resulting impact among different countries remain unclear due to the lack of quantitative factors. In this study we took a further step to incorporate the effect of the NPIs into the pandemic dynamics model using the concept of policy intensity factor (PIF). This idea enables us to characterize the transition rates as time varying quantities instead of constant values, and thus capturing the dynamical behavior of the basic reproduction number variation in the pandemic. By leveraging a great amount of data reported by the governments and the World Health Organization, we projected the dynamics of the pandemic for the major economies in the world, including the numbers of infected, susceptible, and recovered cases, as well as the pandemic durations. It is observed that the proposed variable-rate susceptible-exposed-infected-recovered (VR-SEIR) model fits and projects the pandemic dynamics very well. We further showed that the resulting PIFs correlate with the stringency of NPIs, which allows us to project the final affected numbers of people in those countries when their current NPIs have been imposed for 90, 180, 360 days. It provides a quantitative insight into the effectiveness of the implemented NPIs, and sheds a new light on minimizing both affected people from COVID-19 and the economic impact.


title: Bio-mimic four-dimensional printing of nanostructured interactive hydrogels

abstract: Nature has exhibited numerous soft-interactive botanical or zoological systems with self-adaptivenss or reconfigurable shape, however, artificial micro/nano materials of same merit are formidable due to material/structural limitations, posing multidimensional challenges to current chemical/physical fabrications. Here, we propose a new nanostructured hydrogel by four-dimensional (4D) printing for function integration and dimension reduction. The cross-linked matrix relaxes or contracts in robust hierarchical heterojunction to eliminate interface issues of dual-layer desgin.


title: The weighted Bergman space on a sector and a degenerate parabolic equation

abstract: In this work we solve a degenerate parabolic equation for the half line with Dirichlet boundary data, and use some results from the theory of Reproducing Kernel Hilbert Spaces to show that the null reachable space of this degenerate parabolic equation is a RKHS of analytic functions on a sector, whose reproducing kernel can be written in terms of the weighted Bergman kernel on the half plane C+.


title: Skill Discovery of Coordination in Multi-agent Reinforcement Learning

abstract: Unsupervised skill discovery drives intelligent agents to explore the unknown environment without task-specific reward signal, and the agents acquire various skills which may be useful when the agents adapt to new tasks. In this paper, we propose "Multi-agent Skill Discovery"(MASD), a method for discovering skills for coordination patterns of multiple agents. The proposed method aims to maximize the mutual information between a latent code Z representing skills and the combination of the states of all agents. Meanwhile it suppresses the empowerment of Z on the state of any single agent by adversarial training. In another word, it sets an information bottleneck to avoid empowerment degeneracy. First we show the emergence of various skills on the level of coordination in a general particle multi-agent environment. Second, we reveal that the "bottleneck" prevents skills from collapsing to a single agent and enhances the diversity of learned skills. Finally, we show the pretrained policies have better performance on supervised RL tasks.


title: A linesearch projection algorithm for solving equilibrium problems without monotonicity in Hilbert spaces

abstract: We propose a linesearch projection algorithm for solving non-monotone and non-Lipschitzian equilibrium problems in Hilbert spaces. It is proved that the sequence generated by the proposed algorithm converges strongly to a solution of the equilibrium problem under the assumption that the solution set of the associated Minty equilibrium problem is nonempty. Compared with existing methods, we do not employ Fej\'{e}r monotonicity in the strategy of proving the convergence. This comes from projecting a fixed point instead of the current point onto a subset of the feasible set at each iteration. Moreover, employing an Armijo-linesearch without subgradient has a great advantage in CPU-time. Some numerical experiments demonstrate the efficiency and strength of the presented algorithm.


title: Local theta correspondence: the basic theory

abstract: We give an elementary introduction to Classical Invariant Theory and its modern extension "Transcending Classical Invariant Theory", commonly known as the theory of local theta correspondence. We explain the two fundamental assertions of the theory: the Howe duality conjecture and the Kudla-Rallis conservation relation conjecture. We give a status report on the problem of explicitly describing local theta correspondence in terms of Langlands-Vogan parameters. We conclude with a discussion on a certain problem of automatic continuity, which manifests unity of the theory in algebraic and smooth settings.


title: Sources of high leverage in linear regression model

abstract: Some reasons for high leverage are analytically investigated by decomposing leverage into meaningful components. The results in this work can be used for remedial action as a next step of data analysis.


title: Approaching the limits of optoelectronic performance in mixed cation mixed halide perovskites by controlling surface recombination

abstract: We demonstrate the critical role of surface recombination in mixed-cation, mixed-halide perovskite, FA0.83Cs0.17Pb(I0.85Br0.15)3. By passivating non-radiative defects with the polymerizable Lewis base (3-aminopropyl)trimethoxysilane (APTMS) we transform these thin films. We demonstrate average minority carrier lifetimes > 4 {\mu}s, nearly single exponential monomolecular PL decays, and concomitantly high external photoluminescence quantum efficiencies (>20%, corresponding to ~97% of the maximum theoretical quasi-Fermi-level splitting) at low excitation fluence. We confirm both the composition and valence band edge position of the FA0.83Cs0.17Pb(I0.85Br0.15)3 perovskite using multi-institution, cross-validated, XPS and UPS measurements. We extend the APTMS surface passivation to higher bandgap double cation (FA,Cs) compositions (1.7 eV, 1.75 eV and 1.8 eV) as well as the widely used triple cation (FA,MA,Cs) composition and observe significant PL and PL lifetime improvements after surface passivation. Finally, we demonstrate that the average surface recombination velocity (SRV) decreases from ~1000 cm/s to ~10 cm/s post APTMS passivation for FA0.83Cs0.17Pb(I0.85Br0.15)3. Our results demonstrate that surface-mediated recombination is the primary non-radiative loss pathway in MA-free mixed-cation mixed-halide films with a range of different bandgaps, which is a problem observed for a wide range of perovskite active layers and reactive electrical contacts. This study indicates that surface passivation and contact engineering will enable near-theoretical device efficiencies with these materials.


title: SharinGAN: Combining Synthetic and Real Data for Unsupervised Geometry Estimation

abstract: We propose a novel method for combining synthetic and real images when training networks to determine geometric information from a single image. We suggest a method for mapping both image types into a single, shared domain. This is connected to a primary network for end-to-end training. Ideally, this results in images from two domains that present shared information to the primary network. Our experiments demonstrate significant improvements over the state-of-the-art in two important domains, surface normal estimation of human faces and monocular depth estimation for outdoor scenes, both in an unsupervised setting.


title: Efficient Architecture Search for Continual Learning

abstract: Continual learning with neural networks is an important learning framework in AI that aims to learn a sequence of tasks well. However, it is often confronted with three challenges: (1) overcome the catastrophic forgetting problem, (2) adapt the current network to new tasks, and meanwhile (3) control its model complexity. To reach these goals, we propose a novel approach named as Continual Learning with Efficient Architecture Search, or CLEAS in short. CLEAS works closely with neural architecture search (NAS) which leverages reinforcement learning techniques to search for the best neural architecture that fits a new task. In particular, we design a neuron-level NAS controller that decides which old neurons from previous tasks should be reused (knowledge transfer), and which new neurons should be added (to learn new knowledge). Such a fine-grained controller allows one to find a very concise architecture that can fit each new task well. Meanwhile, since we do not alter the weights of the reused neurons, we perfectly memorize the knowledge learned from previous tasks. We evaluate CLEAS on numerous sequential classification tasks, and the results demonstrate that CLEAS outperforms other state-of-the-art alternative methods, achieving higher classification accuracy while using simpler neural architectures.


title: Convex Relaxation of Combined Heat and Power Dispatch

abstract: Combined heat and power dispatch promotes interactions and synergies between electric power systems and district heating systems. However, nonlinear and nonconvex heating flow imposes significant challenges on finding qualified solutions efficiently. Most existing methods rely on constant flow assumptions to derive a linear heating flow model, sacrificing optimality for computational simplicity. This paper proposes a novel convex combined heat and power dispatch model based on model simplification and constraint relaxation, which improves solution quality and avoids assumptions on operating regimes of district heating systems. To alleviate mathematical complexity introduced by the commonly used node method, a simplified thermal dynamic model is proposed to capture temperature changes in networked pipelines. Conic and polyhedral relaxations are then applied to convexify the original problems with bilinear and quadratic equality constraints. Furthermore, an adaptive solution algorithm is proposed to successively reduce relaxation gaps based on dynamic bivariate partitioning, improving solution optimality with desirable computational efficiency. The proposed method is verified on a 33-bus electric power system integrated with a 30-node district heating system and compared to nonlinear programming solvers and constant-flow-based solutions.


title: Ethics, Data Science, and Health and Human Services: Embedded Bias in Policy Approaches to Teen Pregnancy Prevention

abstract: Background: This study aims to evaluate the Chicago Teen Pregnancy Prevention Initiative delivery optimization outcomes given policy-neutral and policy-focused approaches to deliver this program to at-risk teens across the City of Chicago. Methods: We collect and compile several datasets from public sources including: Chicago Department of Public Health clinic locations, two public health statistics datasets, census data of Chicago, list of Chicago public high schools, and their Locations. Our policy-neutral approach will consist of an equal distribution of funds and resources to schools and centers, regardless of past trends and outcomes. The policy-focused approaches will evaluate two models: first, a funding model based on prediction models from historical data; and second, a funding model based on economic and social outcomes for communities. Results: Results of this study confirms our initial hypothesis, that even though the models are optimized from a machine learning perspective, there is still possible that the models will produce wildly different results in the real-world application. Conclusions: When ethics and ethical considerations are extended beyond algorithmic optimization to encompass output and societal optimization, the foundation and philosophical grounding of the decision-making process become even more critical in the knowledge discovery process.


title: Validation and Administration of a Conceptual Survey on the Formalism and Postulates of Quantum Mechanics

abstract: We developed and validated a conceptual survey that focuses on the formalism and postulates of quantum mechanics covered in upper-level undergraduate quantum mechanics courses. The concepts included in the Quantum Mechanics Formalism and Postulate Survey (QMFPS) focus on Dirac notation, the Hilbert space, state vectors, physical observables and their corresponding Hermitian operators, compatible and incompatible observables, quantum measurement, time-dependence of quantum states and expectation values, and spin angular momenta. Here we describe the validation and administration of the survey, which has been administered to over 400 upper-level undergraduate and graduate students from six institutions. The QMFPS is valid and reliable for use as a low-stakes test to measure the effectiveness of instruction in an undergraduate quantum mechanics course that covers relevant content. The survey can also be used by instructors to identify student understanding of the formalism and postulates of quantum mechanics at the beginning and end of a graduate quantum mechanics course since graduate students are expected to have taken an undergraduate quantum mechanics course that covers the content included in the survey. We found that undergraduate students who engaged with research-validated learning tools performed better than students who did not on the QMFPS after the first semester of a junior/senior level quantum mechanics course. In addition, the performance of graduate students on QMFPS after instruction in the first semester of a core graduate-level quantum mechanics course was significantly better than the performance of undergraduate students at the end of the first semester of an undergraduate quantum mechanics course. A comparison with the base line data on the validated QMFPS presented here can aid instructors in assessing the effectiveness of their instructional approaches.


title: Semantic Loss Application to Entity Relation Recognition

abstract: Usually, entity relation recognition systems either use a pipe-lined model that treats the entity tagging and relation identification as separate tasks or a joint model that simultaneously identifies the relation and entities. This paper compares these two general approaches for the entity relation recognition. State-of-the-art entity relation recognition systems are built using deep recurrent neural networks which often does not capture the symbolic knowledge or the logical constraints in the problem. The main contribution of this paper is an end-to-end neural model for joint entity relation extraction which incorporates a novel loss function. This novel loss function encodes the constraint information in the problem to guide the model training effectively. We show that addition of this loss function to the existing typical loss functions has a positive impact over the performance of the models. This model is truly end-to-end, requires no feature engineering and easily extensible. Extensive experimentation has been conducted to evaluate the significance of capturing symbolic knowledge for natural language understanding. Models using this loss function are observed to be outperforming their counterparts and converging faster. Experimental results in this work suggest the use of this methodology for other language understanding applications.


title: Fundamental group in the projective knot theory

abstract: In this paper, properties of a link $L$ in the projective space $\mathbb R P^3$ are related to properties of its group $\pi_1(\mathbb R P^3\smallsetminus L)$: $L$ is isotopic to a projective line if and only if $\pi_1(\mathbb R P^3\smallsetminus L)=\mathbb Z$. $L$ is isotopic to an affine circle if and only if $\pi_1(\mathbb R P^3\smallsetminus L)=\mathbb Z*\mathbb Z_{/2}$. $L$ is isotopic to a link disjoint from a projective plane if and only if $\pi_1(\mathbb R P^3\smallsetminus L)$ contains a non-trivial element of order two. A simple algorithm which finds a system of generators and relations for $\pi_1(\mathbb R P^3\smallsetminus L)$ in terms of a link diagram of $L$ is provided.


title: A Comparative Analysis of E-Scooter and E-Bike Usage Patterns: Findings from the City of Austin, TX

abstract: E-scooter-sharing and e-bike-sharing systems are accommodating and easing the increased traffic in dense cities and are expanding considerably. However, these new micro-mobility transportation modes raise numerous operational and safety concerns. This study analyzes e-scooter and dockless e-bike sharing system user behavior. We investigate how average trip speed change depending on the day of the week and the time of the day. We used a dataset from the city of Austin, TX from December 2018 to May 2019. Our results generally show that the trip average speed for e-bikes ranges between 3.01 and 3.44 m/s, which is higher than that for e-scooters (2.19 to 2.78 m/s). Results also show a similar usage pattern for the average speed of e-bikes and e-scooters throughout the days of the week and a different usage pattern for the average speed of e-bikes and e-scooters over the hours of the day. We found that users tend to ride e-bikes and e-scooters with a slower average speed for recreational purposes compared to when they are ridden for commuting purposes. This study is a building block in this field, which serves as a first of its kind, and sheds the light of significant new understanding of this emerging class of shared-road users.


title: Student understanding of Fermi energy, the Fermi-Dirac distribution and total electronic energy of a free electron gas

abstract: We investigated the difficulties that physics students in upper-level undergraduate quantum mechanics and graduate students after quantum and statistical mechanics core courses have with the Fermi energy, the Fermi-Dirac distribution and total electronic energy of a free electron gas after they had learned relevant concepts in their respective courses. These difficulties were probed by administering written conceptual and quantitative questions to undergraduate students and asking some undergraduate and graduate students to answer those questions while thinking aloud in one-on-one individual interviews. We find that advanced students had many common difficulties with these concepts after traditional lecture-based instruction. Engaging with a sequence of clicker questions improved student performance, but there remains room for improvement in their understanding of these challenging concepts.


title: Changes of Magnetism in a Magnetic Insulator due to Proximity to a Topological Insulator

abstract: This letter reports the modification of magnetism in a magnetic insulator Y3Fe5O12 thin film by topological surface states (TSS) in an adjacent topological insulator Bi2Se3 thin film. Ferromagnetic resonance measurements show that the TSS in Bi2Se3 produces a perpendicular magnetic anisotropy, results in a decrease in the gyromagnetic ratio, and enhances the damping in Y3Fe5O12. Such TSS-induced changes become more pronounced as the temperature decreases from 300 K to 50 K. These results suggest a completely new approach for control of magnetism in magnetic thin films.


title: Kinetics of segregation formation in elastic field of edge dislocation in bcc iron

abstract: We study the kinetics of the redistribution of impurity atoms in the elastic fields of dislocations by computer simulation methods. A work consists of several stages. The first is the simulation of a dislocation core structure with a Burgers vector along [100] direction by using the modified molecular static method. The second is obtaining the coefficients that determine the influence of the components of the strain tensor on the diagonal elements of the matrix of diffusion coefficients and in the equations for fluxes of carbon atoms in bcc iron. The third stage is associated with modeling the diffusion characteristics of carbon atoms by the method of molecular dynamics in a crystal without defects. The fourth and final stage uses the data about atomic structure that we obtained at first stage, as well as the characteristics calculated in the second and third, is a simulation of the formation of segregations of interstitial atoms, which is based on solving diffusion equations that take into account the elastic deformations created by the dislocation. The complex of developed models is used to analyze the kinetics of segregation formation. 3D graphs illustrate the distribution of interstitial atoms in the vicinity of a dislocation for different times at certain temperatures.


title: Reinforcement Learning for Multi-Product Multi-Node Inventory Management in Supply Chains

abstract: This paper describes the application of reinforcement learning (RL) to multi-product inventory management in supply chains. The problem description and solution are both adapted from a real-world business solution. The novelty of this problem with respect to supply chain literature is (i) we consider concurrent inventory management of a large number (50 to 1000) of products with shared capacity, (ii) we consider a multi-node supply chain consisting of a warehouse which supplies three stores, (iii) the warehouse, stores, and transportation from warehouse to stores have finite capacities, (iv) warehouse and store replenishment happen at different time scales and with realistic time lags, and (v) demand for products at the stores is stochastic. We describe a novel formulation in a multi-agent (hierarchical) reinforcement learning framework that can be used for parallelised decision-making, and use the advantage actor critic (A2C) algorithm with quantised action spaces to solve the problem. Experiments show that the proposed approach is able to handle a multi-objective reward comprised of maximising product sales and minimising wastage of perishable products.


title: Propensity score weighting under limited overlap and model misspecification

abstract: Propensity score (PS) weighting methods are often used in non-randomized studies to adjust for confounding and assess treatment effects. The most popular among them, the inverse probability weighting (IPW), assigns weights that are proportional to the inverse of the conditional probability of a specific treatment assignment, given observed covariates. A key requirement for IPW estimation is the positivity assumption, i.e., the PS must be bounded away from 0 and 1. In practice, violations of the positivity assumption often manifest by the presence of limited overlap in the PS distributions between treatment groups. When these practical violations occur, a small number of highly influential IPW weights may lead to unstable IPW estimators, with biased estimates and large variances. To mitigate these issues, a number of alternative methods have been proposed, including IPW trimming, overlap weights (OW), matching weights (MW), and entropy weights (EW). Because OW, MW, and EW target the population for whom there is equipoise (and with adequate overlap) and their estimands depend on the true PS, a common criticism is that these estimators may be more sensitive to misspecifications of the PS model. In this paper, we conduct extensive simulation studies to compare the performances of IPW and IPW trimming against those of OW, MW, and EW under limited overlap and misspecified propensity score models. Across the wide range of scenarios we considered, OW, MW, and EW consistently outperform IPW in terms of bias, root mean squared error, and coverage probability.


title: Simulating brain rhythms using an ODE with stochastically varying coefficients

abstract: The brain produces rhythms in a variety of frequency bands. Some are likely by-products of neuronal processes; others are thought to be top-down. Produced entirely naturally, these rhythms have clearly recognizable beats, but they are very far from periodic in the sense of mathematics. They produce signals that are broad-band, episodic, wandering in magnitude, in frequency and in phase; the rhythm comes and goes, degrading and regenerating. Rhythms with these characteristics do not match standard dynamical systems paradigms of periodicity, quasi-periodicity, or periodic motion in the presence of a Brownian noise. Thus far they have been satisfactorily reproduced only using networks of hundreds of integrate-and-fire neurons. In this paper, we tackle the mathematical question of whether signals with these properties can be generated from simpler dynamical systems. Using an ODE with two variables inspired by the FitzHugh-Nagumo model, and varying randomly three parameters that control the magnitude, frequency and degree of degradation, we were able to replicate the qualitative characteristics of these natural brain rhythms. Viewing the two variables as Excitatory and Inhibitory conductances of a typical neuron in a local population, our model produces results that closely resemble gamma-band activity in real cortex, including the moment-to-moment balancing of E and I-currents seen in experiments.


title: Projective and amplified symmetries in metric-affine theories

abstract: In this paper we extend the projective symmetry of the full metric-affine Einstein-Hilbert theory to a new symmetry transformation in the space of affine connections called the amplified symmetry. We prove that the Lagrangian of the Standard Model of particle physics is invariant under this new symmetry. We also show that the gravitational Lagrangian can be modified so that the amplified symmetry extends to the gravitational sector and hence to the whole action. The new theory so constructed is shown to be dynamically equivalent to Einstein-Cartan's though genuinely metric-affine.


title: What needles do sparse neural networks find in nonlinear haystacks

abstract: Using a sparsity inducing penalty in artificial neural networks (ANNs) avoids over-fitting, especially in situations where noise is high and the training set is small in comparison to the number of features. For linear models, such an approach provably also recovers the important features with high probability in regimes for a well-chosen penalty parameter. The typical way of setting the penalty parameter is by splitting the data set and performing the cross-validation, which is (1) computationally expensive and (2) not desirable when the data set is already small to be further split (for example, whole-genome sequence data). In this study, we establish the theoretical foundation to select the penalty parameter without cross-validation based on bounding with a high probability the infinite norm of the gradient of the loss function at zero under the zero-feature assumption. Our approach is a generalization of the universal threshold of Donoho and Johnstone (1994) to nonlinear ANN learning. We perform a set of comprehensive Monte Carlo simulations on a simple model, and the numerical results show the effectiveness of the proposed approach.


title: An Algorithm for Fuzzification of WordNets, Supported by a Mathematical Proof

abstract: WordNet-like Lexical Databases (WLDs) group English words into sets of synonyms called "synsets." Although the standard WLDs are being used in many successful Text-Mining applications, they have the limitation that word-senses are considered to represent the meaning associated to their corresponding synsets, to the same degree, which is not generally true. In order to overcome this limitation, several fuzzy versions of synsets have been proposed. A common trait of these studies is that, to the best of our knowledge, they do not aim to produce fuzzified versions of the existing WLD's, but build new WLDs from scratch, which has limited the attention received from the Text-Mining community, many of whose resources and applications are based on the existing WLDs. In this study, we present an algorithm for constructing fuzzy versions of WLDs of any language, given a corpus of documents and a word-sense disambiguation (WSD) system for that language. Then, using the Open-American-National-Corpus and UKB WSD as algorithm inputs, we construct and publish online the fuzzified version of English WordNet (FWN). We also propose a theoretical (mathematical) proof of the validity of its results.


title: SVGA-Net: Sparse Voxel-Graph Attention Network for 3D Object Detection from Point Clouds

abstract: Accurate 3D object detection from point clouds has become a crucial component in autonomous driving. However, the volumetric representations and the projection methods in previous works fail to establish the relationships between the local point sets. In this paper, we propose Sparse Voxel-Graph Attention Network (SVGA-Net), a novel end-to-end trainable network which mainly contains voxel-graph module and sparse-to-dense regression module to achieve comparable 3D detection tasks from raw LIDAR data. Specifically, SVGA-Net constructs the local complete graph within each divided 3D spherical voxel and global KNN graph through all voxels. The local and global graphs serve as the attention mechanism to enhance the extracted features. In addition, the novel sparse-to-dense regression module enhances the 3D box estimation accuracy through feature maps aggregation at different levels. Experiments on KITTI detection benchmark demonstrate the efficiency of extending the graph representation to 3D object detection and the proposed SVGA-Net can achieve decent detection accuracy.


title: Revisiting the Israel junction conditions in Einstein-Cartan gravity

abstract: The Israel junction conditions of a thin shell in the context of Einstein-Cartan gravity are revisited. It is shown that with a choice of the torsion discontinuity taken to be orthogonal to the hypersurface and consistent with the antisymmetric properties of torsion tensor and contorsion tensor, the generalized asymmetric surface energy-momentum tensor turns out to be tangent to the hypersurface while the resulting generalized Israel junction conditions are modified. The main differences to previous works are mentioned.


title: A Generic First-Order Algorithmic Framework for Bi-Level Programming Beyond Lower-Level Singleton

abstract: In recent years, a variety of gradient-based first-order methods have been developed to solve bi-level optimization problems for learning applications. However, theoretical guarantees of these existing approaches heavily rely on the simplification that for each fixed upper-level variable, the lower-level solution must be a singleton (a.k.a., Lower-Level Singleton, LLS). In this work, we first design a counter-example to illustrate the invalidation of such LLS condition. Then by formulating BLPs from the view point of optimistic bi-level and aggregating hierarchical objective information, we establish Bi-level Descent Aggregation (BDA), a flexible and modularized algorithmic framework for generic bi-level optimization. Theoretically, we derive a new methodology to prove the convergence of BDA without the LLS condition. Our investigations also demonstrate that BDA is indeed compatible to a verify of particular first-order computation modules. Additionally, as an interesting byproduct, we also improve these conventional first-order bi-level schemes (under the LLS simplification). Particularly, we establish their convergences with weaker assumptions. Extensive experiments justify our theoretical results and demonstrate the superiority of the proposed BDA for different tasks, including hyper-parameter optimization and meta learning.


title: On Suboptimality of Least Squares with Application to Estimation of Convex Bodies

abstract: We develop a technique for establishing lower bounds on the sample complexity of Least Squares (or, Empirical Risk Minimization) for large classes of functions. As an application, we settle an open problem regarding optimality of Least Squares in estimating a convex set from noisy support function measurements in dimension $d\geq 6$. Specifically, we establish that Least Squares is mimimax sub-optimal, and achieves a rate of $\tilde{\Theta}_d(n^{-2/(d-1)})$ whereas the minimax rate is $\Theta_d(n^{-4/(d+3)})$.


title: DeepRelativeFusion: Dense Monocular SLAM using Single-Image Relative Depth Prediction

abstract: In this paper, we propose a dense monocular SLAM system, named DeepRelativeFusion, that is capable to recover a globally consistent 3D structure. To this end, we use a visual SLAM algorithm to reliably recover the camera poses and semi-dense depth maps of the keyframes, and then use relative depth prediction to densify the semi-dense depth maps and refine the keyframe pose-graph. To improve the semi-dense depth maps, we propose an adaptive filtering scheme, which is a structure-preserving weighted average smoothing filter that takes into account the pixel intensity and depth of the neighbouring pixels, yielding substantial reconstruction accuracy gain in densification. To perform densification, we introduce two incremental improvements upon the energy minimization framework proposed by DeepFusion: (1) an improved cost function, and (2) the use of single-image relative depth prediction. After densification, we update the keyframes with two-view consistent optimized semi-dense and dense depth maps to improve pose-graph optimization, providing a feedback loop to refine the keyframe poses for accurate scene reconstruction. Our system outperforms the state-of-the-art dense SLAM systems quantitatively in dense reconstruction accuracy by a large margin.


title: Sharp Representation Theorems for ReLU Networks with Precise Dependence on Depth

abstract: We prove sharp dimension-free representation results for neural networks with $D$ ReLU layers under square loss for a class of functions $\mathcal{G}_D$ defined in the paper. These results capture the precise benefits of depth in the following sense: 1. The rates for representing the class of functions $\mathcal{G}_D$ via $D$ ReLU layers is sharp up to constants, as shown by matching lower bounds. 2. For each $D$, $\mathcal{G}_{D} \subseteq \mathcal{G}_{D+1}$ and as $D$ grows the class of functions $\mathcal{G}_{D}$ contains progressively less smooth functions. 3. If $D^{\prime} < D$, then the approximation rate for the class $\mathcal{G}_D$ achieved by depth $D^{\prime}$ networks is strictly worse than that achieved by depth $D$ networks. This constitutes a fine-grained characterization of the representation power of feedforward networks of arbitrary depth $D$ and number of neurons $N$, in contrast to existing representation results which either require $D$ growing quickly with $N$ or assume that the function being represented is highly smooth. In the latter case similar rates can be obtained with a single nonlinear layer. Our results confirm the prevailing hypothesis that deeper networks are better at representing less smooth functions, and indeed, the main technical novelty is to fully exploit the fact that deep networks can produce highly oscillatory functions with few activation functions.


title: Afterglow light curves of the non-relativistic ejecta mass in a stratified circumstellar medium

abstract: We present the afterglow light curves produced by the deceleration of the non-relativistic ejecta mass in a stratified circumstellar medium with a density profile $n(r)\propto r^{-k}$ with $k=0$, $1$, $1.5$, $2$ and $2.5$. Once the ejecta mass is launched with equivalent kinetic energy parametrized by $E(>\beta)\propto \beta^{-\alpha}$ (where beta is the ejecta velocity) and propagates into the surrounding circumstellar medium, it first moves with constant velocity (the free-coasting phase), and later it decelerates (the Sedov-Taylor expansion). We present the predicted synchrotron and synchrotron-self Compton light curves during the free-coasting phase, and the subsequent Sedov-Taylor expansion. In particular cases, we show the corresponding light curves generated by the deceleration of several ejecta masses with different velocities launched during the coalescence of binary compact objects and the core-collapse of dying massive stars which will contribute at distinct timescales, frequencies, and intensities. Finally, using the multi-wavelength observations and upper limits collected by a large campaign of orbiting satellites and ground telescopes, we constrain the parameter space of both the KN afterglow in GW170817 and the possibly generated KN afterglow in S190814bv. Further observations on timescales of years post-merger are needed to derive tighter constraints.


title: Growing Together: Modeling Human Language Learning With n-Best Multi-Checkpoint Machine Translation

abstract: We describe our submission to the 2020 Duolingo Shared Task on Simultaneous Translation And Paraphrase for Language Education (STAPLE) (Mayhew et al., 2020). We view MT models at various training stages (i.e., checkpoints) as human learners at different levels. Hence, we employ an ensemble of multi-checkpoints from the same model to generate translation sequences with various levels of fluency. From each checkpoint, for our best model, we sample n-Best sequences (n=10) with a beam width =100. We achieve 37.57 macro F1 with a 6 checkpoint model ensemble on the official English to Portuguese shared task test data, outperforming a baseline Amazon translation system of 21.30 macro F1 and ultimately demonstrating the utility of our intuitive method.


title: On initial conditions for fractional delay differential equations

abstract: Derivatives of fractional order are introduced in different ways: as left-inverse of the fractional integral or by generalizing the limit of the difference quotient defining integer-order derivatives. Although the two approaches lead (under standard smoothness assumptions) to equivalent operators, the first one does not involve the function at the left of the initial point where, instead, the latter forces the function to assume selected values. With fractional delay differential equations new problems arise: the presence of the delay imposes to assign the solution not just at the initial point but on an entire interval. Due to the freedom in the choice of the initial function, some inconsistencies with the values forced by the fractional derivative are possible and the operators may no longer be equivalent. In this paper we discuss the initialization of fractional delay differential equations, we investigate the effects of the initial condition not only on the solution but also on the fractional operator as well and we study the difference between solutions obtained by incorporating or not the initial function in the memory of the fractional derivative. The exact solution of a family of linear equations is obtained by the Laplace transform whilst numerical methods are used to solve nonlinear problems; the different results are therefore shown and commented.


title: Shrinkage priors for nonparametric Bayesian prediction of nonhomogeneous Poisson processes

abstract: We consider nonparametric Bayesian estimation and prediction for nonhomogeneous Poisson process models with unknown intensity functions. We propose a class of improper priors for intensity functions. Nonparametric Bayesian inference with kernel mixture based on the class improper priors is shown to be useful, although improper priors have not been widely used for nonparametric Bayes problems. Several theorems corresponding to those for finite-dimensional independent Poisson models hold for nonhomogeneous Poisson process models with infinite-dimensional parameter spaces. Bayesian estimation and prediction based on the improper priors are shown to be admissible under the Kullback--Leibler loss. Numerical methods for Bayesian inference based on the priors are investigated.


title: A Novel Grip Force Measurement Concept for Tactile Stimulation Mechanisms -- Design, Validation, and User Study

abstract: We developed a new grip force measurement concept that allows for embedding tactile stimulation mechanisms in a gripper. This concept is based on a single force sensor to measure the force applied on each side of the gripper, and it substantially reduces artifacts of force measurement caused by tactor motion. To test the feasibility of this new concept, we built a device that measures control of grip force in response to a tactile stimulation from a moving tactor. First, we used a custom designed testing setup with a second force sensor to calibrate our device over a range of 0 to 20 N without movement of the tactors. Second, we tested the effect of tactor movement on the measured grip force and measured artifacts of 1% of the measured force. Third, we demonstrated that during the application of dynamically changing grip forces, the average errors were 2.9% and 3.7% for the left and right sides of the gripper, respectively. Finally, we conducted a user study and found that in response to tactor movement, participants increased their grip force, and that the increase was larger for a smaller target force and depended on the amount of tactile stimulation.


title: Far-field heat and angular momentum radiation of the Haldane model

abstract: We investigate the radiation of energy and angular momentum from 2D topological systems with broken inversion symmetry and time reversal symmetry. A general theory of far-field radiation is developed using the linear response of 2D materials to the fluctuational electromagnetic field. Applying the theory to the Haldane model, we verify that the heat radiation complies with Planck's law only at low temperature and deviates from it as temperature becomes high. Angular momentum radiation is possible for this system and exhibits saturation as temperature increases. Parameters crucial to the radiation are investigated and optimized. This research enlightens the possibility of transposing the quantum information to the angular momentum degree of freedom.


title: Green Resource Allocation and Energy Management in Heterogeneous Small Cell Networks Powered by Hybrid Energy

abstract: In heterogeneous networks (HetNets), how to improve spectrum efficiency is a crucial issue. Meanwhile increased energy consumption inspires network operators to deploy renewable energy sources as assistance to traditional electricity. Based on above aspects, we allow base stations (BSs) to share their licensed spectrum resource with each other and adjust transmission power to adapt to the renewable energy level. Considering the sharing fairness among BSs, we formulate a multi-person bargaining problem as a stochastic optimization problem. We divide the optimization problem into three parts: data rate control, resource allocation and energy management. An online dynamic control algorithm is proposed to control admission rate and resource allocation to maximize the transmission and sharing profits with the least grid energy consumption. Simulation results investigate the time-varying data control and energy management of BSs and demonstrate the effectiveness of the proposed scheme.


title: Power-law growth of time and strength of squeezing near quantum critical point

abstract: The dynamics of squeezing across quantum phase transition in two basic models, viz., the one-axis twisting model in transverse field and the Dicke model, is investigated using Holstein-Primakoff representation in the large spin limit. Near the phase boundary between the disordered (normal) and the ordered (superradiant) phase, the strength of spin and photon squeezing and the duration of time for which the system stays in the highly squeezed state are found to exhibit strong power-law growth with distance from the quantum critical point. The critical exponent for squeezing time is found to be 1/2 in both the models, and for squeezing strength, it is shown to be 1/2 in the one-axis twisting model, and 1 for the Dicke model which in the limit of extreme detuning also becomes 1/2.


title: Facial Expression Recognition using Deep Learning

abstract: Throughout the various ages, facial expressions have become one of the universal ways of non-verbal communication. The ability to recognize facial expressions would pave the path for many novel applications. Despite the success of traditional approaches in a controlled environment, these approaches fail on challenging datasets consisting of partial faces. In this paper, I take one such dataset FER-2013 and will implement deep learning models that are able to achieve significant improvement over the previously used traditional approaches and even some of the deep learning models.


title: NITS-VC System for VATEX Video Captioning Challenge 2020

abstract: Video captioning is process of summarising the content, event and action of the video into a short textual form which can be helpful in many research areas such as video guided machine translation, video sentiment analysis and providing aid to needy individual. In this paper, a system description of the framework used for VATEX-2020 video captioning challenge is presented. We employ an encoder-decoder based approach in which the visual features of the video are encoded using 3D convolutional neural network (C3D) and in the decoding phase two Long Short Term Memory (LSTM) recurrent networks are used in which visual features and input captions are fused separately and final output is generated by performing element-wise product between the output of both LSTMs. Our model is able to achieve BLEU scores of 0.20 and 0.22 on public and private test data sets respectively.


title: Soft Gradient Boosting Machine

abstract: Gradient Boosting Machine has proven to be one successful function approximator and has been widely used in a variety of areas. However, since the training procedure of each base learner has to take the sequential order, it is infeasible to parallelize the training process among base learners for speed-up. In addition, under online or incremental learning settings, GBMs achieved sub-optimal performance due to the fact that the previously trained base learners can not adapt with the environment once trained. In this work, we propose the soft Gradient Boosting Machine (sGBM) by wiring multiple differentiable base learners together, by injecting both local and global objectives inspired from gradient boosting, all base learners can then be jointly optimized with linear speed-up. When using differentiable soft decision trees as base learner, such device can be regarded as an alternative version of the (hard) gradient boosting decision trees with extra benefits. Experimental results showed that, sGBM enjoys much higher time efficiency with better accuracy, given the same base learner in both on-line and off-line settings.


title: On the variance of squarefree integers in short intervals and arithmetic progressions

abstract: We evaluate asymptotically the variance of the number of squarefree integers up to $x$ in short intervals of length $H < x^{6/11 - \varepsilon}$ and the variance of the number of squarefree integers up to $x$ in arithmetic progressions modulo $q$ with $q > x^{5/11 + \varepsilon}$. On the assumption of respectively the Lindel\"of Hypothesis and the Generalized Lindel\"of Hypothesis we show that these ranges can be improved to respectively $H < x^{2/3 - \varepsilon}$ and $q > x^{1/3 + \varepsilon}$. Furthermore we show that obtaining a bound sharp up to factors of $H^{\varepsilon}$ in the full range $H < x^{1 - \varepsilon}$ is equivalent to the Riemann Hypothesis. These results improve on a result of Hall (1982) for short intervals, and earlier results of Warlimont, Vaughan, Blomer, Nunes and Le Boudec in the case of arithmetic progressions.


title: Dual Policy Distillation

abstract: Policy distillation, which transfers a teacher policy to a student policy has achieved great success in challenging tasks of deep reinforcement learning. This teacher-student framework requires a well-trained teacher model which is computationally expensive. Moreover, the performance of the student model could be limited by the teacher model if the teacher model is not optimal. In the light of collaborative learning, we study the feasibility of involving joint intellectual efforts from diverse perspectives of student models. In this work, we introduce dual policy distillation(DPD), a student-student framework in which two learners operate on the same environment to explore different perspectives of the environment and extract knowledge from each other to enhance their learning. The key challenge in developing this dual learning framework is to identify the beneficial knowledge from the peer learner for contemporary learning-based reinforcement learning algorithms, since it is unclear whether the knowledge distilled from an imperfect and noisy peer learner would be helpful. To address the challenge, we theoretically justify that distilling knowledge from a peer learner will lead to policy improvement and propose a disadvantageous distillation strategy based on the theoretical results. The conducted experiments on several continuous control tasks show that the proposed framework achieves superior performance with a learning-based agent and function approximation without the use of expensive teacher models.


title: Consistency Regularization for Certified Robustness of Smoothed Classifiers

abstract: A recent technique of randomized smoothing has shown that the worst-case (adversarial) $\ell_2$-robustness can be transformed into the average-case Gaussian-robustness by "smoothing" a classifier, i.e., by considering the averaged prediction over Gaussian noise. In this paradigm, one should rethink the notion of adversarial robustness in terms of generalization ability of a classifier under noisy observations. We found that the trade-off between accuracy and certified robustness of smoothed classifiers can be greatly controlled by simply regularizing the prediction consistency over noise. This relationship allows us to design a robust training objective without approximating a non-existing smoothed classifier, e.g., via soft smoothing. Our experiments under various deep neural network architectures and datasets show that the "certified" $\ell_2$-robustness can be dramatically improved with the proposed regularization, even achieving better or comparable results to the state-of-the-art approaches with significantly less training costs and hyperparameters.


title: Non-Canonical Volume-Form Formulation of Modified Gravity Theories and Cosmology

abstract: A concise description is presented of the basic features of the formalism of non-canonical spacetime volume-forms and its application in modified gravity theories and cosmology. The well known unimodular gravity theory appears as a very special case. Concerning the hot issues facing cosmology now, we specifically briefly outline the construction of: (a) unified description of dark energy and dark matter as manifestations of a single material entity -- a special scalar field "darkon"; (b) quintessential models of universe evolution with a gravity-"inflaton"-assisted dynamical Higgs mechanism -- dynamical suppression/generation of spontaneous electroweak gauge symmetry breaking in the "early"/"late" universe; (c) unification of dark energy and dark matter with diffusive interaction among them; (d) mechanism for suppression of 5-th force without fine-tuning.


title: Bayesian Graph Neural Networks with Adaptive Connection Sampling

abstract: We propose a unified framework for adaptive connection sampling in graph neural networks (GNNs) that generalizes existing stochastic regularization methods for training GNNs. The proposed framework not only alleviates over-smoothing and over-fitting tendencies of deep GNNs, but also enables learning with uncertainty in graph analytic tasks with GNNs. Instead of using fixed sampling rates or hand-tuning them as model hyperparameters in existing stochastic regularization methods, our adaptive connection sampling can be trained jointly with GNN model parameters in both global and local fashions. GNN training with adaptive connection sampling is shown to be mathematically equivalent to an efficient approximation of training Bayesian GNNs. Experimental results with ablation studies on benchmark datasets validate that adaptively learning the sampling rate given graph training data is the key to boost the performance of GNNs in semi-supervised node classification, less prone to over-smoothing and over-fitting with more robust prediction.


title: Semi-order continuous operators on vector spaces

abstract: In this manuscript, we will study both $\tilde{o}$-convergence in (partially) ordered vector spaces and a kind of convergence in a vector space $V$. A vector space $V$ is called semi-order vector space (in short semi-order space), if there exist an ordered vector space $W$ and an operator $T$ from $V$ into $W$. In this way, we say that $V$ is semi-order space with respect to $\{W, T\}$. A net $\{x_\alpha\}\subseteq V$ is said to be ${\{W,T\}}$-order convergent to a vector $x\in V$ (in short we write $x_\alpha\xrightarrow {\{W, T\}}x$), whenever there exists a net $\{y_\beta\}$ in $W$ satisfying $y_\beta \downarrow 0$ in $W$ and for each $\beta$, there exists $\alpha_0$ such that $\pm (Tx_\alpha -Tx) \leq y_\beta$ whenever $\alpha \geq \alpha_0$. In this manuscript, we study and investigate some properties of $\{W,T\}$-convergent nets and its relationships with other order convergence in partially ordered vector spaces. Assume that $V_1$ and $V_2$ are semi-order spaces with respect to $\{{W_1}, T_1\}$ and $\{W_2, T_2\}$, respectively. An operator $S$ from $V_1$ into $V_2$ is called semi-order continuous, if $x_\alpha\xrightarrow {\{{W_1}, T_1\}}x$ implies $Sx_\alpha\xrightarrow {\{W_2, T_2\}}Sx$ whenever $\{x_\alpha\}\subseteq V_1$. We study some properties of this new classification of operators.


title: Generalized Lorenz Systems Family

abstract: This article briefly introduces the generalized Lorenz systems family, which includes the classical Lorenz system and the relatively new Chen system as special cases, with infinitely many related but not topologically equivalent chaotic systems in between.


title: Linked vortices as baryons in the miscible BEC-Skyrme model

abstract: We introduce a variation of the Bose-Einstein condensate(BEC)-Skyrme model, with an altered potential for miscible BECs that gives rise to two physical vortex strings. In the ground state of each topological sector, the vortices are linked exactly $B$ times, due to a recently formulated theorem, with $B$ being the baryon number of the solution. The model also possesses metastable states, where the vortices are degenerate and do not lend the interpretation of the baryon number as the linking number of the vortices.


title: An Overview of Computational Fluid Structure Interaction: Methods and Applications

abstract: Over the past few decades, there has been a rapid improvement in computational power as well as techniques to simulate the real world phenomenon which has enabled us to understand the physics and develop new systems which outperform the existing ones. In the domain of multi-physics problems, fluid and structure interactions have been studied and various numerical methods are introduced to solve them. An extensive review of most commonly employed numerical techniques to solve fluid structure interaction(FSI) problems has been done in this article. It also becomes utmost important to understand the applicability of each method and hence a critical reasoning for usage of different methods has been provided. Application domains are presented which range from energy harvesting processes to simulation of human vocal cords and movement of bolus(food) inside esophagus. Suitable numerical methods applied for each application have also been discussed. Numerical methods developed so far are classified in particular groups based on the discretization, the manner in which coupling is performed and on the basis of meshing(division of entire domain into small blocks inside which variation of a variable is approximated). Challenges and instabilities posed by presently available numerical methods are discussed and potential applications where there is a possibility of errors due to these methods have been listed. A brief set of application areas which have not been explored through the lens of fluid structure interaction also have been discussed at the end of this article.


title: Fusion Recurrent Neural Network

abstract: Considering deep sequence learning for practical application, two representative RNNs - LSTM and GRU may come to mind first. Nevertheless, is there no chance for other RNNs? Will there be a better RNN in the future? In this work, we propose a novel, succinct and promising RNN - Fusion Recurrent Neural Network (Fusion RNN). Fusion RNN is composed of Fusion module and Transport module every time step. Fusion module realizes the multi-round fusion of the input and hidden state vector. Transport module which mainly refers to simple recurrent network calculate the hidden state and prepare to pass it to the next time step. Furthermore, in order to evaluate Fusion RNN's sequence feature extraction capability, we choose a representative data mining task for sequence data, estimated time of arrival (ETA) and present a novel model based on Fusion RNN. We contrast our method and other variants of RNN for ETA under massive vehicle travel data from DiDi Chuxing. The results demonstrate that for ETA, Fusion RNN is comparable to state-of-the-art LSTM and GRU which are more complicated than Fusion RNN.


title: Constructing rigid-foldable generalized Miura-ori tessellations for curved surfaces

abstract: Origami has shown the potential to approximate three-dimensional curved surfaces by folding through designed crease patterns on flat materials. The Miura-ori tessellation is a widely used pattern in engineering and tiles the plane when partially folded. Based on constrained optimization, this paper presents the construction of generalized Miura-ori patterns that can approximate three-dimensional parametric surfaces of varying curvatures while preserving the inherent properties of the standard Miura-ori, including developability, flat-foldability and rigid-foldability. An initial configuration is constructed by tiling the target surface with triangulated Miura-like unit cells and used as the initial guess for the optimization. For approximation of a single target surface, a portion of the vertexes on the one side is attached to the target surface; for fitting of two target surfaces, a portion of vertexes on the other side is also attached to the second target surface. The parametric coordinates are adopted as the unknown variables for the vertexes on the target surfaces whilst the Cartesian coordinates are the unknowns for the other vertexes. The constructed generalized Miura-ori tessellations can be rigidly folded from the flat state to the target state with a single degree of freedom.